Spot Event Plugins - Spot Fleet Requests

Spot Event Plugin

AWS Permissions Setup

Amazon Machine Images

Spot Fleet Requests

Security Credentials Configuration

Spot Fleet Configuration

Spot Event Configuration Options

Spot Event Configuration Utility

Deadline Connectivity Configuration

VPC Endpoints Configuration

Multiple Region Support

Overview

A Spot Fleet Request defines a collection of Spot instances and the parameters with which they will be launched.

The Spot Event Plugin uses a separate Spot Fleet Request for each Deadline Group.

Note

In order to work with Deadline, a Spot Fleets Request must be set to Maintain target capacity mode which allows the scaling of the Fleet in and out,
and the Total target capacity of the Spot Fleet Request must be set to the maximum number of Workers that may be started for that Fleet.

Creating the Spot Fleet Requests

To create a Spot Fleet Request via the AWS Management Console:

  1. Sign in to the AWS Management Console.

  2. Click on Services at the top of the AWS Management Console, then click on EC2 under Compute.

  3. In the EC2 panel, click Spot Requests in the sidebar under Instances, then click the Request Spot Instances button.

    ../_images/spot_fleet_request_creation_1.png

  4. Select a Launch template for your AMI if you have created one (optional). Otherwise select the AMI that you created.

    Warning

    If using Launch Templates you must add the following key/value pair as a Tag in the Launch Template.

    DeadlineTrackedAWSResource : SpotEventPlugin

    Failure to add this Tag will result in EC2 Instances being launched that won’t be managed/monitored by the Resource Tracker if it’s enabled.

    It’s possible that if this Tag is not included, EC2 Instances that can’t connect to the repository may become stuck and won’t shut themselves down.

    It’s crucial that this Tag is added to prevent large overspends in your AWS Account that could otherwise be prevented by the Resource Tracker and other mechanisms.

    ../_images/spot_launch_template_tracking_tag.png
    ../_images/spot_fleet_request_creation_3.png

  5. Expand Additional launch parameters - optional.

    ../_images/spot_fleet_request_creation_2.png

  6. Set Auto-assign IPv4 public IP to Enable

    ../_images/spot_fleet_request_creation_4.png

  7. Set the IAM Instance Profile to the “DeadlineSpot*” IAM instance Profile you created earlier.

    ../_images/spot_fleet_request_creation_5.png

  8. Set the Total target capacity value to the maximum number of Workers you would like in your Spot Fleet, and enable Maintain target capacity.

    ../_images/spot_fleet_request_creation_6.png

  9. Set the IAM Fleet Role if you created a new one, otherwise leave it at its default.

  10. If you would like to perform any custom setup when your instance starts up, you can add a User data script. See Render Farm Connectivity.

  11. Download the Fleet Configuration by pressing the JSON Config button at the bottom of the page.

    ../_images/spot_fleet_request_creation_7.png

See the Spot Fleet Request Configurations topic for an example JSON configuration.

Note

In Deadline 10.1.14 and higher, the Spot Event Configuration Utility can be used to create and modify Spot Fleet Requests based on the ones created via the AWS Management Console.

Warning

The Spot Event Configuration Utility does not currently support using Multiple Regions