•  Advanced clusters
  •  Advanced cluster types
  •  Fully-managed clusters
    •  Setting up cluster resources for a fully-managed cluster
    •  Creating a fully-managed cluster
    •  Submitting jobs to a fully-managed cluster
    •  Stopping a fully-managed cluster
  •  Self-service clusters
  •  Local clusters
    •  Default local clusters
    •  Default staging and log locations
  •  Managing advanced cluster costs
•  Setting up AWS
  •  Step 1. Complete prerequisites
    •  Verify privileges in your organization
    •  Verify AWS subscriptions
    •  Learn about roles and policies in the AWS environment
    •  Learn about resource access
  •  Step 2. Create storage locations for cluster files
  •  Step 3. Create the VPC and subnets (optional)
    •  Create subnets with enough IP addresses
    •  Verify the routing configuration
    •  Accept inbound traffic
  •  Step 4. Create user-defined security groups for Amazon EC2
    •  Create the ELB security group
    •  Create the master security group
    •  Create the worker security group
    •  Use default security groups (alternative)
  •  Step 5. Download and install a Secure Agent
  •  Step 6. Allow domains in AWS
  •  Step 7. Create IAM roles
    •  Create the cluster operator role
    •  Create the cluster operator policy
    •  Attach the cluster operator policy
    •  Configure the maximum CLI/API session duration for the cluster operator role
    •  Create or reuse the Secure Agent role
    •  Add the AssumeRole permission to the Secure Agent role
    •  Configure the trust relationship for the cluster operator role to include the Secure Agent role
    •  Create user-defined master and worker roles
    •  Encrypt staging data and log files at rest (optional)
    •  Create role-based security policies for Amazon data sources (optional)
    •  Create or reuse a log access policy for the Secure Agent role
  •  Step 8. Configure environment variables (optional)
  •  Step 9. Configure the Elastic Server
  •  Additional setup for CLAIRE-powered configurations
  •  IAM policy reference
    •  Cluster operator role actions
    •  Master role actions
    •  Worker role actions
  •  Master and worker role types reference
  •  Master and worker policy restriction reference
•  Setting up Google Cloud
  •  Step 1. Complete prerequisites
    •  Verify privileges in your organization
    •  Verify Google Cloud services
    •  Learn about resource access
    •  Learn about Google Cloud cluster
  •  Step 2. Create storage locations for cluster files
  •  Step 3. Create the VPC and subnets (optional)
    •  Create a subnet with enough IP addresses
    •  Create a Google Cloud NAT gateway
    •  Create firewall rules in the VPC network
  •  Step 4. Download and install a Secure Agent
  •  Step 5. Allow domains in Google Cloud
  •  Step 6. Configure a proxy for the cluster (optional)
  •  Step 7. Create roles and service accounts
    •  Create a Secure Agent role and service account
    •  Create a master role and service account
    •  Create a worker node role and service account
  •  Step 8. Configure the JAVA_HOME environment variable
  •  Step 9. Create a staging connection
•  Setting up Microsoft Azure
  •  Step 1. Complete prerequisites
    •  Verify privileges in your organization
    •  Verify Microsoft Azure products
    •  Learn about resource access
  •  Step 2. Download and install a Secure Agent
  •  Step 3. Allow domains in Azure
  •  Step 4. Configure a proxy for the cluster (optional)
  •  Step 5. Create storage accounts for cluster files
  •  Step 6. Create a cluster resource group
  •  Step 7. Create a managed identity for the Secure Agent
    •  Create a managed identity
    •  Create an agent role
    •  Add role assignments
  •  Step 8. Create a service principal for the cluster
    •  Create a service principal
    •  Create a cluster role
    •  Add a role assignment
    •  Store the credentials in a key vault
    •  Add an access policy to the key vault
  •  Step 9. Create a managed identity to access sources and targets (optional)
  •  Step 10. Create user defined security groups (optional)
    •  Default network security groups for advanced clusters
    •  User defined security groups in an advanced cluster on Azure
    •  Troubleshoot cluster pre-validation failures
  •  Step 11. Configure the JAVA_HOME environment variable (optional)
  •  Step 12. Create a staging connection (optional)
•  Setting up a self-service cluster
  •  Step 1. Complete prerequisites
    •  Verify privileges in your organization
    •  Learn about resource access
  •  Step 2. Create a Kubernetes cluster
    •  Add annotations and tolerations (optional)
  •  Step 3. Download and install a Secure Agent
  •  Step 4. Allow domains for self-service clusters
  •  Step 5. Create a Kubernetes ClusterRole and Role
    •  Configure role permissions
    •  Create role bindings
    •  Use an Informatica-managed service account (alternative)
  •  Step 6. Create a storage role
    •  Create a storage role on AWS
    •  Create a storage role on Microsoft Azure
  •  Step 7. Configure access to data sources
  •  Additional configuration for clusters on AWS
    •  Configure cluster authentication
    •  Configure cluster nodes with IMDSv2
•  Setting up a local cluster
  •  Prepare for local clusters
  •  Download and install a Secure Agent
  •  Troubleshoot a local cluster
•  Advanced configurations
  •  CLAIRE-powered configurations
    •  Cluster budget estimates
    •  CLAIRE recommendations
  •  AWS properties
    •  Validating the configuration
    •  Amazon Linux 2 images
    •  GPU worker instance type
    •  Graviton worker instance type
    •  Spot Instances
    •  High availability
    •  Accessing a new staging location
    •  Propagating tags to cloud resources
    •  Default tags for cloud resources
    •  Data encryption
  •  Google Cloud properties
    •  Validating the configuration
    •  Propagating labels to cloud resources
    •  Data encryption
  •  Microsoft Azure properties
    •  Validating the configuration
    •  Spot Instances
    •  High availability
    •  Accessing a new staging location
    •  Propagating tags to cloud resources
    •  Default tags for cloud resources
    •  Data encryption
  •  Local cluster advanced configuration
    •  Change staging and log locations (optional)
    •  Local cluster properties
    •  Configure cloud permissions
    •  Data encryption
  •  Self-service cluster properties
    •  Runtime Properties
    •  Validating the configuration
  •  Resource requirements for cluster nodes
    •  Reconfiguring resource requirements
    •  Resource requirements example
  •  Initialization scripts
  •  Initialization script failures
  •  Updating the runtime environment or the staging location
•  Troubleshooting
  •  Troubleshooting an advanced cluster
  •  Troubleshooting an advanced cluster on AWS
  •  Troubleshooting an advanced cluster on Microsoft Azure
  •  Troubleshooting an advanced cluster subtask
  •  Troubleshooting a self-service cluster
  •  Shutting down the Secure Agent machine and cloud resources
•  Command reference
  •  generate-policies-for-userdefined-roles.sh
  •  list-clusters.sh
  •  delete-clusters.sh
  •  cluster-operations.sh

Advanced clusters

cluster-operations.sh

ADMIN_AT_SCALE_CLUSTERS

SELF_SERVICE_CLUSTERS

HL_GoogleCloudCluster

SETTINGUPLOCALCLUSTER

ADMIN_AT_SCALE_CONFIG