Amazon S3 Sources > Before you begin > Create a connection
  

Create a connection

Before you configure the Amazon S3 catalog source, create a connection object in IDMC Administrator.
To use an external secrets manager to connect to the source system, use one of the following authentication tools:
    1In Administrator, select Connections.
    2Click Add Connection.
    3Search for and select Amazon S3 V2 and then click Next.
    4Enter the following connection details:
    Property
    Description
    Connection Name
    Name of the connection.
    Each connection name must be unique within the organization. Connection names can contain alphanumeric characters, spaces, and the following special characters: _ . + -,
    Maximum length is 255 characters.
    Description
    Description of the connection. Maximum length is 4000 characters.
    Use Secret Vault
    Stores sensitive credentials for this connection in the secrets manager that is configured for your organization.
    This property appears only if secrets manager is set up for your organization.
    When you enable the secret vault in the connection, you can select the credentials that the Secure Agent retrieves from the secrets manager. If you don't enable this option, the credentials are stored in the repository or on a local Secure Agent, depending on how your organization is configured.
    Note:
    If you’re using this connection to apply data access policies through pushdown or proxy services, you cannot use the Secret Vault configuration option.
    For information about how to configure and use a secrets manager, see Secrets manager configuration.
    Runtime Environment
    The name of the runtime environment where you want to run tasks.
    Access Key
    The access key ID used to access the Amazon account resources. Required if you do not use AWS Identity and Access Management (IAM) authentication.
    Note:
    Ensure that you have valid AWS credentials before you create a connection.
    Secret Key
    The secret access key used to access the Amazon account resources.
    This value is associated with the access key and uniquely identifies the account. You must specify this value if you specify the access key ID. Required if you do not use AWS Identity and Access Management (IAM) authentication.
    Folder Path
    Bucket name or complete folder path to the Amazon S3 objects.
    For tasks other than application ingestion and database ingestion tasks, don't use a slash at the end of the folder path. For example, <bucket name>/<my folder name>.
    IAM Role ARN (Advanced Setting)
    The Amazon Resource Name of the IAM role assumed by the IAM user or the EC2 role to use temporary security credentials and access the AWS resources.
    External ID (Advanced Setting)
    The AssumeRole request parameter to generate temporary session credentials that enable an IAM user or AWS service to assume a role.
    For more information about how to use the assume role, see the Using an assume role for Amazon S3 resources in Informatica Cloud Data Integration How-To Library.
    Use EC2 Role to Assume Role (Advanced Setting)
    Enables the EC2 role to assume an IAM role specified in the IAM Role ARN option.
    Note:
    If you choose to configure the IAM user to assume an IAM role specified in the IAM Role ARN option, clear this option.
    S3 Account Type (Advanced Setting)
    The type of the Amazon S3 account. Select one of the following options:
    • - Amazon S3 Storage. Enables you to use the Amazon S3 services.
    • - S3 Compatible Storage. Enables you to use the endpoint for a third-party storage provider such as Scality RING or MinIO.
    Default is Amazon S3 storage.
    REST Endpoint (Advanced Setting)
    The S3 storage endpoint required for an S3 compatible storage.
    Enter the S3 storage endpoint in the HTTP or HTTPs format.
    For example, http://s3.isv.scality.com.
    5Select the authentication type to connect to Amazon S3 and enter the required properties.
    You can use the following authentication types:
    6Click Test to test your connection to the source system.
    7Click Save.

Basic authentication

Basic authentication requires access key and secret key values from your AWS account.
The following table describes the basic connection properties for basic authentication:
Property
Description
Access Key
Access key to access the Amazon S3 bucket.
Secret Key
Secret key to access the Amazon S3 bucket. The secret key is associated with the access key and uniquely identifies the account.
Folder Path
Amazon S3 bucket name or the folder path within the Amazon S3 bucket where the Amazon S3 objects are stored.
For example, <bucket name>/<my folder name>
Region Name
The AWS region of the bucket that you want to access.
Before you select a region, ensure that the Secure Agent is up and running. If you still do not see your region in the list, restart the Data Integration Server.
Select one of the following regions:
  • - Africa (Cape Town)
  • - Asia Pacific (Hong Kong)
  • - Asia Pacific (Hyderabad)
  • - Asia Pacific (Jakarta)
  • - Asia Pacific (Melbourne)
  • - Asia Pacific (Osaka)
  • - Asia Pacific(Mumbai)
  • - Asia Pacific(Seoul)
  • - Asia Pacific(Singapore)
  • - Asia Pacific(Sydney)
  • - Asia Pacific(Tokyo)
  • - AWS GovCloud (US)
  • - AWS GovCloud (US-East)
  • - Canada(Central)
  • - EU (Milan)
  • - EU (Paris)
  • - EU (Spain)
  • - EU (Stockholm)
  • - EU (Zurich)
  • - EU(Frankfurt)
  • - EU(Ireland)
  • - EU(London)
  • - Israel (Tel Aviv)
  • - Middle East (Bahrain)
  • - Middle East (UAE)
  • - South America(Sao Paulo)
  • - US East(N. Virginia)
  • - US East(Ohio)
  • - US ISO East
  • - US ISO West
  • - US ISOB East (Ohio)
  • - US West(N. California)
  • - US West(Oregon)
Default is US East(N. Virginia).

AssumeRole via EC2 role authentication

AssumeRole via EC2 role authentication requires you to enable the EC2 role to assume another IAM role specified in the IAM Role ARN option.
The following table describes the basic connection properties for AssumeRole via EC2 role authentication:
Property
Description
Folder Path
Amazon S3 bucket name or the folder path within the Amazon S3 bucket where the Amazon S3 objects are stored.
For example, <bucket name>/<my folder name>
Region Name
The AWS region of the bucket that you want to access.
Before you select a region, ensure that the Secure Agent is up and running. If you still do not see your region in the list, restart the Data Integration Server.
Select one of the following regions:
  • - Africa (Cape Town)
  • - Asia Pacific (Hong Kong)
  • - Asia Pacific (Hyderabad)
  • - Asia Pacific (Jakarta)
  • - Asia Pacific (Melbourne)
  • - Asia Pacific (Osaka)
  • - Asia Pacific(Mumbai)
  • - Asia Pacific(Seoul)
  • - Asia Pacific(Singapore)
  • - Asia Pacific(Sydney)
  • - Asia Pacific(Tokyo)
  • - AWS GovCloud (US)
  • - AWS GovCloud (US-East)
  • - Canada(Central)
  • - EU (Milan)
  • - EU (Paris)
  • - EU (Spain)
  • - EU (Stockholm)
  • - EU (Zurich)
  • - EU(Frankfurt)
  • - EU(Ireland)
  • - EU(London)
  • - Israel (Tel Aviv)
  • - Middle East (Bahrain)
  • - Middle East (UAE)
  • - South America(Sao Paulo)
  • - US East(N. Virginia)
  • - US East(Ohio)
  • - US ISO East
  • - US ISO West
  • - US ISOB East (Ohio)
  • - US West(N. California)
  • - US West(Oregon)
Default is US East(N. Virginia).
IAM Role ARN
The Amazon Resource Name (ARN) of the AWS Identity and Access Management (IAM) role assumed by the user to use the dynamically generated temporary security credentials.
Enter the ARN value if you want to use the temporary security credentials to access AWS resources.
Note:
Even if you remove the IAM role that grants the agent access to the Amazon S3 bucket, the test connection is successful.
For more information about how to get the ARN of the IAM role, see the AWS documentation.
External ID
The external ID of your AWS account.
External ID provides a more secure access to the Amazon S3 bucket when the Amazon S3 bucket is in a different AWS account.
Use EC2 Role to Assume Role
Enables the EC2 role to assume another IAM role specified in the IAM Role ARN option.
By default, this property is not selected.
Note:
The EC2 role must have a policy attached with permissions to assume an IAM role from the same or different account.

Credential Profile File authentication

Credential profile file authentication requires the credential profile file path and profile name.
The following table describes the basic connection properties for credential profile file authentication:
Property
Description
Folder Path
Amazon S3 bucket name or the folder path within the Amazon S3 bucket where the Amazon S3 objects are stored.
For example, <bucket name>/<my folder name>
Region Name
The AWS region of the bucket that you want to access.
Before you select a region, ensure that the Secure Agent is up and running. If you still do not see your region in the list, restart the Data Integration Server.
Select one of the following regions:
  • - Africa (Cape Town)
  • - Asia Pacific (Hong Kong)
  • - Asia Pacific (Hyderabad)
  • - Asia Pacific (Jakarta)
  • - Asia Pacific (Melbourne)
  • - Asia Pacific (Osaka)
  • - Asia Pacific(Mumbai)
  • - Asia Pacific(Seoul)
  • - Asia Pacific(Singapore)
  • - Asia Pacific(Sydney)
  • - Asia Pacific(Tokyo)
  • - AWS GovCloud (US)
  • - AWS GovCloud (US-East)
  • - Canada(Central)
  • - EU (Milan)
  • - EU (Paris)
  • - EU (Spain)
  • - EU (Stockholm)
  • - EU (Zurich)
  • - EU(Frankfurt)
  • - EU(Ireland)
  • - EU(London)
  • - Israel (Tel Aviv)
  • - Middle East (Bahrain)
  • - Middle East (UAE)
  • - South America(Sao Paulo)
  • - US East(N. Virginia)
  • - US East(Ohio)
  • - US ISO East
  • - US ISO West
  • - US ISOB East (Ohio)
  • - US West(N. California)
  • - US West(Oregon)
Default is US East(N. Virginia).
Other Authentication Type
Determines whether you want to use the credential profile file authentication to connect to Amazon S3.
Select one the following authentication types:
  • - NONE. Select if you do not want to use credential profile file authentication.
  • - Credential Profile File Authentication. Select to use credential profile file authentication to access the Amazon S3 credentials from a credential file.
Note:
To use IAM Roles Anywhere authentication also, you must select Credential Profile File Authentication as the authentication type.
Enter the credential profile file path and profile name to connect to Amazon S3.
You can use permanent IAM credentials or temporary session tokens when you configure the credential profile file authentication.
Default is NONE.
Credential Profile File Path
The path to the credential profile file.
If you don't enter the credential profile path, the Secure Agent uses the credential profile file available in the following default location in your home directory:
~/.aws/credentials
Profile Name
Name of the profile in the credential profile file used to get credentials to access Amazon S3 resources.
If you don't enter the profile name, the credentials from the default profile in the credential profile file are used.

IAM Roles Anywhere authentication

You can configure AWS IAM Roles Anywhere authentication to generate temporary security credentials to securely access Amazon S3 resources from your servers, applications, or containers outside of AWS using X.509 certificates instead of long-term credentials.
IAM Roles Anywhere authentication requires the credential profile file path and profile name.
The following table describes the basic connection properties for IAM Roles Anywhere authentication:
Property
Description
Folder Path
Amazon S3 bucket name or the folder path within the Amazon S3 bucket where the Amazon S3 objects are stored.
For example, <bucket name>/<my folder name>
Region Name
The AWS region of the bucket that you want to access.
Before you select a region, ensure that the Secure Agent is up and running. If you still do not see your region in the list, restart the Data Integration Server.
Select one of the following regions:
  • - Africa (Cape Town)
  • - Asia Pacific (Hong Kong)
  • - Asia Pacific (Hyderabad)
  • - Asia Pacific (Jakarta)
  • - Asia Pacific (Melbourne)
  • - Asia Pacific (Osaka)
  • - Asia Pacific(Mumbai)
  • - Asia Pacific(Seoul)
  • - Asia Pacific(Singapore)
  • - Asia Pacific(Sydney)
  • - Asia Pacific(Tokyo)
  • - AWS GovCloud (US)
  • - AWS GovCloud (US-East)
  • - Canada(Central)
  • - EU (Milan)
  • - EU (Paris)
  • - EU (Spain)
  • - EU (Stockholm)
  • - EU (Zurich)
  • - EU(Frankfurt)
  • - EU(Ireland)
  • - EU(London)
  • - Israel (Tel Aviv)
  • - Middle East (Bahrain)
  • - Middle East (UAE)
  • - South America(Sao Paulo)
  • - US East(N. Virginia)
  • - US East(Ohio)
  • - US ISO East
  • - US ISO West
  • - US ISOB East (Ohio)
  • - US West(N. California)
  • - US West(Oregon)
Default is US East(N. Virginia).
Other Authentication Type
Determines whether you want to use the IAM Roles Anywhere authentication to connect to Amazon S3.
To use IAM Roles Anywhere authentication, select Credential Profile File Authentication.
Enter the credential profile file path and profile name to connect to Amazon S3.
Credential Profile File Path
The path to the credential profile file.
If you don't enter the credential profile path, the Secure Agent uses the credential profile file available in the following default location in your home directory:
~/.aws/credentials
Profile Name
Name of the profile in the credential profile file used to get credentials to access Amazon S3 resources.
If you don't enter the profile name, the Secure Agent uses the credentials from the default profile in the credential profile file.