•  Introduction to Amazon S3 V2 Connector
  •  Amazon S3 V2 Connector assets
  •  Introduction to Amazon S3
•  Connections for Amazon S3 V2
  •  Prepare for authentication
    •  Create a minimal Amazon IAM policy
    •  IAM authentication
    •  AssumeRole using EC2 role and IAM user
    •  Credential profile file authentication
  •  Connect to Amazon S3
    •  Before you begin
    •  Connection details
    •  Authentication types
    •  Advanced settings
    •  Related links
  •  Private communication with Amazon S3
  •  Server-side encryption with KMS
  •  Client-side encryption with serverless runtime environment
  •  SSE-KMS encryption for mappings in advanced mode
  •  Proxy server settings
    •  Bypass the proxy server
  •  Rules and guidelines for AssumeRole via IAM user authentication
  •  Rules and guidelines for AWS regions
  •  Rules and guidelines for S3 compatible storage
•  Amazon S3 V2 sources and targets
  •  Amazon S3 V2 sources
    •  Data encryption in Amazon S3 V2 sources
    •  Source types in Amazon S3 V2 sources
    •  Reading from multiple files
    •  Incrementally loading files
    •  Wildcard characters
    •  Recursively read files from directories
    •  Source partitioning
    •  Reading source objects path
    •  SQL ELT optimization
  •  Amazon S3 V2 targets
    •  Data encryption in Amazon S3 V2 targets
    •  Overwriting existing files
    •  Target partitioning
    •  Incremental write to partition directory
    •  Distribution column
    •  Writing to multiple target objects
    •  Object tag
  •  Directory-level partitioning
    •  Rules and guidelines for reading from and writing to a partition folder
  •  Data compression in Amazon S3 V2 sources and targets
    •  Reading a compressed flat file
    •  Reading a compressed JSON file
  •  Fixed-width file formats
•  Mappings and mapping tasks with Amazon S3 V2
  •  Amazon S3 V2 objects in mappings
    •  Amazon S3 V2 sources in mappings
    •  Amazon S3 V2 targets in mappings
    •  Amazon S3 V2 lookups
    •  File formatting options
    •  Specifying a target
    •  Amazon S3 V2 parameterization
    •  Rules and guidelines for mappings in advanced mode
    •  Mapping in advanced mode example
•  Migrating a mapping
  •  Use the same object path for the migrated mapping
    •  Rules and guidelines for the same object path
  •  Use a different object path for the migrated mapping
    •  Migration options
    •  Rules and guidelines
•  Upgrading to Amazon S3 V2 Connector
  •  Upgrade the connection type
  •  Connection switching example
  •  Advanced properties retained after the switch
•  Data type reference
  •  Flat file data types and transformation data types
  •  Avro Amazon S3 file data types and transformation data types
    •  Enabling Date, Decimal, and Timestamp types
  •  Parquet Amazon S3 file data types and transformation data types
  •  ORC Amazon S3 file data types and transformation data types
  •  JSON Amazon S3 file data types and transformation data types
  •  Delta data types and transformation data types
•  Troubleshooting
  •  Troubleshooting for Amazon S3 V2 Connector
  •  Troubleshooting FAQ

Introduction to Amazon S3 V2 Connector

Troubleshooting FAQ

CDI_AMAZONS3V2_PREPARE_FOR_AUTHENTICATION

AMAZON_S3V2_CONN

AMAZON_S3V2_CONN-CONN_NAME

AMAZON_S3V2_CONN-CONN_DESC

AMAZON_S3V2_CONN-CONN_TYPE

AMAZON_S3V2_CONN-USE_SECRET_VAULT

AMAZON_S3V2_CONN-AGENTGROUPID

AMAZON_S3V2_CONN-ACCESSKEY

AMAZON_S3V2_CONN-SECRETKEY

AMAZON_S3V2_CONN-FOLDERPATH

AMAZON_S3V2_CONN-REGIONNAME

AMAZON_S3V2_CONN-USEEC2ROLETOASSUMEROLE

AMAZON_S3V2_CONN-IAMROLEARN

AMAZON_S3V2_CONN-EXTERNALID

AMAZON_S3V2_CONN-OTHERAUTHENTICATIONTYPE

AMAZON_S3V2_CONN-OTHERAUTHENTICATIONTYPE-CREDENTIAL_PROFILE_FILE_AUTHENTICATION

AMAZON_S3V2_CONN-CREDENTIAL_PROFILE_FILE_AUTHENTICATION-CREDENTIALPROFILEFILEPATH

AMAZON_S3V2_CONN-CREDENTIAL_PROFILE_FILE_AUTHENTICATION-PROFILENAME

AMAZON_S3V2_CONN-FEDERATEDSSOIDP

AMAZON_S3V2_CONN-ADFS_3.0

AMAZON_S3V2_CONN-ADFS_3.0-FEDERATEDUSERNAME

AMAZON_S3V2_CONN-ADFS_3.0-FEDERATEDUSERPASSWORD

AMAZON_S3V2_CONN-ADFS_3.0-IDPSSOURL

AMAZON_S3V2_CONN-ADFS_3.0-SAMLIDENTITYPROVIDERARN

AMAZON_S3V2_CONN-ADFS_3.0-ROLEARN

AMAZON_S3V2_CONN-S3ACCOUNTTYPE

AMAZON_S3V2_CONN-S3ACCOUNTTYPE-AMAZON_S3_STORAGE

AMAZON_S3V2_CONN-S3ACCOUNTTYPE-S3_COMPATIBLE_STORAGE

AMAZON_S3V2_CONN-S3_COMPATIBLE_STORAGE-RESTENDPOINT

AMAZON_S3V2_CONN-S3VPCENDPOINTTYPE

AMAZON_S3V2_CONN-INTERFACE_ENDPOINT-S3ENDPOINTDNSNAME

AMAZON_S3V2_CONN-STSVPCENDPOINTTYPE

AMAZON_S3V2_CONN-INTERFACE_ENDPOINT-STSENDPOINTDNSNAME

AMAZON_S3V2_CONN-KMSVPCENDPOINTTYPE

AMAZON_S3V2_CONN-INTERFACE_ENDPOINT-KMSENDPOINTDNSNAME

AMAZON_S3V2_CONN-MASTERSYMMETRICKEY

AMAZON_S3V2_CONN-CUSTOMERMASTERKEYID

CDI_AMAZONS3V2_PVTCOMMS3

CDI_AMAZONS3V2_CLIENTSIDEENCRYPT

CDI_AMAZONS3V2_SSEKMSENCRYPT

CDI_AMAZONS3V2_PROXYSERVER

CDI_AMAZONS3V2_RULESTEMPSECURITY

CDI_AMAZONS3V2_RULESAWSREGIONS

CDI_AMAZONS3V2_RULESS3STORAGE