You can select the Is Directory option under the advanced properties for a Google Cloud Storage source object to read all the files in a Google Cloud Storage folder and sub-folder.
Use the following rules and guidelines to configure the Is Directory option:
•You cannot read files available in a sub-folder within a sub-folder.
•All the source files in the directory must contain the same schema.
•When you read files in a Google Cloud Storage folder in Delimited format, all the files must have data in the same format. For example, delimiters, header fields, and escape characters must be same.
•When you run a mapping to read data from the files in a Google Cloud Storage folder and sub-folder using the Is Directory source advanced property, ensure that the folder and the sub-folder does not contain a file with the same schema. Otherwise, the mapping fails.
•The source files in the directory must have the same format and metadata. The file format, delimiters, header fields, escape characters, and compression format must be same for all the files. Otherwise, the mapping results are unpredictable.