Microsoft Fabric OneLake Connector > Mappings for Microsoft Fabric OneLake > File formatting options
  

File formatting options

Select the format of the Microsoft Fabric OneLake file and configure the formatting options.
The following table describes the formatting options for Avro, Parquet, JSON, ORC, Document, and delimited flat files:
Property
Description
Schema Source
The schema of the source or target file.
Select one of the following options to specify a schema:
  • - Read from data file. Imports the schema from a file in Microsoft Fabric OneLake.
  • - Import from schema file. Imports the schema from a schema definition file in the agent machine.
Schema File
The schema definition file in the agent machine from where you want to upload the schema.
You cannot upload a schema file when you create a target at runtime.
The following table describes the formatting options for flat files:
Property
Description
Flat File Type
The type of flat file.
Select one of the following options:
  • - Delimited. Reads a flat file that contains column delimiters.
  • - Fixed Width. Reads a flat file with fields that have a fixed length.
    • You must select the file format in the Fixed Width File Format option.
    If you do not have a fixed-width file format, click New > Components > Fixed Width File Format to create one.
Delimiter
Character used to separate columns of data in a delimited flat file. You can set values as comma, tab, colon, semicolon, or others.
You cannot set a tab as a delimiter directly in the Delimiter field. To set a tab as a delimiter, you must type the tab character in any text editor. Then, copy and paste the tab character in the Delimiter field.
EscapeChar
Character immediately preceding a column delimiter character embedded in an unquoted string, or immediately preceding the quote character in a quoted string data in a delimited flat file.
When you write data to Microsoft Fabric OneLake and specify a qualifier, by default, the qualifier is considered as the escape character. Else, the character specified as the escape character is considered.
Qualifier
Quote character that defines the boundaries of data in a delimited flat file. You can set qualifier as single quote or double quote.
Qualifier Mode
Specify the qualifier behavior when you write data to a delimited flat file.
You can select one of the following options:
  • - Minimal. Default mode. Applies qualifier to data enclosed within a delimiter value or a special character.
  • - All. Applies qualifier to all data.
  • - Non_Numeric. Not applicable.
  • - All_Non_Null. Not applicable.
Disable escape character when a qualifier is set
Applicable to a Microsoft Fabric OneLake target.
Select to disable the escape character when a qualifier is set.
When you disable the escape character, the special characters not escaped and are considered as part of the data written to the target.
Code Page
Select the code page that the Secure Agent must use to read or write data to a delimited flat file.
Select UTF-8 for mappings.
Select one of the following options for mappings in advanced mode:
  • - UTF-8
  • - MS Windows Latin 1
  • - Shift-JIS
  • - ISO 8859-15 Latin 9 (Western European)
  • - ISO 8859-3 Southeast European
  • - ISO 8859-5 Cyrillic
  • - ISO 8859-9 Latin 5 (Turkish)
  • - IBM EBCDIC International Latin-1
Header Line Number
Specify the line number that you want to use as the header when you read data from a delimited flat file.
Specify the value as 0 or 1.
To read data from a file with no header, specify the value as 0.
First Data Row
Specify the line number from where you want the Secure Agent to read data in a delimited flat file. You must enter a value that is greater or equal to one.
To read data from the header, the value of the Header Line Number and the First Data Row fields should be the same. Default is 1.
Target Header
Select whether you want to write data to a target that contains a header or without a header in the delimited flat file. You can select With Header or Without Header options.
This property is not applicable when you read data from aMicrosoft Fabric OneLake source.
Distribution Column
Not applicable.
Max Rows To Preview
Not applicable.
Row Delimiter
Character used to separate rows of data. You can set values as \r, \n, and \r\n.
This property is not applicable when you read data from a Microsoft Fabric OneLake source.

Rules and guidelines for Document file format

Certain rules and guidelines apply to Document file format.
Consider the following rules and guidelines when you use the Document file format to read PDF files: