Microsoft Fabric Data Warehouse Connector > Mappings and mapping tasks with Microsoft Fabric Data Warehouse Connector > Microsoft Fabric Data Warehouse sources in mappings
  

Microsoft Fabric Data Warehouse sources in mappings

To read data from Microsoft Fabric Data Warehouse, configure a Microsoft Fabric Data Warehouse object as a source in a mapping or mapping in advanced mode.
Specify the name and description of the Microsoft Fabric Data Warehouse source. Configure the source and advanced properties for the source object.
The following table describes the source properties that you can configure for a Microsoft Fabric Data Warehouse source:
Property
Description
Connection
Name of the source connection.
Select an existing connection, create a new connection, or define parameter values for the source connection property.
If you want to overwrite the parameter at runtime, select the Allow parameter to be overridden at run time option when you create a parameter. When the task runs, the agent uses the parameters from the file that you specify in the task advanced session properties. Ensure that the parameter file is in the correct format.
Specify the parameter file directory and name in the advanced session properties.
When you switch between a non-parameterized and a parameterized Microsoft Fabric Data Warehouse connection, the advanced property values are retained.
Source Type
Type of the source object.
Select Single Object, Query, or Parameter.
Default is Single Object.
Note: You cannot read multiple Microsoft Fabric Data Warehouse objects, even though Multiple Objects appear in the list of source objects.
Parameter
A parameter file where you define values that you want to update without having to edit the task.
The Parameter property appears only if you select the source type as Parameter.
Select an existing parameter for the source object or click New Parameter to define a new parameter for the source object.
If you want to overwrite the parameter at runtime, select the Allow parameter to be overridden at run time option when you create a parameter. When the task runs, the agent uses the parameters from the file that you specify in the task advanced session properties. Ensure that the parameter file is in the correct format.
Object
Name of the Microsoft Fabric Data Warehouse source object.
Select the source object for a single source. You can also select an existing object from the list.
Ensure that the table headers of the source object do not contain special characters.
The following table describes the query options that you can configure for a Microsoft Fabric Data Warehouse source:
Property
Description
Filter
Filters record based on the filter condition in a read operation. Click Configure to add conditions to filter records from the data that the Secure Agent reads from the source.
You can specify the following filter conditions:
  • - Not parameterized. Uses a basic filter to specify the object, field, operator, and value to select specific records.
  • - Completely parameterized. Uses a parameter to represent the field mapping.
  • - Advanced. Uses an advanced filter to define a more complex filter condition.
Default is Not parameterized.
Sort
Not applicable.
The following table describes the advanced source properties that you can configure for a Microsoft Fabric Data Warehouse source:
Property
Description
Schema Name Override
Overrides the schema name configured in the source object and uses the specified schema name to read data at runtime.
Table Name Override
Overrides the table name configured in the source object and uses the specified table name to read data at runtime.
SQL Override
The SQL statement to override the default query that is used to read data from the Microsoft Fabric Data Warehouse source.
Pre SQL
The pre-SQL command to run on the Microsoft Fabric Data Warehouse source table before the Secure Agent reads the data.
For example, if you want to update records in the database before you read the records from the table, specify a pre-SQL statement.
Post SQL
The post-SQL command to run on the Microsoft Fabric Data Warehouse table after the Secure Agent completes the read operation.
For example, if you want to delete some records after the latest records are loaded, specify a post-SQL statement.
On Pre-Post SQL Error
Determines the behavior when a task that includes pre-SQL or post-SQL commands encounters errors.
Select one of the following options:
  • - Continue. The task continues regardless of errors.
  • - Stop. The task stops when errors occur while running pre-SQL or post-SQL commands.
Tracing Level
Sets the amount of detail that appears in the log file.
Select one of the following options from the list:
  • - Terse
  • - Normal
  • - Verbose Initialization
  • - Verbose Data
Default is Normal.

Key range partitioning

You can configure key range partitioning when you use a mapping task to read data from Microsoft Fabric Data Warehouse sources.
When you run a mapping configured with key range partitioning, the Secure Agent distributes rows of source data based on the fields that you define as partition keys. The Secure Agent compares the field value to the range values for each partition and sends rows to the appropriate partitions.
Use key range partitioning for columns that have an even distribution of data values. Otherwise, the partitions might have unequal size.
For example, a column might have 10 rows between key values 1 and 1000 and the column might have 999 rows between key values 1001 and 2000. If the mapping includes multiple sources, use the same number of key ranges for each source.
When you define key range partitioning for a column, the Secure Agent reads the rows that are within the specified partition range.
For example, if you configure two partitions for a column with the ranges as 10 through 20 and 30 through 40, the Secure Agent does not read the rows 20 through 30 because these rows are not within the specified partition range.
You can configure a partition key for fields of any numeric data type. However, you cannot use decimals in key range values.
Key range partitions are not available in the following scenarios:

Configuring key range partitioning

Perform the following steps to configure key range partitioning for Microsoft Fabric Data Warehouse sources:
    1In the Source properties, click the Partitions tab.
    2Select the required partition key from the list.
    3Click Add New Key Range to define the number of partitions and the key ranges based on which the Secure Agent must partition data.
    Use a blank value for the start range to indicate the minimum value. Use a blank value for the end range to indicate the maximum value.
    The following image displays the Partitions tab:
    The image shows the partitions and the corresponding key ranges.