CLAIRE Copilot for Data Integration > Data Ingestion and Replication > Application Ingestion and Replication examples of creating a task
  

Application Ingestion and Replication examples of creating a task

Let's look at some examples of configuring an application ingestion and replication task in CLAIRE Copilot

Example: Application ingestion initial load of Workday data to Snowflake

You want to perform a point-in-time load of human resources data from a Workday source to a Snowflake data warehouse that you use for analysis and reporting.
To do this, let's create an application ingestion and replication initial load task in CLAIRE Copilot
  1. 1Start CLAIRE Copilot.
  2. 2In the Ask CLAIRE box, type Create an initial load ingestion task with a Workday source and Snowflake target. Then click the Submit icon.
    3. A list of Snowflake target connections available in your organization appears.
  3. List of Snowflake target connections to choose from.
  4. 3Type the number associated with the Snowflake target connection you want to use. In this example, let's type 1 for the AIN_Snowflake connection.
    5. Note: If the connection isn't listed, you can type the name of a valid Snowflake connection. Specify an existing connection that you've previously tested.
    A list of SQL Server source connections available in your organization appears.
  5. List of Workday source connections to choose from.
  6. 4Type the number associated with the Workday source connection you want to use. In this example, let's type 1 for the AIN_Workday connection.
    7. A prompt for the runtime environment appears:
  7. Runtime environment prompt
  8. 5Type @ to list runtime environments. Click a running runtime environment in the list and then click the Submit icon.
    9. A prompt for the Snowflake target schema appears:
  9. Prompt for entering the Snowflake target schema.
  10. 6Type @ to list Snowflake target schemas. Click the target schema you want to use and then click the Submit icon.
    11. A summary of the task definition appears for your verification.
  12. 7To create the task asset, click Yes.
    13. The task is generated and opens in the task configuration wizard.
  13. 8Verify the task definition. You can edit field values and set additional fields on the Task Details, Transform, and Let's Go pages. Toggle on Show Advanced Options to see all fields. However, do not change the source and target connections.
    14. For example, for the Snowflake target, you must specify a value in the required Stage field. On the Let's Go page, you can enter a custom name and description for the task and your project location so that you can find the task again easily.
  14. 9Save the task.
  15. 10Deploy the task to create a job instance. You can then run the job from My Jobs.
You're done! You've successfully created and deployed an application ingestion and replication initial load task using CLAIRE Copilot.

Example: Application ingestion incremental load of Salesforce data to Snowflake

You want to replicate Salesforce data changes continuously to a Snowflake data warehouse to make sure downstream applications get the latest customer information.
To do this, let's create an application ingestion and replication incremental load task in CLAIRE Copilot
  1. 1Start CLAIRE Copilot.
  2. 2In the Ask CLAIRE box, type Incremental load of Salesforce data to Snowflake. Then click the Submit icon.
    3. A list of Snowflake target connections available in your organization appears.
  3. List of Snowflake target connections to choose from.
  4. 3Type the number associated with the Snowflake target connection you want to use. In this example, let's type 1 for the AIN_Snowflake connection.
    5. Up to five of the most frequently used connections are listed.
    Note: If the connection isn't listed, you can type the name of a valid Snowflake connection. Specify an existing connection that you've previously tested.
    A list of Salesforce source connections available in your organization appears.
  5. List of Salesforce source connections to choose from.
  6. 4Type the number associated with the Salesforce source connection you want to use. In this example, let's type 1 for the AIN_Salesforce connection.
    7. A prompt for the runtime environment appears:
  7. Runtime environment prompt
  8. 5Type @ to list runtime environments. Click a runtime environment in the list and then click the Submit icon.
    9. A prompt for the Snowflake target schema appears:
  9. Prompt for entering the Snowflake target schema.
  10. 6Type @ to list Snowflake target schemas. Click the target schema you want to use and then click the Submit icon.
    11. A summary of the task definition appears for your verification.
  11. Summary of the application ingestion task definition.
  12. 7To create the task asset, click Yes.
    13. The task is generated and opens in the task configuration wizard.
  13. 8Verify the task definition. You can edit field values and set additional fields on the Task Details, Transform, and Let's Go pages. Toggle on Show Advanced Options to see all fields. However, do not change the source and target connections.
    14. For example, for the Snowflake target, you must specify a value in the required Stage field. On the Let's Go page, you can enter a custom name and description for the task and your project location so that you can find the task again easily.
  14. 9Save the task.
  15. 10Deploy the task to create a job instance. You can then run the job from My Jobs or another monitoring interface.
Success! You've created and deployed an application ingestion and replciation incremental load job in CLAIRE Copilot!