Data Asset Publication Overview
Data publication is the process of making prepared data available in the data lake.
When you publish prepared data, Intelligent Data Lake applies the recipe to the data in the input source. Intelligent Data Lake writes the transformed input source to a Hive table in the data lake. These mappings are stored in the Model repository and can be accessed using the Developer tool.
Use the Developer tool to modify the Informatica mappings created when you published a project in the Intelligent Data Lake application. Use the Administrator tool to run and monitor the mappings. For more information, see the Informatica Big Data Management User Guide and the Informatica Administrator Guide.
You can use a third-party business intelligence or advanced analytic tool to run reports to further analyze the published data. Other analysts can add the published data to their projects and create new data assets.
Operationalizing the Loading of Data Assets
When analysts publish data in the Intelligent Data Lake application, the Intelligent Data Lake Service converts the preparation recipes into Informatica mappings. You can operationalize the mappings to regularly load data with the new structure into the data lake.
Use the Developer tool to view and edit the converted mappings. The mappings use the same name as the Intelligent Data Lake worksheet with the published data. Verify that the converted mappings meet your requirements, and then deploy the mappings.
Use the Administrator tool or the infacmd command line program to run the mappings to load and transform the data. The Data Integration Service writes the data to Hive tables in the data lake. You can schedule the deployed mappings to regularly load data into the data lake. Use the Administrator tool to monitor each mapping run.
For more information about developing and running mappings that write to Hive, see the Informatica Big Data Management User Guide.