Architecture
The mass ingestion architecture includes the components that create, deploy, run, and monitor a mass ingestion specification.
The following image shows the mass ingestion components:
Clients and Tools
The mass ingestion components include the following clients and tools:
- Informatica Administrator
- Administrator tool. The client where you can create and configure a Mass Ingestion Service.
- Informatica Mass Ingestion
- Mass Ingestion tool. The web application where you design and implement mass ingestion specifications. Use the web application to configure, deploy, run, and monitor a mass ingestion specification.
Application Services
The mass ingestion components include the following application services:
- Mass Ingestion Service
- Manages and validates mass ingestion specifications that you create in the Mass Ingestion tool. The Mass Ingestion Service deploys specifications and schedules the specifications to run. When a specification runs, the Mass Ingestion Service generates ingestion job statistics.
- Model Repository Service
- Manages the Model repository. The Model Repository Service connects to the Model repository when you create a mass ingestion specification to store the specification in the Model repository.
- Data Integration Service
- Manages deployed mass ingestion specifications. Connects to the Hadoop environment to ingest the data configured in the mass ingestion specification.
Repositories
The mass ingestion components include the following repositories:
- Model repository
The repository that stores the mass ingestion specification metadata when you create a mass ingestion specification.
Mass ingestion specifications are stored in the project INFA_MI_PROJECT in the Model repository. If a specification is stored in a different project, the Mass Ingestion Service ignores the specification. To allow the Mass Ingestion Service to read all specifications, do not move the specification to a different project. You cannot view the project in the Developer tool, and you cannot view the specifications stored in the project from the Developer tool. You can only list the specifications that are stored in the project from the command line.
