Data Processor Transformation Ports
Define the Data Processor transformation ports on the transformation Overview view.
A Data Processor transformation can read input from a file, a buffer, or a streamed buffer from a complex file reader. You can use a flat file reader as a buffer to read an entire file at one time. You can also read an input file from a database.
The output ports that you create depend on whether you want to return a string, complex files, or rows of relational data from the transformation.
Data Processor Transformation Input Ports
When you create a Data Processor transformation, the Developer tool creates a default input port. When you define an additional input port in a Script startup component, the Developer tool creates an additional input port in the transformation.
The input type determines the type of data that the Data Integration Service passes to the Data Processor transformation. The input type determines whether the input is data or a source file path.
Configure one of the following input types:
- Buffer
- The Data Processor transformation receives rows of source data in the Input port. Use the buffer input type when you configure the transformation to receive data from a flat file or from an Informatica transformaton.
- File
The Data Processor transformation receives the source file path in the Input port. The Data Processor startup component opens the source file. Use the file input type to parse binary files such as Microsoft Excel or Microsoft Word files. You can also use the File input type for large files that might require a lot of system memory to process with a buffer input port.
- Service Parameter
- The Data Processor transformation receives values to apply to variables in the service parameter ports. When you choose the variables to receive input data, the Developer tool creates a service parameter port for each variable.
- Output_Filename
- When you configure the default output port to return a file name instead of row data, the Developer tool creates an Output_Filename port. You can pass a file name to the Output_Filename port from a mapping.
When you define an input port you can define the location of the example input file for the port. An example input file is a small sample of the input file. Reference an example input file when you create Scripts. You also use the example input file when you test the transformation in the Data Viewer view. Define the example input file in the Input Location field.
Service Parameter Ports
You can create input ports that receive values for variables. The variables can contain can contain any datatype such a string, a date, or a number. A variable can also contain a location for a source document. You can reference the variables in a Data Processor component.
When you create an input port for a variable, the Developer tool shows a list of variables that you can choose from.
Creating Service Parameter Ports
You can create input ports that receive values for variables. You can also remove the ports that you create from variables.
1. Open the Data Processor transformation Overview view.
2. Click Choose.
The Developer tool displays a list of variables and indicates which variables already have ports.
3. Select one or more variables.
The Developer tool creates a buffer input port for each variable that you select. You cannot modify the port.
4. To remove a port that you create from a variable, disable the selection from the variable list. When you disable the selection, the Developer tool removes the input port.
Data Processor Transformation Output Ports
The Data Processor transformation has one output port by default. If you define additional output ports in a Script, the Developer tool adds the ports to the Data Processor transformation. You can create groups of ports if you configure the transformation to return relational data. You can also create service parameter ports and pass-through ports.
Default Output Port
The Data Processor transformation has one output port by default. When you create relational output, you can define groups of related output ports instead of the default output port. When you define an additional output port in a Script component, the Developer tool adds an additional output port to the transformation.
Configure one of the following output types for a default output port:
- Buffer
- The Data Processor transformation returns XML through the Output port. Choose the Buffer file type when you parse documents or when you map XML to other XML documents in the Data Processor transformation.
- File
The Data Integration Service returns an output file name in the Output port for each source instance or row. The Data Processor transformation component writes the output file instead of returning data through the Data Processor transformation output ports.
When you select a File output port, the Developer tool creates an Output_Filename input port. You can pass a file name into the Output filename port. The Data Processor transformation creates the output file with a name that it receives in this port.
If the output file name is blank, the Data Integration Service returns a row error. When an error occurs, the Data Integration Service writes a null value to the Output port and returns a row error.
Choose the File output type when you transform XML to a binary data file such as a PDF file or a Microsoft Excel file.
Pass-Through Ports
You can configure pass-through ports to any Data Processor transformation. Pass-through ports are input and output ports that receive input data and return the same data to a mapping without changing it.
You can configure pass-through ports in a Data Processor transformation instance that is in a mapping.
To add a pass-through port, drag a port from another transformation in the mapping. You can also add ports in the Ports tab of the Properties view. Click New to add a pass-through port.
Note: When you add pass-through ports to a Data Processor transformation with relational input and hierarchical output, add the ports to the root group of the relational structure.
Data Processor transformations can include pass-through ports with custom data types.