You can use Hadoop Files Connector to securely read data from and write data to complex files on local system or to HDFS. You can read or write structured, semi-structured, and unstructured data.
Hadoop Files Connector uses Hadoop API infrastructure to read from or write to a local file system or to HDFS. The agent connects to the name node to read data from or write data to HDFS. You can read from and write to one or more complex files in different format such as PDF, JSON, and JPG. Hadoop Files Connector reads or writes data in the binary format. You can use complex file objects as sources and targets in synchronization tasks, mappings, and mapping tasks.
When you use the Hadoop Files Connector to read or write complex files, you can perform operations such as copy, rename, compress, or decompress a file.