The Informatica Hadoop connector allows you to perform the Read and Insert operations on Hadoop. You can use the Hadoop connector on a kerberos cluster and a non-kerberos cluster.
Hadoop Connector on a Kerberos Cluster
On a kerberos cluster, you can install the Secure Agent outside the cluster and perform read and write operations successfully. The Hadoop connector exhibits the following features on a kerberos cluster:
•Connects to Hive to perform relevant data operations.
•Supports all operators supported in HiveQL.
•Supports the AND conjunction between filters. It supports both AND and OR conjunctions in advanced filters.
•Supports filtering on all filterable columns in Hive tables.
The Hadoop connector supports the following distributions on a kerberos cluster:
•Cloudera 5.8 - 5.13
•Hortonworks 2.5
Hadoop Connector on a non-Kerberos Cluster
On a non-kerberos cluster, you can perform the read operation if the Secure Agent is installed outside the cluster. However, you must install the Secure Agent on one of the nodes of the Hadoop cluster to perform the write operation successfully. The Hadoop connector exhibits the following features on a non-kerberos cluster:
•Connects to Hive and Cloudera Impala to perform relevant data operations.
•Supports all operators supported in HiveQL.
•Supports the AND conjunction between filters. It supports both AND and OR conjunctions in advanced filters.
•Supports filtering on all filterable columns in Hive and Impala tables.
The Hadoop connector supports the following distributions on a non-kerberos cluster: