bashrc file and add its bin directory to sqoop help

Set environment variables SQOOP_HOME with sqoop installation directory in.

Copy this tar ball into preferred location of installation directory (usually into /usr/lib/sqoop) and extract the contents of gzipped the tar ball.

Download gzipped Sqoop binary tar ball from Apache Download mirrors at sqoop site.

Sqoop installation on Ubuntu machine is simple and straight. In this section we will install Sqoop1.4.5 version (latest stable version) on Ubuntu machine and configure it to run on Hadoop cluster. Sqoop is named after Sql + Had oop (Sqoop) meaning that bridge between Sql databases and Hadoop eco system. Sqoop has two versions, Sqoop1 and Sqoop2 but at the time of this writing, Sqoop2 is not suitable for production deployment so, we will discuss using Sqoop1 only. Now Sqoop is top level project at Apache Software foundation.

Sqoop was originally developed by Cloudera but later provided to Apache Open source community.

But the difference is Instead of moving data between clusters, Sqoop is designed to move data from/to hadoop to/from relational databases. Take advantage of its parallelism and fault tolerance. In many ways Sqoop is similar to hadoop’s distcp(Moving data efficiently between clusters using Distributed Copy). It is a mechanism for unlocking hadoop for relational database users. Sqoop can be used to both import data from external structured databases into HDFS or related systems like Hive and HBase, as well as export data from Hadoop to external relational databases and enterprise data warehouses. And Relational databases supported at this time are MySQL, PostGreSQL, Oracle, SQL Server and DB2.Īpache Sqoop is another top level open source project from Apache software foundation. Here Hadoop eco system includes, HDFS, Hive, HBase, HCatalog, etc. Sqoop is open source tool that enables users to transfer bulk data between Hadoop eco system and relational databases.

Qlikview install on ubuntu