All Forums Aster
Aastha007 6 posts Joined 03/13
05 Aug 2014
Connectivity between Aster 6.0 and HDP 2.1

We were trying to establish connectivity between Aster 6 and Hadoop 2.1 for which we tried two approaches as mentioned below:
 
Approach 1: Connectivity through SQL-H
Issue with this approach: While making the host entry in Aster AMC I do not see HDP 2.1 version in the drop down. 
 
Exact error:
retail_sales=> select * from load_from_hcatalog ( ON mr_driver SERVER ('153.65.161.221' ) USERNAME ('hive') DBNAME ('default') TABLENAME ('sample_07') ) ;
ERROR:  SQL-MR function LOAD_FROM_HCATALOG failed: Failed to load hadoop classes : sqlh config not found for server 153.65.161.221
 
 
Approach 2: Connectivity through Sqoop
Issue with this approach : I faced some transaction isolation level error and it looks like the jar used for this connection has set the isolation level which is not compatible with the PostgreSQL/Aster database
 
Exact error:
 
sqoop import   --connect jdbc:ncluster://153.65.160.120:2406/retail_sales  --table prod.customer_dim   --driver com.asterdata.ncluster.Driver  --connection-param-file /poc_dir/sqoop.properties
14/08/05 05:09:59 INFO sqoop.Sqoop: Running Sqoop version: 1.4.4.2.1.1.0-385
14/08/05 05:09:59 WARN sqoop.ConnFactory: Parameter --driver is set to an explicit driver however appropriate connection manager is not being set (via --connection-manager). Sqoop is going to fall back to org.apache.sqoop.manager.GenericJdbcManager. Please specify explicitly which connection manager should be used next time.
14/08/05 05:09:59 INFO manager.SqlManager: Using default fetchSize of 1000
14/08/05 05:09:59 INFO tool.CodeGenTool: Beginning code generation
14/08/05 05:09:59 INFO mule.Mule: sslEnabled : false, ssoEnabled : false
14/08/05 05:09:59 INFO mule.Mule: Authenticating user 'beehive' for database 'retail_sales'
14/08/05 05:09:59 INFO mule.MuleInterface: Authenticating using passwd for user beehive for database retail_sales
14/08/05 05:10:00 INFO mule.Mule: Successfully authenticated
14/08/05 05:10:00 ERROR manager.SqlManager: Error executing statement: java.sql.SQLException: [AsterData][JDBC](11975) Unsupported transaction isolation level: 2.
 
It looks like connectivity between Aster 6 and HDP 2.1 is not supported yet. But can anybody confirm if this holds true or we do have a work around it? 
 
Regards,
Aastha

Uttamn 1 post Joined 10/14
09 Oct 2014

Even i am looking at the option for connection between Aster and hadoop 2.1.
Any information will be helpful.
-Uttam
 
 

Uttam Nayak

ssurajss 1 post Joined 11/14
26 Nov 2014

Hi Aastha,
Even i am facing the same error. Were you able to resolve this issue ?
 

panda.anilkumar 1 post Joined 01/15
21 Jan 2015

Hi People,

Was anyone able to get this issue resolved ? We too want to implement a similar usecase (Aster <-> HDP) data transfer.
So wanted to know, what is best possible option.

Regards,
Anil

Aastha007 6 posts Joined 03/13
19 Mar 2015

There is a new version for Aster 6 which gives the HDP 2.1 dropdown in the AMC while making the configuration of the host. Not sure when will this version be available for common use but this does support the HDP2.1 with Aster 6

djmdata 4 posts Joined 03/14
09 Apr 2015

Any updates?
 

djmdata 4 posts Joined 03/14
11 Apr 2015

From Aster manual:

Unsupported JDBC Settings

Most JDBC option-setting methods in the Aster Database driver exhibit the standard JDBC
behavior, but there are exceptions. Please note:
• setReadOnly(): Not supported; Aster Database does not allow changing connection type
to read-only.
• setTransactionIsolation(): Not supported; Aster Database does not allow changing
transaction isolation levels.  
Sqoop seems to always set the Transaction Level (level configurable) explicitly yet Aster won't allow it to be set. So...we need Hortonworks to allow a config to not set it...or Aster needs to accept it (even it it doesn't respect - maybe just a warning).

You must sign in to leave a comment.