Qubole Hive

Connectivity Summary

An out of the box connector is available for Qubole Hive databases. It provides support for crawling database objects, profiling of sample data and lineage building.

The connectivity to Qubole Hive is via JDBC driver, which is included in the platform. 

The connector currently supports the following versions of Qubole Hive:

Edition: no-awssdk

Version: 1.0x

The drivers used by the connector are given below:

Driver / API: Qubole Hive JDBC Driver

Version: 1.0 (Latest version is 2.0)

Details: Is JDBC 1.0 https://s3.amazonaws.com/Qubole Hive-downloads/drivers/jdbc/1.2.41.1065/Qubole HiveJDBC42-no-awssdk-1.2.41.1065.jar

Connector Capabilities

The connector capabilities are shown below:

Crawling

Please see this article Crawling Data for more details on crawling.  Supported objects and data types for Crawling are:

Profiling

Please see Profiling Data for more details on profiling.

Lineage Building

Querying 

By default the service account provided for the connector will be used for any query operations. If the service account has write privileges, then Insert / Update / Delete queries can be executed.

Pre-requisites

To use the connector, the following need to be available:

• Connection details as specified in the following section should be available.
• Service account with read privileges.
• JDBC driver is provided by default. In case it needs to be changed, add Qubole Hive client drivers into the OvalEdge Jar path to communicate to the Qubole Hive database. 

Check the Configuration section for further details on how to add the drivers to the jar path.

Connection Details

The following connection settings should be added for connecting to a Qubole Hive database:

• Database Type: Qubole Hive
• License Type: Standard
• Connection Name: Select a Connection name for the Qubole Hive database. The name that you specify is a reference name to easily identify your Qubole Hive database connection in OvalEdge. Example: Qubole Hive Connection1
• Qubole Endpoint: Qubole endpoint
• Cluster Label: Name of the database to connect.
• Driver: com.qubole.jdbc.jdbc41.core.QDriver
• API Token: Qubole API Token
• Connection String: Qubole Hive  connection string. Set the Connection string toggle button to automatic, to get the details automatically from the credentials provided. Alternatively, you can manually enter the string.
  Format:jdbc:qubole://hive/{clusterLabel}?endpoint={server}
  Example:jdbc:qubole://hive/default?endpoint=https://us.qubole.com

Once connectivity is established, additional configurations for Crawling and Profiling can be specified.