A data warehouse connector built on AWS or Azure cloud infrastructure over various databases of Snowflake. It supports crawling database objects, profiling sample data, and building lineage.
Connector Capabilities
Edition |
Supports |
Standard |
Supported |
Enterprise |
Supported |
Business Critical |
Supported |
Virtual Private Snowflake (VPS) |
Supported |
The drivers used by the connector are given below:
Driver / API |
Version |
Details |
Snowflake JDBC driver |
3.10.X and above |
https://mvnrepository.com/artifact/net.snowflake/snowflake-jdbc/3.10.0 Note : Latest version is 3.13.6 |
Technical Specifications
The connector capabilities are shown below:
Crawling
Feature |
Supported Objects |
Remarks |
Crawling |
Tables |
|
Table columns |
All data types in snowflake |
|
Views |
||
Stored procedures |
||
Functions |
||
Triggers |
||
Roles |
||
Users |
||
Permissions |
||
Triggers |
||
Usage statistics |
||
Tasks |
||
Pipes |
Profiling
Please see Profiling Data for more details on profiling.
Feature |
Supported |
Unsupported |
Remarks |
Table Profiling |
Row count, Columns count, View sample data |
- |
- |
View Profiling |
Row count, Columns count, View sample data |
- |
The view is treated as a table for profiling purposes |
Column Profiling |
Min, Max, Null count, distinct, top 50 values |
variant, text, binary, varbinary, object, array, geography |
- |
Full Profiling |
Supported |
- |
- |
Lineage Building
Lineage entities |
Details |
Table lineage |
Supported |
Column lineage |
Supported |
Lineage Sources |
Stored procedures, functions, triggers, views, SQL queries (from Query Sheet), query logs |
Querying
Operation |
Details |
Select |
Supported |
Insert |
Not supported, by default. |
Update |
Not supported, by default. |
Delete |
Not supported, by default. |
Joins within database |
Supported |
Joins outside database |
Not supported |
Aggregations |
Supported |
Group By |
Supported |
Order By |
Supported |
By default, the service account provided for the connector will be used for any query operations. If the service account has to write privileges, then Insert / Update / Delete queries can be executed.
Pre-requisites
To use the connector, the following need to be available:
- Connection details, as specified in the following section, should be available.
- An admin/service account for crawling and profiling. The minimum privileges required are:
Operation |
Access Permission |
Connection validate |
Read |
Crawl schemas |
Read |
Crawl tables |
Read |
Profile schemas, tables |
Read |
Connection Details
The following connection settings should be added for connecting to a snowflake database:
Property |
Details |
Database Type |
SNOWFLAKE |
Connection Name |
Select a Connection name for the Snowflake database. You specify a reference name to identify your SNOWFLAKE database connection in OvalEdge easily. Example: SNOWFLAKE Connection DB1 |
Hostname / IP Address: |
Database instance URL |
Port number |
443 |
Sid / Database |
Name of the database to connect. |
Warehouse |
Name of the data warehouse. |
Role |
Name of the Role. Example: ACCOUNTADMIN, SYSADMIN |
Username |
User account login credential |
Password |
Password for the user |
Driver Name |
JDBC driver name for Snowflake. It will be auto-populated. |
Connection String |
Snowflake connection string. Set the Connection string toggle button to automatic to get the details automatically from the credentials provided. Alternatively, you can manually enter the string. |
Once connectivity is established, additional configurations for crawling and profiling can be specified:
Crawler & Profiler Settings:
Property |
Details |
Crawler Configuration |
|
Tables, views, and Columns |
If the checkbox is selected, it will crawl the tables and columns in snowflake. |
Procedure, Functions, and triggers |
If the checkbox is selected, it will crawl the procedures, functions, triggers, pipes, and tasks. |
Include Table Regex |
It catalogs the table based on the regex search pattern added. |
Exclude Table Regex |
It doesn’t catalog the table based on the regex search pattern added. |
Profiler Settings |
|
Profile Type |
Auto - Full profiling will be performed if the rowcount of the table is less than the rowcount field. Sample - Sample profiling will be performed based on sample profile size Disabled - profiling is disabled completely. |
No. of threads |
No threads used for profiling |
Query TimeOut |
It is a waiting time for query response |
Rowcount constraint |
If it is checked, the profiling performed based on the rowcount limit |
Profile rules |
It will include/ exclude the tables to perform profiling based on regex search pattern added. |
FAQs
- How much does the driver cost?
The JDBC Driver for SNOWFLAKE is available at no additional charge. - Can I use the driver to access Snowflake from a Linux computer?
Yes! You can use the driver to access snowflake from Linux, Unix, and other non-Windows platforms.
Copyright © 2022, OvalEdge LLC, Peachtree Corners GA USA