Snowflake Connector

A data warehouse connector built on AWS or Azure cloud infrastructure over various databases of Snowflake. It supports crawling database objects, profiling sample data, and building lineage.

Connector Capabilities

Edition	Supports
Standard	Supported
Enterprise	Supported
Business Critical	Supported
Virtual Private Snowflake (VPS)	Supported

The drivers used by the connector are given below:

Driver / API

Version

Details

Snowflake JDBC driver

3.10.X and above

https://mvnrepository.com/artifact/net.snowflake/snowflake-jdbc/3.10.0

Note : Latest version is 3.13.6

Technical Specifications

The connector capabilities are shown below:

Crawling

Feature	Supported Objects	Remarks
Crawling	Tables
	Table columns	All data types in snowflake
	Views
	Stored procedures
	Functions
	Triggers
	Roles
	Users
	Permissions
	Triggers
	Usage statistics
	Tasks
	Pipes

Profiling

Please see Profiling Data for more details on profiling.

Feature	Supported	Unsupported	Remarks
Table Profiling	Row count, Columns count, View sample data	-	-
View Profiling	Row count, Columns count, View sample data	-	The view is treated as a table for profiling purposes
Column Profiling	Min, Max, Null count, distinct, top 50 values	variant, text, binary, varbinary, object, array, geography	-
Full Profiling	Supported	-	-

Lineage Building

Lineage entities	Details
Table lineage	Supported
Column lineage	Supported
Lineage Sources	Stored procedures, functions, triggers, views, SQL queries (from Query Sheet), query logs

Querying

Operation	Details
Select	Supported
Insert	Not supported, by default.
Update	Not supported, by default.
Delete	Not supported, by default.
Joins within database	Supported
Joins outside database	Not supported
Aggregations	Supported
Group By	Supported
Order By	Supported

By default, the service account provided for the connector will be used for any query operations. If the service account has to write privileges, then Insert / Update / Delete queries can be executed.

Pre-requisites

To use the connector, the following need to be available:

Connection details, as specified in the following section, should be available.
An admin/service account for crawling and profiling. The minimum privileges required are:

Operation	Access Permission
Connection validate	Read
Crawl schemas	Read
Crawl tables	Read
Profile schemas, tables	Read

Connection Details
The following connection settings should be added for connecting to a snowflake database:

2-Feb-01-2022-01-27-38-18-PM

Property	Details
Database Type	SNOWFLAKE
Connection Name	Select a Connection name for the Snowflake database. You specify a reference name to identify your SNOWFLAKE database connection in OvalEdge easily. Example: SNOWFLAKE Connection DB1
Hostname / IP Address:	Database instance URL Example: https://ovaledgepartner.us-east-1.snowflakecomputing.com
Port number	443
Sid / Database	Name of the database to connect.
Warehouse	Name of the data warehouse.
Role	Name of the Role. Example: ACCOUNTADMIN, SYSADMIN
Username	User account login credential
Password	Password for the user
Driver Name	JDBC driver name for Snowflake. It will be auto-populated. Example: net.snowflake.client.jdbc.SnowflakeDriver
Connection String	Snowflake connection string. Set the Connection string toggle button to automatic to get the details automatically from the credentials provided. Alternatively, you can manually enter the string. Format: jdbc: snowflake://{server}:443/?db={sid}&warehouse={warehouse}&role={IAMRole}

Once connectivity is established, additional configurations for crawling and profiling can be specified:

Crawler & Profiler Settings:

Property	Details
Crawler Configuration
Tables, views, and Columns	If the checkbox is selected, it will crawl the tables and columns in snowflake.
Procedure, Functions, and triggers	If the checkbox is selected, it will crawl the procedures, functions, triggers, pipes, and tasks.
Include Table Regex	It catalogs the table based on the regex search pattern added.
Exclude Table Regex	It doesn’t catalog the table based on the regex search pattern added.
Profiler Settings
Profile Type	Auto - Full profiling will be performed if the rowcount of the table is less than the rowcount field. Sample - Sample profiling will be performed based on sample profile size Disabled - profiling is disabled completely.
No. of threads	No threads used for profiling
Query TimeOut	It is a waiting time for query response
Rowcount constraint	If it is checked, the profiling performed based on the rowcount limit
Profile rules	It will include/ exclude the tables to perform profiling based on regex search pattern added.

FAQs

How much does the driver cost?
The JDBC Driver for SNOWFLAKE is available at no additional charge.
Can I use the driver to access Snowflake from a Linux computer?
Yes! You can use the driver to access snowflake from Linux, Unix, and other non-Windows platforms.