Snowflake Connector

A data warehouse connector built on AWS or Azure cloud infrastructure over various databases of Snowflake. It supports crawling database objects, profiling sample data, and building lineage.

Connector Capabilities

Edition

Supports

Standard

Supported

Enterprise

Supported

Business Critical

Supported

Virtual Private Snowflake (VPS)

Supported

The drivers used by the connector are given below:

Driver / API

Version

Details

Snowflake JDBC driver

3.10.X and above

https://mvnrepository.com/artifact/net.snowflake/snowflake-jdbc/3.10.0 

Note : Latest version is 3.13.6

Technical Specifications

The connector capabilities are shown below:

Crawling

Feature

Supported Objects

Remarks

Crawling

Tables

 

Table columns

All data types in snowflake

Views

 

Stored procedures

 

Functions

 

Triggers

 

Roles

 

Users

 

Permissions

 

Triggers

 

Usage statistics

 

Tasks

 

Pipes

 

Profiling

Please see Profiling Data for more details on profiling.

Feature

Supported

Unsupported

Remarks

Table Profiling

Row count, Columns count, View sample data

-

-

View Profiling

Row count, Columns count, View sample data

-

The view is treated as a table for profiling purposes

Column Profiling

Min, Max, Null count, distinct, top 50 values

variant, text, binary, varbinary, object, array, geography

-

Full Profiling 

Supported

-

-

Lineage Building

Lineage entities

Details

Table lineage

Supported

Column lineage

Supported

Lineage Sources

Stored procedures, functions, triggers, views, SQL queries (from Query Sheet), query logs

Querying

Operation 

Details

Select

Supported

Insert

Not supported, by default.

Update

Not supported, by default.

Delete

Not supported, by default.

Joins within database

Supported

Joins outside database

Not supported

Aggregations

Supported

Group By

Supported

Order By

Supported

By default, the service account provided for the connector will be used for any query operations. If the service account has to write privileges, then Insert / Update / Delete queries can be executed.

Pre-requisites

To use the connector, the following need to be available:

  • Connection details, as specified in the following section, should be available.
  • An admin/service account for crawling and profiling. The minimum privileges required are:

Operation 

Access Permission

Connection validate

Read

Crawl schemas

Read

Crawl tables

Read

Profile schemas, tables

Read

Connection Details
The following connection settings should be added for connecting to a snowflake database:

2-Feb-01-2022-01-27-38-18-PM

    Property

    Details

    Database Type

    SNOWFLAKE

    Connection Name

    Select a Connection name for the Snowflake database. You specify a reference name to identify your SNOWFLAKE database connection in OvalEdge easily. Example: SNOWFLAKE Connection DB1

    Hostname / IP Address:

    Database instance URL
    Example: https://ovaledgepartner.us-east-1.snowflakecomputing.com

    Port number

    443

    Sid / Database

    Name of the database to connect.

    Warehouse

    Name of the data warehouse.

    Role

    Name of the Role. Example: ACCOUNTADMIN, SYSADMIN

    Username 

    User account login credential

    Password 

    Password for the user

    Driver Name

    JDBC driver name for Snowflake. It will be auto-populated.
    Example: net.snowflake.client.jdbc.SnowflakeDriver

    Connection String 

    Snowflake connection string. Set the Connection string toggle button to automatic to get the details automatically from the credentials provided. Alternatively, you can manually enter the string.
    Format: jdbc: snowflake://{server}:443/?db={sid}&warehouse={warehouse}&role={IAMRole}

    Once connectivity is established, additional configurations for crawling and profiling can be specified:

    Crawler & Profiler Settings:

    Property

    Details

    Crawler Configuration

    Tables, views, and Columns

    If the checkbox is selected, it will crawl the tables and columns in snowflake.

    Procedure, Functions, and triggers

    If the checkbox is selected, it will crawl the procedures, functions, triggers, pipes, and tasks.

    Include Table

    Regex

    It catalogs the table based on the regex search pattern added.

    Exclude Table Regex

    It doesn’t catalog the table based on the regex search pattern added.

    Profiler Settings

     

    Profile Type

    Auto - Full profiling will be performed if the rowcount of the table is less than the rowcount field.

    Sample - Sample profiling will be performed based on sample profile size Disabled - profiling is disabled completely. 

    No. of threads

    No threads used for profiling

    Query TimeOut

    It is a waiting time for query response

    Rowcount constraint

    If it is checked, the profiling performed based on the rowcount limit

    Profile rules

    It will include/ exclude the tables to perform profiling based on regex search pattern added.

    FAQs

    1. How much does the driver cost?
      The JDBC Driver for SNOWFLAKE is available at no additional charge.
    2. Can I use the driver to access Snowflake from a Linux computer?
      Yes! You can use the driver to access snowflake from Linux, Unix, and other non-Windows platforms. 


    Copyright © 2022, OvalEdge LLC, Peachtree Corners GA USA