Matillion Connector

OvalEdge provides RESTful APIs that enable connectivity and integration with various applications and services, including Matillion. These APIs allow you to access, manipulate, and exchange data and information between OvalEdge and Matillion to streamline data management and analytics processes.

Windows Requirements

The specific requirements for Windows can vary depending on the version and purpose. Here are some common requirements for Windows operating systems:

Edition	Version	Support
Version	Default version	Supported

Technical Specifications

Technical specifications are detailed descriptions of the technical characteristics, requirements, and capabilities of a product, system, or component.

The connector capabilities are shown below:

Crawling

Feature	Supported Objects	Remarks
Crawling	Get Project Groups and Projects as Schemas.	Differentiating the ProjectGroup and Project as ProjectGroup ~~ Project

Lineage Building

Lineage entities	Details
Table to Table	Supported
Table-File Lineage	Supported
File - Table Lineage	Supported
Column lineage	Supported

Pre-requisites

This section lists the prerequisites necessary to establish a connection between the Matillion connector and OvalEdge Application.

Service Account Permissions

To use the connector, the following permissions are needed:

A service account for crawling is required.
The connection details mentioned in the table below must be accessible and provided.

Operation	Access Permission
Connection validate	Should have API Role permission for the given specified Matillion Instance
Crawl Jobs with Project Groups and Projects	Should have read access for the specified Project Group and Project

Establish a Connection

To establish a connection with Matillion Connector, follow these steps:

In the OvalEdge application, click on the "Administration" module from the left panel menu.
Select "Connectors" to display the Connectors page.
Click on the "+" (New Connector) button at the top right corner of the page. The ‘Add Connector’ pop-up window is displayed.
Select the connection type as Matillion. The Add Connector with Matillion details is displayed.

Fields	Details
Connector Type	It allows users to select the connector from the drop-down menu. By default, Matillion is displayed as the selected connection type.
License Type	OvalEdge offers a default Base Connector License for all connectors, allowing users to crawl and profile data sources to obtain metadata and statistical information. Additionally, OvalEdge provides various Add-Ons to cater to different connector functionality requirements: Auto Lineage Add-On: To enable the automatic construction of data lineage for a connector, choose the Auto Lineage Add-On license, which supports the Lineage feature. Data Quality Add-On: To identify, report, and resolve data quality issues for a connector that requires data quality support, opt for the Data Quality Add-On license. This license provides features such as Data Quality Rules/functions, Anomaly detection, Reports, and more. Data Access Add-On: For connector access management via OvalEdge with the Remote Data Access Management (RDAM) feature enabled, select the Data Access Add-On license.
Connection Name	Select a Connection name for the Matillion. The name that you specify is a reference name to easily identify the Matillion connection in OvalEdge. Example: matilllion_dev
Connector Environment	Select the desired environment for the connector from the dropdown list. The environment field provides information about the specific environment in which the connector is established, such as UAT, NON-PROD, etc.
Server	Provide the appropriate Matillion Instance URL
Is SSL Enabled	By default, the SSL (Secure Sockets Layer) option is disabled, with the value set to "false."
User Name	Provide the User Name which has an API Role
Password	Provide the respective Password.
Plugin Server	Provide the server name if you are running this as a Plugin
Plugin Port	Provide the port number on which Plugin is running
Default Governance Roles	Steward*: Select the Steward from the drop-down options.
Admin Roles	Custodian*: Select the Custodian from the drop-down options.
No of Archive Objects	Owner*: Select the Owner from the drop-down options.
Select Bridge	The OvalEdge Bridge component enables seamless connectivity between cloud-hosted servers and on-premise or public cloud data sources without requiring modifications to firewall rules. It offers real-time control, simplifying the management of data movement between different sources and destinations. For more information, refer to Bridge Overview

How to Validate the Lineage:

To validate the lineage in Matillion, follow these steps:

Open the Matillion instance with respective username and password.
Open a specific Project from the Project Group.
Navigate to the respective job (orchestration and transformation)

References:

OvalEdge supports Snowflake and Redshift as databases for AWS instances.
The Matillion connector offers a range of services to facilitate data integration and transformation, as shown in the below image.