OvalEdge uses Java Database Connectivity (JDBC) to connect to SQL ServerV2, which allows it to crawl and profile data objects (Tables, Table Columns, etc.) and build Lineage.
SQL ServerV2 vs. SQL Server
SQL ServerV2 |
SQL Server |
This is a Case-sensitive database. Example: Ignores case differences in identifiers and data during comparisons. For example, SELECT * FROM MyTable and SELECT * FROM mytable would be treated the same. |
This is a Case-insensitive database. Example: Distinguishes between uppercase and lowercase letters in identifiers (like table names and column names) and data. For example, SELECT * FROM MyTable and SELECT * FROM mytable would be treated as separate queries if the database is case-sensitive. |
Overview
Connector Details
Connector Category |
RDBMS System |
Connector Version |
6.3.4 |
OvalEdge Releases Supported (Available from) |
Release4.3 onwards |
Connectivity [How OvalEdge connects to SQL Server] |
JDBC |
SQL Server Versions Verified |
SQL Server 2019 |
Note: The SQL Server connector has been verified internally with SQL Server 2019 and is expected to be compatible with other supported SQL Server versions. If you have any issues with different SQL Server versions, please contact the GCS team.
Connector Features
Crawling |
✅ |
|
Delta Crawl |
❌ |
|
Profiling |
✅ |
|
Query Sheet |
✅ |
|
Data Preview |
✅ |
|
Auto Lineage |
✅ |
|
Manual Lineage |
✅ |
|
Authentication via Credential Manager |
✅ |
|
Data Quality |
✅ |
|
DAM (Data Access Management) |
❌ |
|
Bridge |
✅ |
Getting Ready to Establish a Connection
Prerequisites
The following are the prerequisites to establish a connection between SQL Server and OvalEdge:
Service Account User Permissions
Note: It is recommended to use a separate service account to establish the connection to the data source, configured with the following minimal set of permissions.
Operation |
Access Permission |
Connection Validation |
SELECT |
Crawl Schemas |
SELECT |
Crawl Tables |
SELECT |
Profile Schemas, Tables |
SELECT |
Lineage Building |
View DEFINITION |
View Source Code |
View DEFINITION |
Relationships |
REFERENCES |
Please refer to Appendix A for guidelines on creating a service account with the required permissions.
Set up a Connection
Important: The Connector Creator role is required to set up a connection.
-
Log into OvalEdge, go to Administration > Connectors, click + (New Connector), search for SQL Server, and complete the specific parameters.
Note: Fields marked with an asterisk (*) are mandatory for establishing a connection.
Field Name |
Description |
||||||
Connector Type |
By default, "SQL Server" is displayed as the selected connector type. |
||||||
Connector Settings |
|||||||
Authentication |
OvalEdge supports the following three types of authentication for SQL Server:
|
||||||
OvalEdge Installed Environment |
Select the installed environment from the drop-down list: Options:
Note: This Field is available when the Authentication mechanism is selected as "Windows Authentication." This field refers to where the OvalEdge application is installed. |
||||||
Credential Manager* |
Select the desired credentials manager from the drop-down list. Relevant parameters will be displayed based on your selection. Supported Credential Managers:
|
||||||
License Add Ons |
|
||||||
Connector Name* |
Enter a unique name for the SQL Server connection (Example: "SQL Server_Prod"). |
||||||
Connector Environment |
Select the environment (Example: PROD, STG) configured for the connector. |
||||||
Server* |
Enter the SQL Server database Server name or IP address (Example: xxxx-sqlserver.xxxx4ijtzasl.xx-south-1.rds.amazonaws.com or 192.168.1.10). |
||||||
Port* |
By default, the port number for the SQL Server database "1433" is auto-populated. If necessary, you can change this to a different port number. |
||||||
Database* |
Enter the database name to which the service account user has access within the SQL Server. |
||||||
Domain |
Enter the Qualified SQL Server Domain name. Note: This field is available when the authentication mechanism is set to Windows Authentication, and the OvalEdge installed environment is Linux. |
||||||
Driver* |
By default, the SQL Server driver details (Example: com.microsoft.sqlserver.jdbc.SQLServerDriver) are auto-populated. OvalEdge artifacts include the required drivers for supported databases. |
||||||
Username* |
Enter the service account username set up to access the SQL Server database (Example: "oesauser"). |
||||||
Password* |
Enter the password associated with the service account user (Example: "password"). |
||||||
Connection String |
Configure the connection string for the SQL Server database:
jdbc:sqlserver://{server}:1433;database={sid}
Replace placeholders with actual database details. {sid} refers to Database Name |
Default Governance Roles |
|
Default Governance Roles* |
Select the appropriate users or teams for each governance role from the drop-down list. All users and teams configured in OvalEdge Security are displayed for selection. |
Admin Roles |
|
Admin Roles* |
Select one or more users from the dropdown list for Integration Admin and Security and Governance Admin. All users configured in OvalEdge Security are available for selection. |
No of Archive Objects |
|
No Of Archive Objects* |
It indicates the number of recent metadata changes to a dataset at the source. By default, it is off. You can enable it by toggling the Archive button and specifying the number of objects to archive. Example: Setting it to 4 retrieves the last four changes, shown in the 'version' column of the 'Metadata Changes' module. |
Bridge |
|
Select Bridge* |
If applicable, select the bridge from the drop-down list. The drop-down list displays all active bridges configured in OvalEdge. These bridges enable communication between data sources and OvalEdge without altering firewall rules. |
- After entering all connection details, you can perform the following actions:
- Click Validate to verify the connection.
- Click Save to store the connection for future use.
- Click Save & Configure to apply additional settings before saving.
- The saved connection will appear on the Connectors home page.
Connectivity Troubleshooting
If incorrect parameters are provided, you may encounter error messages. To resolve these issues, ensure all input is correct. If problems persist, contact your assigned support team.
S.No. |
Error Message(s) |
Error Description / Resolution |
1 |
Login failed for user. ClientConnectionId:xxx |
Error Description: Either username and password might be wrong. Resolution:
|
2 |
SQLServerException: Login failed for user. |
Error Description: Resolution: In SQL Server, change the password for the user referenced in the error message. For more information, see Microsoft's Alter Login documentation. |
Manage Connector Operations
Crawl/Profile
Important: The Integration Admin role is required to perform crawl and profile operations.
A Crawl/Profile button allows you to select one or more schemas for crawling.
- Navigate to the Connectors page and click Crawl/Profile. It allows you to select the schemas that need to be crawled.
- The crawl option is selected by default.
- Click on the Run button, which gathers all metadata from the connected source and puts it into the OvalEdge Data Catalog. After a successful crawl, all the information is displayed in the Data Catalog > Databases tab.
Other Operations
The Connectors page in OvalEdge provides a centralized view of all configured connectors, including their health status.
Managing connectors includes:
- Connectors Health: Displays performance with a green (active) or red (inactive) icon, helping monitor data flow and address issues early.
- Viewing: Shows connector details (e.g., Databases, Tables, Table Columns, Codes, etc) via the View icon.
Nine Dots Menu Options:
You can view, edit, validate, and delete connectors using the Nine Dots menu.
- Edit Connector: Update and revalidate the data source.
- Validate Connector: Check the connection's integrity.
- Settings: Modify connector settings.
- Crawler: Configure data that needs to be extracted.
- Profiler: Customize data profiling rules and methods.
- Query Policies: Define rules for executing queries based on roles.
- Access Instructions: Specify how data can be accessed as a note.
- Business Glossary Settings: Manage term associations at the connector level.
- Anomaly Detection Settings: Configure anomaly detection preferences at the connector level.
- Others: Configure notification recipients for metadata changes.
- Build Lineage: Automatically build data lineage using source code parsing.
- Delete Connector: Remove connectors with confirmation.
Metadata Mapping
Source Object Name |
OvaEdge Data Object |
OvalEdge Data Object Type |
Schemas |
Schemas |
- |
Tables |
Tables |
Table |
Columns |
Columns |
Column |
Views |
Tables |
View |
Functions |
Codes |
Function |
Triggers |
Codes |
Trigger |
Stored Procedures |
Codes |
Procedure |
Limitations
S.No. |
Description |
Crawling |
Not supporting SSH tunneling in SQL Server |
Profiling |
- |
Lineage |
- |
Data Quality |
NA |
Data Preview |
- |
Appendix A
Please refer to the below sample queries to create a service account user and grant the required permissions. For more information, please refer to the SQL Server documentation or Consult your SQL Server DBA to check and execute these queries.
- Create a SQL Server Login and a database user.
- CREATE LOGIN <<Loginname>> WITH PASSWORD = '<<password>>';
- CREATE USER <<username>> FOR LOGIN <<Loginname>>;
- Grant Connection Permission.
GRANT CONNECT TO <<username>>; - Grant SELECT Permission on the Schema.
GRANT SELECT ON SCHEMA::<<schemaname>> TO <<username>>; - Grant REFERENCES Permission.
GRANT REFERENCES TO <<username>>; - Grant VIEW DEFINITION Permission.
GRANT VIEW DEFINITION TO <<username>>;