Elastic Search On-Prem Connector

Table Profiling

Row Count, Columns Count, View Sample data

-

View Profiling

Row Count, Columns Count, View sample data

View is treated as a table for profiling purposes.

Column Profiling

Min, Max, Null Count, Distinct, Top 50 values

-

Full Profiling

Supported

-

Sample Profiling

Supported

-

1

Rest API

Connection validate

Read

Crawl objects

Read

Profile indexes

Read

Connector Type

By default, 'Elastic Search On Premise' is displayed as the selected connector type. If you want you can select the connector from the drop-down list.

Credential Manager

Select the option from the drop-down list, where you want to save your credentials.

OE Credential Manager: The connection is configured with the basic Username and Password of the service account in real-time when OvalEdge establishes a connection to the Elasticsearch On-Prem. 

HashiCorp: The credentials are stored in the HashiCorp database server and fetched from HashiCorp to OvalEdge.  

AWS Secrets Manager: The credentials are stored in the AWS Secrets Manager database server and fetched from the AWS Secrets Manager to OvalEdge.

AzureKeyVault: The credentials are stored in the Azure Key Vault database server and fetched from the Azure Key Vault to OvalEdge. Click here to know more.

For more information on Credential Manager, refer to Credential Manager.

License Add Ons

All the connectors will have a Base Connector License by default that allows you to crawl and profile to obtain the metadata and statistical information from a data source.

Connector Name*

Provide a connector name for the Elasticsearch On-Prem data source in OvalEdge. This name will serve as a reference to identify the specific Elasticsearch On-Prem database connection.

 Example: "ESOnPrem_Connection_test"

Connector Environment

The Connector Environment drop-down list allows you to select the environment configured for the connector from the drop-down list. 

For example, PROD, or STG (based on the configured items in the OvalEdge configuration for the connector.environment).

The purpose of the environment field is to help you identify which connector is connecting what type of system environment (Production, STG, or QA).

 Note: The steps to set up environment variables are explained in the Configuring Environment Variables section.

Base URL*

Specify the name of the database instance server IP/URL, which is accessible by the OvalEdge application.

Format: http://{ip address}:{port}

Username*

Enter the Service Account Username of the Elasticsearch On-Prem.

Password*

Enter the password of the Elasticsearch On-Prem data source.

Steward*

Select the Steward from the drop-down list options.

Custodian*

Select the Custodian from the drop-down list options.

Owner*

Select the Owner from the drop-down list options.

Governance Roles 4, 5, 6*

Select the respective user from the drop-down options.

Note: The drop-down list displays all the configurable roles (single user or a team) as per the configurations made in the OvalEdge Security > Governance Roles section.

Integration Admins*

To add Integration Admin Roles, search for or select one or more roles from the Integration Admin options, and then click on the Apply button.
The responsibility of the Integration Admin includes configuring crawling and profiling settings for the connector, as well as deleting connectors, schemas, or data objects.

Security and Governance Admins*

To add Security and Governance Admin roles, search for or select one or more roles from the list, and then click on the Apply button.
The security and Governance Admin is responsible for:

• Configure role permissions for the connector and its associated data objects.
• Add admins to set permissions for roles on the connector and its associated data objects.
• Update governance roles.
• Create custom fields.
• Develop Service Request templates for the connector.
• Create Approval workflows for the templates.

No. of Archived Objects*

The number of archive objects indicates the number of recent metadata modifications made to a dataset at a remote/source location. By default, the archive objects feature is deactivated. However, users may enable it by clicking the Archive toggle button and specifying the number of objects they wish to archive. 

Select Bridge

With the OvalEdge Bridge component, any cloud-hosted server can connect with any on-premise or public cloud data sources without modifying firewall rules. A bridge provides real-time control that makes it easy to manage data movement between any source and destination. For more information, refer to Bridge Overview.

For more information, refer to Bridge Overview

S.No

Error Message(s)

Description

1

Failed to establish a connection, please check the credentials.

In case of an invalid username and password.

Connection Settings

Description

Crawler

Crawler settings are configured to connect to a data source and collect and catalog all the data elements in the form of metadata. 

Profiler

The process of gathering statistics and informative summaries about the connected data source(s). Statistics can help assess the quality of data sources before using them for analysis. Profiling is always optional; crawling can be run without profiling. 

Access Instruction

Access Instruction allows the data owner to instruct others on using the objects in the application.

Business Glossary Settings

The Business Glossary Setting provides flexibility and control over how they view and manage term association within the context of a business glossary at the connector level.

Notification

The Enable/Disable Metadata Change Notifications option is used to set the change notification about the metadata changes of the data objects.

• You can use the toggle button to set the Default Governance Roles (Steward, Owner Custodian, etc.) 
• Using the Roles and Teams, you can select the role and team to receive the notification of metadata changes.