OvalEdge Releases

Release6.3.2

About OvalEdge Release6.3.2

The OvalEdge Release6.3.2 introduces key enhancements and bug fixes across various modules, improving functionality, usability, and system performance. 

Key highlights include:

  • Minor Enhancements to Tags, Data Catalog, Business Glossary, Reports, and Service Desk.
  • Governance Catalog upgrades, with improvements to Data Classification and Governed Data Query (GDQ)
  • New Advanced Jobs and System Settings with additional automation and configuration controls.
  • Resolving Critical Issues in connectors, data catalog, and business glossary functionalities, enhancing overall user experience and system reliability.

Release Type   

Release Version

Build

<Release. Build Number. Release Stamp>

Build Date

Service Release

Release6.3.2

Release6.3.2.6320.c4ec98f 8 Oct 2024

Minor Enhancements

Tags

  • +New option is added to Parent and Child tags: In Tags > Summary Page > Child Tags > Edit Tags, a ""+New"" option has been added to both the Parent Tags and Child Tags sections to improve functionality.

Data Catalog

  • Ability to Add a Virtual Object as View: A "View" option has been added to the Type drop-down list in the Data Catalog > Tables > Manage Tables > Create Virtual Table pop-up screen, allowing users to create a Virtual Object as a view.

Business Glossary

  • Sorting Enabled for Endorsement Column in Business Glossary List View: The Business Glossary List View now includes a sorting option for the Endorsement column. Users can now sort the Endorsement column, making it easier to analyze and find specific information.

Reports

  • New Reports Introduced
    • Published vs. Draft by Age and Category: This report generates data based on term status, allowing users to view published terms by category and track the time from draft to published state.
    • Critical Business Terms with Enriched Description and Needs Description: This report generates data based on custom fields such as critical business terms. It displays terms with completed and pending descriptions.
    • Published vs Draft by Category: This report generates data based on term status, showing published and draft terms by category.

Service Desk

  • ServiceNow Integration Update in Service Desk

When ServiceNow is integrated with OvalEdge, the UserID or Username in OvalEdge is automatically converted to the user's email address in ServiceNow. This enhances user identification and analysis within the ServiceNow platform.

  • Service Desk Update: Reopening Rejected Requests

In the Service Desk, the alert messages for reopening rejected requests have been updated for clarity. The message "No directly reopen" has been changed to "Yes, Reopen," and "Modify and Reopen" has been updated to "Yes, Modify and Reopen."

Governance Catalog

Data Classification Recommendations

  • Enhanced Data Classification Recommendations: Data Classification Recommendations have been improved to allow users to download recommendations. Users can download recommendations through the Nine Dots menu by selecting Recommendations > Download Recommendations or by clicking the download icon located at the bottom right corner of the page.

Governed Data Query

  • GDQ 'Like Condition' in Redshift Now Supports Case-Insensitive Records Retrieval: In the Governance Catalog > GDQ, the 'Like Condition' for the selected GDQ, especially for the Redshift connector, now fetches and retrieves the case-insensitive records.
  • GDQ Input Simplified: No More Double Quotes Needed for Record Retrieval: In Governance Catalog > GDQ, users previously had to enter input in double quotes to fetch records. Now, they can input values directly without needing to use double quotes.

ROPA

  • Author License Users Can Now Request Publication of ROPA Processing Activities: Author License users can now access the request to publish option to publish any ROPA processing activity.
  • New Drop-Down Option Added for Method of Storage in GDPR ROPA Processing Activity: A new drop-down option, “Physical & Manual” has been added in the Data Storage > Method of Storage within the Add Processing Activity screen, part of GDPR ROPA.

Jobs

  • Download Option Added for Jobs Summary in Jobs Module: The Jobs module now has a download option, allowing users to download the Jobs summary to analyze the overall Job status.

Advanced Tools

  • The following are the enhancements made to the OvalEdge APIs webpage:
  • Users can now view an expanded and collapsed view of OvalEdge APIs by adding a URL extension.
  • Expanded View: /api-docs?docExpansion=list 
  • Collapsed View: /api-docs?docExpansion=none
  • Users can view the alphabet sorting of OvalEdge APIs.
  • Business Glossary Now Supports Domain Filtering: Users can filter specific domains from the Business Glossary List View, make changes, and later upload them using the Load Metadata from Files feature. Uploading the Domains xlsx document with up to 15 sheets is recommended, and exceeding this will result in a Job log error.
  • LMDF Template Upload: Avoid Special Characters in Titles to Prevent Job Log Errors: In Advanced Tools > Load Metadata from Files (LMDF), users should avoid using special characters in the title of the downloaded LMDF templates to prevent errors in the job logs when uploading them.

Administration

Connectors

  • Delta Crawl Option Added: In Administration > Connectors > Qlik Cloud > Nine dots > Settings > Crawler, the Delta Crawl option has been added.
  • Schema Registry Now Supports Protobuf: Schema Registry has been improved to support Protobuf files for retrieving metadata.
  • New 'Crawl Streams' Field Added to QlikSense OnPrem Connector: In Administration > Connectors > QlikSense OnPrem, in the Add Connector page, a new field, 'Crawl Streams,' has been added to crawl streams from the data source.
  • New 'Crawl Spaces and Collections' Field Added to Qlik Cloud Connector: In Administration > Connectors > Qlik Cloud, a new field, 'Crawl Spaces and Collections' in the Add Connector page, has been added to crawl spaces and collections from the data source.
  • BigQuery Connector Update: In Administration > Connectors > BigQuery connector, a new enhancement has been made to crawl all the datasets from all pages. Earlier, only one page of datasets was able to crawl.
  • Connector Settings Update: Previously, saving connector settings was cumbersome. If the user clicked "Save" after making changes in one tab (e.g., Crawler) before moving to another tab (e.g., Profiler), the settings window would close. This required the user to return to the connector main page and navigate through the nine dots menu to access connector settings and other tabs (e.g., Profiler).
    Now, this process has been streamlined. After changes are made in a tab (such as Crawler), a pop-up appears with "Save Changes" and "Continue Editing" options. Selecting "Save Changes" saves the current tab's actions and smoothly transitions to the next tab (e.g., Profiler).
  • OBIEE Connector Update: The Oracle Business Intelligence Enterprise Edition (OBIEE) connector has been developed to integrate with Oracle Analytics Server (OAS) version 7 and GreenPlum Database. This connector ensures smooth data flow and full compatibility between OBIEE and OAS7, supporting all features and functionalities. The implementation also involves comprehensive testing and validation to ensure efficient and reliable integration.

Users & Roles

  • UserID Length Increase: The maximum supported length for UserID in the User & Roles module has been increased from 50 to 250 characters.

Advanced Jobs

  • Active Directory Group Comparison
    A new advanced job has been developed to compare users in two Active Directory groups with their OvalEdge licenses. This job ensures alignment between group memberships and assigned licenses by identifying inconsistencies, such as users with mismatched licenses or those present in both groups.

System Settings 

  • System Settings Update: Email Notification Template for Data Quality Rule
    The Email Notification Template for the Data Quality Rule has been improved. It now displays only the required failed values in the notification instead of showing the DQ Rule Summary, DQ Validation Rule Results, DQ Rule Associated Objects, and all failed values of the rule.

DAM

Azure Synapse Integration in Data Access Management

Support for Azure Synapse has been added, introducing the following functionalities:

  • User, Role, and Permission Crawling: Crawl users, roles, and their permissions on various data objects within Azure Synapse.
  • Permission Synchronization: Permissions defined at the source system level are replicated in OvalEdge, enabling seamless metadata management for users.
  • Audit Logs: Logs of user actions, roles, and permissions on crawled data objects are audited, capturing details such as the action performed, the user responsible, and the timestamp.

Custom Fields

  • Hyperlink Support in Custom Fields: Users can now add hyperlinks to Text Custom Fields in Custom Fields. This allows users to include URL links directly within the Text field.

New Connectors

  • CartoVista Connector: OvalEdge connects to the data source using APIs to crawl and build lineage. The following are the characteristics of the connector:
    • Type: Reporting
    • Crawl: Supported
    • Profile: Not Supported
    • Lineage: Supported
    • Data Quality: Not Supported
    • Query Execution: Not Supported
    • Bridge: Not Supported
  • Qlik Talend Connector: OvalEdge connects to the data source using APIs to crawl Plans and Tasks. The following are the characteristics of the connector:
    • Type: ETL
    • Crawl: Supported
    • Profile: Not Supported
    • Lineage: Not Supported
    • Data Quality: Not Supported
    • Query Execution: Not Supported
    • Bridge: Not Supported

New System Settings

The latest release introduces new settings that enhance user control over the application's behavior. 

Key 

Description

oe.diagnostics.delete.query.audit.enable

Configure to view the 'Delete Query Audit' on the Application Diagnostics page.


Parameters:

The default value is False.

If set to True, the Delete Query Audit option displays on the Application Diagnostics page.

I set it to False, Delete Query Audit option does not display on the Application Diagnostics page.

businessglossary.term.publish

Configure which governance role should be able to publish the term in the Business Glossary.


Parameters:

Available values are: Owner, Steward, Custodian, Governance Role4, Governance Role5, and Governance Role6.

The default value is Owner.

To add more governance roles, select from the drop-down list. If left blank, "Owner" is displayed.

es.search.dropdown.disabled

Configure to view the Global Search results in the Search drop-down.

Parameters:

If set to True, the search results will be extracted from Global Search based on the entered keyword.

If set to False, the search results will be extracted from a database based on the entered keyword.

New Advanced Jobs

The latest release introduces a set of new advanced jobs that allow users to update the data specific to modules or features using advanced algorithms.

Name 

Description

Upload Table Column Sheet from S3 to LMDF

This job will retrieve the table column file from S3, create domains and terms, and then upload the file via LMDF.

Salesforce Source Column Description Parsing

This job involves parsing the JSON description in Salesforce's source column into custom fields.

Lineage using YML Files

This job will create the lineage using the YML files.

OvalEdge User Licenses AD Verification

This job will generate a comparison report of the users in the AD groups and those in OvalEdge Licenses. Attributes:
Attr1: Compare Azure AD Groups with Author License (comma separated)
Attr2: Compare Azure AD Groups with Viewer License (comma separated)
Attr3: Notify Users (comma separated) - Enter the users to notify
Attr4: Notify Team (comma separated) [The users in the Team will be notified] - Enter the team names Attr5: Notify Roles (comma separated) [The users of given Roles will be notified] - Enter the roles

Load Dataset For Data Quality

This job involves loading the dataset from the xlsx file to associate data quality rules.

Advance job for modifying the column lengths of userid

This job allows data to be inserted into the userid column with a maximum length of 255 characters.

Migrate Service Desk Notification Templates

This job involves updating service desk inbox notification templates with the old service desk inbox message.

Bug Fixes

In Release6.3.2, the following bugs have been resolved, ensuring the OvalEdge application functions as expected.

Home

  • In the Home > Global Search, an issue where clicking a Table Column from the recommendation drop-down resulted in an "Access Denied" error has been fixed. Users can now click the Table Column from the recommendations without encountering this error.
  • In the My Resources > My Profile, an issue where the Viewer licensed users could view the My Desk (View Permissions) option has been resolved. Now, this option has been hidden for Viewer-licensed users.

Data Catalog

  • When migrated from 6.1.2 to 6.3.1, In Data Catalog > Tables > Table Summary page > Lineage > Edit Lineage, For manual lineage, an issue where the lineage Type was showing as Auto Lineage has been resolved. The License Type shows Auto for Auto Lineage and Manual for Manual Lineage.
  • When migrated from 6.1.2 to 6.3.1, In Data Catalog > Tables > Table Summary page > Columns > Column Lineage, an issue where the lineage description was not showing has been resolved. Now, it shows the lineage description.
  • In Data Catalog > Tables, an issue where the lineage icons were not showing for the Synapse connector has been resolved. Now, the Lineage icons are showing.
  • In the Data Catalog > Object Summary, an issue where duplicate custom fields are being created due to running the same Custom Field Migration Job multiple times has been resolved. Users can now view unique custom fields without duplication.
  • In the Data Catalog > Table summary, an issue where the virtual table status appears as profiled has been resolved. The created virtual column must be associated with the profiled table.

Business Glossary

  • In the Business Glossary > List View, an issue where downloading other irrelevant objects in the downloaded template, irrespective of the applied filter condition, has been resolved. Users can now view only the filtered object details in the downloaded template.
  • In the Business Glossary > Term Summary, an issue where inconsistency in the detailed description of the term when added in Cambodian language has been resolved. Users can now view the exact detailed description without any content loss after refreshing the term summary.
  • In the Business Glossary > Term summary, an issue where the business description content was being updated as the detailed description has been resolved. Users can now independently update and save both Business and Detailed descriptions.
  • In the Business Glossary > Term Summary, an issue of not finding the objects from the related objects search functionality has been resolved. Users can now accurately utilize the search functionality for related objects.
  • In the Business Glossary, an issue with opening the XLS template downloaded from the Business Glossary has been fixed. Users can now easily open and view the downloaded template.
  • In the Business Glossary, an issue where changing the terms from one category to another subcategory, the governance roles of the new category being applied on a term(s) instead of subcategory, has been resolved.
  • In the Business Glossary > Term summary, an issue where clicking on the associated objects of a term resulting in an error has been resolved. Users can now view the associated objects of a term.
  • In the Business Glossary List View, users experienced an "illegal argument exception" error when attempting to download detailed data in XLSX format. This issue has been resolved, and users can now successfully download term list details in XLSX format.

Data Stories

  • In the Data Stories, an issue where the invisibility of the Data Stories edit screen options when the content is overflowed has been resolved. Users can now view the complete Data Story, including its edit options.
  • In the Data Stories, an issue where images in a data story using HTML code were not aligning correctly when added to the home screen has been resolved. Users can now see properly aligned images in the Data Story and Home Page.

Dashboards

  • In the Dashboards, an issue where the Author License Count report was showing as zero has been resolved. Users can now run an advanced Job to retrieve the exact Author License Count report details.

Projects

  • In the Projects, an issue where only the Admin user icon was shown in the project status history has been fixed. Now, users can see the specific icons of the users who made changes to the project task.
  • In the Projects, an issue where non-admin users couldn't see tasks in List View but could see them in Board View has been resolved. They can now view the tasks both in Board View and List View.

Service Desk

  • In the Service Desk, user actions from the nine dots menu are now easily distinguishable. Options that are not applicable to the current situation, such as the "Withdraw" option, will be displayed in a grayed-out and disabled state. This ensures that users can easily identify and select the appropriate actions.

Governance Catalog

Data Classification Reports

  • In the Governance Catalog > Data Classification Reports, an issue where enabling the 'Select All' checkbox for the chosen classifications has been resolved. Users can now enable the 'Select All' option.

Governed Data Query

  • In the Governance Catalog > GDQ, an issue where, after running the GDQ, the error or warning messages in Job logs showing the Inactive records has been resolved. Users can now view the GDQ results as expected.

Data Quality

  • In the Data Quality Data Functions Table Column, users encountered an error message indicating incorrect syntax when modifying queries using additional settings. This issue has been resolved, and users can now modify queries according to their requirements without encountering errors.
  • In the Data Quality Rules > Summary, previously, when the "Send Alert on Failure" option was enabled for a Data Quality Rule, the failure email notification was sent only to the Steward. However, when the rule was executed, the notification was sent to users listed in the Data Quality Contacts, excluding the Steward. This issue has now been resolved. When the rule is executed, the notification will be sent to the users listed in the Data Quality Contacts. Additionally, if the "Send Alert on Failure" option is selected, the notification will be sent to the Steward.

Advanced Tools

  • In the Advanced Tools > OvalEdge APIs, an issue where the Business Glossary API (/api/businessglossary/domain/getBusinessTermsDomainWise/v2) resulted in a 404 Error has been resolved. Users can now use this API as per their requirements.
  • In the Advanced Tools > LMDF, an issue with adding columns to a table from LMDF for a manual connector has been resolved. Users can now add columns to a table using LMDF.
  • In Load Metadata from Files > Data Quality Template, users experienced an issue with custom queries created for data quality rules not uploading into the application. This issue has been resolved, and the custom queries are now visible in the data quality rules, provided they have been cataloged in the application.
  • In Administration > Advanced Jobs, an issue where running Sync Project Status and stats for old and new project advanced jobs triggered more than 360 email notifications, which has been resolved.

Administration

Connectors

  • In the Administration > Connectors, while editing the Snowflake connector with Keypair Authentication and Credential Manager as AWS Secrets Manager, an issue where the Private Key File Password was visible in plain text has been resolved. Now, the Private Key File Password is shown in an encrypted format.
  • In the Administration > Connectors > Nine dots > Settings > Profiler > Profile Settings, an issue where the user was unable to kill the job if the thread count is more than one has been resolved. Now, the user is able to kill the job if the thread count is greater than one.
  • In the Administration > Connectors > Alteryx connector, the issue of duplicate workflows being crawled has been resolved. Now, the workflows are crawled without any duplication.
  • In the Administration > Connectors > Snowflake, an issue where job logs were missing and data was not showing on the Data tab after profiling had been resolved. Now, job logs are displayed correctly, and the data is visible on the Data tab.

Custom Fields

  • In Administration > Custom Fields, an issue where hiding the system field "Last Crawled Date" of the Report type object in custom fields was causing an error ("Error: [Object Object]") when trying to view the reports in the Data Catalog has been resolved.
  • In Administration > Custom Fields, users encountered an issue where options provided for the Code Custom Field dropdown did not display correctly in the Data Catalog object summary. This issue has been resolved, and the custom field and associated options are now correctly displayed in the dropdown within the Data Catalog object summary.

                                                 Copyright © 2024, OvalEdge LLC, Peachtree Corners, GA USA