Release 5.2.8

About OvalEdge 5.2.8

The OvalEdge 5.2.8 is the latest release enhanced with the new Data Custodian Role, which represents the IT sidetracking of data metrics, including data lineage, overseeing data storage, and tracking the data usage. This release includes the Entity Delete Framework that allows the users with system administrator privileges to remove specific database connections, schemas, domains, and archiving or transferring roles. 

Along with the existing functionality enhancements in Home, Data Catalog, Business Glossary, Data Stories, Governance Catalog, My Resources, Jobs, Advanced Tools, and Administration modules.

• The Elasticsearch Filter is improvised to display the search results specific to data objects. Each data object is enabled with a set of search filters to simplify the search results further.
• The Data Catalog and Business Glossary main data grids are improvised with the customizable view functionality. The user can select the desired columns to be displayed in the Data Catalog and Business Glossary main data grids.
• The Sankey Lineage Diagram is enhanced to a multi-level horizontal level to display data flow among the objects at a higher level and can trace a single object through the flow.
• The Projects module is redesigned to display the list of all tasks assigned to the logged-in user with Kanban and Table view formats with the different Project statuses displayed in separate columns. 

In this release, the critical and significant bugs associated with the Home, Data Catalog, Business Glossary, Data Stories, Governance Catalog, My Resources, Jobs, Advanced Tools, Administration, and Connectors are fixed and working as expected.

Release Type                                                              Release Date

Major Release                                                            03 April, 2022

What’s New

1. Governance Roles
   The OvalEdge Governance Roles are enhanced with the new Data Custodian Role, which represents the IT sidetracking of data metrics, including data lineage, overseeing data storage, and tracking the data usage, data governance, and are responsible for more technical responsibilities. 
   The Custodian is often someone on the BI/Data Services team and works closely with the Data Steward to share and prioritize backlogs, agree on tech debt retirements, and move users to self-service areas.
   Along with the Data Custodian role, the OvalEdge application has labels for Owner, Steward, Custodian, and has the ability to define more labels according to new roles (Governance Roles 4,5, and 6) for additional responsibilities required for integrity and security of data usage. 
2. Delete Framework
   The OvalEdge Entity Delete Framework allows the users with system administrator privileges to remove specific database connections, schemas, domains, and archiving or transferring roles. The purpose of this framework is to follow a pattern when the OE admin deletes an entity in the application. This pattern involves deleting all child objects iteratively, transferring all responsibilities, and archiving (if required) before deleting the entity.  
3. Elasticsearch Filter
   The Elasticsearch Filter functionality is improvised to display the search results specific to data objects like Databases/Tables/Table Columns/Files/File Columns/Reports/Report Columns/Queries/Business Glossary/Tags/Projects/Data Stories/Service Requests. Each data object is enabled with a set of search filters to simplify the search results further. 
   • The Advanced Filter is allowed to refine the search results by applying AND/OR/NOT operations next to the search filters.
   • The new highlight option is available next to the data object title to display how the search keyword is related and matched to the data object.
   • The Popularity Score/Endorsement Score /Relevance Score is also available for every search result.
   • The Global Search Filter with exact search term functionality is enhanced to fetch the precise search results by including qualifiers (& for AND,  II for OR, - for NOT) in the search filter.
4. Customizable  View
   The Data Catalog and Business Glossary main data grids are improvised with the customizable view functionality. The user can select the desired columns to be displayed in the Data Catalog and Business Glossary main data grids. Here, the user can create multiple views for a page, add a name and description to the view, and specify the view to be Private/Public/System.
   • Along with the customizable view, the existing Data Catalog Entity Relationship Diagrams functionality is improvised with the following features:
   • The complete logical relationship between tables and their attributes in a database is displayed.
   • The Primary Key or Foreign Key associated with the Table columns are discriminated against using the key symbol next to the Table column name.
   • The different Table Column relationships, including One-to-One, One-to-Many, Many-to-One, and Many-to-Many, are identified.
   • Zoom in Zoom out functionality for the ER Diagrams is enabled for more readability and visualization. It provides an option to drag the tables left/right/top/bottom to clear visuals of the Table relations.
   • Displays the Similarity and Join Scores, and additionally, the Main and Linked Tables are provided with the hyperlinks to navigate the users to the respective Table Detail page.
5. Multi-Level Sankey
   The Sankey Lineage Diagram is enhanced to a multi-level horizontal level to display data flow among the objects at a higher level and can trace a single object through the flow. Users can now dig deep into the lineage relationships from Schema level to table and column levels. Apart from the existing viewing capabilities, viewing data lineage graphs has made it user-friendly with the following features:
   • Schema Level Movement: Displays the data flow among the data assets (Tables/Files/Reports) in the application.
   • Table Level Movement: Displays the relationships among a specific object to different other tables.
   • Column Level Movement: Displays the relationships of each Table to different columns in other tables.
   • Zoom In Zoom Out:  This allows users to zoom in and zoom out the Sankey diagram at the Schema/Table/Column level and also permits them to drag the nodes as per their convenience and understand the links better.
6. Projects
   The Projects module is redesigned to display the list of all tasks assigned to the logged-in user with Kanban and Table view formats with the different Project statuses displayed in separate columns. Users can create more Project statuses along with the predefined statuses, drag and drop the objects from one status to another, add transitions to the Project Tasks, and change the multiple project tasks at one instance. The different project status counts for To Do, In Progress, and Done are displayed using the color bar for better visualization.

Features

• Data Catalog
  In the Data Catalog, all data objects - Table/Table Columns/File/File Columns/Report/Report Columns/ Queries are made downloadable for the Customize View selected in the excel format.
  The existing user interface of the Data Catalog is improvised to apply filters on the selected columns, and apply sorting to display the results in alphabetical order from A-Z/Z-A, and also supports the multi-level sorting where the sorting can be performed individually to the columns without impacting other columns.
• Business Glossary 
  The Business Glossary module is enhanced to allow the users to update the governance roles (Owner, Steward, Custodian, Governance Roles 4, Governance Roles 5, and Governance Roles 6) for a term and manage the default governance roles through the term and assign the terms on the object (s) or data set. 
  If a user updates the governance roles, the Audit Trail - Data Objects records the object on which the user got updated. For example, the owner of a table called 'customerorder' was named 'Harry', later admin users could update this user name to 'Robert', in this case, User Harry would be recorded as deletion, and User 'Robert' recorded as an insertion. Users can be either individuals or teams. 
• Advanced Tools
  In the Advanced Tools module, the Load Metadata from Files template is improvised, and the Object Names are included with the following fields:

• Administration
  In the Crawler module, the Manage Connection is improvised and categorized into Connection  Settings and Default Governance Roles. Here, by default, the governance roles and users configured in the system are displayed, where the user can select a specific user or a team for that particular connector. 

Improvements

1. Home
   1. In the Home page when a tag is selected, the Tag Description, Created By user, and Created Date details are displayed at the top of the page.
   2. The Filter is provided to refine the search process by selecting specific data objects. Users can now select all the data objects in the filter options by entering an object name, and the search filter results are shown.
   3. The Tooltip feature is enabled to the Table Plugin, hovering over any element the user can view the brief information about the element.
   4. All the Date fields in the Table plugin are made filterable, and the user can choose to select the date from the calendar pop-up.
   5. In the Helpful Resources, earlier users were only able to save the resource links. Now, the Functionality is enhanced where the resource links are made clickable, and users can now navigate to the resource links page directly.
   6. While performing any validation, saving, or crawling, any error message usually pops up on the screen. Users can now Copy the error message to the clipboard to view the full details of the error and figure out what the error is about.
   7. The Bookmark feature is enhanced to organize the Bookmark as per the user requirements. Here the Bookmark names can be edited/deleted/unpin from the Bookmark list. 
      
      Elasticsearch Filter
      1. In the Home module, the Elasticsearch Filter is improvised to support the search based on the Custom Fields, and when a user searches an Object using Tag, then the search results are now refined to include all the Objects associated with the Tags.
      2. In the Elasticsearch page, a new pagination box is provided in the bottom left of the page to show the current page count and the total number of pages, and users can use the right and left arrows to navigate to the left/right pages.
2. Data Catalog
   1. In the Data Catalog > Tables page, an additional Column count column is added, similar to the row count to the main table.
   2. In the Data Catalog > Tables page, when a table with no data is downloaded then the downloaded file now displays the names of the column related to the table.
   3. In the Data Catalog > Table > Lineage > Edit Lineage > the Map column via AI is now enabled for File columns and Report columns.
   4. In the Data Catalog > Reports page, the search Audit Report is updated to show the most searched terms for 12 weeks.
   5. The Object Type column is added to the respective object table page to display the Object Type from the Empty/Table/View options.
   6. In the Data Catalog, users can now certify an object with Certify/Caution/Violation/Inactive/None options from a specific object and can endorse data objects at Column level - Table Columns/File Columns/Report Columns.
      
      Reports
      1. The new report “Role Wise Access on the Objects” is developed to display the user's role in having access to the various data objects like Schema, Table, File, and Reports.
      2. The new report “Duplicate Count” is developed to display the duplicate count of objects in the schema based on the connections, and these duplicates can be seen in Tables and File.
3. Business Glossary
   1. In the Business Glossary, the AI Recommendation is improvised to display the data score and pattern score for the object type file column similar to the Table Column object. Here, the File Column object associated with a term displays a recommendation based on the 'Smart Score', 'Name,' 'Data,' and 'Pattern'. 
   2. Users can now download Business Glossary Term data along with custom field details, associated objects to the Term Details, and Description.
   3. The Custom Fields are now provided with the View History option to display the logs of updates with the Username, Date & Time. 
   4. Users can now delete multiple terms from the Business Glossary main page by selecting multiple objects.
   5. Users can now download all the tables and columns within each table and their descriptions at an instance from the Data Catalog main page.
4. Data Stories
   1. The Data Stories is enhanced with the use of the @ notation feature to access the object and users list as listed below:
      1. @ Users (owner, steward, owner, and other governance roles)
      2. @ Objects( Schema/Table/TableColum/Report/ReportColumn/File/FileColumn, Business Glossary)
      3. @  in the collaboration message tool
      4. @ in the content page to pull any data objects
5. Projects
   1. In the Project Detailed page, the breadcrumbs are provided in the top left of the screen to show the navigation path from the Project module to a specific project detail page.
   2. In the All Projects page, additional columns are added to the main table that includes Added by, Added on, Update By, Updated on, Completed By, Completed On columns, and by default, the 1000 objects are displayed.
6. Governance Catalog
   1. In the Data Quality, DQR Objects page, the Results Stats Query and Failed Data Query are now provided with the tooltips to view the detailed descriptions.
   2. In the Certification Policy page, the Policy Description is now made as an editable field and displayed in a separate pop-up window.
   3. In the Data Classification, additional category and subcategory fields are included, and if the domain is selected, pertaining category and subcategory options are displayed.
   4. In the Data Classification > Business Glossary Page > Domain Column, a filter option is enabled for the users to refine the search based on the keyword entered.
      

      Note: 

      Governance Catalog > Service Desk

      For the migration customers, if a customer wants to raise a service request (Content change) on a data object having both TERM and DAG then the customer needs to manually remove one of the TERM or DAG on the data object otherwise, the service request may not be approved as per the new design i.e. the customer is allowed to add only a TERM or a DAG but not both.

7. My Resource
   1. In the My Resources, My Profile page, the Add Slack ID and Add Phone Number fields are now made clickable and allow the user to edit the profile details.
   2. In the My Resource, the Watchlist Notification is now integrated with the overall application to receive notifications associated with the Metadata and Remote Metadata modifications. Here, whenever the data objects in the watchlist undergo a significant percentage of data change, the users get notifications for the newly created custom fields or update or delete content in the custom fields.
8. Jobs
   1. In Jobs, the main table, the Duration and Size columns, are added for the users to view the duration and size of every job.
   2. The Job Log Value is enhanced with a search filter that allows filtering by timestamp and date for the list of jobs executed.
9. Advanced Tools
   1. In the Load Metadata From Files, the DQR template is improvised to support uploading the SQL functions in the query.
   2. In the Load Meta Data Files, Data Quality Rules are improvised to upload 100+rules for DQR SQL functions for both existing and non-existing queries.
   3. In the OvalEdge API, the new API (/api/term/searchTerms) is included to fetch the list of all terms associated with all the objects in the OE application.
10. Administration
    1. Users & Roles
       1. The add role page is implemented with the ‘Role description’ column that gives a brief description of a role. It is also provided with an edit option to update the role description further.
       2. The bulk deletion option is provided to delete one or more roles in the list at one instant.
    2. Security
       1. In the Security module, the existing Domain main page is enhanced to delete multiple domain users at one instant.
       2. In the Security, Reports tab, a new Schema column is added to the table.
    3. Manage Servicedesk
       1. The Manage Servicedesk data grid is included with a column called ‘Status’ and ‘Approval Status’ for a custom template. When a custom template is created, by default status of the custom template is set as ‘Published.’ The Approval Status indicates whether the template is active or not. Here, whenever the templates are no longer necessary and need to hide from the list, they can be set as ‘Inactive’ mode.
       2. A user can change the approval status of the custom or system-defined template from the ‘Edit Service Request template’ (Custom or System) and cannot make it to an ‘Inactive’ status when a custom template is in the process of approval with a Servicedesk ticket. 
    4. Advanced Job
       1. In the Advanced Job page, the Last Run Date and Status columns are added to the table.
    5. Audit Trails
       1. In the Audit Trails page, the Audit Trail title is provided in the header for easy reference of the page.
       2. In Audit Trails, Catalog > Terms, the complete Term value is displayed in specific Term fields along with domain name, category name, subcategory name, and term name.
       3. In the Audit Trails, the existing Catalog page is improvised and included with the ‘Custom Field’ tab to capture the value changes done to the custom field type, and the Object Name field also displays the name of the object along with a hyperlink clicking upon which user navigates to the specific objects page.
       4. In Audit Trails, Catalog > Tags > the DAG tags are now shown using a superscript.

Copyright © 2019, OvalEdge LLC, Peachtree Corners GA USA