DryvIQ Platform Release Notes

DryvIQ Platform Release Notes

Version: 5.9.1
Release Date: November 7, 2024

 

DryvIQ Platform version 5.9.1 was available on November 7, 2024. This is a maintenance release that focuses on enhancements and bug fixes. Learn more about the release below. For detailed information about individual items, refer to the DryvIQ Platform Documentation Center.

 

If updating DryvIQ from version older than 5.8, the upgrade will take an extended amount of time due to database updates. Do not cancel the update; let the update complete even if it seems to be taking an excessive amount of time.

New Features and Enhancements

Entity Types

  • The default threshold value for the PII Extraction Module was increased from .01 to .6 to decrease the number of false positives. This affects Discover scans and Govern policies that use the PII Extraction entity type. In order to get the new threshold value, you will need to upgrade your extension policy packs to version 5.9.1. Contact your DryvIQ Consultative Services representative or DryvIQ Customer Support for assistance.

Migrate

  • DryvIQ now supports migrating OneNote files. OneNote files migrated from any source connector to a SharePoint connector will retain the OneNote file format.

Settings

  • The disable option was removed from the individual extensions in the Settings. This helps streamline installation and enables faster pod start up

 


Fixes

Discover

  • The updates were made to the Results and Accounts pages to fix an issue with the pages loading on the hub tenant for hub installations.

Migrate

  • Filtering a user map by “External” now properly filters the results.

  • Items will not transfer twice when the parent folder is in a “Retry” status.

  • Microsoft SharePoint Online connectors will sanitize colons in root path names properly based on the unsupported character setting for the job.

  • SharePoint Libraries will not be identified as Sites for tenant SharePoint Online connections when crawling is enabled for the connector.

  • The DryvIQ Box connector will properly assign Owner to access rules during change detection.

  • The DryvIQ Migration API was updated to ensure permissions are properly propagated when inheritance is broken.

 

Updating the DryvIQ Platform does not update the Command-line Interface (CLI). If you use the CLI, you should update it when you update to a new version of DryvIQ to ensure the CLI is current. Run the CLI install command to update the CLI.  

 



Previous Release Notes

 

New Features and Enhancements

Discover

5.9 removes the original default Discover scan (the default scan available before full customization through the user interface was available). If your scans fail with the message, "There must be at least 1 active policy attached to this location," the scans use the default template, and you must recreate the scans using the Discover scan setup.

Insights

  • Improved chart messages: Insights charts now display different messages when they are in an empty state to help you understand why the chart is not displaying. This helps you understand the necessary adjustments you need to make to your data source or filter options so that the chart displays as expected. Learn more here.

  • Tooltips for stale data date parameters: When working with the dates for the stale data parameters, you can hover on the question mark icon next to the date field to view a definition of the selected date. The help text is dynamic and will change based on the date you select and may help you choose a date if you are unsure which date to select. Learn more here.

Results

  • Filters updates: Several filters have been updated to improve usability.

    • Included Entities: This filter now follows the same three-tier hierarchy used by the scan templates: Tier one is the template, tier two is the category, and tier three is the entity types. This structure provides consistency between the scan setup and the filters. In addition, a new Migration Details template will display in this section to display the Item Status entity type for files that have been added to migration plans. Learn more here.

    • Duplicate Data: You can now select multiple Duplicate Data filter options. In addition, “hash” was removed from the help text definitions and replaced with “signature” to clarify how DryvIQ defines each duplicate data category. Learn more here.

  • Does not Contain Refine option added: When searching account or group permissions, you now have a Does not contain operator that can be used to filter out domains so you can identify external accounts or groups that have access to files. This refine option is also available for custom insight charts.

  • Column Updates: Improvements were made to multiple columns to improve viewing content.

    • Size (Including Versions): In the Metadata section, this column will always display a dash (-) for folders since no size data will be reported in this column for folders. This more clearly indicates a null value due to the item being a folder.

    • URL: The Origin URL column was renamed URL to simplify the name and cause less confusion about the information being displayed.

  • Toolbox Updates: The following updates were made to the file toolbox to improve functionality:

    • A Copy link button was added to the toolbox. It is used to copy the file URL to your clipboard so it can be pasted as needed. This button also serves as a workaround for when the Go to location button is blocked by browsers. Learn more here.

    • Directory is now Path to reflect more clearly the information being displayed.

    • An Intelligent Migration section will display at the bottom of the file toolbox for files added to a migration plan. This section displays all the information relevant to the migration for the file. Learn more here.

Scans

  • Improved Scan Processing: The Start scan button is now always active and shows the number of scans it will start. When you start scans, a modal displays and remains on screen with the progress of the process. You will not be able to close the modal while the scans are starting since important processes are being performed. Once all requested scans have been started, you will be able to close the modal. Learn more here.

  • Next Scan information: The Status column was updated to display the next scan information for every scan. This information helps you easily identify when a scan will run based in its schedule or identify scans that do not have a schedule set and that need to be run manually. Learn more here.

  • Improved scan status displays: Updates were made to make the scan status more visible for Queued, In progress, and Failed jobs. This allows you to more easily identify the status of each scan.

  • View activity log for failed scans: Failed scans now display a View Activity Log link that can be used to view the activity for the scan. This will help identify what caused the scan to fail so you can take the necessary actions before attempting to start the scan again. Learn more here.

  • New Refine Options: Three new refine options have been added to provide additional search capabilities: Has Executions, Scan Date, and Scan Status. Learn more about each option here.

  • Enhanced warning messages: Since there is a direct correlation between the number of entity types added to a scan and scan performance, DryvIQ will display warning messages if you select multiple templates for a Discover scan. The messages serve as guidance to help you understand when your selections could impact your scan performance. Learn more here.

Migrate

Jobs

  • Link detection setting renamed: The job setting used to enable link detection has been renamed to Allow link detection and remediation on supported files to reflect the full capabilities available when the feature is enabled for the job. Learn more here.

Navigation

  • Improved navigation support: DryvIQ added browser support for improved navigation through the Migrate section of the application. This area now supports using the browser’s Back, Forward, and Refresh buttons without losing your place in the application.

Connectors

  • Docusign shared template handling: The DryvIQ Docusign connector was updated to manage shared templates. Templates will be shared to the Administrators group when migrating; In Discover, the template containers and their documents will all show the Administrators group for group sharing access. Learn more here.


Fixes

Discover

  • Sorting the Results grid by the Item Name column no longer causes an error.

  • Sorting columns in the Results grid no longer scrolls the grid back to the left (first column).

  • Govern policy activity no longer displays in the Discover activity log.

Migrate

  • Updates were made to link remediation aggregates to ensure negative values are not being calculated.

 

New Features and Enhancements

Migrate

  • New messaging for paused jobs: A new informational message has been added to the Overview page for scheduled jobs that have been paused to indicate that the job will not run again until manually started due to the paused state. This helps users understand why a job is not running despite having a schedule so users can take the necessary action to resume the job or leave it paused as desired.

 


Fixes

Discover

  • The MIP classifier now works properly with the SMB Network File System and cloud connectors for Discover scans and Govern policies.

  • Updates were made to prevent an "Object reference..." error for Discover scans that use the root folder as the data source.

Migrate

  • The Network File System SMB connector was updated to fix an issue that prevented the connector from seeing users or groups during a permissions migration.

  • Batch support was added to the Dropbox for Business connector when author preservation is enabled to reduce the number of “too_many_write_operations” messages encountered.

  • The Microsoft OneDrive for Business and Microsoft Office 365 connectors were updated to correct an issue where files with more than 200 versions were listing the versions out of order.

  • The Dropbox for Business connector was updated to prevent the impersonation list from timing out when searching for a user.

  • Link remediation was updated to properly escape forward slashes when remediating links on Microsoft Office 365 tenants.

  • Updates were made to ensure the destination_exists column on the Items export populates with the correct value.

  • Updates were made to ensure distinct SIDs are assigned to disabled users across multiple jobs.

  • Item tracking was improved to prevent issues when moving a root-level item to a newly created folder.

 

New Features and Enhancements

Discover

  • New user account Discover results: A new Accounts page has been added to Discover so you can instantly view Discover scan results by account to help you identify your largest users by both file count and size. This page provides the same filter, refine, customization, saved views, and export options as the Results page, so you have all the same great functionality available to you while viewing your scan results by account. Learn more here.

  • New Discover scan settings: A new Settings step has been added to the Discover Scan Setup. This step allows you to add filters based on path, pattern, file type, and files size and offers settings to specify how much of a file gets scanned. You can even enable optical character recognition (OCR) if you want PDFs and images to be scanned for text. The settings allow you to have full control over what is included and excluded in your Discover scans. Learn more here.

  • Enhanced scan editing capabilities: Several editing capabilities have been added to allow to you update scans after you create them. This includes renaming scans and duplicating scans to use as templates, so you don’t have to create new scans from scratch. You can even edit the scan categories once the scan has been created to adjust them as needed. Learn more here.

  • PII label change for clarity: When using the PII entity type, the “Entity Type” label was renamed “Organization Name” to accurately reflect the information being displayed.

  • Filter label change for clarity: The “Date Range” filter in the left filter panel has been renamed “Item Date Filter” to clarify that the dates refer to the “created on” and “modified on” dates for the items.

  • Discover Scan Setup Review page formatting updates: Several formatting updates were made to the Discover Scan Setup Review page to improve readability. The header font for each section was increased and the items under each section now display as bulleted lists.

  • Simplified save options for new Discover scans: When saving a new scan, the save options will change based on the data source you select. Learn more here.

Migrate

  • Improved job filter logic: DryvIQ now applies the job filters to all items that have changed on subsequent job runs to improve transfer results. This means that an item that did not transfer on a previous job run will transfer on a subsequent run if a change causes the item to now meet an include filter criteria. Similarly, an item that originally transferred will be skipped if the update causes the item to now meet an exclude filter criteria.

  • Improved link remediation performance: Updates were made to improve the link remediation queries. This will result in overall faster performance of the link remediation feature.

Manage

  • New Docusign connector: DryvIQ now offers a read-only Docusign connector that can be used to scan files and templates in your Docusign account and migrate them out of your account and into your preferred content storage platform. Learn more here.

  • New separate managed Network File System connector: DryvIQ now offers two Network File System connections in Linux environments. The Network File System (SMB) connector is the native connector that uses SMB protocol to access files. It can be used for Migrate, Discover, and Govern. The new Network File System (Managed) connector is a read-only connector that uses SMBLibrary to make the connection, which performs faster than native Samba. The managed connector can be used as a source connection for Migrate jobs or for Discover scans and Govern policies where DryvIQ only needs to read content. The managed connector cannot be used as the destination connection for Migrate jobs or for Govern policies that require actions to be taken against content.


Fixes

Migrate

  • Owner preservation for disabled users on root folder creation for Microsoft Office 365 will now be preserved if the information needed to resolve the user is available through either the EnsureUser CSOM API call or the _api/web/siteusers REST API call from Microsoft.

  • External email invitations are now properly sent for Microsoft Office 365 connections.

  • A fix was made to prevent the “Object reference not set to an instance of an object" error could occur during link remediation.

Manage

  • SharePoint On-premises connections can now be created in Linux environments.

 

New Features and Enhancements

Connectors

  • New SMB Authentication option: The SMB Network File System Connector now allows you to choose between using NTLM and Kerberos Authentication when you create a new connection. Learn more here.

Discover

  • Stale Data Insights updated to display child job location: The Top 5 Stale Data Locations and Stale Data Storage Use By Location cards now display the child job path. The location now displays as “parent job name (/child job path).”


Fixes

Migrate

  • The Google Drive connector was updated to accommodate paging through file versions from the Google API to ensure all versions transfer when version preservation is enabled.

  • Updates were made to link remediation to prevent jobs from hanging when certain link patterns are present in documents.

  • The Links tab for a parent job now displays the links identified for all its child jobs.

  • The Network File System (SMB) connector was updated to correct a "The path 'xxxx' cannot be made relative to parent 'yyyy'" error that would occur when scanning items for this connector.

 

New Features and Enhancements

Migrate

  • New Jobs Grid and Jobs Export Headers: The Jobs grid was enhanced to add additional column headers to provide more options for viewing information on the page. In addition, the Jobs Export was updated to include the new fields to provide more comprehensive reporting on your jobs. The new fields include:

    • last_execution

    • next_execution

    • current_execution_duration

    • category

    • created_on

    • modified_on

    • successful_bytes

    • successful_bytes_all_versions

    • revised_bytes

    • revised_bytes_all_versions

    • revised_items

    • retry_bytes

    • retry_bytes_all_versions

    • retry_items

    • flagged_bytes

    • flagged_bytes_all_versions

    • flagged_items

    • skipped_bytes

    • skipped_bytes_all_versions

    • skipped_items

    • transfer_rate_bytes_per_second


Fixes

Migrate

  • Duplicate entries are no longer added to the audit logs when access rules are applied to items.

  • Logs now respect applied filter dates.

  • Dropbox connections can now successfully be created.

  • Duplicated jobs using Google Shared Drives as the source platform now start without error.

  • The Microsoft Office 365 connector can now access classic picture library types.

  • The Box connector was updated to correct an issue that affected creating impersonation jobs through the REST API. A job will no longer produce an error when created through the REST API with only the username field in the impersonate_as block.

  • If Microsoft responds with an “item already exists” during a batch migration job, DryvIQ now compares the latest set of item properties (modified, versions and number of bytes) to the item properties in the batch job. If the properties on the existing destination file do not match the properties in the batch job, DryvIQ will generate an error identifying the conflicting properties. In the error, original is the item property in the batch job, and latest is the item property on the destination. The item will be flagged as “Retry” and will be handled like a normal retry item.  After selecting the retry action (Retry, Ignore, etc.), the item should be resolved.  

  • The OpenText and ShareFile connectors were updated to ensure folder renames migrate when one of these connectors is used as the source connection for a migration job.

  • Updates were made to link remediation to prevent malformed links from affecting job performance or preventing jobs from finishing.

DryvIQ Platform Version: 5.9.1
Release Date: November 7, 2024