...
On This Page
Table of Contents |
---|
Overview
Batch mode is an optimized way to upload high volume of data using special API provided by few of the platforms. Currently Dropbox, Dropbox For Business, Office 365 and OneDrive For Business have support for this feature. When running in batch mode, instead of committing one file at a time, files are committed in batches optimized for each platform.
Note |
---|
To leverage the Bulk (Batch) Migration API, transfer accounts must be an Site Collection Administrator. Non-Administrator transfer accounts will default to use CSOM, even when batch mode is requested with the job. |
Configure Your Job
Batch mode policy can be changed or disabled by setting transfer.batch_mode to:
...
Code Block |
---|
{ "name":"Simple Transfer Job with no batch mode", "kind": "transfer", "transfer": { "batch_mode": "none", "transfer_type": "copy", "source": { "connection": { "id": "{{nfs_connection}}" } }, "destination": { "connection": { "id": "{{cloud_connection}}" }, "target": { "path": "/MyDestination1" } } }, "schedule": { "mode": "manual" } } |
Enable Batch Manifests
Batch Manifests are configured in your appSettings.json file.
...
Code Block |
---|
{ "data": { "provider": "sqlserver", "connection": "SERVER=localhost;DATABASE=SkySyncV4;Integrated Security=SSPI;", "directory": "C:\\ProgramData\\SkySync\\v4" }, "server": { "proxy_url": "http://192.168.1.76:9090/" }, "deployment": { "packageDirectory": "C:\\ProgramData" }, "office365-oauth2": { "batch_save_manifests": true }, "onedrive-business-oauth2": { "batch_save_manifests": true }, "license": { "activation_key": "ab4e994a-342f-0000-0000-b5da2577579b" } } } |
Configure Batch Size
Batch Size is configured in your appSettings.json file.
...
Code Block |
---|
{ "data": { "provider": "sqlserver", "connection": "SERVER=localhost;DATABASE=SkySyncV4;Integrated Security=SSPI;", "directory": "C:\\ProgramData\\SkySync\\v4" }, "server": { "proxy_url": "http://192.168.1.76:9090/" }, "deployment": { "packageDirectory": "C:\\ProgramData" }, "office365": { "batch_save_manifests": true, "batch_item_limit": "5" }, "onedrive-business": { "batch_save_manifests": true, "batch_item_limit": "5" }, "license": { "activation_key": "ab4e994a-342f-0000-0000-b5da2577579b" } } } |
...
Setting Through the Scripting Page in the UI
Add the following to the JSON block on the Scripting page in Create the Job Advanced Features when creating the job.
Code Block |
---|
{ "transfer": { "batch_mode": "none" } } |
...