• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer
TSB Alfresco Cobrand White tagline

Technology Services Group

  • Home
  • Products
    • Alfresco Enterprise Viewer
    • OpenContent Search
    • OpenContent Case
    • OpenContent Forms
    • OpenMigrate
    • OpenContent Web Services
    • OpenCapture
    • OpenOverlay
  • Solutions
    • Alfresco Content Accelerator for Claims Management
      • Claims Demo Series
    • Alfresco Content Accelerator for Policy & Procedure Management
      • Compliance Demo Series
    • OpenContent Accounts Payable
    • OpenContent Contract Management
    • OpenContent Batch Records
    • OpenContent Government
    • OpenContent Corporate Forms
    • OpenContent Construction Management
    • OpenContent Digital Archive
    • OpenContent Human Resources
    • OpenContent Patient Records
  • Platforms
    • Alfresco Consulting
      • Alfresco Case Study – Canadian Museum of Human Rights
      • Alfresco Case Study – New York Philharmonic
      • Alfresco Case Study – New York Property Insurance Underwriting Association
      • Alfresco Case Study – American Society for Clinical Pathology
      • Alfresco Case Study – American Association of Insurance Services
      • Alfresco Case Study – United Cerebral Palsy
    • HBase
    • DynamoDB
    • OpenText & Documentum Consulting
      • Upgrades – A Well Documented Approach
      • Life Science Solutions
        • Life Sciences Project Sampling
    • Veeva Consulting
    • Ephesoft
    • Workshare
  • Case Studies
    • White Papers
    • 11 Billion Document Migration
    • Learning Zone
    • Digital Asset Collection – Canadian Museum of Human Rights
    • Digital Archive and Retrieval – ASCP
    • Digital Archives – New York Philharmonic
    • Insurance Claim Processing – New York Property Insurance
    • Policy Forms Management with Machine Learning – AAIS
    • Liferay and Alfresco Portal – United Cerebral Palsy of Greater Chicago
  • About
    • Contact Us
  • Blog

Documentum or Alfresco Migration Tools – What about Speed?

You are here: Home / Alfresco / Documentum or Alfresco Migration Tools – What about Speed?

April 27, 2015

Back in 2013, Documentum announced the Enterprise Migration Appliance while pushing to get clients to upgrade to 7.x.   Renamed the Documentum Enterprise Migration Appliance (DEMA), one of the selling points of the DEMA is a focus on speed.  Architected for the “fastest migration possible”, DEMA was constructed to avoid the Documentum API and go directly to the underlying database.  This post will discuss the impact of speed and compare approaches of different migration tools. 

Migration Speed  – Why does it matter?

The logic for a fast migration typically follows the approach of:

  • I have to migrate 1,000,000 documents.
  • I would like to complete the migration as fast as possible
  • If tool A takes 1 second per document and tool B takes .5 seconds per document in my test environment, tool B will be twice as fast. (277 hours versus 138 hours).

While the scenario above makes sense, it misses a couple of key factors:

  • Test Environment – rarely is a test environment set up the same way as a production environment.
  • Multi-Threading – Migrations do not have to be single threaded. For the majority of tools, the ability to run multiple threads will reduce the migration time proportionally by the number of threads depending on system resources.
  • System Downtime – the above scenario assumes that the migration will be run sequentially and the system will be down for the entire time the migration is taking place.

The focus on speed should really be a focus on reducing the system downtime.   The remainder of this post will talk about multi-threading to improve the speed of migration as well as a Delta Migration approach to reduce downtime.

Multi-Threading to speed migration

Multi-threading allows the migration program to run multiple instances of itself and take advantage of parallel processing to reduce the time and throughput of the migration.  In the example above, if I run 10 instances of the migration tools, time will reduce by a factor of 10.  (in our example, if Tool A can be multi-threaded and Tool B cannot, the 277 hours would be reduced to 27.7 hours  for Tool A versus 138 for tool B.  Some key points to keep in mind when considering multi-threading:

  • Eventually system resources will reduce the efficiency of multi-threading. Ex (100 threads are not 10 times better than 10 threads – sometimes it is worse).  Typically in our Documentum or Alfresco migrations, we see the target (or write) repository as the limiting factor.  Clients will work to tune the number of threads to not overload the write repository.
  • Thread communication – to be truly multi-threaded, the migration tool has to make sure that activities are divided up correctly by each thread to avoid conflicts.

Delta Migration to reduce system downtime

We have discussed Delta migrations before but continue to recommend that clients consider a delta migration versus a big bang approach.  With a Delta migration, as much content as possible is migrated while the old system is still up.  On cut-over weekend, the delta (or new) documents are migrated over before the new system is turned on.  A typical example:

  • I need to migrate 1,000,000 documents.
  • The migration program begins migrating documents created before X/X/X to the new environment while the old environment is still active.
  • On cut-over weekend, the migration program moves every document created or modified after X/X/X to the new repository.

As we mentioned back in 2013, the Documentum Enterprise Migration Appliance works on the database level and, at the date of this posting, cannot execute a delta migration.  To migrate 1,000,000 documents, DEMA requires the system to be down the entire time the migration is occurring and has limited ability to test the migration during the migration activities.  With a Delta approach, the system only needs to be down while the last “delta” content is being moved.

A Delta approach has several big advantages over the traditional Big Bang approach surrounding risk.

  • Majority of documents can be moved while existing repository is still active to reduce downtime window.
  • Migration to new environment can be proven while testing a large volume of documents.

Summary – Speed of Tool not as important as reducing system downtime.

While speed of the migration tool is important, the ability to add threads and execute delta migrations have the greatest impact on reducing system downtime.  Clients should avoid stopping at the vendor claims that their tool is the “fastest” and further consider the overall migration process.

For additional information on migration, see our recent OpenMigrate webinar recording with Alfresco (or watch below) that demonstrates Big Bang, Delta, Gradual and Rolling Migrations.

Filed Under: Alfresco, Documentum, Migrations, News, OpenMigrate

Reader Interactions

Leave a Reply Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Primary Sidebar

Search

Related Posts

  • Documentum Migration – "Two-Step" Bulk Load versus a "One-Step" Migration Approach
  • Alfresco Consulting – Documentum Disruptor #2
  • Documentum – Top 12 Tips
  • Migrating to Alfresco – Reducing Risk, Stress and Cost with a Rolling Migration
  • Redaction for AWS, Alfresco, Documentum and Hadoop – Bulk Redaction upon Ingestion or Migration
  • Alfresco Solutions of the Year 2017 – TSG wins Alfresco award for sixth year in a row
  • Data Visualization Dashboard for ECM Migrations
  • Documentum Migration to Alfresco – Best Practices – Recording Available
  • Documentum Migration to Alfresco – Best Practices – Webinar February 26th
  • Enterprise Document Search – A Publishing rather than Crawler/Federated Approach

Recent Posts

  • Alfresco Content Accelerator and Alfresco Enterprise Viewer – Improving User Collaboration Efficiency
  • Alfresco Content Accelerator – Document Notification Distribution Lists
  • Alfresco Webinar – Productivity Anywhere: How modern claim and policy document processing can help the new work-from-home normal succeed
  • Alfresco – Viewing Annotations on Versions
  • Alfresco Content Accelerator – Collaboration Enhancements
stacks-of-paper

11 BILLION DOCUMENT
BENCHMARK
OVERVIEW

Learn how TSG was able to leverage DynamoDB, S3, ElasticSearch & AWS to successfully migrate 11 Billion documents.

Download White Paper

Footer

Search

Contact

22 West Washington St
5th Floor
Chicago, IL 60602

inquiry@tsgrp.com

312.372.7777

Copyright © 2023 · Technology Services Group, Inc. · Log in

This website uses cookies to improve your experience. Please accept this site's cookies, but you can opt-out if you wish. Privacy Policy ACCEPT | Cookie settings
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these cookies, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may have an effect on your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
Non-necessary
Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.
SAVE & ACCEPT