• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer
TSB Alfresco Cobrand White tagline

Technology Services Group

  • Home
  • Products
    • Alfresco Enterprise Viewer
    • OpenContent Search
    • OpenContent Case
    • OpenContent Forms
    • OpenMigrate
    • OpenContent Web Services
    • OpenCapture
    • OpenOverlay
  • Solutions
    • Alfresco Content Accelerator for Claims Management
      • Claims Demo Series
    • Alfresco Content Accelerator for Policy & Procedure Management
      • Compliance Demo Series
    • OpenContent Accounts Payable
    • OpenContent Contract Management
    • OpenContent Batch Records
    • OpenContent Government
    • OpenContent Corporate Forms
    • OpenContent Construction Management
    • OpenContent Digital Archive
    • OpenContent Human Resources
    • OpenContent Patient Records
  • Platforms
    • Alfresco Consulting
      • Alfresco Case Study – Canadian Museum of Human Rights
      • Alfresco Case Study – New York Philharmonic
      • Alfresco Case Study – New York Property Insurance Underwriting Association
      • Alfresco Case Study – American Society for Clinical Pathology
      • Alfresco Case Study – American Association of Insurance Services
      • Alfresco Case Study – United Cerebral Palsy
    • HBase
    • DynamoDB
    • OpenText & Documentum Consulting
      • Upgrades – A Well Documented Approach
      • Life Science Solutions
        • Life Sciences Project Sampling
    • Veeva Consulting
    • Ephesoft
    • Workshare
  • Case Studies
    • White Papers
    • 11 Billion Document Migration
    • Learning Zone
    • Digital Asset Collection – Canadian Museum of Human Rights
    • Digital Archive and Retrieval – ASCP
    • Digital Archives – New York Philharmonic
    • Insurance Claim Processing – New York Property Insurance
    • Policy Forms Management with Machine Learning – AAIS
    • Liferay and Alfresco Portal – United Cerebral Palsy of Greater Chicago
  • About
    • Contact Us
  • Blog

Documentum and Alfresco Large Migrations – Thoughts on a Hybrid/Rolling Approach

You are here: Home / Alfresco / Documentum and Alfresco Large Migrations – Thoughts on a Hybrid/Rolling Approach

April 15, 2014

One of the biggest challenges in rolling out new interfaces for ECM is migration from older/legacy systems.  We just started working with one financial services client that, in moving toward an Alfresco and HPI 2.1 solution, has initiated a hybrid approach to allow the interface to be introduced quickly while simplifying and reducing the risk of a large migration and big bang rollout.  This post will detail the approach for reference and discussion.

Big Bang Migration – What are the issues for a large, legacy content repository?

Upon moving to a new system, our existing client identified a number of issues that would have to be addressed including:

  • Large (10 million) amount of content and storage (multiple terabytes)
  • Majority of content is historical but difficult to predict which documents would become “active”
  • Existing systems that create content that are tied to the legacy system
  • File format of existing document (single page TIFF) that would need to be converted to PDF

The initial approach and thinking was this massive migration effort would need to be completed before the users could start using the new system.  Discussion about the sizing of the system would require a large Alfresco instance, a large migration approach leveraging delta migrations to gradually move all the content and a “big bang” with users to start using the new interface where the legacy system would be turned off with the new system turned on.

Hybrid Approach and Rolling Migration

In brainstorming about the approach, we started thinking, “how can we release the interface in a shorter time frame without the effort and risk of a large migration?”  The legacy system, similar to many old systems, is a very stable custom database with a file store.  While many efforts with migration focus on old systems that are off support or the business case is tied into reduced maintenance,  in this case, there is no need to immediately retire the legacy system.    Our approach focused on “what if we just display the old content in the new interface and allow new documents to be stored in Alfresco?”

In working through the approach, we came up with the hybrid approach and process for gradually bringing folders from the old system to the new system as presented below:

  1. User wants to access a folder
  2. If the folder doesn’t exist in Alfresco – create the folder
  3. Access the legacy system, transform old documents into PDF
  4. Store documents in Alfresco
  5. User accesses documents from Alfresco and creates new ones in Alfresco only

The process is slightly different if the folder already exists.

  1. User wants to access a folder
  2. If folder does exist, access old legacy system to determine if any new documents need to be moved
  3. If documents need to be moved, access legacy system, transform any new documents into PDF
  4. Store documents in Alfresco
  5. User accesses documents and creates new ones in Alfresco only

With the approach above, the user might notice a slight delay when they first enter the folder, with subsequent access being much quicker as only the changed content would be copied to the existing folder rather, than the whole folder.

Hybrid/Rolling Migration – Performance Options

With the rolling approach, there are a number of options to tweak performance if required:

  • Caching Folders – the business process for our client follows involves an automated process that places a document in a historical folder to kick-off activity within the folder. Our approach allows this activity to initiate the folder copy to Alfresco using the above process to avoid the user having to wait for it to be cached.
  • Multi-Threaded Image Conversion – One of the concerns, particularly with large files, was the performance of the conversion of the single page TIFF documents to multi-page PDF. We are discussing ways to kick these off in a multi-threaded approach, similar to OpenMigrate, to improve performance.
  • User Interface Background Options – We could allow the user to access the folder and gradually have the converted images appear as a background activity rather than have the user wait for all documents to be converted before the interface appears.

During our initial POC activities, we will be testing the different performance options.

Hybrid/Rolling Migration – Benefits for Final Migration

The Hybrid/Rolling Migration provides a number of benefits as we prepare for eventual retirement of the legacy image system.

  • Gradual build-up of Users – The approach allows the client to gradually release the interface to users based on types of folders. The approach does not require all users to start using the new interface immediately.
  • Gradual build-up of Alfresco size and infrastructure – The initial deployment will be a smaller Alfresco and server infrastructure that can be expanded as content and users move to the new system.
  • Gradual movement of automatic feeds – As the use of Alfresco expands, the team can gradually starting moving the automated feeds from the legacy system to directly feed Alfresco to reduce the copy efforts for new content.
  • Gradual Final Migration – Once the automatic feeds are complete and all users are using the new system, processes could be kicked off leveraging the same folder copy infrastructure to finish copying all the remaining folders. The Alfresco system does not need to be down or off-line during these copies.

Summary

A Hybrid/Rolling Migration should be an option for ECM clients to consider that want to avoid a “big-bang” migration effort.  Benefits include:

  • Quick introduction of a new and improved interface
  • Gradual migration of older content rather than a big-bang approach
  • Gradual conversion of automatic feeds from old system to new system
  • Gradual build-up of users and infrastructure for new approach while legacy system is gradually retired.

Let us know your thoughts below.

Filed Under: Alfresco, Documentum, Migrations, OpenContent Management Suite, OpenMigrate

Reader Interactions

Comments

  1. Paras says

    April 18, 2014 at 6:35 am

    Interesting article – some out of the box thinking to deliver an innovative solution in a short time frame (which is increasignly becoming the most important kpi for technology projects)

    We faced a similar situation in a project – but our challenge was that the customer wanted to completely overhaul their folder tree and security model; but bulk of their legacy content was stored in Centerra

    The quick-win for us was to

    – migrate all the legacy content to the new repository – without changing the folder tree but the security model was standardised and aligned to the new security model (to avoid duplicate administration effort)

    – if required – users could find and copy legacy content to thier new working folders

    – Centerra content did not have to be physically migrated; the new repository pointed to the legac Centerra file-store and new content was archived to a new Centerra filestore

    Reply

Trackbacks

  1. Documentum and Alfresco – Performance Thoughts for a Hybrid/Rolling Migration | TSG Blog says:
    July 14, 2014 at 11:35 am

    […] a more traditional big-bang migration approach.  See our initial thoughts on development of a rolling migration approach for the eventual retirement of a client’s old system over time.  After working through […]

    Reply
  2. Documentum or Alfresco – Insurance – extending existing data driven systems | TSG Blog says:
    July 21, 2014 at 12:24 pm

    […] policy and claim management  as well as migration approaches like our recommendation for a rolling migration.  For most clients, while they would like to update their document management capabilities, they […]

    Reply
  3. Documentum and Alfresco – Performance Thoughts for a Hybrid/Rolling Migration – Technology Services Group says:
    June 21, 2016 at 7:19 am

    […] a more traditional big-bang migration approach.  See our initial thoughts on development of a rolling migration approach for the eventual retirement of a client’s old system over time.  After working through […]

    Reply
  4. PDF Renditions – leveraging Adlib as a high volume web based service – Technology Services Group says:
    June 21, 2016 at 3:22 pm

    […] of our high volume ECM clients has a need to convert many word documents on demand as part of a rolling migration approach.  TSG is a partner with Adlib, the premier rendition services provider.  In brainstorming […]

    Reply

Leave a Reply Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Primary Sidebar

Search

Related Posts

  • Migrating to Alfresco – Reducing Risk, Stress and Cost with a Rolling Migration
  • Redaction for AWS, Alfresco, Documentum and Hadoop – Bulk Redaction upon Ingestion or Migration
  • Alfresco Consulting – Consulting in an Open Source world
  • Alfresco Consulting – Documentum Disruptor #2
  • Documentum – Top 12 Tips
  • Third Annual TSG Client Briefing – June 3rd – 2010
  • Alfresco Solutions of the Year 2017 – TSG wins Alfresco award for sixth year in a row
  • OpenContent Solr Services – New TSG Product Offering
  • Data Visualization Dashboard for ECM Migrations
  • Ephesoft Accounts Payable Solution for Alfresco, Documentum and Hadoop

Recent Posts

  • Alfresco Content Accelerator and Alfresco Enterprise Viewer – Improving User Collaboration Efficiency
  • Alfresco Content Accelerator – Document Notification Distribution Lists
  • Alfresco Webinar – Productivity Anywhere: How modern claim and policy document processing can help the new work-from-home normal succeed
  • Alfresco – Viewing Annotations on Versions
  • Alfresco Content Accelerator – Collaboration Enhancements
stacks-of-paper

11 BILLION DOCUMENT
BENCHMARK
OVERVIEW

Learn how TSG was able to leverage DynamoDB, S3, ElasticSearch & AWS to successfully migrate 11 Billion documents.

Download White Paper

Footer

Search

Contact

22 West Washington St
5th Floor
Chicago, IL 60602

inquiry@tsgrp.com

312.372.7777

Copyright © 2023 · Technology Services Group, Inc. · Log in

This website uses cookies to improve your experience. Please accept this site's cookies, but you can opt-out if you wish. Privacy Policy ACCEPT | Cookie settings
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these cookies, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may have an effect on your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
Non-necessary
Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.
SAVE & ACCEPT