• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer
TSB Alfresco Cobrand White tagline

Technology Services Group

  • Home
  • Products
    • Alfresco Enterprise Viewer
    • OpenContent Search
    • OpenContent Case
    • OpenContent Forms
    • OpenMigrate
    • OpenContent Web Services
    • OpenCapture
    • OpenOverlay
  • Solutions
    • Alfresco Content Accelerator for Claims Management
      • Claims Demo Series
    • Alfresco Content Accelerator for Policy & Procedure Management
      • Compliance Demo Series
    • OpenContent Accounts Payable
    • OpenContent Contract Management
    • OpenContent Batch Records
    • OpenContent Government
    • OpenContent Corporate Forms
    • OpenContent Construction Management
    • OpenContent Digital Archive
    • OpenContent Human Resources
    • OpenContent Patient Records
  • Platforms
    • Alfresco Consulting
      • Alfresco Case Study – Canadian Museum of Human Rights
      • Alfresco Case Study – New York Philharmonic
      • Alfresco Case Study – New York Property Insurance Underwriting Association
      • Alfresco Case Study – American Society for Clinical Pathology
      • Alfresco Case Study – American Association of Insurance Services
      • Alfresco Case Study – United Cerebral Palsy
    • HBase
    • DynamoDB
    • OpenText & Documentum Consulting
      • Upgrades – A Well Documented Approach
      • Life Science Solutions
        • Life Sciences Project Sampling
    • Veeva Consulting
    • Ephesoft
    • Workshare
  • Case Studies
    • White Papers
    • 11 Billion Document Migration
    • Learning Zone
    • Digital Asset Collection – Canadian Museum of Human Rights
    • Digital Archive and Retrieval – ASCP
    • Digital Archives – New York Philharmonic
    • Insurance Claim Processing – New York Property Insurance
    • Policy Forms Management with Machine Learning – AAIS
    • Liferay and Alfresco Portal – United Cerebral Palsy of Greater Chicago
  • About
    • Contact Us
  • Blog

Documentum and Alfresco – Performance Thoughts for a Hybrid/Rolling Migration

We recently discussed the concept of a rolling migration versus a more traditional big-bang migration approach. See our initial thoughts on development of a rolling migration approach for the eventual retirement of a client’s old system over time. After working through some of the challenges, we now have a system that can quickly move content into the new repository on demand. This post will discuss our results.

You are here: Home / Alfresco / Documentum and Alfresco – Performance Thoughts for a Hybrid/Rolling Migration

July 14, 2014

We recently discussed the concept of a rolling migration versus a more traditional big-bang migration approach.  See our initial thoughts on development of a rolling migration approach for the eventual retirement of a client’s old system over time.  After working through some of the challenges, we now have a system that can quickly move content into the new repository on demand.  This post will discuss our results.

What is a rolling migration?

Our current client is an insurance client that developed a custom system for storage of claim related documents.  Like many old custom systems, the client’s current system consists of a database containing all of the document metadata with database pointers specifying the location of the content, which is located on an FTP server. Considering the large quantity of documents and large storage needs, the client opted for a “rolling migration” approach. The rolling migration moves content over to the new repository only once it becomes “active” – essentially when the user needs to view it.   For this client, the user is leveraging Alfresco with TSG HPI interface for their interface.

Rolling Migration

 

The next time the content needs to be accessed, the system logic checks if the content has already been moved to the new repository and, if so, redirects the user directly to HPI.  Benefits of this approach include:

  • Gradual build-up of content, avoiding the complications of a “big bang” migration.
  • Gradual build-up of users.
  • Gradual movement of automatic feeds from the old system to the new system.
  • Gradual build-up of repository size and infrastructure.

All of this benefit comes in an intermediary web layer that sits between the client’s source system and HPI/OpenContent. This web layer contains the functions to pull the documents into the new repository and set the corresponding metadata, along with a simple UI that displays the progress of the migration. Once the migration is complete, the user is routed into HPI inside the claim folder that was just migrated as depicted above. Until the old system is completely retired, the service will always check for new updates to the old system and migrate new documents as required to Alfresco.  The concept of separating this logic into a separate web layer is very beneficial.  Once the client is ready to retire the old system, the web service layer can be removed and bring the users directly into HPI.

Rolling “On-Demand” Migration Performance?

The new web layer employs multi-threading techniques in order to speed up migration times, as well as a simple UI to show the user the progress of the migration. As shown in the table below, the time for the first visit to the claim folder is greatly sped up by utilizing mutli-threading. The time shown is for a claim folder with 12 documents. The second visit to the claim folder, when the web layer checks if any new content needs to be migrated, is brought down to 2.5 seconds, most of which is a programmed delay to provide the user with feedback as to what the web layer is doing.

Single-Threaded/ Multi-Threaded Time for first visit (seconds) Time for second visit (seconds)
Single-Threaded 31.39 N/A
Multi-Threaded 6.86 2.49

In addition to multi-threading, the web layer also converts several image types (TIFF, JPEG, PNG, BMP, GIF) to PDF. This conversion adds a small amount of time to  migration (this can be removed based on the migration requirements), but gives the benefit of allowing the documents to be easily viewed in HPI and also be annotated using TSG’s OpenAnnotate tool.

Summary

With the implementation of the new rolling migration web layer that takes advantage of multi-threading, we see the benefits of a smaller rollout with great performance increases.

Please let us know your thoughts in the comments below.

Filed Under: Alfresco, Documentum, Migrations

Reader Interactions

You must log in to post a comment.

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Primary Sidebar

Search

Related Posts

  • ECM 2.0 – One-Step vs. Two-Step Migrations
  • Federated Content Management – Enterprise Search with a new moniker?
  • Migrating to Alfresco – Reducing Risk, Stress and Cost with a Rolling Migration
  • Redaction for AWS, Alfresco, Documentum and Hadoop – Bulk Redaction upon Ingestion or Migration
  • Data Visualization Dashboard for ECM Migrations
  • ECM Roadmap – Thoughts on Planning for the Future
  • Documentum or Alfresco Migration Tools – What about Speed?
  • Documentum Migration to Alfresco – Best Practices – Recording Available
  • Documentum Migration to Alfresco – Best Practices – Webinar February 26th
  • Enterprise Document Search – A Publishing rather than Crawler/Federated Approach

Recent Posts

  • Alfresco Content Accelerator and Alfresco Enterprise Viewer – Improving User Collaboration Efficiency
  • Alfresco Content Accelerator – Document Notification Distribution Lists
  • Alfresco Webinar – Productivity Anywhere: How modern claim and policy document processing can help the new work-from-home normal succeed
  • Alfresco – Viewing Annotations on Versions
  • Alfresco Content Accelerator – Collaboration Enhancements
stacks-of-paper

11 BILLION DOCUMENT
BENCHMARK
OVERVIEW

Learn how TSG was able to leverage DynamoDB, S3, ElasticSearch & AWS to successfully migrate 11 Billion documents.

Download White Paper

Footer

Search

Contact

22 West Washington St
5th Floor
Chicago, IL 60602

inquiry@tsgrp.com

312.372.7777

Copyright © 2023 · Technology Services Group, Inc. · Log in

This website uses cookies to improve your experience. Please accept this site's cookies, but you can opt-out if you wish. Privacy Policy ACCEPT | Cookie settings
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these cookies, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may have an effect on your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
Non-necessary
Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.
SAVE & ACCEPT