• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer
TSB Alfresco Cobrand White tagline

Technology Services Group

  • Home
  • Products
    • Alfresco Enterprise Viewer
    • OpenContent Search
    • OpenContent Case
    • OpenContent Forms
    • OpenMigrate
    • OpenContent Web Services
    • OpenCapture
    • OpenOverlay
  • Solutions
    • Alfresco Content Accelerator for Claims Management
      • Claims Demo Series
    • Alfresco Content Accelerator for Policy & Procedure Management
      • Compliance Demo Series
    • OpenContent Accounts Payable
    • OpenContent Contract Management
    • OpenContent Batch Records
    • OpenContent Government
    • OpenContent Corporate Forms
    • OpenContent Construction Management
    • OpenContent Digital Archive
    • OpenContent Human Resources
    • OpenContent Patient Records
  • Platforms
    • Alfresco Consulting
      • Alfresco Case Study – Canadian Museum of Human Rights
      • Alfresco Case Study – New York Philharmonic
      • Alfresco Case Study – New York Property Insurance Underwriting Association
      • Alfresco Case Study – American Society for Clinical Pathology
      • Alfresco Case Study – American Association of Insurance Services
      • Alfresco Case Study – United Cerebral Palsy
    • HBase
    • DynamoDB
    • OpenText & Documentum Consulting
      • Upgrades – A Well Documented Approach
      • Life Science Solutions
        • Life Sciences Project Sampling
    • Veeva Consulting
    • Ephesoft
    • Workshare
  • Case Studies
    • White Papers
    • 11 Billion Document Migration
    • Learning Zone
    • Digital Asset Collection – Canadian Museum of Human Rights
    • Digital Archive and Retrieval – ASCP
    • Digital Archives – New York Philharmonic
    • Insurance Claim Processing – New York Property Insurance
    • Policy Forms Management with Machine Learning – AAIS
    • Liferay and Alfresco Portal – United Cerebral Palsy of Greater Chicago
  • About
    • Contact Us
  • Blog

ECM 2.0 – Cloud for Metadata and On Premise Document/Object Storage

You are here: Home / Alfresco / ECM 2.0 – Cloud for Metadata and On Premise Document/Object Storage

October 28, 2019

We have recently had some interesting discussions with clients in regards to storage of documents and objects on premise with cloud options for the meta-data.  One of the advantages of the TSG solutions is that we can support a variety of alternatives for both on premise as well as cloud based document and object storage.  This post will discuss the various alternatives.

Cloud Based Document and Object Storage – What are the concerns?

When it comes to storing documents and other objects in the cloud, typically clients can have the following concerns:

  • Performance – depending on cloud connectivity and use case, on premise solutions that are located closer to the user will typically perform faster than options in the cloud.
  • Ownership – given a focus on privacy, many clients are concerned about allowing certain content to be stored in the cloud.
  • Cost – given the new options and pricing of on premise large storage options, it is not always a cost-effective solution to put all content into the cloud, particularly content that will be accessed often as most cloud vendors have a low initial storage cost but charge monthly for storage and for each retrieval of your own content
  • Migration – for large repository customers, there will be a need to move large amounts of content to the cloud either leveraging bandwidth or with some bulk solution like Amazon Snowball.  This process can be expensive and time consuming.

While TSG will work with clients to reduce the concerns and costs, we have seen a comeback of sorts from the on-premise object storage vendors with pricing and hyper-convergent options that don’t always make the cloud the cheaper option.  We are also seeing clients considering cloud options on premise.  See solutions like AWS Storage Gateway or AWS Outpost  that look to take advantage of cloud capabilities on premise.

Cloud for Meta-Data storage – what are the options

As we have mentioned before in regards to ECM 2.0, typical legacy ECM repositories rely on a relational database for storing metadata, relationships, security and other data components surrounding document storage.  For modern approaches, NoSQL options are available like TSG’s efforts with HBase/Hadoop and DynamoDB.  The ability to store the database component of the system in the cloud provides for a number of different hosted options that take advantage of the ease of management and scaling of the cloud without the process to move and pay for all the content to be stored in the cloud.

For legacy relational database approaches, we would recommend clients consider the following options:

  • Amazon Web Services – Amazon provides a Relational Database Service (RDS) for running multiple types of databases in a managed service environment. Both open source ( PostgreSQL, MySQL, MariaDB) as well as Oracle and SQLServer are available. AWS also has two flavors of Aurora (MySQL and PostgreSQL). Moving to a different database vendor is also easier with AWS’ Database Migration Service.
  • Microsoft Azure – Microsoft provides their Azure SQL Server options for a managed MS SQL instance on Azure. They also offer PaaS databases for MySQL and PostgreSQL.
  • Google Cloud – GCP offers a fully managed SQL instance on MySQL, PostgreSQL and MS SQL.

For modern NoSQL approaches, we would recommend clients consider the following options.

  • Amazon Web Services – TSG recommends DynamoDB.  See our results from our 11 billion document benchmark.
  • Microsoft Azure – TSG has had success with our clients leveraging Azure’s HDInsights platform to quickly spin up an HBase environment to store the metadata for TSG’s ECM running on top of a managed HBase instance.
  • Google Cloud – TSG is current conducting a benchmark coordinated with Michigan State to test Google’s BigTable NoSQL database with TSG’s ECM on NoSQL database offering. Our initial experience is that it is consistent with AWS’s DynamoDB and Azure’s HDInsights promise of a simple, scaleable NoSQL database.

For either a relational DB, or a NoSQL DB that is being moved to the cloud, since all of the solutions just store a pointer to the actual content file, the migration path of moving the DB is typically just a shift of the database to the new database system. Since the APIs abstract the access of the files, regardless of where the content is stored, users will be able to get access to the content leveraging the same access patterns that they are used to, and with the same responsiveness as they are used to since the content is still located on-premise.

Summary

Those considering leveraging the cloud for their ECM 2.0 solution don’t necessarily have to migrate all components to the cloud if they are more comfortable and have cost-effective and high performance on-premise options.  By leveraging solutions that can support both cloud and on-premise storage, ECM 2.0 clients can choose either storage options (or both) to best support their use case.

Let us know your thoughts below.

Filed Under: Alfresco, Amazon, Google Cloud, Microsoft Azure

Reader Interactions

Trackbacks

  1. Azure Stack for ECM – On Premise with Cloud Infrastructure and Object Store — Technology Services Group says:
    February 3, 2020 at 3:33 pm

    […] in the past, by taking advantage of TSG’s OpenContent Management Suite on top of HBase, users have the flexibility to leverage some or all of the capabilities of the cloud along-side with …. For clients that are looking to augment their existing data center with the capabilities of the […]

    Reply

Leave a Reply Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Primary Sidebar

Search

Related Posts

  • Redaction for AWS, Alfresco, Documentum and Hadoop – Bulk Redaction upon Ingestion or Migration
  • Redacting Roadmap – User Scenarios
  • Alfresco Solutions of the Year 2017 – TSG wins Alfresco award for sixth year in a row
  • ECM Roadmap – Thoughts on Planning for the Future
  • Claims Documentation – Modernizing Insurance Platforms
  • Amazon S3 – Viewing content fast and securely in-browser with the Alfresco Enterprise Viewer
  • FileNet AWS Cloud Native? Thoughts on recent announcement
  • ECM 2.0 – Vision & Review of 2019
  • ECM 2.0 – Can you build it yourself?
  • AWS & Alfresco – AAIS Case Study – Insurance Policy Management and Machine Learning

Recent Posts

  • Alfresco Content Accelerator and Alfresco Enterprise Viewer – Improving User Collaboration Efficiency
  • Alfresco Content Accelerator – Document Notification Distribution Lists
  • Alfresco Webinar – Productivity Anywhere: How modern claim and policy document processing can help the new work-from-home normal succeed
  • Alfresco – Viewing Annotations on Versions
  • Alfresco Content Accelerator – Collaboration Enhancements
stacks-of-paper

11 BILLION DOCUMENT
BENCHMARK
OVERVIEW

Learn how TSG was able to leverage DynamoDB, S3, ElasticSearch & AWS to successfully migrate 11 Billion documents.

Download White Paper

Footer

Search

Contact

22 West Washington St
5th Floor
Chicago, IL 60602

inquiry@tsgrp.com

312.372.7777

Copyright © 2023 · Technology Services Group, Inc. · Log in

This website uses cookies to improve your experience. Please accept this site's cookies, but you can opt-out if you wish. Privacy Policy ACCEPT | Cookie settings
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these cookies, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may have an effect on your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
Non-necessary
Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.
SAVE & ACCEPT