TSG continues to have success with Hadoop/HBase and DynamoDB as alternatives to legacy ECM platforms that rely on relational databases. As more clients adopt modern NoSQL platforms for ECM, we are seeing additional and interesting benefits from NoSQL/Key-Value database. This post will highlight the 'key' design in these Key-Value databases to allow for massively scalable content management on HBase and DynamoDB for billions of documents and millisecond retrieval times. ... [Continue Reading]
DynamoDB Benchmark – Building an 11 Billion Document DR Process
In June, 2019, Technology Services Group completed an unprecedented 11 billion document benchmark leveraging Amazon Web Services and specifically DynamoDB and Elasticsearch. As with any of our enterprise class solutions, we didn't view the benchmark as complete without a disaster recovery process in place. This post will share our architecture approach and lessons learned from implementing DR for the benchmark. ... [Continue Reading]
The Deep Analysis Podcast – The 11 Billion File Benchmark
Dave Giordano, CEO of TSG, recently sat down with Alan Pelz-Sharpe to discuss our recent 11 Billion File Benchmark on AWS and DynamoDB. Additionally, hear Dave's thoughts on the future of ECM and why companies are considering alternatives to the traditional ECM Suite. ... [Continue Reading]
DynamoDB 11 Billion Document Benchmark – Summary of Postings
TSG initiated our 11 Billion Document DynamoDB benchmark on Friday, May 10th 2019 and ended all of our testing activities on June 20th 2019. The benchmark was an unbelievable success with our team learning many lessons in regards to scaling AWS, DynamoDB, Elasticsearch and our OpenContent and OpenMigrate products. This post will present a summary of the benchmark activities and lessons learned. ... [Continue Reading]
DynamoDB 11 Billion Benchmark 11 Thousand Concurrent Users Success!!! – Lessons Learned
TSG initiated our 11 Billion benchmark on Friday, May 10th. As of today we have completed the fourth and final phase, testing our repository with 11,000 concurrent users. This post will share the results. ... [Continue Reading]
DynamoDB 11 Billion Benchmark Add Documents Success!!! – Lessons Learned
TSG initiated our 11 Billion benchmark on Friday, May 10th. The first phase of the benchmark was aimed at building a large repository with our OpenMigrate ingestion tool and proving access for OpenContent Search, OpenContent Case and OpenAnnotate. The initial ingestion phase concluded on May 17th with 11 Billion documents and ingestion speeds of 20,000 documents per second to DynamoDB and related folders indexed into Elasticsearch. We took some time to decompress and started ... [Continue Reading]
Amazon Textract – Improving Document Indexing with OpenContent Management Suite
Recently we've been updating our products to leverage Amazon Textract, officially released on May 29th, for it's text extraction capabilities and how it can be used to create full text PDFs. For this post, we're going to look into how we can use the indexing modules within the OpenContent Management Suite (OCMS) to improve document indexing and also explore some possible future improvements that Textract an other tools could enable. Indexing Scenario The scenario we've been using for our ... [Continue Reading]
Amazon Textract for Full Text Search
TSG had added Amazon Textract to our ECM offerings for Alfresco, Documentum, Hadoop and DynamoDB as well as our search offerings with Solr and Elastic Search. Previously, we looked at Textract's text extraction capabilities. For this post, we will discuss and demonstrate how Amazon Textract can be leveraged as a modern OCR indexing engine for image conversion to support full-text search efforts for both on-premise and cloud-based solutions. ... [Continue Reading]
DynamoDB 11 Billion Benchmark Ingestion Success!!! – Lessons Learned
TSG started an 11 Billion Document Benchmark with DynamoDB last Friday to test and verify the power of Amazon Web Services as well as the TSG ECM products on an unprecedented scale. As of this morning, we are pleased to announce we have fully ingested our goal of 11 billion documents!!! This post will share some of the lessons learned this week. ... [Continue Reading]
DynamoDB 11 Billion Benchmark – AWS Walk-through
TSG started an 11 Billion Document Benchmark with DynamoDB last Friday to test and verify the power of Amazon Web Services as well as the TSG ECM products on an unprecedented scale. As of this morning we have migrated approximately 10.5 billion documents. This post will present some underlying detail of DynamoDB repository with a particular focus on document and folder objects. Our post Monday detailed the reasons and expectations for the 11 billion document benchmark, our post ... [Continue Reading]
DynamoDB 11 Billion Benchmark – Document and Folder Details
TSG started an 11 Billion Document Benchmark with DynamoDB last Friday to test and verify the power of Amazon Web Services as well as the TSG ECM products on an unprecedented scale. As of this morning we have migrated approximately 9 billion documents. This post will present some underlying detail of DynamoDB repository with a particular focus on document and folder objects. Our post Monday detailed the reasons and expectations for the 11 billion document benchmark with a post Tuesday ... [Continue Reading]
DynamoDB 11 Billion Benchmark – Repository Walk-through
TSG started a 11 Billion Document Benchmark with DynamoDB last Friday to test and verify the power of Amazon Web Services as well as the TSG ECM products on an unprecedented scale. As of this morning we have migrated approximately 7 billion documents. This post will dive into the repository itself and show the functionality we have been able to maintain at massive scale. ... [Continue Reading]
DynamoDB – Amazon Web Services 11 Billion Document Benchmark
TSG started a 11 Billion Document Benchmark with DynamoDB last Friday to test and verify the power of Amazon Web Services as well as the TSG ECM products on an unprecedented scale. As of this morning we have migrated approximately 6.3 billion documents averaging 20,000 ingested per second, well over halfway to our goal of 11 Billion. This post will discuss the goals and approach of the benchmark. ... [Continue Reading]
Managing Security Videos – What are the issues?
TSG is seeing clients with more and more video management needs, particularly around video surveillance. Clients have to manage a variety of different vendor solutions and formats. Sharing and viewing long and large video files can be a redundant and an inefficient process. TSG worked with the Michigan State Capstone experience to build a prototype that would allow customers to efficiently capture and share video from multiple cameras. ... [Continue Reading]
FileNet to AWS – An 80 Million Document Case Study
As part of TSG’s ongoing efforts to assist clients move from legacy ECM systems like FileNet to modern cloud alternatives, TSG has recently published a case study highlighting how one FileNet customer was able to successfully move to Amazon Web Services. ... [Continue Reading]
FileNet Migration to Amazon Web Services – Why now more than ever?
TSG is currently finalizing a case study on a client that has successfully moved from an legacy on-premise FileNet system to Amazon Web Services. In preparation for that piece coming out in the next two weeks, we thought we would write some of our thoughts on why so many clients, after years of delaying migration efforts, are finally moving off of FileNet to Amazon Web Services. ... [Continue Reading]
Amazon Textract and OpenText Capture Recognition Engine (RecoStar) Comparison
Editor's Note (5/31/219): This article was original posted on 2/12/19 when Amazon Textract was currently in a pre-release phase. All results have been completed using a non-production version of the service. Now that Textract has been formally released, look for results to be updated shortly. As part of our R&D effort into Amazon Textract with Alfresco, TSG conducted some initial research on the quality of the OCR results of Textract on a sample set of images from a real-world TSG ... [Continue Reading]
A Big Data Approach to ECM – White Paper from Deep Analysis
TSG recently participated in a research effort with Deep Analysis. The fundamental undertaking was to understand what alternatives innovative customers are considering when it comes to moving from Legacy ECM 1.0 to modern ECM 2.0 capabilities on premise or in the cloud. Alan Pelz-Sharpe and the analysts of Deep Analysis conducted a deep dive into Big Data and particularly NoSQL databases, Hadoop and DynamoDB. ... [Continue Reading]
ECM 2.0 – What does it mean?
Great whitepaper available at Deep Analysis from long-time ECM analyst Alan Pelz-Sharpe entitled “Intelligent Information Management – From ECM 1.0 to 2.0”. This post will highlight the relevant points and add our thoughts. ECM 2.0 – What are the opportunities? We would agree with Alan that, while repository centric ECM 1.0 systems dominate the market, 2.0 opportunities exist to offer more insight, automation and decentralization. Combined with new technology from cloud ... [Continue Reading]
DynamoDB – ECM / Content Process Services Roadmap
One of the key TSG efforts for the end of 2018 is extending Amazon’s DynamoDB to include document management capabilities with connectivity to the all of the TSG products including the OpenContent Search, OpenContent Case, OpenAnnotate and OpenMigrate. This post will present our plans and roadmaps along with key dates. ... [Continue Reading]
DynamoDB – Database model for Document Management
One of the ongoing myths about DynamoDB for Document Management we hear too often is “but isn’t that just for big data?” This post will try to explain the benefits of DynamoDB’s big data capabilities and data model in a Document Management context compared to traditional database systems. Examples will include how we are currently building our own DynamoDB offering scheduled to be released at the end of 2018. ... [Continue Reading]
DynamoDB and Hadoop / HBase – What are some of the differences?
As an Amazon Web Services Partner, TSG has begun developing out our document management solution for DynamoDB, we have been surprised with some of the implementation differences between DynamoDB and Hadoop / HBase. This post will dive into the differences in building we have encountered some examples while building out our ECM/Content Process Services solution. ... [Continue Reading]
Gartner Content Service Platforms (CPS) Magic Quadrant 2018 – What’s Missing?
Back in 2015, we posted the question of whether the magic quadrant was really magic anymore. In the following years, Gartner has evolved the rating with a complete change of the evaluation in 2016 as well as the big news in 2017 when IBM/FileNet being dropped from the leader quadrant after being the default leader for 10+ years. In the recent 2018 Gartner Magic Quadrant (download from Alfresco here), Gartner has made more changes along with IBM being back in the leader quadrant. This post ... [Continue Reading]
Amazon DynamoDB – Can it do ECM?
In discussing our next steps as part of our Amazon Web Services practice, one exciting item TSG is pursuing this quarter will be focused on Amazon DynamoDB and adding Enterprise Content Management capabilities. This post will begin a series of posts on our design and development activities to provide an OpenContent connection to Amazon DynamoDB. ... [Continue Reading]
Redaction for AWS, Alfresco, Documentum and Hadoop – Bulk Redaction upon Ingestion or Migration
As we presented in our Redaction Roadmap earlier this year, one of our product development additions to OpenMigrate this quarter is the ability to bulk redact incoming documents as part of an ingestion or migration into Alfresco, Documentum, AWS, or Hadoop. As detailed earlier in our Redacting Roadmap, both OpenMigrate and the OpenContent Management Suite will have capabilities surrounding the redaction of specific values. This post will focus on demonstrating how OpenMigrate can be used to ... [Continue Reading]
