We have recently had some interesting discussions with clients in regards to storage of documents and objects on premise with cloud options for the meta-data. One of the advantages of the TSG solutions is that we can support a variety of alternatives for both on premise as well as cloud based document and object storage. This post will discuss the various alternatives. ... [Continue Reading]
ECM 2.0 – Can you build it yourself?
Recently Gartner Analyst and long-time ECM evangelist Marko Sillapaa posted an interesting article titled “Why Build a Content Services Platform from Scratch?” . In the article Marko correctly points out that "build your own" isn’t easy and it's better to avoid home grown solutions where support could be required for 20 years. An alternative viewpoint comes from another long-time ECM evangelist Jeff Pots, “ECM, You Ain’t Gonna Need it” where Jeff points out how his firm has built light-weight ... [Continue Reading]
AWS & Alfresco – AAIS Case Study – Insurance Policy Management and Machine Learning
TSG, Alfresco, and AAIS have partnered to provide a best in class content management and tailored advisory solution ensuring the success of each of its members and customers. Watch our recent case study to see how the flexibility of a cloud native content management solution running on Amazon Web Services with OpenContent Management Suite and powered by Kira's machine learning technology has enabled AAIS to redefine their entire form management process. https://youtu.be/eOoFZOsSf_I The ... [Continue Reading]
DynamoDB – 11 Billion Document Benchmark White Paper
In May of 2019, Technology Services Group initiated an 11 Billion Document DynamoDB benchmark, which was completed in June 2019. With the success of the benchmark, TSG was able to successfully demonstrate that AWS, DynamoDB, Elasticsearch and our OpenContent, OpenAnnotate and OpenMigrate products could scale to an unprecedented level and represented the next evolution of enterprise content management, a Big-Data, NoSQL approach for the multi-billion object repository. This white paper will ... [Continue Reading]
ECM Large Repositories – Volume Testing With the TSG Test Harness
One of the more interesting achievements of the TSG 11 Billion Document benchmark was our ability to quickly load a large repository and test performance for search and retrieval performance as well as concurrent usage. For those clients considering developing a large repository of documents, TSG now has both the experience as well as additional tools to help conduct a significant volume test at scale in a very short timeframe. This post will describe how our tools can be leveraged for large ... [Continue Reading]
DynamoDB and Hadoop/HBase as a Document Store – How Key Design can be used to reduce index requirements
TSG continues to have success with Hadoop/HBase and DynamoDB as alternatives to legacy ECM platforms that rely on relational databases. As more clients adopt modern NoSQL platforms for ECM, we are seeing additional and interesting benefits from NoSQL/Key-Value database. This post will highlight the 'key' design in these Key-Value databases to allow for massively scalable content management on HBase and DynamoDB for billions of documents and millisecond retrieval times. ... [Continue Reading]
DynamoDB Benchmark – Building an 11 Billion Document DR Process
In June, 2019, Technology Services Group completed an unprecedented 11 billion document benchmark leveraging Amazon Web Services and specifically DynamoDB and Elasticsearch. As with any of our enterprise class solutions, we didn't view the benchmark as complete without a disaster recovery process in place. This post will share our architecture approach and lessons learned from implementing DR for the benchmark. ... [Continue Reading]
The Deep Analysis Podcast – The 11 Billion File Benchmark
Dave Giordano, CEO of TSG, recently sat down with Alan Pelz-Sharpe to discuss our recent 11 Billion File Benchmark on AWS and DynamoDB. Additionally, hear Dave's thoughts on the future of ECM and why companies are considering alternatives to the traditional ECM Suite. ... [Continue Reading]
DynamoDB 11 Billion Document Benchmark – Summary of Postings
TSG initiated our 11 Billion Document DynamoDB benchmark on Friday, May 10th 2019 and ended all of our testing activities on June 20th 2019. The benchmark was an unbelievable success with our team learning many lessons in regards to scaling AWS, DynamoDB, Elasticsearch and our OpenContent and OpenMigrate products. This post will present a summary of the benchmark activities and lessons learned. ... [Continue Reading]
DynamoDB 11 Billion Benchmark 11 Thousand Concurrent Users Success!!! – Lessons Learned
TSG initiated our 11 Billion benchmark on Friday, May 10th. As of today we have completed the fourth and final phase, testing our repository with 11,000 concurrent users. This post will share the results. ... [Continue Reading]
DynamoDB 11 Billion Benchmark Add Documents Success!!! – Lessons Learned
TSG initiated our 11 Billion benchmark on Friday, May 10th. The first phase of the benchmark was aimed at building a large repository with our OpenMigrate ingestion tool and proving access for OpenContent Search, OpenContent Case and OpenAnnotate. The initial ingestion phase concluded on May 17th with 11 Billion documents and ingestion speeds of 20,000 documents per second to DynamoDB and related folders indexed into Elasticsearch. We took some time to decompress and started ... [Continue Reading]
Amazon Textract – Improving Document Indexing with OpenContent Management Suite
Recently we've been updating our products to leverage Amazon Textract, officially released on May 29th, for it's text extraction capabilities and how it can be used to create full text PDFs. For this post, we're going to look into how we can use the indexing modules within the OpenContent Management Suite (OCMS) to improve document indexing and also explore some possible future improvements that Textract an other tools could enable. Indexing Scenario The scenario we've been using for our ... [Continue Reading]
Amazon Textract for Full Text Search
TSG had added Amazon Textract to our ECM offerings for Alfresco, Documentum, Hadoop and DynamoDB as well as our search offerings with Solr and Elastic Search. Previously, we looked at Textract's text extraction capabilities. For this post, we will discuss and demonstrate how Amazon Textract can be leveraged as a modern OCR indexing engine for image conversion to support full-text search efforts for both on-premise and cloud-based solutions. ... [Continue Reading]
DynamoDB 11 Billion Benchmark Ingestion Success!!! – Lessons Learned
TSG started an 11 Billion Document Benchmark with DynamoDB last Friday to test and verify the power of Amazon Web Services as well as the TSG ECM products on an unprecedented scale. As of this morning, we are pleased to announce we have fully ingested our goal of 11 billion documents!!! This post will share some of the lessons learned this week. ... [Continue Reading]
DynamoDB 11 Billion Benchmark – AWS Walk-through
TSG started an 11 Billion Document Benchmark with DynamoDB last Friday to test and verify the power of Amazon Web Services as well as the TSG ECM products on an unprecedented scale. As of this morning we have migrated approximately 10.5 billion documents. This post will present some underlying detail of DynamoDB repository with a particular focus on document and folder objects. Our post Monday detailed the reasons and expectations for the 11 billion document benchmark, our post ... [Continue Reading]
DynamoDB 11 Billion Benchmark – Document and Folder Details
TSG started an 11 Billion Document Benchmark with DynamoDB last Friday to test and verify the power of Amazon Web Services as well as the TSG ECM products on an unprecedented scale. As of this morning we have migrated approximately 9 billion documents. This post will present some underlying detail of DynamoDB repository with a particular focus on document and folder objects. Our post Monday detailed the reasons and expectations for the 11 billion document benchmark with a post Tuesday ... [Continue Reading]
DynamoDB 11 Billion Benchmark – Repository Walk-through
TSG started a 11 Billion Document Benchmark with DynamoDB last Friday to test and verify the power of Amazon Web Services as well as the TSG ECM products on an unprecedented scale. As of this morning we have migrated approximately 7 billion documents. This post will dive into the repository itself and show the functionality we have been able to maintain at massive scale. ... [Continue Reading]
DynamoDB – Amazon Web Services 11 Billion Document Benchmark
TSG started a 11 Billion Document Benchmark with DynamoDB last Friday to test and verify the power of Amazon Web Services as well as the TSG ECM products on an unprecedented scale. As of this morning we have migrated approximately 6.3 billion documents averaging 20,000 ingested per second, well over halfway to our goal of 11 Billion. This post will discuss the goals and approach of the benchmark. ... [Continue Reading]
Managing Security Videos – What are the issues?
TSG is seeing clients with more and more video management needs, particularly around video surveillance. Clients have to manage a variety of different vendor solutions and formats. Sharing and viewing long and large video files can be a redundant and an inefficient process. TSG worked with the Michigan State Capstone experience to build a prototype that would allow customers to efficiently capture and share video from multiple cameras. ... [Continue Reading]
FileNet to AWS – An 80 Million Document Case Study
As part of TSG’s ongoing efforts to assist clients move from legacy ECM systems like FileNet to modern cloud alternatives, TSG has recently published a case study highlighting how one FileNet customer was able to successfully move to Amazon Web Services. ... [Continue Reading]
FileNet Migration to Amazon Web Services – Why now more than ever?
TSG is currently finalizing a case study on a client that has successfully moved from an legacy on-premise FileNet system to Amazon Web Services. In preparation for that piece coming out in the next two weeks, we thought we would write some of our thoughts on why so many clients, after years of delaying migration efforts, are finally moving off of FileNet to Amazon Web Services. ... [Continue Reading]
Amazon Textract and OpenText Capture Recognition Engine (RecoStar) Comparison
Editor's Note (5/31/219): This article was original posted on 2/12/19 when Amazon Textract was currently in a pre-release phase. All results have been completed using a non-production version of the service. Now that Textract has been formally released, look for results to be updated shortly. As part of our R&D effort into Amazon Textract with Alfresco, TSG conducted some initial research on the quality of the OCR results of Textract on a sample set of images from a real-world TSG ... [Continue Reading]
A Big Data Approach to ECM – White Paper from Deep Analysis
TSG recently participated in a research effort with Deep Analysis. The fundamental undertaking was to understand what alternatives innovative customers are considering when it comes to moving from Legacy ECM 1.0 to modern ECM 2.0 capabilities on premise or in the cloud. Alan Pelz-Sharpe and the analysts of Deep Analysis conducted a deep dive into Big Data and particularly NoSQL databases, Hadoop and DynamoDB. ... [Continue Reading]
ECM 2.0 – What does it mean?
Great whitepaper available at Deep Analysis from long-time ECM analyst Alan Pelz-Sharpe entitled “Intelligent Information Management – From ECM 1.0 to 2.0”. This post will highlight the relevant points and add our thoughts. ECM 2.0 – What are the opportunities? We would agree with Alan that, while repository centric ECM 1.0 systems dominate the market, 2.0 opportunities exist to offer more insight, automation and decentralization. Combined with new technology from cloud ... [Continue Reading]
DynamoDB – ECM / Content Process Services Roadmap
One of the key TSG efforts for the end of 2018 is extending Amazon’s DynamoDB to include document management capabilities with connectivity to the all of the TSG products including the OpenContent Search, OpenContent Case, OpenAnnotate and OpenMigrate. This post will present our plans and roadmaps along with key dates. ... [Continue Reading]
