In May of 2019, Technology Services Group initiated an 11 Billion Document DynamoDB benchmark, which was completed in June 2019. With the success of the benchmark, TSG was able to successfully demonstrate that AWS, DynamoDB, Elasticsearch and our OpenContent, OpenAnnotate and OpenMigrate products could scale to an unprecedented level and represented the next evolution of enterprise content management, a Big-Data, NoSQL approach for the multi-billion object repository. This white paper will ... [Continue Reading]
DynamoDB and Hadoop/HBase as a Document Store – How Key Design can be used to reduce index requirements
TSG continues to have success with Hadoop/HBase and DynamoDB as alternatives to legacy ECM platforms that rely on relational databases. As more clients adopt modern NoSQL platforms for ECM, we are seeing additional and interesting benefits from NoSQL/Key-Value database. This post will highlight the 'key' design in these Key-Value databases to allow for massively scalable content management on HBase and DynamoDB for billions of documents and millisecond retrieval times. ... [Continue Reading]
DynamoDB Benchmark – Building an 11 Billion Document DR Process
In June, 2019, Technology Services Group completed an unprecedented 11 billion document benchmark leveraging Amazon Web Services and specifically DynamoDB and Elasticsearch. As with any of our enterprise class solutions, we didn't view the benchmark as complete without a disaster recovery process in place. This post will share our architecture approach and lessons learned from implementing DR for the benchmark. ... [Continue Reading]
The Deep Analysis Podcast – The 11 Billion File Benchmark
Dave Giordano, CEO of TSG, recently sat down with Alan Pelz-Sharpe to discuss our recent 11 Billion File Benchmark on AWS and DynamoDB. Additionally, hear Dave's thoughts on the future of ECM and why companies are considering alternatives to the traditional ECM Suite. ... [Continue Reading]
TECHNOLOGY SERVICES GROUP SUCCESSFULLY BENCHMARKS 11 BILLION DOCUMENT REPOSITORY WITH AMAZON WEB SERVICES – PRESS RELEASE
Chicago, IL. June 25th, 2019 – Technology Services Group, Inc. (TSG), a leading provider of document management integration software announced today that it has successfully tested the OpenContent Management Suite (OCMS) of products with a repository containing 11 billion documents running on Amazon Web Services. The benchmark was populated with TSG’s OpenMigrate product and was able to achieve ingestion speeds of 20,000 documents per second with over 1 billion documents migrated on an ... [Continue Reading]
DynamoDB 11 Billion Document Benchmark – Summary of Postings
TSG initiated our 11 Billion Document DynamoDB benchmark on Friday, May 10th 2019 and ended all of our testing activities on June 20th 2019. The benchmark was an unbelievable success with our team learning many lessons in regards to scaling AWS, DynamoDB, Elasticsearch and our OpenContent and OpenMigrate products. This post will present a summary of the benchmark activities and lessons learned. ... [Continue Reading]
DynamoDB 11 Billion Benchmark 11 Thousand Concurrent Users Success!!! – Lessons Learned
TSG initiated our 11 Billion benchmark on Friday, May 10th. As of today we have completed the fourth and final phase, testing our repository with 11,000 concurrent users. This post will share the results. ... [Continue Reading]
DynamoDB 11 Billion Benchmark Add Documents Success!!! – Lessons Learned
TSG initiated our 11 Billion benchmark on Friday, May 10th. The first phase of the benchmark was aimed at building a large repository with our OpenMigrate ingestion tool and proving access for OpenContent Search, OpenContent Case and OpenAnnotate. The initial ingestion phase concluded on May 17th with 11 Billion documents and ingestion speeds of 20,000 documents per second to DynamoDB and related folders indexed into Elasticsearch. We took some time to decompress and started ... [Continue Reading]
DynamoDB 11 Billion Benchmark Search Index Success!!! – Lessons Learned
TSG initiated our 11 Billion benchmark test on Friday, May 10th. The first phase of the benchmark was aimed at building a large repository with our OpenMigrate ingestion tool and proving access for OpenContent Search, OpenContent Case and OpenAnnotate. The initial ingestion phase concluded on May 17th with 11 Billion documents and ingestion speeds of 20,000 documents per second to DynamoDB and related folders indexed into Elasticsearch. We took some time to decompress and ... [Continue Reading]
DynamoDB and AWS – How to build your own ECM capabilities for massive scale and performance
After the successful 11 Billion Document Benchmark with DynamoDB, we had a discussion with a couple of the major analysts as well as a nice shout-out from Jeff Potts on ECM Architect. We received a ton of great feedback on the scale of what we were able to accomplish along with lots of discussion specifically on how we built it and sharing some lessons learned. This post will break down the components of our NoSQL (DynamoDB and Hadoop) ECM components with background and comparison to ... [Continue Reading]
DynamoDB 11 Billion Benchmark Ingestion Success!!! – Lessons Learned
TSG started an 11 Billion Document Benchmark with DynamoDB last Friday to test and verify the power of Amazon Web Services as well as the TSG ECM products on an unprecedented scale. As of this morning, we are pleased to announce we have fully ingested our goal of 11 billion documents!!! This post will share some of the lessons learned this week. ... [Continue Reading]
DynamoDB 11 Billion Benchmark – AWS Walk-through
TSG started an 11 Billion Document Benchmark with DynamoDB last Friday to test and verify the power of Amazon Web Services as well as the TSG ECM products on an unprecedented scale. As of this morning we have migrated approximately 10.5 billion documents. This post will present some underlying detail of DynamoDB repository with a particular focus on document and folder objects. Our post Monday detailed the reasons and expectations for the 11 billion document benchmark, our post ... [Continue Reading]
DynamoDB 11 Billion Benchmark – Document and Folder Details
TSG started an 11 Billion Document Benchmark with DynamoDB last Friday to test and verify the power of Amazon Web Services as well as the TSG ECM products on an unprecedented scale. As of this morning we have migrated approximately 9 billion documents. This post will present some underlying detail of DynamoDB repository with a particular focus on document and folder objects. Our post Monday detailed the reasons and expectations for the 11 billion document benchmark with a post Tuesday ... [Continue Reading]
DynamoDB 11 Billion Benchmark – Repository Walk-through
TSG started a 11 Billion Document Benchmark with DynamoDB last Friday to test and verify the power of Amazon Web Services as well as the TSG ECM products on an unprecedented scale. As of this morning we have migrated approximately 7 billion documents. This post will dive into the repository itself and show the functionality we have been able to maintain at massive scale. ... [Continue Reading]
DynamoDB – Amazon Web Services 11 Billion Document Benchmark
TSG started a 11 Billion Document Benchmark with DynamoDB last Friday to test and verify the power of Amazon Web Services as well as the TSG ECM products on an unprecedented scale. As of this morning we have migrated approximately 6.3 billion documents averaging 20,000 ingested per second, well over halfway to our goal of 11 Billion. This post will discuss the goals and approach of the benchmark. ... [Continue Reading]
Technology Services Group Releases new DynamoDB Document Management Capabilities for AWS
Complete OpenContent Management Suite now available natively for DynamoDB on Amazon Web Services Marketplace Chicago, IL. – January 30th, 2019 – Technology Services Group, Inc. (TSG), a leading provider of document management integration software and services, today announced that its OpenContent Management Suite (OCMS) for DynamoDB has been released on the Amazon Marketplace. OCMS provides a modern user interface for common document management capabilities for a variety of ECM platforms. ... [Continue Reading]
A Big Data Approach to ECM – White Paper from Deep Analysis
TSG recently participated in a research effort with Deep Analysis. The fundamental undertaking was to understand what alternatives innovative customers are considering when it comes to moving from Legacy ECM 1.0 to modern ECM 2.0 capabilities on premise or in the cloud. Alan Pelz-Sharpe and the analysts of Deep Analysis conducted a deep dive into Big Data and particularly NoSQL databases, Hadoop and DynamoDB. ... [Continue Reading]
ECM 2.0 – What does it mean?
Great whitepaper available at Deep Analysis from long-time ECM analyst Alan Pelz-Sharpe entitled “Intelligent Information Management – From ECM 1.0 to 2.0”. This post will highlight the relevant points and add our thoughts. ECM 2.0 – What are the opportunities? We would agree with Alan that, while repository centric ECM 1.0 systems dominate the market, 2.0 opportunities exist to offer more insight, automation and decentralization. Combined with new technology from cloud ... [Continue Reading]
DynamoDB and Hadoop – Why Big Data will disrupt Document Management
Back in the 80’s, the emergence and low cost of PC’s, network and relational databases combined to create the beginnings of modern image management systems. Solutions and approaches gradually evolved to include documents and the creation of the ECM (enterprise content management/document management) industry. Back in 2015, TSG began brainstorming about what’s next for the document management industry. In addition to cloud computing already disrupting the data center for ... [Continue Reading]
Adobe Acrobat Alternative – Doing more with just a web browser
Many users rely on PDF viewing, annotation, and manipulation tools when working with documents, especially in case management scenarios such as policy and claim document management within the Insurance industry. In many of these systems, users are forced to download PDFs to the local machine in order to work with the document within Adobe Acrobat. However, with modern browser technologies, it is possible to streamline this process by doing more in the web browser, side-stepping the need to ... [Continue Reading]
DynamoDB – ECM / Content Process Services Roadmap
One of the key TSG efforts for the end of 2018 is extending Amazon’s DynamoDB to include document management capabilities with connectivity to the all of the TSG products including the OpenContent Search, OpenContent Case, OpenAnnotate and OpenMigrate. This post will present our plans and roadmaps along with key dates. ... [Continue Reading]
DynamoDB – Database model for Document Management
One of the ongoing myths about DynamoDB for Document Management we hear too often is “but isn’t that just for big data?” This post will try to explain the benefits of DynamoDB’s big data capabilities and data model in a Document Management context compared to traditional database systems. Examples will include how we are currently building our own DynamoDB offering scheduled to be released at the end of 2018. ... [Continue Reading]
DynamoDB and Hadoop / HBase – What are some of the differences?
As an Amazon Web Services Partner, TSG has begun developing out our document management solution for DynamoDB, we have been surprised with some of the implementation differences between DynamoDB and Hadoop / HBase. This post will dive into the differences in building we have encountered some examples while building out our ECM/Content Process Services solution. ... [Continue Reading]
Amazon DynamoDB – Can it do ECM?
In discussing our next steps as part of our Amazon Web Services practice, one exciting item TSG is pursuing this quarter will be focused on Amazon DynamoDB and adding Enterprise Content Management capabilities. This post will begin a series of posts on our design and development activities to provide an OpenContent connection to Amazon DynamoDB. ... [Continue Reading]
