TSG started an 11 Billion Document Benchmark with DynamoDB last Friday to test and verify the power of Amazon Web Services as well as the TSG ECM products on an unprecedented scale. As of this morning we have migrated approximately 10.5 billion documents. This post will present some underlying detail of DynamoDB repository with a particular focus on document and folder objects.
Our post Monday detailed the reasons and expectations for the 11 billion document benchmark, our post Tuesday showed the interface and migration process and we had a post yesterday discussing document and folder details for a NoSQL database. This post will guide users through the AWS console and point out exactly what architecture we have setup for our 11 billion document benchmark, as well as highlight what metrics to pay attention to when ingesting data into DynamoDB and Elasticsearch indexes.
While our other posts have focused on NoSQL and the functionality OCMS can provide at scale using a NoSQL database, today we want to dive into the AWS console and walk users though the various components we have configured for this effort. In particular, we want to highlight the tables and metrics we closely pay attention to when migrating into a DynamoDB environment in order to help clarify the AWS setup needed at this scale.
Below is a daily video of our progress to date on the benchmark with some more detail on the AWS console for this effort.
Let us know your thoughts below and look for another entry tomorrow.
Leave a Reply