• Skip to primary navigation
  • Skip to main content
  • Skip to primary sidebar
  • Skip to footer
TSB Alfresco Cobrand White tagline

Technology Services Group

  • Home
  • Products
    • Alfresco Enterprise Viewer
    • OpenContent Search
    • OpenContent Case
    • OpenContent Forms
    • OpenMigrate
    • OpenContent Web Services
    • OpenCapture
    • OpenOverlay
  • Solutions
    • Alfresco Content Accelerator for Claims Management
      • Claims Demo Series
    • Alfresco Content Accelerator for Policy & Procedure Management
      • Compliance Demo Series
    • OpenContent Accounts Payable
    • OpenContent Contract Management
    • OpenContent Batch Records
    • OpenContent Government
    • OpenContent Corporate Forms
    • OpenContent Construction Management
    • OpenContent Digital Archive
    • OpenContent Human Resources
    • OpenContent Patient Records
  • Platforms
    • Alfresco Consulting
      • Alfresco Case Study – Canadian Museum of Human Rights
      • Alfresco Case Study – New York Philharmonic
      • Alfresco Case Study – New York Property Insurance Underwriting Association
      • Alfresco Case Study – American Society for Clinical Pathology
      • Alfresco Case Study – American Association of Insurance Services
      • Alfresco Case Study – United Cerebral Palsy
    • HBase
    • DynamoDB
    • OpenText & Documentum Consulting
      • Upgrades – A Well Documented Approach
      • Life Science Solutions
        • Life Sciences Project Sampling
    • Veeva Consulting
    • Ephesoft
    • Workshare
  • Case Studies
    • White Papers
    • 11 Billion Document Migration
    • Learning Zone
    • Digital Asset Collection – Canadian Museum of Human Rights
    • Digital Archive and Retrieval – ASCP
    • Digital Archives – New York Philharmonic
    • Insurance Claim Processing – New York Property Insurance
    • Policy Forms Management with Machine Learning – AAIS
    • Liferay and Alfresco Portal – United Cerebral Palsy of Greater Chicago
  • About
    • Contact Us
  • Blog

Documentum Search Services – The Real Deal

You are here: Home / Documentum / Documentum Search Services – The Real Deal

May 21, 2010

Way back at Momentum 2001 in Chicago, I remember having an in-depth conversation with a Documentum architect in integrating Autonomy into the Documentum platform. TSG was implementing Autonomy at the time and Documentum was looking to build a pluggable architecture into Documentum in which any search engine could be integrated. The 5.3 platform helped usher in that pluggable architecture with the replacement of Verity (now owned by Autonomy) with FAST. 9 years later at EMC World 2010, Documentum is getting closer to releasing Documentum Search Services, which is essentially an integration between Lucene and xDB.
Ed Buche and Aamir Farooq both presented at EMC World, providing a good technical overview of DSS and lessons learned from how FAST currently interacts with the Content Server. I’ve always looked forward to Ed Buche’s presentations, and glad he has been very involved in the architecture of DSS. A couple of items to highlight:

Overview

Using an XML database like xDB in conjunction with Lucene makes a lot of sense in regards to performance and scalability. All metadata for content is being converted to an XML file and stored within xDB. This is very similar to how FAST ingests metadata today. However, with DSS, an XML representation of the ACL will also be created and stored in xDB, allowing security to be evaluated by the search engine, not at the Documentum level. Replication of ACLs from the Content Server to DSS will be asynchronous, not necessarily transaction based.

A new full text admin interface will also be available, providing much more detailed reports on indexing status, errors, graphs, etc.

Performance and Scalability

Queries that may have taken minutes in FAST, will take seconds in DSS. Documentum has taken a number of lessons learned from the FAST integration and has addressed a number of performance issues that have caused angst in the past. Querying inside folders with a large number of subfolders has been optimized. Additionally, underprivileged users belonging to a small subset of content but searching a wide range of content should see a significant increase in performance. This is a specific issue we’ve run into with our clients and looking forward to comparing the performance difference.

Facets

Facets provide the ability to display your search results and drill down further by a set of pre-defined categories. If you have a large results set, you can further drill down by date, format, etc. to refine your search. CenterStage will support this out of the box. I will be curious how or if this will be integrated into Webtop Search Results or how custom search applications will be able to make use of the capability.

Cost / Upgrading to DSS

DSS will remain part of the Content Server and will not be licensed separately.
Microsoft/FAST and Documentum have agreed on extended support for customers until the end of 2011. Therefore, customers making use of full text indexing must upgrade to at least 6.5 SP2 and migrate to DSS by then. DSS will become standard starting with the D6.7 Release. This may be a key driver for customers to start planning you upgrades based on the 2011 date.
Customers who are currently deployed on 6.5 SP2 or later will be able to upgrade to DSS. To evaluate and test DSS compared to FAST, a new docbase may be created using DSS. Both FAST and DSS can therefore be running at the same time and provide a seamless transition from one search platform to another.

Filed Under: Documentum, Lucene, News, Search, xPlore Tagged With: Documentum, EMC World, Lucene, Search, xDB, XML Database

Reader Interactions

Comments

  1. Frank Muller says

    May 23, 2010 at 7:11 am

    When Documentum replaced Verity with Fast, it did this out of desperation. There were a lot of nice things with Verity such as not requiring external servers for search which Fast introduced. Also, HA sucked with FAST. But, Documentum never listened to their customers and went ahead with the decision anyway. We asked them for the lucene search engine that was built into their OEM edition, but they wouldn’t give it to their non-OEM customers. They told us FAST is their strategic search platform.

    Guess all that changed when Microsoft bought FAST!!!

  2. Tim Hiss says

    January 31, 2012 at 12:53 pm

    Is the Documentum search engine really pluggable? Have you done anything with making the Sharepoint/FAST index the target of the Documentum search action rather than DSS or Documentum FAST?

  3. George says

    January 31, 2012 at 2:50 pm

    Tim,

    The pluggable architecture mentioned in this article is referring to the vision that Documentum had for search services back at the Chicago Momentum conference in 2001. EMC does allow you to configure the search engine in the server.ini through the ft_engine_to_use property, but we don’t know of any clients that have implemented search engines other than xPlore, Documentum FAST, or Verity.

Trackbacks

  1. EMC World 2010: Next-generation Search: Documentum Search Services | Content Perspective says:
    May 22, 2010 at 7:46 am

    […] sure to also read the good summary from Technology Services Group and Blue Fish Development Group about their take on DSS. var a2a_config = a2a_config || {}; […]

  2. TSG Blog – 18 months and counting « TSG Blog says:
    September 13, 2010 at 6:16 am

    […] Search – multiple posts regarding leveraging Lucene, Documentum Search Services,  as well as understanding the differences of FAST versus Lucene  continue to get lots of […]

  3. Documentum Search – How to get around the user request of “I just want a search like Google” « TSG Blog says:
    February 22, 2011 at 2:52 pm

    […] Documentum Search Services (now xPlore) the Real Deal […]

You must log in to post a comment.

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Primary Sidebar

Search

Related Posts

  • Documentum/Momentum EMC World Prep
  • Documentum – Understanding DQL’s Performance Limitation with xPlore
  • Documentum Performance – Search, Retrieval and Inbox
  • Virtual Momentum Lisbon 2010 and Midwest Documentum User Group
  • Documentum – Top 12 Tips
  • Documentum Search – Lucene, FAST, Verity, Google and upcoming DSS
  • EMC said planning to sell Documentum Business Amid Dell Deal – (Bloomberg)
  • Documentum – EMC World 2015 – Overall ECD Product Vision and Roadmap – Ahson Ahmad and Mark Arbour
  • Documentum / IIG / ECD? – EMC Announces 2014 Earnings, Layoffs and thoughts on a spin-off
  • Documentum and Alfresco – What are some of the bigger differences?

Recent Posts

  • Alfresco Content Accelerator and Alfresco Enterprise Viewer – Improving User Collaboration Efficiency
  • Alfresco Content Accelerator – Document Notification Distribution Lists
  • Alfresco Webinar – Productivity Anywhere: How modern claim and policy document processing can help the new work-from-home normal succeed
  • Alfresco – Viewing Annotations on Versions
  • Alfresco Content Accelerator – Collaboration Enhancements
stacks-of-paper

11 BILLION DOCUMENT
BENCHMARK
OVERVIEW

Learn how TSG was able to leverage DynamoDB, S3, ElasticSearch & AWS to successfully migrate 11 Billion documents.

Download White Paper

Footer

Search

Contact

22 West Washington St
5th Floor
Chicago, IL 60602

inquiry@tsgrp.com

312.372.7777

Copyright © 2023 · Technology Services Group, Inc. · Log in

This website uses cookies to improve your experience. Please accept this site's cookies, but you can opt-out if you wish. Privacy Policy ACCEPT | Cookie settings
Privacy & Cookies Policy

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these cookies, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may have an effect on your browsing experience.
Necessary
Always Enabled
Necessary cookies are absolutely essential for the website to function properly. This category only includes cookies that ensures basic functionalities and security features of the website. These cookies do not store any personal information.
Non-necessary
Any cookies that may not be particularly necessary for the website to function and is used specifically to collect user personal data via analytics, ads, other embedded contents are termed as non-necessary cookies. It is mandatory to procure user consent prior to running these cookies on your website.
SAVE & ACCEPT