Conceptual Index Updates

When working with a conceptual index for Relativity analytics, there are different circumstances when the training set, the searchable set, and the index should be updated.

• When documents with new concepts are added, these documents should be added to both the training set [from which term relationships are learned] and the searchable set [on which the analytics tools like clustering and categorization are run]. Perform an incremental build on the index.

• When documents with no new concepts are added, these documents should be added to the searchable set. Perform an incremental build on the index.

• When documents that make up more than 10-30% of the entire set are added, these documents should be added to both the training set and the searchable set . Perform an incremental build on the index.

• When documents that make up less than 10-30% of the entire set are added, these documents should be added to the searchable set. Perform an incremental build on the index.

• When documents are removed from a training or searchable set, an incremental index build should be performed.

• When new words are added to the list of concept stop words, the index should be deactivated and then rebuilt.

• When extracted text is modified, perform a full build on the index.

• When email header and repeated content filters are revised, perform a full build on the index.