Conceptual Index Updates
- Sean O'Shea
- Apr 26, 2021
- 1 min read
When working with a conceptual index for Relativity analytics, there are different circumstances when the training set, the searchable set, and the index should be updated.
When documents with new concepts are added, these documents should be added to both the training set [from which term relationships are learned] and the searchable set [on which the analytics tools like clustering and categorization are run]. Perform an incremental build on the index.
When documents with no new concepts are added, these documents should be added to the searchable set. Perform an incremental build on the index.
When documents that make up more than 10-30% of the entire set are added, these documents should be added to both the training set and the searchable set . Perform an incremental build on the index.
When documents that make up less than 10-30% of the entire set are added, these documents should be added to the searchable set. Perform an incremental build on the index.
When documents are removed from a training or searchable set, an incremental index build should be performed.
When new words are added to the list of concept stop words, the index should be deactivated and then rebuilt.
When extracted text is modified, perform a full build on the index.
When email header and repeated content filters are revised, perform a full build on the index.