🗺️Diagrams

Pipeline diagrams for indexing and retrieval

TRS implements basic indexing and retrieved-augmented generation pipelines.

Data indexing pipeline

Retrieval pipeline

Planning

Planned upgrades to the pipelines include:

• Addition of summary index

  • Summarized text is stored in it's own index

  • Retrieval can query both the document and summary index then synthesize answer across both sources

• Better management of previously processed URLs