🗺️Diagrams

Pipeline diagrams for indexing and retrieval

TRS implements basic indexing and retrieved-augmented generation pipelines.

Data indexing pipeline
Retrieval pipeline

Planning

Planned upgrades to the pipelines include:

  • Addition of summary index

    • Summarized text is stored in it's own index

    • Retrieval can query both the document and summary index then synthesize answer across both sources

  • Better management of previously processed URLs

Last updated