Manage Chunks

Chunks are the minimal units of information within the TaskingAI retrieval system. When storing long records, the system splits them into smaller segments known as chunks. These chunks are then vectorized and stored into vector databases. They are also the primary elements used for similarity searching and retrieving information from the retrieval system.

In this section, we will discuss the chunk management, involving the creation, updating, retrieval, and deletion of chunks. This functionality is vital for handling the data within the collections of the TaskingAI retrieval system.