Skip to main content

Manage Chunks

Chunks are the smallest units of information within the TaskingAI retrieval system. When storing lengthy records, the system splits them into smaller segments known as chunks. These chunks are then vectorized and stored in vector databases. They serve as the primary elements for similarity searching and information retrieval within the system.

Create a Chunk​

There are two ways to create chunks in TaskingAI's console: by creating a new record or by directly creating a chunk.

  1. Creating a new record will automatically generate chunks, as they are the fundamental units of information storage.
  2. Chunks can also be manually created within a selected record to extend the content of that record.

Creating Chunks by Creating a New Record​

Refer to the Create a Record guide for instructions on creating a new record. This method will automatically generate chunks for the record.

Creating Chunks Directly​

To manually create a chunk for a record, follow these steps:

  1. Click the Action button on the right side of the record you wish to add a chunk to.

  2. Select the Edit option.

    Chunk Listing

  3. In the record management page, click the Edit chunks button to access the chunk editing page.

    Chunk Editing

  4. Add new chunks after any existing chunks by clicking the Add chunk button to the right of the current chunk.

  5. Click Save to store the changes.

Manage Chunks​

From the chunk editing page shown above, you can also perform the following actions on existing chunks:

  1. Edit: Modify the textual content of the chunk directly within the chunk editing page.
  2. Delete: Remove the chunk from the record by clicking the Remove button to the right of the chunk.
  3. Disable: Temporarily disable the chunk from being retrieved by the system. This is useful if you want to remove a chunk from retrieval without deleting it permanently.