Why is there a limit on the number of files in a chat or agent?

Learn why chats and agents limit how many files you can attach, and how to work with larger document collections using Knowledge Hub folders.

Large Language Models have a context window, which is the maximum amount of text they can process at once. This includes the prompt you send to the model, the previous chat history, and any attached files (this is explained in this guide). To work efficiently with files, reduce the number of attached documents to the lowest number possible.

The file limit helps to increase the probability that all of the content fits into the context window. To work with larger documents or more files, add them to a Knowledge Hub folder, which uses semantic search to retrieve only the most relevant sections, and reference that folder from a chat or agent.