Tools are external functionalities or APIs that can be used by a large language model (LLM) to perform specific actions or retrieve information beyond its inherent capabilities. AIP Agents equipped with tools use a chain-of-thought, which may result in a slower time to first token. Tools are especially useful for allowing the LLM to determine control flow and construct inputs.
There are six types of tools available:
When deployed in edit mode, view mode, Workshop, or AIP Threads, you can select View reasoning below a response to investigate the LLM reasoning process used to generate the response.