What is an AI agent?
An AI agent is an LLM plus a harness plus tools running in a loop, with the model deciding each next step.
Guide details
- Type
- Explainer
- Reading time
- 2 min read
- Scope
- Final rung of the agent fundamentals ladder: the full loop assembled from the previous five cards.
An AI agent is an LLM, a harness, and a set of tools arranged in a loop, with the model rather than a fixed script deciding the next step at every turn. Given a goal, the agent reasons about the situation, picks a tool call, observes the result, and repeats until the goal is met or a limit stops it.
This places agents at one end of a spectrum. A plain chat request is one model call. A workflow chains model calls along paths fixed in code; Anthropic's building-agents guide recommends starting there, because predictable steps are easier to test and cheaper to run. An agent is what you reach for when the steps cannot be known in advance: open-ended coding tasks, research, or operating software.
The pieces in this series are the whole story. Tokens set the budget, chat defines the request, the LLM is the engine, the harness runs the loop, and tools are the hands. What makes an agent an agent is handing control of the loop to the model.
That power has a price: errors compound across iterations. Bound the loop with step limits, verify results before acting on them, and keep humans in the loop for irreversible actions.
Sources
- Building effective agents — AnthropicofficialAnthropic
- Agents — OpenAI documentationdocumentationOpenAI
Taxonomy
Concepts
Topics
Related content
- RequiresWhat is an LLM?The LLM is the decision engine of the agent loop.
- RequiresWhat is an agent harness?The harness hosts the loop and enforces the agent's limits.
- RequiresWhat is a tool?Agents act on the world only through tool calls.
Related
- What is a tool?Mellnx first-partyagent-fundamentals
A tool is a schema-described function the model can call by name, turning text output into real action.
- What is an agent harness?Mellnx first-partyagent-fundamentals
An agent harness is the runtime around a model that assembles context, dispatches tools, and drives the working loop.
- What is an LLM?Mellnx first-partyagent-fundamentals
An LLM is a neural network trained to predict the next token, and that single mechanism is the engine every chat app and agent runs on.