Skip to main content

The LLM node

An LLM node makes a single, well-scoped call to a language model from inside a multi agent flow and hands the result to the node that comes next. Unlike the Agent node — which holds a multi-turn conversation with the user — the LLM node does not talk to the user and does not loop. It takes an input, calls the model once, and returns a value.

Reach for it for a focused transformation in an otherwise deterministic flow: summarise a ticket, classify intent, extract fields from free text, or rewrite a message.

An LLM node on the flow canvas, with Success and Fallback exits

LLM node vs. Agent node​

Use the LLM node when…Use the Agent node when…
You need one model call to produce a valueYou need a back-and-forth with the user
The step is a transformation — summarise / classify / extract / rewriteThe step is a conversation with its own exits
The result feeds straight into the next nodeThe agent decides for itself when the job is done

Configure the node​

System prompt — a static instruction that tells the model what to do. It stays the same on every run.

Input — the content the model acts on for this call. Type your text and drop in variables as {{variables.x}} mention chips; they resolve at runtime. The Input lives on the node itself, so the same underlying agent can be reused across more than one node.

Output format — choose how the model must reply:

  • Text — a plain string.
  • JSON — a structured object. Supply a JSON Schema and the model is constrained to match it. (JSON output is available where structured output is enabled for your account.)

The LLM node editor — System prompt, Input, Output format and Store response

Using the result​

The node stores its result as a small envelope that the next node can read and branch on:

FieldWhat it holds
statusWhether the call succeeded
textThe model's reply (Text output)
jsonThe parsed object (JSON output)
errorSet when the call failed

Wire the following node to this output — for example, branch on status, or template text / json into a later message, API call, or condition.