Back to glossaryGLOSSARY · Concepts

System Prompt

Instructions given to an LLM before any user input. Defines the model's role, constraints, and tone. Usually invisible to the end user. The most important and most underrated optimisation in agent engineering.

How it works

Modern LLM APIs accept a system prompt as a separate field, applied to every request in the conversation. It's where you set the model's persona, give it tools, define output format, and specify constraints. A well-written system prompt is often the difference between a good agent and a bad one.

Example

A B2B SaaS support agent's system prompt: 'You are a senior customer support specialist for [Product]. Answer in 2-4 sentences max. Use only the tools provided. If unsure, escalate. Never invent product features.' Plus tool definitions and brand voice guidelines.

Related terms

Need to actually use System Prompt?

We build production AI systems that put these concepts to work. 30 minutes, we map your use case.