Layer 01 · ExperienceThe agent shows up where the work already happens.
An agent nobody opens is a research project. We ship the interface with the agent: a Databricks App for an internal audience, a served endpoint your product calls, Genie One for business users who want to ask questions of governed data directly, or the agent surfaced inside Slack, Teams or a support console. Databricks Apps run serverless Python - Streamlit, Dash, Gradio, Shiny, Flask or FastAPI - with the signed-in user’s identity carried through, so the app sees exactly what that person is entitled to see.
Databricks AppsGenie OneModel Serving endpointReview AppMCP connectors · Slack, Teams, Jira
What we do here. Design the interaction, not just the API - where the agent asks before it acts, how it shows its sources, and what a user does when it is wrong. The fastest route to a real answer is usually a Databricks App in front of a governed agent.
Layer 02 · AgentDeclarative where it fits. Real code where it does not.
Databricks now gives you both, and choosing correctly is most of the value. Knowledge Assistant builds a cited, document-grounded assistant with an instructed retriever and improves from expert feedback rather than prompt archaeology. Supervisor Agent - generally available since February 2026 - routes a question across Genie Agents, Knowledge Assistants, Unity Catalog functions, MCP servers and your own agent endpoints, and learns its routing from natural-language guidance. When the problem needs bespoke control flow, we author a custom agent on the MLflow ResponsesAgent interface - the one Databricks recommends - which gives streaming, multi-agent support, tool-call confirmation and automatic tracing for free, in LangGraph, LangChain, LlamaIndex or the OpenAI Agents SDK.
Knowledge Assistant · GASupervisor Agent · GAMLflow ResponsesAgentLangGraph · LangChain · LlamaIndexagents.deploy()
What we do here. Pick the cheapest thing that will hold. Most teams over-build: a Knowledge Assistant answers the question a six-week custom RAG project was scoped to answer. We reserve custom agents for the cases where control flow, side effects or latency genuinely demand them - and then Forge supplies the scaffolding so week one is the hard part, not the setup.
Layer 03 · ToolsA tool is a catalog object with a grant on it.
This is the layer that separates a governed agent from a risky one. On Databricks a tool is not a Python function someone wired up - it is a Unity Catalog function or an MCP Service addressed by its three-level name, with EXECUTE grants, tool-level selection and policies attached. Databricks hosts managed MCP servers for AI Search indexes, Genie Agents, Unity Catalog functions and Databricks SQL, and managed OAuth connectors reach outward to systems like GitHub, Jira, Confluence, SharePoint, Google Drive and Slack - with credentials held centrally instead of pasted into an agent’s config.
Unity Catalog functionsDatabricks-managed MCP serversMCP Services · BetaManaged OAuth connectorsEXECUTE grants · tool selection
What we do here. Write the tool surface deliberately - narrow, typed, individually granted, and reviewed like an API rather than accumulated like a prompt. Our Blocks library supplies the patterns we have already proven: retrieval tools, write-back tools with confirmation, and the routing logic between them.
Layer 04 · ContextGrounding is a data engineering problem wearing an AI hat.
Databricks AI Search (formerly Databricks Vector Search) keeps an index in sync with a Delta table, so the agent’s knowledge moves when your data moves - no nightly export, no drift between the answer and the warehouse. It does hybrid keyword and vector retrieval, merging both rankings, and offers a real cost-versus-latency choice: standard endpoints answer in tens of milliseconds, storage-optimized endpoints scale past a billion vectors and index far faster for a fraction of the cost. For structured questions, Genie Agents hold the trusted tables, metrics and business rules so “revenue” means the same thing to the agent as to finance. And unstructured input becomes governed rows through ai_parse_document, ai_extract and ai_classify.
Databricks AI SearchDelta Sync indexesGenie Agents · metric viewsai_parse_document · ai_extractUnity Catalog volumes
What we do here. Almost every “the agent is not accurate enough” problem is a retrieval problem, so we treat it as one: chunking, hybrid weighting, filters and a retrieval eval set measured on its own before anyone blames the model. This is also where this page meets Modern Data Engineering - same team, one layer down.
Layer 05 · ModelsModel choice should be a config change, not a rebuild.
Databricks serves frontier models from Anthropic, OpenAI and Google alongside strong open models, all through one governed interface, plus external providers and your own fine-tuned models on the same endpoints. Consumption is a real design decision rather than a detail: pay-per-token for variable traffic, a priority tier for latency-sensitive interactive use, provisioned throughput when load is steady, and AI Functions such as ai_query when the job is reasoning over a whole table rather than one request at a time.
Foundation Model APIsProvisioned throughputExternal modelsFine-tuned custom modelsai_query · batch inference
What we do here. Keep the model behind an interface so it can be swapped when a better or cheaper one lands - then prove the swap with the same evaluation set rather than a vibe check. Nine times out of ten the smaller model passes, and the bill falls.
Layer 06 · Governance & operationsThe layer that decides whether the agent is allowed to exist.
Databricks frames this in three parts and so do we. Assets: every model, function, index, MCP server and connection is a Unity Catalog securable with an owner, grants, lineage and audit - and attribute-based access control now applies row filters and column masks from governed tags rather than per-table grants. Traffic: Unity AI Gateway (Beta) sits in front of every model and MCP call to enforce rate limits, budgets, usage tracking and service policies - content-and-identity rules that return allow, deny, or ask a human, and that fail closed. Quality: MLflow 3 traces every request, evaluates against judges and your own guidelines, and keeps scoring a sample of live traffic after launch.
Unity Catalog · securables & lineageABAC row filters & column masksUnity AI Gateway · BetaService policies · allow / deny / askMLflow Tracing & evaluationsystem.access.audit
What we do here. This is where Sentinel lives - our production-readiness layer on top of these primitives: the eval gate an agent has to clear, the guardrail set, the trace and monitoring wiring, and the evidence pack that lets a risk committee sign off. See AI Governance.