Middleware is where coordination and control take shape. It is the layer that carries requests between models, tools, policies, and applications, and decides what survives each handoff.

This pillar collects notes and artifacts on mediation, routing, context brokerage, and the controls that keep multi-step systems legible as work moves through them.

Field Record

Canonical questions

Where do request translation, context assembly, and tool selection actually happen, and who owns that layer?

Which controls belong in the mediation layer rather than in the model or the application?

How do we keep handoffs legible and accountable as work moves across services, tools, and boundaries?

Register

Primary references

  • Model Context Protocol (MCP) A protocol for how context and tools attach to requests as they move through the mediation layer.
  • API Gateways and Service Mesh Established middleware patterns for routing, policy, and observability, now applied to AI systems.
  • Open Policy Agent Policy decision and enforcement treated as a mediation-layer responsibility rather than application logic.

Recent Entries

Research paths

View all research

Survey Works

Supporting artifacts

View all artifacts