ECPEvaluation Context Protocol
Demos

Examples

The ECP repository ships several example manifests that cover plain Python agents, framework integrations, and HTTP transport.

Customer support

The flagship demo. Checks final output, required tool calls, and evaluator-safe audit context — a realistic case where output-only evals are not enough.

bash
ecp validate examples/customer_support_demo/manifest.yaml
ecp run --manifest examples/customer_support_demo/manifest.yaml --report report.html

Framework demos

Wrap agents built with popular frameworks behind the same evaluation contract.

bash
ecp run --manifest examples/langchain_demo/manifest.yaml
ecp run --manifest examples/crewai_demo/manifest.yaml
ecp run --manifest examples/pydantic_ai_demo/manifest.yaml
ecp run --manifest examples/llamaindex_demo/manifest.yaml
ecp run --manifest examples/plain_python_demo/manifest.yaml
ecp run --manifest examples/two_agent_demo/manifest.yaml

Install the matching SDK extra before running:

bash
pip install "ecp-sdk[langchain]==0.3.1" langchain-openai
pip install "ecp-sdk[crewai]==0.3.1" crewai
pip install "ecp-sdk[pydanticai]==0.3.1" pydantic-ai
pip install "ecp-sdk[llamaindex]==0.3.1" llama-index llama-index-llms-openai llama-index-tools-yahoo-finance

Streamable HTTP

Run an agent as an HTTP server and target it from the runtime:

bash
python examples/streamable_http_demo/agent.py
ecp run --manifest examples/streamable_http_demo/manifest.yaml --json

Inspector

Browse agent runs with the interactive inspector:

bash
npm run inspector

Open http://127.0.0.1:6274 after it starts.