Skip to content

Notebooks

Real-LLM narrative notebooks that show Orqest primitives composed into something whole. They live in notebooks/ in the repo and are best read in Jupyter Lab — see the notebooks README for setup.

A skeptical engineer should follow this tour. Notebook 12 leads because it's the architecture proving itself end-to-end with a measured win on a real benchmark. The other tour notebooks drill into each pillar individually.

# Notebook What's surprising
1 12_combo_autonomous_coder.ipynb The full combo with a measured win. Designer agent picks the topology, AgentFactory spawns coder+fixer from AgentSpec, GeneratedToolSpec + SubprocessSandbox run each iteration's tests dynamically. Beats single-shot baseline by +17pp pass@1 / +14pp test_pass_rate on a 10-problem coding benchmark (same model, 3-trial average). Zero regressions.
2 10_runtime_topology.ipynb Topology design in isolation. RuntimeTopologyDesigner synthesises a shape per request; MemoryStoreCache reuses for similar future requests.
3 02_meta_orchestrator.ipynb Specialists spawn themselves from a goal. MetaOrchestratorAgentSpecAgentFactory → live agents.
4 11_dynamic_tools.ipynb Tools materialise at runtime, sandboxed. GeneratedToolSpecDynamicToolFactorySandbox. Three safety tiers in the same notebook.
5 04_orchestrated_workflow.ipynb The connective tissue, by hand. Router → Parallel → Pipeline → RefinementLoop with Workbench carrying tracer + bus.
6 01_cognitive_substrate.ipynb Agents know when they're struggling. metacognition.confidenceRegressionDetectorWatchdogHookFallbackModel.

If you have 5 minutes, open notebook 12 and skip to section 7 ("Head-to-head") — that's the measured win in one table.

All narrative notebooks

Notebook Theme
01_cognitive_substrate An agent that knows when it's struggling
02_meta_orchestrator Decompose a goal, spawn specialists at runtime
03_generative_ui Agents that design their own surface
04_orchestrated_workflow Route, fan out, chain, refine — with observability
05_reasoning Provider-agnostic reasoning knob
06_optimization_basic Evolve a research summariser's prompt (GEPA)
07_optimization_compound Evolve the planner inside MetaOrchestrator
08_topology_search_basic ADAS-style topology search (offline)
09_topology_with_gepa Two-phase: discover topology, then evolve prompts
10_runtime_topology Per-request topology synthesis with semantic cache
11_dynamic_tools Runtime tool spawning with sandbox tiers
12_combo_autonomous_coder The combo end-to-end with a measured win — designer + dynamic agents + dynamic tools + iteration on a coding benchmark (+17pp pass@1)

★ = part of the 6-notebook evaluation tour.

Primitive references

For one-primitive-at-a-time references (basic agent, streaming, pipeline, parallel, router, memory, observability), see the concept docs. Each page is a runnable snippet matching one of the pieces the narrative notebooks compose.