Review this design as a CTO and a security engineer.
Explain where model knowledge, retrieved context, runtime state and tools live.
Identify whether each decision is fixed by code or chosen by a real LLM.
Evaluate source retrieval, unsupported claims, correct abstention, authorized
access, action correctness, stopping behavior, latency and token usage.
Use the same labelled cases for replay and live-model runs; report both.
Inspect tool observations and final state, not just the final paragraph.
Do not ask for private chain-of-thought. Record tool names, arguments,
observable outcomes and concise user-facing explanations instead.
Propose the smallest measurable improvement. Preserve all failure evidence.
