Plan or Retrieve First? A Scale Study of Tool Discovery Architectures

Tool-augmented LLM agents explore APIs by first generating abstract stubs, then retrieving matching tools, a new Plan‑then‑Retrieve (PtR) method. This contrasts with the common Retrieve‑then‑Plan (RtP) approach and may reduce context‑window strain. Experiments on large tool registries show PtR improves relevance and planning efficiency for AI agents.

Opening Kapyn…