N.V.J.K KartikKartik

AI engineering · Future AGI · 2025 · Python · LiveKit · provider SDKs

Simulate SDK

An open-source SDK that tests voice and chat agents against simulated customers: a persona with a goal talks to your agent, and the conversation is evaluated.

Plate: a conversation between a simulated customer and an agent.

What I did

I started the SDK in October 2025: a simulated customer joins a LiveKit room with a voice agent, holds the call, records and transcribes it, and hands it to evaluation. It went out as agent-simulate 0.1.1.

In December I added chat: agent wrappers for OpenAI, LangChain, Anthropic and Gemini, tool calls and tool outputs in responses, traced conversations, timeouts, and runs through the Future AGI platform. I moved the LiveKit voice engine into its own module so voice and chat share one runner.

First release, PR #1 ↗Chat simulation, PR #4 ↗Repository ↗

Who I made it with

I wrote most of the SDK. The platform’s simulation product, which it runs through, is Future AGI team work.

What it’s for

Simulate SDK runs scenarios against an agent: a simulated customer with a goal and a persona talks to it, and the conversation is evaluated. It started with voice, over LiveKit.

Chat came in December 2025, so the same scenarios can run against text agents built on OpenAI, LangChain, Anthropic or Gemini.

Why it was hard

Every agent framework returns messages, tool calls and tool outputs in a different shape. A simulation has to read all of them the same way and still trace the conversation.

Receipts

  1. future-agi/simulate-sdk PR #1 — Version 0.1.1, the first release (merged 9 Oct 2025)Simulate SDK’s first version, all 20 commits by Kartik from the repository’s initial commit (6 Oct 2025): LiveKit integration, RTC, transcription, call recording, the simulated-customer agent definition, end-call handling. Released as agent-simulate 0.1.1 on PyPI (9 Oct 2025). Kartik has 60 of the repository’s 70 commits (26 Sep 2026).
  2. future-agi/simulate-sdk PR #4 — chat simulation (merged 30 Dec 2025)Agent wrappers for OpenAI, LangChain, Anthropic, Gemini; tool calls and outputs; traced conversations; timeouts; platform runs; LiveKit engine split out. All 28 commits by Kartik.

Every source on the site

Next, a little further back in timeAgent Optimizer →