For truly realistic conversational research, we must rethink fully autonomous agent design. DialogLab, our new open-source prototyping framework, uses a human-in-the-loop control strategy to achieve realistic human-AI group simulation, offering a necessary alternative to fully autonomous agents.