Pavlov’s List: RL Environment Startups

Source: https://x.com (tweet) Author: unknown Date: 2025-2026

Summary

A curated list of RL environment startups (“Pavlov’s List”), including AfterQuery (Code & Finance), BenchFlow (Code), Bespoke Labs (Enterprise), and others. Documents an emerging ecosystem of companies selling RL training environments to labs.

Key Claims

  • A new category of startup: RL environment companies selling tasks/environments to AI labs
  • Named companies: AfterQuery, BenchFlow, Bespoke Labs, Calaveras (among others)
  • Domain specializations: code, finance, enterprise
  • Ecosystem forming around the idea that quality RL environments are a scarce resource

Connection to Other Sources

Connects to OpenReward API (330+ environments through one API). The market for RL environments is becoming formalized.

Concepts