VOR.TECH — open multiplayer gameplay data for world models

multiplayer world models · open data & Source pipeline

README

World models keep popping up. Nobody has cracked multiplayer at scale, because multiplayer data is painful to gather. It takes three things, all on the same clock:

  • every player's view
  • every input they make
  • the full game state

We put in the work. Vortech is 3 people, racks of GPU instances, and a couple years of plumbing. Below is what came out of it.

DATASETfree for research

Thousands of hours of 10-player first-person gameplay, free, so anyone can start building multiplayer world models. The game state is open to all; the video is for non-commercial research.

3,958 hof 5v5 matches
state + actions, every player
3,283 hof POV video
aligned frame-by-frame
218,768rounds
195M steps at 16 Hz
189.1Mframes
256² · 10 views per moment

dataset spec

ONE ROUND · TEN POVSground truth

Ten first-person views of the same Counter-Strike round, five Terrorists over five Counter-Terrorists

One bot round from the dataset, recorded from all ten players at once. Every view, every number and every hit sits on the same 16 Hz clock — pick a player and watch the others see them.

open spectator mode

PIPELINEoh, by the way

The data comes from a pipeline that turns Source-engine games into unlimited multiplayer data, for anyone who holds the licence to the game, or is Valve itself. These games ship with bots and GOTV, a built-in recorder that captures every tick of every match. That is a perfect setup for automated data production: no players to recruit, no screens to capture.

  1. generate
  2. parse + render
  3. align
  4. encode
  5. train

First run: CS:GO, one map, 33 servers, five days. Gameplay generation scales linearly with compute. Other Source titles plug into the same steps, given the rights to them.

walk through the pipeline

MODELoh, and by the waaay

We have been training a multiplayer world model on this for a while.It predicts the next frame and the next game state for all ten players.It is a work in progress; we will put it out when it is good enough.

Meanwhile, a sneak peek: the recorded game on the left, the model on the right.

00:00 / 00:25
left: the recorded round · right: every pixel generated by the model

how the model works

WHAT YOU CAN DO WITH THE DATA

  • Train a multiplayer world model. Ten synchronized views of one shared world is the part nobody else has.
  • Train your own bots. 195M steps of state → action pairs, with who-hit-whom damage labels.
  • Study a game from the inside. Movement, aim, engagement geometry, all at tick precision.
  • Point it at another game. The pipeline is described step by step; the recipe carries over to any Source title you hold the licence to (or all of them, if you are Valve).

Parquet + MP4, no pre-made splits. State data CC BY 4.0; video for non-commercial research. It lands on Hugging Face; this link becomes the dataset itself the day it goes up.

dataset spec get it on hugging face

FAQ

Why bots and not human players?

Control and scale. We pick the map, the rules and the player count, and servers run around the clock. Expert bots move and fight plausibly enough to teach a model the physics, the map and the combat.

Why Counter-Strike?

Source games record complete demos by design, replay them deterministically, and can re-render any player's view after the fact. That is what makes ten aligned POVs per match possible. And if it has to be a Source game, it might as well be CS.

What exactly is in the data?

Per 16 Hz step: actions, poses, health, weapons and damage events for all ten players, plus 256×256 first-person video for the rendered subset. See the dataset spec.

Can I use it commercially?

Our part, yes: the game-state tables, the alignment metadata and the code are CC BY 4.0, so use them for anything, commercial included, as long as you credit Vortech. The videos are different: they show Counter-Strike: Global Offensive, which belongs to Valve, so we share them for non-commercial research only. Commercial use of the footage needs a licence from Valve, unless you are Valve.

What about Valve?

Counter-Strike is Valve’s, and we are not affiliated with them. The servers, the bots’ matches and the pipeline are ours; the game you see in the footage is theirs. That is why the video is for non-commercial research only, and why anything Valve asks us to take down comes down, no questions asked.

When is the model coming out?

It'll be done when it's done. No date.

Who is behind this?

Three people. Meet the team.

I need more, or a different game.

Then we should probably talk, especially if it is your game. hello@vor.tech