LocalGPT Verse

Now playing · Ember Flats

Every song imagines a world.

LocalGPT Verse is a desktop app that listens to your music and builds a living 3D world for every track — its tempo, its structure, and its mood, staged and performed entirely on your machine.

Get started → View on GitHub

What it does

A world assembled from the music itself

Point LocalGPT Verse at your music folder. It decodes each track, measures its tempo, beats, sections, energy, and mood — then raises a world that performs the song while it plays.

Heard, not uploaded

Every analysis runs on-device — tempo, a beat grid, section boundaries, an energy curve, and a mood — cached beside the app as a content-keyed sidecar. Your music folder is never written to, and nothing ever leaves the machine.

Worlds that perform

Ground props rise out of the terrain and settle on the first downbeat. Choruses shift energy and motion, the skyline traces the energy curve, and song-to-song crossfades land on the next track's section boundaries.

Explore or drift

Fly the world yourself with full 360° freedom, or hand the camera to Drift and let it glide through the arrangement on its own. One key trades one for the other.

Imagination tiers, optional

Opt in to a local CLAP model for zero-shot moods and embedding-ranked placement, or a small local LLM that authors world recipes — and even builds scenes entity-by-entity. Everything cached, never re-run.

Comfort first

Setup opens with a photosensitivity check, and the Comfort settings are real: Reduce flashing holds the glow steady, Gentler world motion damps the sway. Every effect passes through them.

Free inside

Apache-2.0 code, OFL fonts, and 171 CC0 Poly Haven models in 19 kinds — heroes, props, and ground cover with provenance tracked in a manifest, credited in-app.

The worlds

Eight moods, waiting for a song

The analysis lands each track in one of eight worlds along an energy–valence continuum. Each has its own palette, fog, ground, and way of arranging its props.

EMBER FLATSDawn chorus · warm ambers · clumped outcrops VELVET CIRCUITNeon surge · deep indigo · city grid TIDE GARDENSNight bloom · cool aqua · tidal terraces GLASS EXPANSEGlass runner · pale ice · crystal rings CINDER REACHSmoldering · driving, dark, restrained MIRAGE CIRCUITDaylight haze · driving, bright, restrained ABYSS TERRACESThe stillest water · calm, dark, quiet DAWN EXPANSEFirst light · calm, bright, hushed

Quick start

From clone to world in a minute

  1. Build and run. A stable Rust toolchain is all you need — no models, no services, no keys.
  2. Click through setup. Photosensitivity, controls, import — or press Enter to skip straight into a world.
  3. Choose your music folder. MP3, FLAC, WAV, OGG, M4A, and AIFF. The queue fills with your tracks and the first world rises on the first downbeat.
Read the docs → 
$ git clone https://github.com/localgpt-app/localgpt-verse.git
$ cd localgpt-verse
$ cargo run

# a window titled LocalGPT Verse opens —
# choose your music folder, and listen.