worldlabs-mcp (v0.4.0)

MCP gateway to World Labs Marble + Spark 2.0. Generate navigable 3D worlds from text, images, panoramas, multi-view sets, or video; view them with a streaming Gaussian-splat renderer; and ground a voice agent in scene coordinates.

🚀 Quick Start

1. Setup: uv pip install -e ".[dev]"
2. Key: Set WORLDLABS_API_KEY environment variable (get one at https://platform.worldlabs.ai/api-keys).
3. Launch: python scripts/run_server.py

🏛️ Core Engines (v0.4.0)

• Marble (LWM): The Large World Model foundation. Generatively persistent reconstructed worlds with coordinate consistency.
• Spark 2.0 (Renderer): Hierarchical LoD splat trees with virtual GPU memory paging. Handles 100M+ primitives.
• Chisel (Geometry): Geometric distillation pipeline for extracting watertight physics proxies and triangular meshes from radiance fields.

💎 Features

Shipping

• Marble 1.1 + 1.1-plus world generation from text, image, multi-image, video, or local file upload.
• Spark 2.0 Spatial Engine — High-fidelity Gaussian-splat streaming (.rad / .spz) with hierarchical LoD and virtual GPU paging.
• Industrial Toolbox: Persistent Scene Baking (Persistence), Blender DCC Handshake, and Sovereign Art Gallery.
• Plex Cinema: Authenticated media streaming from plex-mcp to in-world 5.5m cinematic surfaces.
• Sovereign Command Console: Interactive 3D terminal with live CPU/MEM/VRAM hardware telemetry.
• World Portals: Seamless TORUS-frame world jumping with procedural "Latent Ripple" shaders.
• Spatial Voice Agent: Integrated WebAudio HRTF (Gemini 3.1 Flash TTS) for coordinate-grounded narration.

Under Refinement

• Automatic Grounding: Chisel-based raycast physics for complex imported Blender meshes.
• DCC Live Link: Real-time transformation sync between Blender and the Spark Viewer.

📚 Documentation

• 📥 Installation
• 🏗️ Architecture
• 🌐 World Modeling — spatial intelligence market context
• 🎙️ Spatial Voice & TTS — Gemini 3.1 Flash TTS + WebAudio HRTF
• 🥽 VR & WebXR
• ⚡ Spark 2.0 — LoD splat tree, .RAD streaming format

🛠️ Tools (16)

Group	Tool
generate	generate_world_from_text, generate_world_from_image, generate_world_from_multi_image, generate_world_from_video, generate_world_from_media_asset
upload	upload_and_generate, prepare_media_upload
poll	get_operation, wait_for_world
world	list_worlds, get_world
spatial	broadcast_spatial_notification, broadcast_spatial_audio, place_world_tv, spawn_agent_avatar
meta	worldlabs_help

🛡️ Quality

Ruff for Python, Biome for Web, Just for automation. Pytest + pytest-httpx for the Marble wrapper. FastMCP 3.2+ with Prefab UI for in-chat rich tool results.

---

MIT License • Maintained by sandraschi. Not affiliated with World Labs.