ECCV 2026

One physical twin. Many parallel rollouts. One GPU.

Boba: Batched Simulation for Physics-Based Gaussian Digital Twins

1 University of Illinois Urbana-Champaign 2 Columbia University 3 Meta Reality Labs Research

Boba co-designs physics, Gaussian deformation, and rendering for batched execution—turning one reconstructed deformable object into many independent, high-fidelity simulation rollouts.

Boba overview showing a physical digital twin, many batched simulations, XR and robot-manipulation applications, and accuracy, throughput, and latency results.
Efficient and high-throughput physical digital twins. Boba preserves simulation fidelity while accelerating single-instance execution and scaling many independent rollouts on one GPU.

>10×

single-instance speedup

over PhysTwin on embedded and desktop GPUs

16.2×

aggregate throughput

over optimized single-instance execution on RTX 4090

13.2×

lower XR latency

Boba-Distributed versus PhysTwin on Orin

26×–>2,000×

faster predictive control

from rope to matched self-collision cloth planning*

Overview

High-fidelity twins should scale like simulations.

Existing Gaussian physical twins deliver realistic appearance and dynamics, but execute one instance at a time. Boba makes parallel rollouts a first-class systems problem.

Abstract

Digital twins replicate the appearance and physical behavior of real-world objects for interactive simulation in XR, robotics, and gaming. While neural representations such as 3D Gaussians enable high-fidelity twins reconstructed from images, existing systems simulate only one instance at a time and barely reach real-time performance, making large-scale rollout evaluation impractical.

We present Boba, the first batched simulator for physics-based Gaussian digital twins. Boba separates the static twin template from dynamic simulation state and co-designs physics, deformation, and rendering/visualization for batched execution. Compact surrogate spring–mass models, mixed-precision Gaussian skinning, memory-efficient execution, and shared-memory-aware batching reduce compute, memory traffic, and synchronization overhead.

Boba achieves over 10× single-instance speedup on XR-class hardware, scales to 3,310 FPS on RTX 4090, and substantially accelerates predictive control for deformable-object manipulation—supporting both power-constrained XR and scalable robot planning.

Method

A model–system co-design from physics to pixels.

Boba optimizes the complete digital-twin path and adds batching-aware memory layouts and scheduling where conventional process replication breaks down.

Boba architecture diagram separating shared assets from per-worker physical state and digital twin simulators, alongside single-instance optimizations.
Shared static assets feed independent workers, while the optimized single-instance path accelerates simulation, deformation, and visualization.
01

Compact physics

Surrogate spring–mass models reproduce dense-system behavior with substantially less compute and memory.

02

Efficient deformation

Mixed-precision Gaussian skinning and memory-traffic-aware execution accelerate per-frame updates.

03

Template sharing

Static twin assets are stored once while each simulation retains an independent dynamic state.

04

Contention-free batching

Shared-memory-aware layouts and atomic-free scheduling turn GPU capacity into sustained throughput.

Deployment variants

Three configurations. One optimized core.

Supplemental Figure 8 comparing Boba-Local, Boba-Distributed, and Boba-Batched deployment pipelines.
Supplemental Fig. 8 — Boba system variants. Boba-Local keeps the full pipeline on one machine; Boba-Distributed splits simulation and skinning from edge rendering; Boba-Batched executes many independent states in one GPU pipeline.
01

Boba-Local

Complete single-instance execution on an edge device or workstation. On XR-class Orin, it reaches 30.8 FPS at 32.5 ms—a 10.2× latency improvement over PhysTwin.

02

Boba-Distributed

Server simulation and skinning with edge rendering. On XR-class Orin, it achieves 39.8 FPS at 25.1 ms—a 1.3× latency improvement and 22.2% lower device dynamic power than Boba-Local.

03

Boba-Batched

A shared GPU pipeline over many independent states. On RTX 4090, it reaches 3,309.9 FPS aggregate throughput—16.2× optimized single-instance execution on the same GPU.

Results

Fast locally. Power-efficient at the edge. Scalable in batches.

Boba-Distributed gives the best XR edge latency–power trade-off, Boba-Local maximizes raw single-instance desktop speed, and Boba-Batched maximizes aggregate throughput.

3,309.9

FPS

Boba-Batched on RTX 4090

Average of the best sustained aggregate throughput over full runs across evaluated scenarios.

39.8

FPS · 25.1 ms

Boba-Distributed for XR

1.3× latency improvement over Boba-Local on XR-class Orin, reducing end-to-end latency from 32.5 ms to 25.1 ms.

−22.2%

Device dynamic power

Boba-Distributed on XR-class Orin

4.76 W versus 6.11 W for Boba-Local on the same edge device.

204.5

FPS

Boba-Local on RTX 4090

12.1× faster than the same-hardware PhysTwin baseline.

30.8

FPS

Boba-Local on XR-class Orin

Real-time local execution at an approximately 15 W embedded compute budget.

Throughput chart showing gains from Boba optimizations through batched execution.
System throughput. Single-instance optimization establishes a fast base; batched execution scales it to thousands of frames per second. Click to enlarge.
Latency and incremental-power comparison across PhysTwin, Boba-Local, and Boba-Distributed configurations.
Deployment trade-offs. Boba-Distributed reaches 25.1 ms while reducing device dynamic power to 4.76 W. Click to enlarge.

Fidelity

Acceleration without abandoning the twin.

Across the full recorded interaction, Boba remains visually consistent with real observations and the PhysTwin baseline.

Choose one of the 21 cases in the original benchmark.

8 of 21 cases

Double lift — sloth

Qualitative results. Explore 21 cases from the original benchmark. Each synchronized clip compares the real observation, PhysTwin, and Boba throughout the interaction.

Applications

Planning, interaction, and learning.

The main paper and supplement demonstrate Boba across robot planning, immersive XR interaction, and reinforcement learning.

Immersive XR · Supplement

A complete interactive 3D application.

A Quest 3 user manipulates a simulated Gaussian physical twin inside a stereo reconstructed scene. The workstation handles simulation, skinning, rendering, composition, and application logic while streaming the composed views to the headset.

Download demo video

Cloth planning

Target and execution
Target cloth configuration for model-based motion planning.
Target
Robot view
Third-person view

Rope planning

Target and execution
Target rope configuration for model-based motion planning.
Target
Robot view
Third-person view

Model-based motion planning · Main + supplement

26×

faster rope predictive control

The supplement shows cloth and rope plans from both robot and third-person views. Parallel rollouts reduce the wall time of PhysTwin-based model predictive control; the paper also reports more than 16× for cloth without self-collision and an estimated greater-than-2,000× speedup with self-collision enabled.

Read the application study
MPC rollout target Chamfer Distance plotted against planning time for Boba and PhysTwin.

MPC accuracy · Supplement

More rollouts without losing planning accuracy.

Boba matches full-PhysTwin rollout target CD in substantially less planning time; under the same time budget, PhysTwin evaluates fewer rollouts and yields higher target error.

PPO reinforcement-learning plots showing wall-clock interactions, reward, and success for Boba and PhysTwin on rope reaching.

RL training · Supplement

Higher-throughput learning from the same task.

Under identical PPO settings, Boba produces more interactions per wall-clock time and reaches higher reward and success earlier on the rope-reaching task.

Boba, Yihan's cat, resting in a woven basket with one paw stretched downward.

Meet Boba

The cat behind the name.

Boba is Yihan’s cat and has supervised him throughout this project.

Resources

Paper, implementation, and citation.

BibTeX

Cite Boba

@inproceedings{pang2026boba,
  title     = {Boba: Batched Simulation for Physics-Based Gaussian Digital Twins},
  author    = {Pang, Yihan and Jiang, Hanxiao and Kondguli, Sushant and
               Adve, Sarita and Wang, Shenlong},
  booktitle = {European Conference on Computer Vision (ECCV)},
  year      = {2026}
}

* The greater-than-2,000× cloth result is an estimate reported for matched self-collision; see the paper for protocol and qualification.