Skip to content

Add GR00T N1.7 DROID support to split-GPU evaluation - #1362

Draft
TuurStuyck wants to merge 6 commits into
release/0.3.0from
TuurStuyck/feature/gr00t-n17
Draft

TuurStuyck wants to merge 6 commits into
release/0.3.0from
TuurStuyck/feature/gr00t-n17

Conversation

@TuurStuyck

@TuurStuyck TuurStuyck commented Oct 3, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

Add GR00T N1.7 to split-GPU evaluation

Detailed description

  • Includes both commits from Add GB300 policy compatibility tooling #1251 unchanged, branching from the same original base ed0fd12be862078be316c73eb7cf423ba9b1c5cd; targets release/0.3.0 and remains a draft.
  • Add a pinned N1.7-DROID server/runtime for GB300 and an Arena adapter for its message format, base-frame end-effector pose, normalized gripper state, and 40-action predictions. Preserve the existing N1.6 setup.
  • Add a documented, seeded three-episode experiment using isaaclab_arena_environments/robolab/tasks/clamp_in_right_bin.yaml with its original 70-second horizon and success criteria.
  • Validation: 18 targeted tests, local pre-commit hooks, and the full Sphinx HTML build with warnings treated as errors pass. The docs heading warning reported by the initial CI run is fixed.
  • Real local evaluation used the GB300 for N1.7 inference and RTX PRO 4000 for simulation through 127.0.0.1:5557: all 3 episodes / 3,150 steps completed without runtime errors; 0/3 task successes and 0% object-moved rate. The integration runs, but this checkpoint did not solve the clamp task. Local report/logs: outputs/gr00t_n1d7_clamp_evaluation_v2/.

xyao-nv and others added 4 commits September 12, 2026 04:39
Signed-off-by: Xinjie Yao <xyao@nvidia.com>
Allow the OpenPI launcher to select a GPU and opt into the existing
CUDA 13 compatibility helpers, with configurable JAX memory settings.
Use the prepared interpreter and source import path without restoring
CUDA 12 pins.

Remove the named NVIDIA runtime requirement so the Arena container can
use Docker GPU support with the configured default runtime.

Validated RTX simulation and GB300 Pi05 inference over three complete
episodes, plus a fresh CUDA 13 GPU probe and all pre-commit hooks.

Signed-off-by: Tuur Stuyck <tstuyck@gmail.com>
Signed-off-by: Tuur Stuyck <tstuyck@gmail.com>
Signed-off-by: Tuur Stuyck <tstuyck@gmail.com>
@TuurStuyck TuurStuyck changed the title Add GR00T N1.7 to split-GPU policy evaluation Add GR00T N1.7 DROID support to split-GPU evaluation Oct 3, 2026
Signed-off-by: Tuur Stuyck <tstuyck@gmail.com>
Bind a local grey PreviewSurface material because the asset references unavailable MDL and texture files. Preserve its geometry, scale, and physics properties.

Signed-off-by: Tuur Stuyck <tstuyck@gmail.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants