Skip to content

Draft tracker: split Franka core migration - #7829

Closed
maxkra15 wants to merge 1 commit into
isaac-sim:developfrom
maxkra15:maximiliank/franka-core-asset-fix
Closed

maxkra15 wants to merge 1 commit into
isaac-sim:developfrom
maxkra15:maximiliank/franka-core-asset-fix

Conversation

@maxkra15

@maxkra15 maxkra15 commented Sep 15, 2026 •

Copy link
Copy Markdown
Contributor

Superseded by four focused draft PRs against develop:

  1. Remove unsupported Franka Reorient task #8168 — Remove unsupported Franka Reorient.
  2. Make flat Franka the main config and fix backend body resolution #8169 — Add the opt-in flat Franka asset config and backend body resolution.
  3. Migrate Franka tasks to the shared asset and add minimal presets #8170 — Migrate Reach, Drawer, and relevant contributed tasks (depends on Make flat Franka the main config and fix backend body resolution #8169).
  4. Improve Franka Lift resets and continuous Reach tracking #8171 — Migrate rigid/deformable Lift and reset/ADR fixes (depends on Remove unsupported Franka Reorient task #8168 and Make flat Franka the main config and fix backend body resolution #8169).

Each PR selects the active-release backport checkbox. Review and merge prerequisites first; then rebase the dependent PRs. The public-S3 flat asset and checkpoint qualification remain separate merge gates. Camera checkpoints are out of scope.

Do not merge this original combined diff.

@github-actions github-actions Bot added bug Something isn't working asset New asset feature or request labels Sep 15, 2026
Comment thread source/isaaclab/isaaclab/envs/mdp/actions/task_space_actions.py Outdated
Comment thread source/isaaclab/isaaclab/envs/mdp/actions/actions_cfg.py Outdated
Comment thread source/isaaclab/isaaclab/envs/mdp/actions/task_space_actions.py Outdated
Comment thread source/isaaclab/test/envs/test_diffik_action_processing.py Outdated
Comment thread source/isaaclab_assets/test/test_franka_cfg.py Outdated
Comment thread source/isaaclab_tasks/isaaclab_tasks/core/lift/mdp/rewards.py Outdated
Comment thread source/isaaclab_tasks/isaaclab_tasks/core/lift/mdp/terminations.py
Comment thread source/isaaclab_tasks/test/core/test_franka_shared_asset_presets.py Outdated
@maxkra15

Copy link
Copy Markdown
Contributor Author

run-ci

@isaaclab-bot isaaclab-bot Bot added ci:run-docker Trigger the on-demand Docker and GPU CI workflow and removed ci:run-docker Trigger the on-demand Docker and GPU CI workflow labels Sep 18, 2026
@greptile-apps

greptile-apps Bot commented Sep 18, 2026 •

Copy link
Copy Markdown
Contributor

RetriggerConfidence Score: 5/5

The PR appears safe to merge; no new findings were introduced since the previous review, and all previous findings are manually resolved.

Summary

Restores the core Franka task contracts around a shared flat Menagerie asset.

  • Makes the flat multi-physics Franka asset canonical while retaining an explicit legacy configuration.
  • Selects backend-specific physics payloads and configurable collision variants across PhysX and Newton.
  • Aligns actuator, mimic-finger, frame-transformer, controller, reset-clearance, and solver behavior.
  • Adds affine differential-IK action offsets and Reorient training bootstrap behavior.
  • Updates affected core tasks, contrib configurations, demos, tests, and changelog fragments.

Diagram

%%{init: {'theme': 'neutral'}}%%
flowchart LR
  Shared[Canonical flat Franka asset] --> Variants{Physics payload}
  Variants -->|physx| PhysX[PhysX backend]
  Variants -->|mujoco| Newton[Newton backend]
  Shared --> Colliders{Collider preset}
  Colliders --> Gripper[gripper_only default]
  Colliders --> Arm[primitive or convex arm contacts]
  PhysX --> Tasks[Reach / Lift / Reorient / Cabinet]
  Newton --> Tasks
  Shared --> Frames[Frame-transformer resolution]
  Frames --> Tasks
  Shared --> Actuators[Unified arm and mimic-finger contract]
  Actuators --> Tasks
Loading

Reviews (3) · Last reviewed commit: "Bootstrap Franka Reorient training"

Comment thread source/isaaclab_assets/isaaclab_assets/robots/franka.py Outdated
Comment thread source/isaaclab_assets/isaaclab_assets/robots/franka.py Outdated
Comment thread source/isaaclab_tasks/isaaclab_tasks/core/lift/mdp/terminations.py Outdated

@isaaclab-review-bot isaaclab-review-bot Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Isaac Lab Review Bot

The canonical Franka asset migration is coherent across backend variants, task presets, DiffIK affine actions, and nested-body frame resolution, but it introduces one likely runtime failure in Lift/Reorient termination handling and two public-configuration compatibility issues that should be resolved before merge.

  • Design and architecture: Using one flat Franka asset with explicit Physics and Colliders variants is consistent across the core tasks. However, deriving the unrelated Robotiq configuration from the new canonical config silently changes its inherited self-collision setting from enabled to disabled; that configuration should explicitly preserve its prior contract or derive from the legacy base.
  • API: The new DifferentialInverseKinematicsActionCfg.offset is backward compatible because its zero default preserves existing action processing. In contrast, FRANKA_PANDA_CFG changes its actuator dictionary keys from panda_shoulder/panda_forearm to panda_arm and adds a passive-finger group. Existing consumers indexing the old public keys will fail, so the assets changelog needs to mark the compatibility change clearly and provide concrete migration guidance.
  • Implementation: The frame-transformer filtering, collider selection, and OSC actuator-property propagation align with their consumers. The Lift out_of_bound term now passes root_pos_w, root_quat_w, and root_vel_w wrappers directly to torch.isfinite and tensor comparisons, unlike the prior and neighboring code that unwraps them through .torch; all three reads should use the tensor accessor.

Significant concerns. Posted 3 actionable findings inline.

Automated review; human maintainers own approval decisions.

Comment thread source/isaaclab_tasks/isaaclab_tasks/core/lift/mdp/terminations.py Outdated
Comment thread source/isaaclab_assets/isaaclab_assets/robots/franka.py Outdated
Comment thread source/isaaclab_assets/isaaclab_assets/robots/franka.py Outdated
@maxkra15

Copy link
Copy Markdown
Contributor Author

run-ci

@isaaclab-bot isaaclab-bot Bot added ci:run-docker Trigger the on-demand Docker and GPU CI workflow and removed ci:run-docker Trigger the on-demand Docker and GPU CI workflow labels Sep 18, 2026
@greptile-apps

greptile-apps Bot commented Sep 22, 2026

Copy link
Copy Markdown
Contributor

Want your agent to iterate on Greptile's feedback? Try greploops.

@maxkra15 maxkra15 changed the title Restore Franka core tasks on the shared Menagerie asset Restore Franka core tasks on the canonical flat asset Sep 23, 2026
@maxkra15

Copy link
Copy Markdown
Contributor Author

run-ci

@isaaclab-bot isaaclab-bot Bot removed the ci:run-docker Trigger the on-demand Docker and GPU CI workflow label Sep 29, 2026
@maxkra15
maxkra15 force-pushed the maximiliank/franka-core-asset-fix branch from afdc00d to fcf43ad Compare September 29, 2026 09:33
@maxkra15

Copy link
Copy Markdown
Contributor Author

run-ci

@isaaclab-bot isaaclab-bot Bot added ci:run-docker Trigger the on-demand Docker and GPU CI workflow and removed ci:run-docker Trigger the on-demand Docker and GPU CI workflow labels Sep 29, 2026
@maxkra15

Copy link
Copy Markdown
Contributor Author

@isaaclab-review-bot review

isaaclab-review-bot[bot]

This comment was marked as outdated.

@maxkra15
maxkra15 force-pushed the maximiliank/franka-core-asset-fix branch from fcf43ad to 2ccf10e Compare September 29, 2026 11:27
@maxkra15

Copy link
Copy Markdown
Contributor Author

run-ci

@isaaclab-bot isaaclab-bot Bot added ci:run-docker Trigger the on-demand Docker and GPU CI workflow and removed ci:run-docker Trigger the on-demand Docker and GPU CI workflow labels Sep 29, 2026
@maxkra15
maxkra15 force-pushed the maximiliank/franka-core-asset-fix branch from 2ccf10e to 937e51c Compare September 29, 2026 11:39
@maxkra15

Copy link
Copy Markdown
Contributor Author

run-ci

@maxkra15

Copy link
Copy Markdown
Contributor Author

Superseded by #8168, #8169, #8170, and #8171. Each targets develop with active-release backport selected.

@maxkra15 maxkra15 closed this Sep 29, 2026
kellyguo11 pushed a commit that referenced this pull request Sep 30, 2026
## Description

Remove the unsupported `Isaac-Reorient-Franka` task registration,
configuration, example, and browser entry. This is the requested
breaking removal; downstream users who still need it must keep a local
copy or migrate to a maintained reorientation task.

This is part 1 of the split of #7829 and is independently reviewable.

## Validation

- `test_lift_env_cfg.py`: 12 passed
- `uv run --frozen isaaclab -f`: passed
- Generated environment browser and changelog checks: passed

## Release backport

- [x] <!-- backport-active-release --> Backport this pull request to the
active release branch after it merges into `develop`
isaaclab-bot Bot pushed a commit that referenced this pull request Sep 30, 2026
## Description

Remove the unsupported `Isaac-Reorient-Franka` task registration,
configuration, example, and browser entry. This is the requested
breaking removal; downstream users who still need it must keep a local
copy or migrate to a maintained reorientation task.

This is part 1 of the split of #7829 and is independently reviewable.

## Validation

- `test_lift_env_cfg.py`: 12 passed
- `uv run --frozen isaaclab -f`: passed
- Generated environment browser and changelog checks: passed

## Release backport

- [x] <!-- backport-active-release --> Backport this pull request to the
active release branch after it merges into `develop`

(cherry picked from commit a1b7e56)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

asset New asset feature or request bug Something isn't working documentation Improvements or additions to documentation isaac-mimic Related to Isaac Mimic team

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

5 participants