[core] ci_entrypoint: fournos: don't crash in the resolve step by kpouget · Pull Request #267 · openshift-psap/forge

kpouget · 2026-09-24T07:31:59Z

crashes at this level are harder to troubleshoot (logs aren't captured in MLFlow)

Summary by CodeRabbit

Bug Fixes
- Fournos configuration resolution failures are now recorded with clearer error details, helping CI report what went wrong.
- Resolver pod logs are saved as CI artifacts when available, making failures easier to investigate.
- CI checks the Fournos job’s resolver status before continuing, so reported resolver errors are surfaced rather than overlooked.
Improvements
- Artifact export now uses the same lenient handling as configuration resolution.

openshift-ci · 2026-09-24T07:32:04Z

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign kpouget for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Details

Needs approval from an approver in each of these files:

OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

coderabbitai · 2026-09-24T07:32:07Z

Navigate logical layers of code changes, visualize relationships, and explore their blast radius.

Note

Currently processing new changes in this PR. This may take a few minutes, please wait...

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Advanced

Run ID: d7dfc285-3d08-41c6-b81a-6eeeaf0d6bff

📥 Commits

Reviewing files that changed from the base of the PR and between 0e74f89 and caec1f3.

📒 Files selected for processing (3)

projects/core/ci_entrypoint/fournos.py
projects/core/ci_entrypoint/fournos_resolve.py
projects/core/library/config.py

 ________________________________________________________________________
< Obi-Wan Kenobi has taught me well. I sense a disturbance in your code. >
 ------------------------------------------------------------------------
  \
   \   (\__/)
       (•ㅅ•)
       / 　 づ

✨ Finishing Touches

🧪 Generate unit tests (beta)

Create a new PR

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

_{Comment @coderabbitai help to get the list of available commands.}

…e FJob status

kpouget · 2026-09-24T07:40:09Z

/test fournos skel hellz

psap-forge-bot · 2026-09-24T07:42:42Z

🔴 Submission of skel hellz failed after 1 minute, 55 seconds 🔴

Error: FournosJobFailureError: FOURNOS Job 'forge-skel-20260924-074047' failed: Tasks Completed: 2 (Failed: 2, Cancelled 0), Skipped: 1

/test fournos skel hellz

kpouget · 2026-09-24T07:48:59Z

/test fournos skel hellz

psap-forge-bot · 2026-09-24T07:50:26Z

✅ Execution of skel | hellz completed with success after 0s ✅

forge-skel-20260924-074935 -- skel hellz

Execution Engine Configuration

clusterless: true
exclusive: false
executionEngine:
  forge:
    args:
    - hellz
    configOverrides: {}
    project: skel
owner: kpouget
pipeline: forge-test-only

MLFlow links

mlflow results

Pipeline Step Details

❓ 00__preflight `0 seconds` (🔴 25E)

📤 02__export-artifacts (🟡 1W)

🔒 Censoring Report
- 📊 25 files scanned
- ✅ Clean files: 25

psap-forge-bot · 2026-09-24T07:50:51Z

🔴 Submission of skel hellz failed after 1 minute, 15 seconds 🔴

Error: FournosJobFailureError: FOURNOS Job 'forge-skel-20260924-074935' failed: Tasks Completed: 2 (Failed: 1, Cancelled 0), Skipped: 1

/test fournos skel hellz

psap-forge-bot · 2026-09-24T07:58:44Z

✅ Execution of skel | hellz completed with success after 0s ✅

forge-skel-20260924-074935 -- skel hellz

Execution Engine Configuration

clusterless: true
exclusive: false
executionEngine:
  forge:
    args:
    - hellz
    configOverrides: {}
    project: skel
owner: kpouget
pipeline: forge-test-only

MLFlow links

mlflow results

Pipeline Step Details

❓ 00__preflight `0 seconds` (🔴 25E)

📤 02__export-artifacts (🟡 1W)

🔒 Censoring Report
- 📊 25 files scanned
- ✅ Clean files: 25

kpouget · 2026-09-24T08:02:45Z

/test fournos skel hellz

psap-forge-bot · 2026-09-24T08:04:12Z

✅ Execution of skel | hellz completed with success after 0s ✅

forge-skel-20260924-080323 -- skel hellz

Execution Engine Configuration

clusterless: true
exclusive: false
executionEngine:
  forge:
    args:
    - hellz
    configOverrides: {}
    project: skel
owner: kpouget
pipeline: forge-test-only

MLFlow links

mlflow results

Pipeline Step Details

❓ 00__preflight `0 seconds` (🔴 25E)

📤 02__export-artifacts (🟡 1W)

🔒 Censoring Report
- 📊 25 files scanned
- ✅ Clean files: 25

psap-forge-bot · 2026-09-24T08:04:51Z

🔴 Submission of skel hellz failed after 1 minute, 26 seconds 🔴

Error: FournosJobFailureError: FOURNOS Job 'forge-skel-20260924-080323' failed: Tasks Completed: 2 (Failed: 1, Cancelled 0), Skipped: 1

/test fournos skel hellz

…rst pipeline step

…ient config init

kpouget · 2026-09-24T08:06:10Z

/test fournos skel hellz

psap-forge-bot · 2026-09-24T08:07:35Z

✅ Execution of skel | hellz completed with success after 0s ✅

forge-skel-20260924-080649 -- skel hellz

Execution Engine Configuration

clusterless: true
exclusive: false
executionEngine:
  forge:
    args:
    - hellz
    configOverrides: {}
    project: skel
owner: kpouget
pipeline: forge-test-only

MLFlow links

mlflow results

Pipeline Step Details

❓ 00__preflight `0 seconds` (🔴 25E)

📤 02__export-artifacts (🟡 1W)

🔒 Censoring Report
- 📊 26 files scanned
- ✅ Clean files: 26

psap-forge-bot · 2026-09-24T08:08:10Z

🔴 Submission of skel hellz failed after 1 minute, 20 seconds 🔴

Error: FournosJobFailureError: FOURNOS Job 'forge-skel-20260924-080649' failed: Tasks Completed: 2 (Failed: 1, Cancelled 0), Skipped: 1

/test fournos skel hellz

openshift-ci · 2026-09-24T08:08:25Z

@kpouget: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name	Commit	Details	Required	Rerun command
ci/prow/fournos	`caec1f3`	link	true	`/test fournos`

Full PR test history. Your PR dashboard.

Details

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

kpouget · 2026-09-24T08:10:02Z

/test fournos skel

psap-forge-bot · 2026-09-24T08:12:28Z

✅ Execution of skel completed with success after 10s ✅

forge-skel-20260924-081058 -- skel

Execution Engine Configuration

clusterless: true
exclusive: false
executionEngine:
  forge:
    args: []
    configOverrides: {}
    project: skel
owner: kpouget
pipeline: forge-test-only

MLFlow links

mlflow results
- nested run load
- nested run smoke

Pipeline Step Details

✅ 00__preflight `1 second`

✅ 01__test `9 seconds`

📊 Test directory: 001__skeleton_seed_data_for_caliper_postprocessing/smoke
- Test completed successfully (cluster info disabled)
- test=skeleton, deep_testing=False, collect_cluster_info=False, scenario=smoke
- Duration test: 0.0s, benchmark: 0.0s
📊 Test directory: 001__skeleton_seed_data_for_caliper_postprocessing/load
- Test completed successfully (cluster info disabled)
- test=skeleton, deep_testing=False, collect_cluster_info=False, scenario=load
- Duration test: 0.0s, benchmark: 0.0s
✅ 002__postprocessing: ✔️ parse | ✔️ visualize | ✔️ artifacts_to_kpis | ✔️ kpis_to_mlflow | ⚪ dashboard_csv | ⚪ artifacts_to_ai_data | ✔️ s3_import | ✔️ analyse_kpis | ✔️ s3_export

📤 02__export-artifacts

🔒 Censoring Report
- 📊 126 files scanned
- ✅ Clean files: 126

✅ Post-processing Status /workspace/artifacts/01__test/002__postprocessing

✅ parse: success
✅ visualize: success
- 📄 reports/throughput_chart.html
- 📄 reports/summary_table.html
✅ artifacts_to_kpis: success
- 🌐 kpis.html
- 📄 kpis.json
✅ kpis_to_mlflow: success
⏭️ dashboard_csv: disabled
- kpi.dashboard_csv disabled
⏭️ artifacts_to_ai_data: disabled
- kpi.artifacts_to_ai_data disabled
✅ s3_import: success
✅ analyse_kpis: success
- 🌐 kpi_analyze.html
- 📊 kpi_analyze.json
- No regression in 4 KPIs
✅ s3_export: success
- 📤 Exported to: s3://psap-dashboard-data/smoke/skeleton-dashboard/26-09-24_081146_462/
- ✅ Uploaded files: 2

kpouget · 2026-09-24T08:12:43Z

looks good, merging

kpouget added 3 commits September 24, 2026 09:39

[core] ci_entrypoint: fournos_resolve: don't fail in the resolve step

ae8e30a

[core] ci_entrypoint: fournos: check_fjob_resolver_error()

17426ee

core] ci_entrypoint: fournos_resolve: save the resolve-pod name in th…

df18a0d

…e FJob status

kpouget force-pushed the resolv branch from 50a1a7e to 1f0ccb6 Compare September 24, 2026 07:39

kpouget force-pushed the resolv branch from 77d9a34 to 2701784 Compare September 24, 2026 08:02

kpouget added 2 commits September 24, 2026 10:05

[core] ci_entrypoint: fournos: capture the resolve pod logs in the fi…

510f49e

…rst pipeline step

[core] library: config: include the export-artifacts step for the len…

caec1f3

…ient config init

kpouget force-pushed the resolv branch from 2701784 to caec1f3 Compare September 24, 2026 08:06

kpouget merged commit c2c3cc8 into openshift-psap:main Sep 24, 2026
4 of 7 checks passed

kpouget deleted the resolv branch September 24, 2026 08:15

Conversation

kpouget commented Sep 24, 2026 • edited by coderabbitai Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary by CodeRabbit

Uh oh!

openshift-ci Bot commented Sep 24, 2026

Uh oh!

coderabbitai Bot commented Sep 24, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

kpouget commented Sep 24, 2026

Uh oh!

psap-forge-bot Bot commented Sep 24, 2026

Uh oh!

kpouget commented Sep 24, 2026

Uh oh!

psap-forge-bot Bot commented Sep 24, 2026

❓ 00__preflight 0 seconds (🔴 25E)

📤 02__export-artifacts (🟡 1W)

Uh oh!

psap-forge-bot Bot commented Sep 24, 2026

Uh oh!

psap-forge-bot Bot commented Sep 24, 2026

❓ 00__preflight 0 seconds (🔴 25E)

📤 02__export-artifacts (🟡 1W)

Uh oh!

kpouget commented Sep 24, 2026

Uh oh!

psap-forge-bot Bot commented Sep 24, 2026

❓ 00__preflight 0 seconds (🔴 25E)

📤 02__export-artifacts (🟡 1W)

Uh oh!

psap-forge-bot Bot commented Sep 24, 2026

Uh oh!

kpouget commented Sep 24, 2026

Uh oh!

psap-forge-bot Bot commented Sep 24, 2026

❓ 00__preflight 0 seconds (🔴 25E)

📤 02__export-artifacts (🟡 1W)

Uh oh!

psap-forge-bot Bot commented Sep 24, 2026

Uh oh!

openshift-ci Bot commented Sep 24, 2026

Uh oh!

kpouget commented Sep 24, 2026

Uh oh!

psap-forge-bot Bot commented Sep 24, 2026

✅ 00__preflight 1 second

✅ 01__test 9 seconds

📤 02__export-artifacts

Uh oh!

kpouget commented Sep 24, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

kpouget commented Sep 24, 2026 •

edited by coderabbitai Bot

Loading

coderabbitai Bot commented Sep 24, 2026 •

edited

Loading

❓ 00__preflight `0 seconds` (🔴 25E)

❓ 00__preflight `0 seconds` (🔴 25E)

❓ 00__preflight `0 seconds` (🔴 25E)

❓ 00__preflight `0 seconds` (🔴 25E)

✅ 00__preflight `1 second`

✅ 01__test `9 seconds`