Issues

• [FEATURE] Framework-agnostic ToolSimulator: support non-Strands agents (LangChain / deepagents) via an adapter interface

  area-devxarea-simulationenhancementpythontriage
  Feature

  strands-agents/evals#487 · Filter by author ilnim opened on Oct 27, 2026

• [BUG] AssistantMessage is restored as UserMessage when a Session round-trips through JSON

  area-devxarea-tracingbug
  Bug

  strands-agents/evals#480 · Filter by author strandly-the-agent opened on Oct 26, 2026
  1

• [BUG] Red team strategies check structured_output is None but strands raises StructuredOutputException, so the attack errors and its transcript and trajectory are lost

  area-redteambugpythontriage
  Bug

  strands-agents/evals#477 · Filter by author yonib05 opened on Oct 24, 2026

• [FEATURE] Add PhoenixProvider to fetch agent traces from Arize Phoenix

  area-tracingenhancementpythontriage
  Feature

  strands-agents/evals#476 · Filter by author nsknojj opened on Oct 23, 2026

• [BUG] LangfuseProvider does not work with Langfuse v4 (SDK and events-only servers)

  area-tracingbug
  Bug

  strands-agents/evals#468 · Filter by author fbalicchia opened on Oct 21, 2026

• [FEATURE] Gherkin/BDD scenarios (.feature files) compiled to Cases and deterministic checks

  area-corearea-devxenhancement
  Feature

  strands-agents/evals#462 · Filter by author kevinlupera opened on Oct 20, 2026

• [Doc][P0] Documentation: usage guide and API reference

  area-communityenhancementpythontriage
  Feature

  strands-agents/evals#460 · Filter by author poshinchen opened on Oct 19, 2026

• [Doc][P0] README: cost formula, end-to-end recipe for config-defined agents

  area-communityenhancementpythontriage
  Feature

  strands-agents/evals#459 · Filter by author poshinchen opened on Oct 19, 2026

• [P0] CLI: strands-evals optimize

  area-clienhancementpythontriage
  Feature

  strands-agents/evals#458 · Filter by author poshinchen opened on Oct 19, 2026

• [P0] SkillLibrary marker: member-file text edits, materialized skills directory

  enhancementpythontriage
  Feature

  strands-agents/evals#457 · Filter by author poshinchen opened on Oct 19, 2026

• [P0] Default rollout with usage metering: trial-status taxonomy, usage metrics

  enhancementpythontriage
  Feature

  strands-agents/evals#456 · Filter by author poshinchen opened on Oct 19, 2026
  3

• [P0] Search layer: Block/Method/Schedule, TPE numeric search, TPE+CaseFrontier construction warning

  area-coreenhancementpythontriage
  Feature

  strands-agents/evals#455 · Filter by author poshinchen opened on Oct 19, 2026

• [P0] Objectives and constraints: Maximize/Minimize/WeightedSum, AtMost/AtLeast, metric-name registry

  area-coreenhancementpythontriage
  Feature

  strands-agents/evals#454 · Filter by author poshinchen opened on Oct 19, 2026

• [P0] Selection strategies: Selection protocol, Greedy default, CaseFrontier with admission, parent sampling, merge

  area-generatorsenhancementpythontriage
  Feature

  strands-agents/evals#453 · Filter by author poshinchen opened on Oct 19, 2026

• [P0] RewardFunction + RewardFunctionEvaluator widened to the full rollout record

  area-evaluatorsenhancementpythontriage
  Feature

  strands-agents/evals#452 · Filter by author poshinchen opened on Oct 19, 2026
  1

• [P0] Component optimization: component/choice/Float/Int/OneOf/TextValue, @tunable and inject= mounts, declaration-time probing Part 1

  enhancementpythontriage
  Feature

  strands-agents/evals#451 · Filter by author poshinchen opened on Oct 19, 2026
  

• [P0] Integration smoke test

  area-communityenhancementpythontriage
  Feature

  strands-agents/evals#450 · Filter by author poshinchen opened on Oct 19, 2026

• [P0] Optimizer loop: parent picked by the selection strategy, Budget hard stop, full lineage

  area-generatorsenhancementpythontriage
  Feature

  strands-agents/evals#449 · Filter by author poshinchen opened on Oct 19, 2026

• [P0] Acceptance v0: train/selection/holdout split with empty-split guards, admission, one challenger per iteration scored on the holdout, paired bootstrap, ties reject

  area-coreenhancementpythontriage
  Feature

  strands-agents/evals#448 · Filter by author poshinchen opened on Oct 19, 2026
  1

• [P0] Proposer v0: reflection from evaluator reasons, code-enforced guardrails

  area-generatorsenhancementpythontriage
  Feature

  strands-agents/evals#447 · Filter by author poshinchen opened on Oct 19, 2026

• [P0] Scoring integration: build_task contract, Experiment reuse, k repeated runs, candidate-scoped store

  area-coreenhancementpythontriage
  Feature

  strands-agents/evals#446 · Filter by author poshinchen opened on Oct 19, 2026

• [P0] Run persistence: run directory, lineage.jsonl (parent ids, admit/dominated/merge events, selection strategy), resume, budget accounting

  area-coreenhancementpythontriage
  Feature

  strands-agents/evals#445 · Filter by author poshinchen opened on Oct 19, 2026

• [P0] Candidate: content-addressed flat typed mapping, lineage, diff()

  area-coreenhancementpythontriage
  Feature

  strands-agents/evals#444 · Filter by author poshinchen opened on Oct 19, 2026
  1

• [P0] File-backed markers: FileText, JsonField, per-candidate workspace materialization

  area-coreenhancementpythontriage
  Feature

  strands-agents/evals#443 · Filter by author poshinchen opened on Oct 19, 2026

• [EPIC] Eval-driven Optimizer workflow

  area-coreenhancementpythontriage
  Feature

  strands-agents/evals#442 · Filter by author poshinchen opened on Oct 19, 2026
  1