mirror of
https://github.com/microsoft/SkillOpt.git
synced 2026-07-07 16:49:08 +08:00
9fcf5868c3
A nightly sleep cycle could run for weeks emitting held-out 0.0 -> 0.0 (gate reject, zero edits), indistinguishable from "nothing to learn", when the real cause was the codex backend returning an error (expired auth / model unsupported on the account / outdated CLI) that got scored as a failed rollout. backend (CodexCliBackend): - split _call into _call_once + a retry wrapper: transient empties/timeouts are retried instead of silently returning "" (mirrors AzureOpenAIBackend's guard); - on a non-zero exit, surface the reason via last_call_error and return "" rather than leaking the CLI error text as if it were a model response; - fail fast (no retries) on fatal auth/model/version errors (401, refresh_token_reused, token_expired, "not supported when using Codex with a ChatGPT account", "requires a newer version of Codex"). backend (CliBackend.reflect): retain last_reflect_raw so a no-edits night is diagnosable. consolidate: ConsolidationResult now carries per-task held-out detail (response, hard/soft, fail_reason) + reflect_raw + call_error. cycle: write diagnostics.json per cycle so a 0.0 night self-explains instead of being a black box. tests: 4 new (retry-not-silent-zero, auth-error-surfaced-not-scored, holdout-detail, reflect-raw). Also gitignore the .skillopt-sleep/ runtime dir. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
64 lines
1.3 KiB
Plaintext
64 lines
1.3 KiB
Plaintext
__pycache__/
|
|
*.pyc
|
|
*.egg-info/
|
|
build/
|
|
dist/
|
|
site/
|
|
|
|
data/*
|
|
!data/README.md
|
|
!data/searchqa_id_split/
|
|
!data/searchqa_id_split/**
|
|
!data/livemathematicianbench_id_split/
|
|
!data/livemathematicianbench_id_split/**
|
|
!data/docvqa_id_split/
|
|
!data/docvqa_id_split/**
|
|
!data/officeqa_id_split/
|
|
!data/officeqa_id_split/**
|
|
!data/spreadsheetbench_id_split/
|
|
!data/spreadsheetbench_id_split/**
|
|
!data/alfworld_path_split/
|
|
!data/alfworld_path_split/**
|
|
outputs/
|
|
logs/
|
|
external/
|
|
# SkillOpt-Sleep runtime state (staging proposals, config, diagnostics, cron logs)
|
|
.skillopt-sleep/
|
|
|
|
/BabyVision/
|
|
/MMRB/
|
|
/SpreadsheetBench/
|
|
/dl4ir-searchQA/
|
|
|
|
configs/local/
|
|
configs/**/*.local.yaml
|
|
*.local.md
|
|
*.secret.md
|
|
*.bak
|
|
|
|
.env
|
|
.secrets/
|
|
.codex_azure*/
|
|
|
|
# Internal docs (not for open-source release)
|
|
docs/ablation_plan.md
|
|
docs/ablation_paper_tables.md
|
|
docs/ablation_paper_tables.html
|
|
docs/experiment_commands.md
|
|
docs/slow_update_flowchart.md
|
|
docs/session_memory.md
|
|
docs/harness_fresh_machine_handoff.md
|
|
docs/harness_monitoring_memory.md
|
|
docs/harness_reproduction_secrets.secret.md
|
|
docs/reflact_conda_env_export.yml
|
|
docs/reflact_overview.html
|
|
docs/render_ablation_paper_tables.py
|
|
docs/让*
|
|
.gradio/
|
|
.venv
|
|
|
|
# Local experiment launchers — contain machine-specific endpoints/identities, never commit
|
|
tests/run_*.sh
|
|
tests/launch_*.py
|
|
*.launch.log
|