Yifan Yang 6f1351edb9 feat(sleep): 3-way train/val/test split + gate_mode on|off ...

Data-split refactor (the anti-overfitting foundation the user asked for):
  - TaskRecord gains split∈{train,val,test} and origin∈{real,dream}.
  - assign_splits: real tasks deterministically split into val/test (disjoint);
    DREAM-augmented tasks (origin='dream') NEVER enter val/test — they only go to
    train. val gates updates; test is the final held-out measure.
  - gbrain loader maps its held-out.jsonl -> test, benchmark.jsonl -> train/val,
    so the gbrain held-out stays the true final score.
  - consolidate(): train drives reflect, val gates; adds gate_mode='off' (greedy,
    no hard filter) reporting val movement (greedy_improved/regressed/flat).
  - run_gbrain/transfer/experiment score on test (val fallback); run_gbrain gains
    --gate on|off. Legacy replay/holdout names normalized.

New test proves dream tasks never land in val/test. 21 tests pass; mock
experiment + gate=off both green.

Co-Authored-By: Claude Opus 4 <noreply@anthropic.com>

2026-06-08 14:31:51 +00:00

..

__init__.py

test: add unit test suite for core utility modules

2026-06-01 02:04:22 +08:00

test_json_utils.py

test: add unit test suite for core utility modules

2026-06-01 02:04:22 +08:00

test_qwen_backend.py

fix(model): forward Qwen timeout and only set enable_thinking when true

2026-06-07 07:41:35 -07:00

test_scoring.py

test: add unit test suite for core utility modules

2026-06-01 02:04:22 +08:00

test_sleep_engine.py

feat(sleep): 3-way train/val/test split + gate_mode on|off

2026-06-08 14:31:51 +00:00

test_types.py

test: add unit test suite for core utility modules

2026-06-01 02:04:22 +08:00