mirror of
https://github.com/microsoft/SkillOpt.git
synced 2026-07-06 16:05:12 +08:00
4a1b984d87
- Rename teacher -> optimizer, student -> target across all code, configs, docs, prompts - CLI: --teacher_model -> --optimizer_model, --student_model -> --target_model - Remove best_skill files, keep only initial skills - Fix slow update gate (force write into skill) - Fix SLOW_UPDATE marker stripping - Remove deep_reflect and meta_reflect mechanisms - Update .env.example with export prefix and azure_cli docs - Add endpoint empty validation in azure_openai.py Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
73 lines
3.4 KiB
Markdown
73 lines
3.4 KiB
Markdown
# Configuration Reference
|
|
|
|
Complete reference for all SkillOpt configuration parameters.
|
|
|
|
## Model
|
|
|
|
| Parameter | Type | Default | Description |
|
|
|---|---|---|---|
|
|
| `model.backend` | str | `azure_openai` | Backend: `azure_openai` / `openai_chat` / `claude_code_exec` / `qwen` |
|
|
| `model.optimizer` | str | `gpt-5.5` | Optimizer model (for reflection & slow update) |
|
|
| `model.target` | str | `gpt-5.5` | Target model (for rollout execution) |
|
|
| `model.reasoning_effort` | str | `medium` | Reasoning effort level |
|
|
|
|
## Training (`train`)
|
|
|
|
| Parameter | Type | Default | DL Analogy | Description |
|
|
|---|---|---|---|---|
|
|
| `train.num_epochs` | int | 4 | Epochs | Number of training epochs |
|
|
| `train.batch_size` | int | 40 | Batch size | Tasks sampled per step |
|
|
| `train.accumulation` | int | 1 | Gradient accumulation | Accumulation rounds per step |
|
|
| `train.seed` | int | 42 | Random seed | Reproducibility seed |
|
|
|
|
## Gradient / Reflection (`gradient`)
|
|
|
|
| Parameter | Type | Default | Description |
|
|
|---|---|---|---|
|
|
| `gradient.minibatch_size` | int | 8 | Reflect minibatch size |
|
|
| `gradient.merge_batch_size` | int | 8 | Patch merge batch size |
|
|
| `gradient.analyst_workers` | int | 16 | Parallel reflection workers |
|
|
| `gradient.max_analyst_rounds` | int | 3 | Max rounds of analyst reflection |
|
|
| `gradient.failure_only` | bool | `false` | Only reflect on failures |
|
|
|
|
## Optimizer (`optimizer`)
|
|
|
|
| Parameter | Type | Default | DL Analogy | Description |
|
|
|---|---|---|---|---|
|
|
| `optimizer.learning_rate` | int | 4 | Learning rate | Max edit patches per step (edit budget) |
|
|
| `optimizer.min_learning_rate` | int | 2 | Min LR | Min edits for decay schedulers |
|
|
| `optimizer.lr_scheduler` | str | `cosine` | LR schedule | `constant` / `linear` / `cosine` / `autonomous` |
|
|
| `optimizer.skill_update_mode` | str | `patch` | — | `patch` / `rewrite_from_suggestions` / `full_rewrite_minibatch` |
|
|
| `optimizer.use_slow_update` | bool | `true` | Momentum | Epoch-boundary longitudinal comparison & guidance |
|
|
| `optimizer.slow_update_samples` | int | 20 | — | Samples for slow update evaluation |
|
|
| `optimizer.use_meta_skill` | bool | `true` | Meta-learning | Cross-epoch optimizer-side strategy memory |
|
|
| `optimizer.longitudinal_pair_policy` | str | `mixed` | — | `mixed` / `changed` / `unchanged` |
|
|
|
|
## Evaluation (`evaluation`)
|
|
|
|
| Parameter | Type | Default | Description |
|
|
|---|---|---|---|
|
|
| `evaluation.use_gate` | bool | `true` | Enable validation gating (accept/reject updates) |
|
|
| `evaluation.eval_test` | bool | `true` | Run test evaluation after training |
|
|
|
|
## Environment (`env`)
|
|
|
|
| Parameter | Type | Default | Description |
|
|
|---|---|---|---|
|
|
| `env.name` | str | — | Benchmark name (e.g., `searchqa`, `docvqa`) |
|
|
| `env.data_path` | str | — | Path to dataset |
|
|
| `env.skill_init` | str | — | Path to initial seed skill (optional) |
|
|
| `env.split_mode` | str | `ratio` | `ratio` or `split_dir` |
|
|
| `env.split_ratio` | str | `2:1:7` | Train:val:test ratio |
|
|
| `env.exec_timeout` | int | 120 | Per-task timeout in seconds |
|
|
| `env.out_root` | str | — | Output directory |
|
|
|
|
## Azure OpenAI Credentials
|
|
|
|
| Variable | Description |
|
|
|---|---|
|
|
| `AZURE_OPENAI_ENDPOINT` / `model.azure_openai_endpoint` | Azure resource endpoint |
|
|
| `AZURE_OPENAI_API_KEY` / `model.azure_openai_api_key` | Azure API key |
|
|
| `OPENAI_API_KEY` | OpenAI API key (for `openai_chat` backend) |
|
|
| `ANTHROPIC_API_KEY` | Anthropic API key (for `claude_code_exec` backend) |
|