mirror of
https://github.com/microsoft/SkillOpt.git
synced 2026-07-03 14:02:58 +08:00
- Skill optimization framework with training loop analogy - 11 benchmarks, 4 model backends (Azure OpenAI, Claude, Codex, Qwen) - WebUI for browser-based training control - Pluggable architecture for extending benchmarks and backends
72 lines
1.5 KiB
Markdown
72 lines
1.5 KiB
Markdown
# CLI Reference
|
|
|
|
## Training
|
|
|
|
```bash
|
|
python scripts/train.py --config <config.yaml> [overrides...]
|
|
```
|
|
|
|
### Arguments
|
|
|
|
| Argument | Description |
|
|
|---|---|
|
|
| `--config` | Path to YAML config file (required) |
|
|
| `key=value` | Override any config parameter |
|
|
|
|
### Examples
|
|
|
|
```bash
|
|
# Basic training
|
|
python scripts/train.py --config configs/searchqa/default.yaml
|
|
|
|
# With overrides
|
|
python scripts/train.py \
|
|
--config configs/searchqa/default.yaml \
|
|
--cfg-options optimizer.learning_rate=16 optimizer.lr_scheduler=linear
|
|
|
|
# With custom initial skill
|
|
python scripts/train.py \
|
|
--config configs/searchqa/default.yaml \
|
|
--cfg-options env.skill_init=skills/my_seed.md
|
|
```
|
|
|
|
## Evaluation
|
|
|
|
```bash
|
|
python scripts/eval_only.py --config <config.yaml> --skill <skill.md>
|
|
```
|
|
|
|
### Arguments
|
|
|
|
| Argument | Description |
|
|
|---|---|
|
|
| `--config` | Path to YAML config file (required) |
|
|
| `--skill` | Path to skill document to evaluate (required) |
|
|
| `--split` | Evaluation split: `test` (default), `valid`, `train` |
|
|
|
|
### Examples
|
|
|
|
```bash
|
|
# Evaluate best skill on test set
|
|
python scripts/eval_only.py \
|
|
--config configs/searchqa/default.yaml \
|
|
--skill outputs/searchqa/run_001/skills/best_skill.md
|
|
|
|
# Evaluate on validation set
|
|
python scripts/eval_only.py \
|
|
--config configs/searchqa/default.yaml \
|
|
--skill outputs/searchqa/run_001/skills/best_skill.md \
|
|
--split valid
|
|
```
|
|
|
|
## WebUI
|
|
|
|
```bash
|
|
python -m skillopt_webui.app [--port PORT] [--share]
|
|
```
|
|
|
|
| Argument | Default | Description |
|
|
|---|---|---|
|
|
| `--port` | 7860 | Port number |
|
|
| `--share` | false | Create public Gradio link |
|