mirror of
https://github.com/github/spec-kit.git
synced 2026-07-03 12:28:06 +08:00
* docs: add Spec Kit spec for agent-context full opt-in Use Spec Kit's own specify workflow to author the spec that makes the agent-context extension a full opt-in, removing all agent-context configuration/support from the Python codebase and removing the deprecation message. Force-added despite specs/ being gitignored; the generated artifact will be purged prior to merge. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * docs: add Spec Kit plan artifacts for agent-context full opt-in Phase 0/1 of the SDD plan workflow: plan.md, research.md, data-model.md, quickstart.md, and contracts/cli-behavior.md. Constitution Check is a documented no-op (repo has no ratified constitution). Force-added despite specs/ being gitignored; generated artifacts will be purged prior to merge. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * docs: correct Constitution Check against ratified v1.0.0 Earlier draft wrongly treated the gate as a no-op; the fork's main is 16 commits behind upstream/main, which carries .specify/memory/constitution.md. Re-evaluate the feature against Principles I-V (all PASS) and note that Principle I mandates keeping context_file as a declared class attribute, validating the R1 metadata decision. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * docs: refresh plan artifacts against synced upstream/main After syncing fork main to upstream and rebasing, re-scan the current agent-context surface. Upstream generalized the single context_file into a plural context_files concept with new resolver helpers (_resolve_context_files, _resolve_context_file_values, _format_context_file_values) and upsert/remove now loop over multiple files. Update research.md, data-model.md, contracts, quickstart grep guards, and the plan summary to cover the expanded removal scope. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * docs: add Spec Kit tasks for agent-context full opt-in Phase 2 of SDD: dependency-ordered tasks.md (30 tasks) organized by the three user stories, with mandatory test tasks (Constitution Principle II) and a foundational phase decoupling __CONTEXT_FILE__ resolution from the extension config. Includes the extension self-seeding task (T015) and a static guard test (T002) enforcing zero agent-context references in the CLI. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * feat!: remove agent-context lifecycle from the Specify CLI Make the agent-context extension a full opt-in. The CLI no longer installs the extension during init, writes agent-context-config.yml, or creates/updates/removes the managed Spec Kit section in agent context files. Context-section upsert/remove, marker resolution, extension-enabled gating, the config helpers, and the obsolete inline deprecation warning are all removed. Integration context_file stays as inert metadata; __CONTEXT_FILE__ now resolves from registry metadata. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * feat(agent-context): self-seed context file from the active integration When agent-context-config.yml has no context_file/context_files, the bundled bash and PowerShell update scripts now resolve the context file from the active integration in .specify/init-options.json via the integration registry, so the extension no longer depends on the CLI writing its config. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * test+docs: update suite and docs for agent-context opt-in Update integration/extension tests to expect no agent-context install, config, or context-section writes during init. Add a static guard test (test_agent_context_cli_free.py) asserting the CLI source is free of agent-context lifecycle symbols, plus backward-compatibility tests for legacy projects. Refresh AGENTS.md, the extension README, and add a CHANGELOG entry describing the opt-in behavior change. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * fix(agent-context): warn on self-seed failure, correct docs, speed up guard test Address PR review feedback: - Self-seed scripts (bash + PowerShell) now emit an actionable warning when an active integration is configured but specify_cli cannot be imported by the chosen Python (e.g. pipx installs), or when the integration declares no context file, instead of silently falling through to 'nothing to do'. - Correct the extension README disable note: command rendering never reads the extension config; __CONTEXT_FILE__ is always substituted from integration metadata, so a stale context_files value cannot affect rendering. - Cache CLI source reads in the static guard test via a module-scoped fixture so the directory walk happens once instead of once per forbidden symbol. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * feat(agent-context): ship self-owned per-agent context-file defaults The extension now bundles agent-context-defaults.json (key→context_file map) and self-seeds from it, dropping any dependency on the Specify CLI registry. Both the bash and PowerShell update scripts read the bundled JSON map keyed by the active integration from init-options.json. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * feat!: remove all agent-context state from the Specify CLI Strip every context_file reference from the CLI: the field on all 35 integration classes, the IntegrationBase plumbing (process_template param/step, _context_file_display, docstrings), the __CONTEXT_FILE__ resolution in agents.py, the legacy context_file/context_markers popping in _helpers.py, and the context_file template in integration_scaffold.py. Also drop the Agent context update step and __CONTEXT_FILE__ placeholder from templates/commands/plan.md. The agent-context extension now solely owns all context-file knowledge, including the per-agent default mapping. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * test: drop context_file coverage and guard against CLI reintroduction Remove CONTEXT_FILE attrs and context_file assertions across the base mixins, all 35 per-integration test files, shared integration tests, and conftest stubs. Rewrite the base-mixin context tests to assert no managed section is written and no __CONTEXT_FILE__ placeholder survives. Extend the CLI-free static guard to forbid context_file, __CONTEXT_FILE__, and _context_file_display in src/specify_cli, and have the extension tests copy the bundled defaults JSON so self-seed runs without the CLI. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * docs: reflect full removal of agent-context state from the CLI Update AGENTS.md (integration examples, required-fields table, context behavior section, pitfalls), CHANGELOG, and the SDD spec artifacts (FR-007, SC-002, data-model) to state that the CLI carries no context_file and the extension fully owns the per-agent default mapping via agent-context-defaults.json. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * docs: align SDD artifacts with full context_file removal Update research.md (R1, R2, R4, summary table), contracts/cli-behavior.md (C3, C5), tasks.md (Phase 2, T026, notes), plan.md (Principle I, source map), and checklists/requirements.md so the spec artifacts reflect the implemented decision: the CLI carries no context_file attribute or __CONTEXT_FILE__ resolution, and the per-agent defaults map lives in the extension. Resolves PR review #4548130110. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * docs: scrub stale context-file mentions from CLI docstrings Update the multi_install_safe docstring (drop the removed "context file" invariant), the RovoDev setup docstring (no longer upserts a context section), the Copilot module docstring (drop the context-file line), and tighten the _update_init_options_for_integration note. Pure docstring changes — no behavioral impact. Resolves PR review #4548237085. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * test+docs: harden agent-context test helper and fix stale docs - base.py: document multi_install_safe as an optional subclass attribute in the IntegrationBase docstring. - test_cli.py: clarify the init-options assertion is guarding against leftover legacy agent-context keys, not relocation. - test_extension_agent_context.py: _install_agent_context_config now asserts the bundled agent-context-defaults.json exists and always copies it, so self-seeding tests fail loudly instead of silently skipping when the map is missing. - test_integration_cursor_agent.py: drop Path/IntegrationManifest imports left unused after removing the context-section frontmatter tests. Resolves PR review #4548293116. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * chore: remove gitignored SDD artifacts from specs/ The specs/001-agent-context-full-optin/ artifacts were force-added for dogfooding visibility, but specs/ is gitignored and these were always intended to be purged before merge. Remove them so merging does not add an intentionally-untracked directory to repo history. Assisted-by: GitHub Copilot (model: Claude Opus 4.8, autonomous) Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * chore: keep CHANGELOG.md identical to upstream CHANGELOG.md is auto-generated at release time, so the branch should not carry a manual entry. Restore it to match upstream/main exactly. Assisted-by: GitHub Copilot (model: Claude Opus 4.8, autonomous) Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * fix: preserve Cursor .mdc frontmatter in agent-context updater scripts The bundled agent-context updater scripts wrote the managed section as plain text. For Cursor-style `.mdc` targets this dropped the required `---\nalwaysApply: true\n---` frontmatter, reintroducing the rule-loading bug originally fixed in #1699. Port the `_ensure_mdc_frontmatter` logic into both the bash and PowerShell updaters: prepend frontmatter when missing, repair `alwaysApply` when set to the wrong value, and leave non-`.mdc` targets untouched. Add regression tests covering both shells. Assisted-by: GitHub Copilot (model: Claude Opus 4.8, autonomous) Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * test: scope CLI-free guard to agent-context-specific symbols Drop the bare "context_file" substring from FORBIDDEN_SYMBOLS so the guard no longer fails on unrelated future CLI fields named context_file. The list still covers agent-context-specific identifiers (__CONTEXT_FILE__, _context_file_display, _resolve_context_files, _resolve_context_file_values). Assisted-by: GitHub Copilot (model: Claude Opus 4.8, autonomous) Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * fix: harden agent-context bash self-seed against malformed init JSON Two robustness fixes in the embedded Python self-seed logic: - Coerce the integration value from init-options.json to a string only when it is actually a string; otherwise treat it as unset so a corrupted dict/list value degrades to the existing nothing-to-do behavior instead of breaking the agents-map lookup. - Normalize agent-context-defaults.json: only use 'agents' when both the JSON root and the 'agents' value are dicts, so a wrong-shaped (but valid) JSON falls back to the warning path instead of raising on .get. Assisted-by: GitHub Copilot (model: Claude Opus 4.8, autonomous) Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * fix: correct PowerShell hyphenated key lookup and regex replace count - Self-seed now reads the defaults mapping via $defaults.agents.PSObject.Properties[$integrationKey].Value instead of member access ($defaults.agents.$integrationKey), which parsed hyphenated keys like 'cursor-agent'/'kiro-cli' as subtraction and failed to resolve. - Replace the static [regex]::Replace(..., 1) call, whose trailing 1 was interpreted as RegexOptions.IgnoreCase rather than a replacement count, with an instance Regex whose Replace(input, replacement, 1) limits to the first match as intended. Assisted-by: GitHub Copilot (model: Claude Opus 4.8, autonomous) Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * fix: make bash .mdc frontmatter guard case-insensitive The bash updater only injected Cursor .mdc frontmatter when ctx_path ended in lowercase '.mdc', so a mixed/upper-case extension (e.g. specify-rules.MDC) was skipped and Cursor would not auto-load the rule file. Compare against the casefolded path. The PowerShell variant already uses -match, which is case-insensitive by default, so no change is needed there. Assisted-by: GitHub Copilot (model: Claude Opus 4.8, autonomous) Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * docs: document separator-agnostic agent-context update invocation The README hard-coded the dot-notation slash command (/speckit.agent-context.update), which hyphen-separator agents like Forge and Cline do not recognize. Document the canonical command ID plus both slash invocations so users copy the form their agent accepts. Assisted-by: GitHub Copilot (model: Claude Opus 4.8, autonomous) Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> --------- Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
874 lines
30 KiB
Python
874 lines
30 KiB
Python
"""Tests for the bundled ``agent-context`` extension and related plumbing."""
|
|
|
|
from __future__ import annotations
|
|
|
|
import json
|
|
import os
|
|
import shutil
|
|
import subprocess
|
|
import sys
|
|
from pathlib import Path
|
|
|
|
import pytest
|
|
import yaml
|
|
|
|
from specify_cli import (
|
|
save_init_options,
|
|
)
|
|
from specify_cli.agents import CommandRegistrar
|
|
from tests.conftest import requires_bash
|
|
|
|
|
|
PROJECT_ROOT = Path(__file__).resolve().parent.parent.parent
|
|
EXT_DIR = PROJECT_ROOT / "extensions" / "agent-context"
|
|
BASH = shutil.which("bash")
|
|
POWERSHELL = (
|
|
shutil.which("pwsh") or shutil.which("powershell.exe") or shutil.which("powershell")
|
|
)
|
|
|
|
|
|
def _write_ext_config(project_root: Path, **overrides: object) -> None:
|
|
"""Write a minimal agent-context extension config directly.
|
|
|
|
The CLI no longer owns the extension config — the bundled extension does —
|
|
so tests write it themselves rather than going through any CLI helper.
|
|
"""
|
|
cfg: dict = {
|
|
"context_file": overrides.get("context_file", ""),
|
|
"context_files": overrides.get("context_files", []),
|
|
"context_markers": overrides.get(
|
|
"context_markers",
|
|
{
|
|
"start": "<!-- SPECKIT START -->",
|
|
"end": "<!-- SPECKIT END -->",
|
|
},
|
|
),
|
|
}
|
|
path = (
|
|
project_root
|
|
/ ".specify"
|
|
/ "extensions"
|
|
/ "agent-context"
|
|
/ "agent-context-config.yml"
|
|
)
|
|
path.parent.mkdir(parents=True, exist_ok=True)
|
|
path.write_text(
|
|
yaml.safe_dump(cfg, default_flow_style=False, sort_keys=False),
|
|
encoding="utf-8",
|
|
)
|
|
|
|
|
|
# ── Bundled extension layout ─────────────────────────────────────────────────
|
|
|
|
|
|
class TestExtensionLayout:
|
|
"""The bundled agent-context extension ships a complete package."""
|
|
|
|
def test_extension_yml_exists(self):
|
|
assert (EXT_DIR / "extension.yml").is_file()
|
|
|
|
def test_extension_yml_has_required_fields(self):
|
|
manifest = yaml.safe_load((EXT_DIR / "extension.yml").read_text())
|
|
assert manifest["extension"]["id"] == "agent-context"
|
|
assert manifest["extension"]["name"] == "Coding Agent Context"
|
|
assert manifest["extension"]["author"] == "spec-kit-core"
|
|
# Provides at least the manual update command
|
|
commands = {c["name"] for c in manifest["provides"]["commands"]}
|
|
assert "speckit.agent-context.update" in commands
|
|
|
|
def test_readme_exists(self):
|
|
readme = EXT_DIR / "README.md"
|
|
assert readme.is_file()
|
|
text = readme.read_text(encoding="utf-8")
|
|
assert "Coding Agent Context Extension" in text
|
|
|
|
def test_config_template_exists(self):
|
|
cfg = EXT_DIR / "agent-context-config.yml"
|
|
assert cfg.is_file()
|
|
parsed = yaml.safe_load(cfg.read_text(encoding="utf-8"))
|
|
assert "context_file" in parsed
|
|
assert "context_markers" in parsed
|
|
|
|
def test_command_file_exists(self):
|
|
cmd = EXT_DIR / "commands" / "speckit.agent-context.update.md"
|
|
assert cmd.is_file()
|
|
assert "agent-context-config.yml" in cmd.read_text(encoding="utf-8")
|
|
|
|
def test_command_file_documents_context_file_constraints(self):
|
|
text = (
|
|
EXT_DIR / "commands" / "speckit.agent-context.update.md"
|
|
).read_text(encoding="utf-8")
|
|
assert "context file(s)" in text
|
|
assert "Windows drive paths" in text
|
|
assert "backslash separators" in text
|
|
|
|
def test_bundled_scripts_exist(self):
|
|
assert (EXT_DIR / "scripts" / "bash" / "update-agent-context.sh").is_file()
|
|
assert (EXT_DIR / "scripts" / "powershell" / "update-agent-context.ps1").is_file()
|
|
|
|
def test_bash_script_reads_extension_config(self):
|
|
text = (EXT_DIR / "scripts" / "bash" / "update-agent-context.sh").read_text(
|
|
encoding="utf-8"
|
|
)
|
|
# The script must consult the extension config, not init-options.json
|
|
assert "agent-context-config.yml" in text
|
|
assert "context_file" in text
|
|
assert "context_markers" in text
|
|
|
|
|
|
# ── Catalog registration ─────────────────────────────────────────────────────
|
|
|
|
|
|
class TestCatalogEntry:
|
|
def test_catalog_lists_agent_context_as_bundled(self):
|
|
catalog = json.loads(
|
|
(PROJECT_ROOT / "extensions" / "catalog.json").read_text(encoding="utf-8")
|
|
)
|
|
entry = catalog["extensions"]["agent-context"]
|
|
assert entry["bundled"] is True
|
|
assert entry["id"] == "agent-context"
|
|
assert entry["author"] == "spec-kit-core"
|
|
|
|
|
|
|
|
|
|
def _install_agent_context_config(project_root: Path, **overrides: object) -> None:
|
|
_write_ext_config(project_root, **overrides)
|
|
# Mirror the real install layout: the extension ships its own
|
|
# agent->context-file defaults map alongside the config. Self-seeding
|
|
# tests depend on it, so require it to exist and always copy it rather
|
|
# than silently skipping when it is missing.
|
|
defaults_src = EXT_DIR / "agent-context-defaults.json"
|
|
assert defaults_src.is_file(), (
|
|
f"bundled agent-context defaults map missing: {defaults_src}"
|
|
)
|
|
defaults_dst = (
|
|
project_root
|
|
/ ".specify"
|
|
/ "extensions"
|
|
/ "agent-context"
|
|
/ "agent-context-defaults.json"
|
|
)
|
|
defaults_dst.parent.mkdir(parents=True, exist_ok=True)
|
|
shutil.copyfile(defaults_src, defaults_dst)
|
|
|
|
|
|
def _bash_posix_path(path: Path) -> str:
|
|
"""Convert a Windows path to the POSIX form used by the available bash."""
|
|
resolved = str(path.resolve())
|
|
if os.name != "nt":
|
|
return resolved
|
|
|
|
if BASH:
|
|
converted = subprocess.run(
|
|
[
|
|
BASH,
|
|
"-lc",
|
|
"command -v cygpath >/dev/null 2>&1 && cygpath -u \"$1\"",
|
|
"bash",
|
|
resolved,
|
|
],
|
|
capture_output=True,
|
|
text=True,
|
|
timeout=30,
|
|
)
|
|
if converted.returncode == 0 and converted.stdout.strip():
|
|
return converted.stdout.strip()
|
|
|
|
drive = path.drive.rstrip(":").lower()
|
|
posix = path.as_posix()
|
|
return f"/mnt/{drive}{posix[2:]}" if drive else posix
|
|
|
|
|
|
def _ensure_test_python_on_path(project_root: Path) -> Path:
|
|
"""Create python/python3 shims that run the current pytest interpreter."""
|
|
shim_dir = project_root / ".test-python-bin"
|
|
shim_dir.mkdir(exist_ok=True)
|
|
python_exe = Path(sys.executable).resolve()
|
|
shell_python = _bash_posix_path(python_exe)
|
|
|
|
for name in ("python", "python3"):
|
|
shell_shim = shim_dir / name
|
|
shell_shim.write_text(
|
|
f"#!/usr/bin/env sh\nexec {shlex_quote(shell_python)} \"$@\"\n",
|
|
encoding="utf-8",
|
|
newline="\n",
|
|
)
|
|
shell_shim.chmod(0o755)
|
|
|
|
if os.name == "nt":
|
|
cmd_shim = shim_dir / f"{name}.cmd"
|
|
cmd_shim.write_text(
|
|
f'@echo off\r\n"{python_exe}" %*\r\n',
|
|
encoding="utf-8",
|
|
)
|
|
|
|
return shim_dir
|
|
|
|
|
|
def _current_pythonpath() -> str:
|
|
"""Return sys.path entries needed by child script interpreters."""
|
|
entries = [
|
|
entry
|
|
for entry in sys.path
|
|
if isinstance(entry, str) and entry
|
|
]
|
|
existing = os.environ.get("PYTHONPATH")
|
|
if existing:
|
|
entries.extend(entry for entry in existing.split(os.pathsep) if entry)
|
|
return os.pathsep.join(dict.fromkeys(entries))
|
|
|
|
|
|
def _bundled_script_env(
|
|
project_root: Path,
|
|
*,
|
|
for_bash: bool = False,
|
|
speckit_python: str | None = None,
|
|
) -> dict[str, str]:
|
|
env = os.environ.copy()
|
|
shim_dir = _ensure_test_python_on_path(project_root)
|
|
env["PATH"] = str(shim_dir) + os.pathsep + env.get("PATH", "")
|
|
env["SPECKIT_PYTHON"] = (
|
|
speckit_python
|
|
if speckit_python is not None
|
|
else (_bash_posix_path(Path(sys.executable)) if for_bash else sys.executable)
|
|
)
|
|
pythonpath = _current_pythonpath()
|
|
if pythonpath:
|
|
env["PYTHONPATH"] = pythonpath
|
|
return env
|
|
|
|
|
|
def _run_bash_agent_context_script(
|
|
project_root: Path,
|
|
*,
|
|
speckit_python: str | None = None,
|
|
) -> subprocess.CompletedProcess:
|
|
script = EXT_DIR / "scripts" / "bash" / "update-agent-context.sh"
|
|
env = _bundled_script_env(
|
|
project_root,
|
|
for_bash=True,
|
|
speckit_python=speckit_python,
|
|
)
|
|
if os.name == "nt":
|
|
root = _bash_posix_path(project_root)
|
|
script_path = _bash_posix_path(script)
|
|
shim_dir = _bash_posix_path(_ensure_test_python_on_path(project_root))
|
|
command = (
|
|
f"export PATH={shlex_quote(shim_dir)}:\"$PATH\"; "
|
|
f"cd {shlex_quote(root)} && {shlex_quote(script_path)}"
|
|
)
|
|
return subprocess.run(
|
|
[BASH, "-lc", command],
|
|
env=env,
|
|
capture_output=True,
|
|
text=True,
|
|
timeout=30,
|
|
)
|
|
return subprocess.run(
|
|
[BASH, str(script)],
|
|
cwd=project_root,
|
|
env=env,
|
|
capture_output=True,
|
|
text=True,
|
|
timeout=30,
|
|
)
|
|
|
|
|
|
def shlex_quote(value: str) -> str:
|
|
return "'" + value.replace("'", "'\"'\"'") + "'"
|
|
|
|
|
|
def _run_powershell_agent_context_script(project_root: Path) -> subprocess.CompletedProcess:
|
|
script = EXT_DIR / "scripts" / "powershell" / "update-agent-context.ps1"
|
|
env = _bundled_script_env(project_root)
|
|
return subprocess.run(
|
|
[
|
|
POWERSHELL,
|
|
"-NoProfile",
|
|
"-ExecutionPolicy",
|
|
"Bypass",
|
|
"-File",
|
|
str(script),
|
|
],
|
|
cwd=project_root,
|
|
env=env,
|
|
capture_output=True,
|
|
text=True,
|
|
timeout=30,
|
|
)
|
|
|
|
|
|
def _run_powershell_agent_context_script_with_env(
|
|
project_root: Path,
|
|
*,
|
|
speckit_python: str,
|
|
) -> subprocess.CompletedProcess:
|
|
script = EXT_DIR / "scripts" / "powershell" / "update-agent-context.ps1"
|
|
env = _bundled_script_env(project_root, speckit_python=speckit_python)
|
|
return subprocess.run(
|
|
[
|
|
POWERSHELL,
|
|
"-NoProfile",
|
|
"-ExecutionPolicy",
|
|
"Bypass",
|
|
"-File",
|
|
str(script),
|
|
],
|
|
cwd=project_root,
|
|
env=env,
|
|
capture_output=True,
|
|
text=True,
|
|
timeout=30,
|
|
)
|
|
|
|
|
|
class TestBundledUpdaterPathValidation:
|
|
def test_bundled_script_env_makes_yaml_importable(self, tmp_path):
|
|
env = _bundled_script_env(tmp_path)
|
|
|
|
result = subprocess.run(
|
|
[env["SPECKIT_PYTHON"], "-c", "import yaml"],
|
|
env=env,
|
|
capture_output=True,
|
|
text=True,
|
|
timeout=30,
|
|
)
|
|
|
|
assert result.returncode == 0, result.stderr + result.stdout
|
|
|
|
@requires_bash
|
|
def test_bash_script_trims_context_file_fallback(self, tmp_path):
|
|
project = tmp_path / "project"
|
|
project.mkdir()
|
|
_install_agent_context_config(
|
|
project,
|
|
context_file=" AGENTS.md ",
|
|
context_files=[],
|
|
)
|
|
|
|
result = _run_bash_agent_context_script(project)
|
|
|
|
assert result.returncode == 0, result.stderr + result.stdout
|
|
assert "agent-context: updated AGENTS.md" in (result.stderr + result.stdout)
|
|
assert (project / "AGENTS.md").exists()
|
|
assert not (project / " AGENTS.md ").exists()
|
|
|
|
@requires_bash
|
|
def test_bash_script_rejects_symlink_escape(self, tmp_path):
|
|
project = tmp_path / "project"
|
|
outside = tmp_path / "outside"
|
|
project.mkdir()
|
|
outside.mkdir()
|
|
_install_agent_context_config(
|
|
project,
|
|
context_file="AGENTS.md",
|
|
context_files=["link/out.md"],
|
|
)
|
|
|
|
if os.name == "nt":
|
|
root = _bash_posix_path(tmp_path)
|
|
create_link = subprocess.run(
|
|
[
|
|
BASH,
|
|
"-lc",
|
|
f"ln -s {shlex_quote(root + '/outside')} "
|
|
f"{shlex_quote(root + '/project/link')}",
|
|
],
|
|
capture_output=True,
|
|
text=True,
|
|
timeout=30,
|
|
)
|
|
if create_link.returncode != 0:
|
|
pytest.skip(f"symlink unavailable: {create_link.stderr}")
|
|
else:
|
|
try:
|
|
(project / "link").symlink_to(outside, target_is_directory=True)
|
|
except OSError as exc:
|
|
pytest.skip(f"symlink unavailable: {exc}")
|
|
|
|
result = _run_bash_agent_context_script(project)
|
|
|
|
assert result.returncode == 1
|
|
assert "resolves outside the project root" in result.stderr
|
|
assert not (outside / "out.md").exists()
|
|
|
|
@requires_bash
|
|
def test_bash_script_deduplicates_context_files_in_order(self, tmp_path):
|
|
project = tmp_path / "project"
|
|
project.mkdir()
|
|
duplicate = "agents.md" if os.name == "nt" else "AGENTS.md"
|
|
_install_agent_context_config(
|
|
project,
|
|
context_file="AGENTS.md",
|
|
context_files=["AGENTS.md", "CLAUDE.md", duplicate],
|
|
)
|
|
|
|
result = _run_bash_agent_context_script(project)
|
|
|
|
assert result.returncode == 0, result.stderr + result.stdout
|
|
output = result.stderr + result.stdout
|
|
assert output.count("agent-context: updated AGENTS.md") == 1
|
|
assert output.count("agent-context: updated CLAUDE.md") == 1
|
|
assert "agent-context: updated agents.md" not in output
|
|
|
|
@requires_bash
|
|
def test_bash_script_falls_back_from_invalid_speckit_python(self, tmp_path):
|
|
project = tmp_path / "project"
|
|
project.mkdir()
|
|
_install_agent_context_config(
|
|
project,
|
|
context_file="AGENTS.md",
|
|
context_files=["AGENTS.md"],
|
|
)
|
|
|
|
result = _run_bash_agent_context_script(
|
|
project,
|
|
speckit_python="/definitely/missing/python",
|
|
)
|
|
|
|
assert result.returncode == 0, result.stderr + result.stdout
|
|
assert "agent-context: updated AGENTS.md" in (result.stderr + result.stdout)
|
|
assert (project / "AGENTS.md").exists()
|
|
|
|
@pytest.mark.skipif(POWERSHELL is None, reason="PowerShell not available")
|
|
def test_powershell_script_rejects_backslash_context_files(self, tmp_path):
|
|
project = tmp_path / "project"
|
|
project.mkdir()
|
|
_install_agent_context_config(
|
|
project,
|
|
context_file="AGENTS.md",
|
|
context_files=["nested\\AGENTS.md"],
|
|
)
|
|
|
|
result = _run_powershell_agent_context_script(project)
|
|
|
|
assert result.returncode == 1
|
|
assert "must not contain backslash separators" in (
|
|
result.stderr + result.stdout
|
|
)
|
|
assert not (project / "nested" / "AGENTS.md").exists()
|
|
|
|
@pytest.mark.skipif(POWERSHELL is None, reason="PowerShell not available")
|
|
def test_powershell_script_rejects_drive_qualified_context_files(self, tmp_path):
|
|
project = tmp_path / "project"
|
|
project.mkdir()
|
|
_install_agent_context_config(
|
|
project,
|
|
context_file="AGENTS.md",
|
|
context_files=["C:tmp/outside.md"],
|
|
)
|
|
|
|
result = _run_powershell_agent_context_script(project)
|
|
|
|
assert result.returncode == 1
|
|
assert "must be project-relative paths" in (result.stderr + result.stdout)
|
|
assert not (project / "tmp" / "outside.md").exists()
|
|
|
|
@pytest.mark.skipif(POWERSHELL is None, reason="PowerShell not available")
|
|
def test_powershell_script_deduplicates_context_files_in_order(self, tmp_path):
|
|
project = tmp_path / "project"
|
|
project.mkdir()
|
|
duplicate = "agents.md" if os.name == "nt" else "AGENTS.md"
|
|
_install_agent_context_config(
|
|
project,
|
|
context_file="AGENTS.md",
|
|
context_files=["AGENTS.md", "CLAUDE.md", duplicate],
|
|
)
|
|
|
|
result = _run_powershell_agent_context_script(project)
|
|
|
|
assert result.returncode == 0, result.stderr + result.stdout
|
|
output = result.stderr + result.stdout
|
|
assert output.count("agent-context: updated AGENTS.md") == 1
|
|
assert output.count("agent-context: updated CLAUDE.md") == 1
|
|
assert "agent-context: updated agents.md" not in output
|
|
|
|
@pytest.mark.skipif(POWERSHELL is None, reason="PowerShell not available")
|
|
def test_powershell_script_falls_back_from_invalid_speckit_python(self, tmp_path):
|
|
project = tmp_path / "project"
|
|
project.mkdir()
|
|
_install_agent_context_config(
|
|
project,
|
|
context_file="AGENTS.md",
|
|
context_files=["AGENTS.md"],
|
|
)
|
|
|
|
result = _run_powershell_agent_context_script_with_env(
|
|
project,
|
|
speckit_python=str(project / "missing-python"),
|
|
)
|
|
|
|
assert result.returncode == 0, result.stderr + result.stdout
|
|
assert "agent-context: updated AGENTS.md" in (result.stderr + result.stdout)
|
|
assert (project / "AGENTS.md").exists()
|
|
|
|
@pytest.mark.skipif(
|
|
POWERSHELL is None or os.name != "nt",
|
|
reason="Windows PowerShell junction test requires Windows",
|
|
)
|
|
def test_powershell_script_rejects_junction_escape(self, tmp_path):
|
|
project = tmp_path / "project"
|
|
outside = tmp_path / "outside"
|
|
project.mkdir()
|
|
outside.mkdir()
|
|
_install_agent_context_config(
|
|
project,
|
|
context_file="AGENTS.md",
|
|
context_files=["link/out.md"],
|
|
)
|
|
|
|
create_link = subprocess.run(
|
|
[
|
|
POWERSHELL,
|
|
"-NoProfile",
|
|
"-ExecutionPolicy",
|
|
"Bypass",
|
|
"-Command",
|
|
(
|
|
"New-Item -ItemType Junction "
|
|
f"-Path {str(project / 'link')!r} "
|
|
f"-Target {str(outside)!r} | Out-Null"
|
|
),
|
|
],
|
|
capture_output=True,
|
|
text=True,
|
|
timeout=30,
|
|
)
|
|
if create_link.returncode != 0:
|
|
pytest.skip(f"junction unavailable: {create_link.stderr}")
|
|
|
|
result = _run_powershell_agent_context_script(project)
|
|
|
|
assert result.returncode == 1
|
|
assert "resolves outside the project root" in (result.stderr + result.stdout)
|
|
assert not (outside / "out.md").exists()
|
|
|
|
|
|
# ── CLI does not resolve agent context placeholders ──────────────────────────
|
|
|
|
|
|
class TestSkillPlaceholderContextResolution:
|
|
"""The CLI no longer resolves any ``__CONTEXT_FILE__`` placeholder.
|
|
|
|
Agent context files are owned entirely by the opt-in agent-context
|
|
extension, so the CLI neither reads integration metadata nor the
|
|
extension config when rendering commands/skills.
|
|
"""
|
|
|
|
def test_cli_does_not_resolve_context_placeholder(self, tmp_path):
|
|
content = CommandRegistrar.resolve_skill_placeholders(
|
|
"codex",
|
|
{},
|
|
"Read __CONTEXT_FILE__",
|
|
tmp_path,
|
|
)
|
|
assert content == "Read __CONTEXT_FILE__"
|
|
|
|
def test_extension_config_does_not_influence_resolution(self, tmp_path):
|
|
# Even a populated extension config must not influence resolution.
|
|
_write_ext_config(
|
|
tmp_path,
|
|
context_file="FROM_CONFIG.md",
|
|
context_files=["ALSO_CONFIG.md"],
|
|
)
|
|
|
|
content = CommandRegistrar.resolve_skill_placeholders(
|
|
"claude",
|
|
{},
|
|
"Read __CONTEXT_FILE__",
|
|
tmp_path,
|
|
)
|
|
assert "FROM_CONFIG.md" not in content
|
|
assert "ALSO_CONFIG.md" not in content
|
|
assert content == "Read __CONTEXT_FILE__"
|
|
|
|
|
|
# ── CLI no longer owns the agent-context extension config ────────────────────
|
|
|
|
|
|
class TestCliDoesNotManageExtensionConfig:
|
|
"""The Python codebase must not read or write the extension config."""
|
|
|
|
def test_config_helpers_are_removed(self):
|
|
import specify_cli
|
|
|
|
for name in (
|
|
"_load_agent_context_config",
|
|
"_save_agent_context_config",
|
|
"_update_agent_context_config_file",
|
|
"_AGENT_CTX_EXT_CONFIG",
|
|
):
|
|
assert not hasattr(specify_cli, name), name
|
|
|
|
def test_no_agent_context_config_symbols_in_source(self):
|
|
src = PROJECT_ROOT / "src" / "specify_cli"
|
|
offenders = []
|
|
for path in src.rglob("*.py"):
|
|
text = path.read_text(encoding="utf-8")
|
|
if "agent-context-config" in text or "agent_context_config" in text:
|
|
offenders.append(str(path.relative_to(PROJECT_ROOT)))
|
|
assert not offenders, offenders
|
|
|
|
def test_update_init_options_does_not_create_ext_config(self, tmp_path):
|
|
from specify_cli.integrations import INTEGRATION_REGISTRY
|
|
from specify_cli.integrations._helpers import (
|
|
_update_init_options_for_integration,
|
|
)
|
|
|
|
_update_init_options_for_integration(
|
|
tmp_path, INTEGRATION_REGISTRY["claude"], script_type="sh"
|
|
)
|
|
|
|
cfg = (
|
|
tmp_path
|
|
/ ".specify"
|
|
/ "extensions"
|
|
/ "agent-context"
|
|
/ "agent-context-config.yml"
|
|
)
|
|
assert not cfg.exists()
|
|
|
|
def test_clear_init_options_does_not_create_ext_config(self, tmp_path):
|
|
from specify_cli.integrations._helpers import (
|
|
_clear_init_options_for_integration,
|
|
)
|
|
|
|
save_init_options(tmp_path, {"integration": "claude", "ai": "claude"})
|
|
_clear_init_options_for_integration(tmp_path, "claude")
|
|
|
|
cfg = (
|
|
tmp_path
|
|
/ ".specify"
|
|
/ "extensions"
|
|
/ "agent-context"
|
|
/ "agent-context-config.yml"
|
|
)
|
|
assert not cfg.exists()
|
|
|
|
|
|
# ── Extension self-seeds its target from the active integration ──────────────
|
|
|
|
|
|
class TestExtensionSelfSeed:
|
|
"""When its own config declares no target, the bundled extension derives
|
|
the context file from the active integration using its OWN bundled
|
|
agent->context-file defaults map (no Specify CLI dependency)."""
|
|
|
|
@requires_bash
|
|
def test_bash_script_self_seeds_from_active_integration(self, tmp_path):
|
|
project = tmp_path / "project"
|
|
project.mkdir()
|
|
# Config present but empty — no context_file / context_files.
|
|
_install_agent_context_config(project, context_file="", context_files=[])
|
|
# Active integration recorded in init-options.json (codex -> AGENTS.md).
|
|
save_init_options(project, {"integration": "codex", "ai": "codex"})
|
|
|
|
result = _run_bash_agent_context_script(project)
|
|
|
|
assert result.returncode == 0, result.stderr + result.stdout
|
|
assert "agent-context: updated AGENTS.md" in (result.stderr + result.stdout)
|
|
assert (project / "AGENTS.md").exists()
|
|
assert "<!-- SPECKIT START -->" in (
|
|
project / "AGENTS.md"
|
|
).read_text(encoding="utf-8")
|
|
|
|
@requires_bash
|
|
def test_bash_script_nothing_to_do_without_integration(self, tmp_path):
|
|
project = tmp_path / "project"
|
|
project.mkdir()
|
|
_install_agent_context_config(project, context_file="", context_files=[])
|
|
|
|
result = _run_bash_agent_context_script(project)
|
|
|
|
assert result.returncode == 0, result.stderr + result.stdout
|
|
assert "nothing to do" in (result.stderr + result.stdout)
|
|
|
|
|
|
_MDC_CONTEXT_FILE = ".cursor/rules/specify-rules.mdc"
|
|
|
|
|
|
class TestMdcFrontmatter:
|
|
"""Cursor-style ``.mdc`` targets must carry ``alwaysApply: true`` frontmatter
|
|
so the rule file is auto-loaded; non-``.mdc`` targets must not gain any."""
|
|
|
|
@requires_bash
|
|
def test_bash_script_prepends_mdc_frontmatter(self, tmp_path):
|
|
project = tmp_path / "project"
|
|
project.mkdir()
|
|
_install_agent_context_config(project, context_file=_MDC_CONTEXT_FILE)
|
|
|
|
result = _run_bash_agent_context_script(project)
|
|
|
|
assert result.returncode == 0, result.stderr + result.stdout
|
|
text = (project / _MDC_CONTEXT_FILE).read_text(encoding="utf-8")
|
|
assert text.startswith("---\nalwaysApply: true\n---\n")
|
|
assert "<!-- SPECKIT START -->" in text
|
|
|
|
@requires_bash
|
|
def test_bash_script_mdc_frontmatter_is_idempotent(self, tmp_path):
|
|
project = tmp_path / "project"
|
|
project.mkdir()
|
|
_install_agent_context_config(project, context_file=_MDC_CONTEXT_FILE)
|
|
|
|
_run_bash_agent_context_script(project)
|
|
result = _run_bash_agent_context_script(project)
|
|
|
|
assert result.returncode == 0, result.stderr + result.stdout
|
|
text = (project / _MDC_CONTEXT_FILE).read_text(encoding="utf-8")
|
|
assert text.count("alwaysApply: true") == 1
|
|
|
|
@requires_bash
|
|
def test_bash_script_repairs_existing_mdc_frontmatter(self, tmp_path):
|
|
project = tmp_path / "project"
|
|
project.mkdir()
|
|
_install_agent_context_config(project, context_file=_MDC_CONTEXT_FILE)
|
|
target = project / _MDC_CONTEXT_FILE
|
|
target.parent.mkdir(parents=True, exist_ok=True)
|
|
target.write_text(
|
|
"---\ndescription: My rules\nalwaysApply: false\n---\n\nUser notes\n",
|
|
encoding="utf-8",
|
|
)
|
|
|
|
result = _run_bash_agent_context_script(project)
|
|
|
|
assert result.returncode == 0, result.stderr + result.stdout
|
|
text = target.read_text(encoding="utf-8")
|
|
assert "alwaysApply: true" in text
|
|
assert "alwaysApply: false" not in text
|
|
assert "description: My rules" in text
|
|
assert "User notes" in text
|
|
|
|
@requires_bash
|
|
def test_bash_script_skips_frontmatter_for_non_mdc(self, tmp_path):
|
|
project = tmp_path / "project"
|
|
project.mkdir()
|
|
_install_agent_context_config(project, context_file="AGENTS.md")
|
|
|
|
result = _run_bash_agent_context_script(project)
|
|
|
|
assert result.returncode == 0, result.stderr + result.stdout
|
|
text = (project / "AGENTS.md").read_text(encoding="utf-8")
|
|
assert "alwaysApply" not in text
|
|
assert text.startswith("<!-- SPECKIT START -->")
|
|
|
|
@pytest.mark.skipif(POWERSHELL is None, reason="PowerShell not available")
|
|
def test_powershell_script_prepends_mdc_frontmatter(self, tmp_path):
|
|
project = tmp_path / "project"
|
|
project.mkdir()
|
|
_install_agent_context_config(project, context_file=_MDC_CONTEXT_FILE)
|
|
|
|
result = _run_powershell_agent_context_script(project)
|
|
|
|
assert result.returncode == 0, result.stderr + result.stdout
|
|
text = (project / _MDC_CONTEXT_FILE).read_text(encoding="utf-8")
|
|
assert text.startswith("---\nalwaysApply: true\n---\n")
|
|
assert "<!-- SPECKIT START -->" in text
|
|
|
|
@pytest.mark.skipif(POWERSHELL is None, reason="PowerShell not available")
|
|
def test_powershell_script_repairs_existing_mdc_frontmatter(self, tmp_path):
|
|
project = tmp_path / "project"
|
|
project.mkdir()
|
|
_install_agent_context_config(project, context_file=_MDC_CONTEXT_FILE)
|
|
target = project / _MDC_CONTEXT_FILE
|
|
target.parent.mkdir(parents=True, exist_ok=True)
|
|
target.write_text(
|
|
"---\ndescription: My rules\nalwaysApply: false\n---\n\nUser notes\n",
|
|
encoding="utf-8",
|
|
)
|
|
|
|
result = _run_powershell_agent_context_script(project)
|
|
|
|
assert result.returncode == 0, result.stderr + result.stdout
|
|
text = target.read_text(encoding="utf-8")
|
|
assert "alwaysApply: true" in text
|
|
assert "alwaysApply: false" not in text
|
|
assert "description: My rules" in text
|
|
assert "User notes" in text
|
|
|
|
@pytest.mark.skipif(POWERSHELL is None, reason="PowerShell not available")
|
|
def test_powershell_script_skips_frontmatter_for_non_mdc(self, tmp_path):
|
|
project = tmp_path / "project"
|
|
project.mkdir()
|
|
_install_agent_context_config(project, context_file="AGENTS.md")
|
|
|
|
result = _run_powershell_agent_context_script(project)
|
|
|
|
assert result.returncode == 0, result.stderr + result.stdout
|
|
text = (project / "AGENTS.md").read_text(encoding="utf-8")
|
|
assert "alwaysApply" not in text
|
|
assert text.startswith("<!-- SPECKIT START -->")
|
|
|
|
|
|
_LEGACY_CONTEXT = (
|
|
"# CLAUDE.md\n\n"
|
|
"Some user notes.\n\n"
|
|
"<!-- SPECKIT START -->\n"
|
|
"Legacy managed section written by an older Spec Kit version.\n"
|
|
"<!-- SPECKIT END -->\n\n"
|
|
"More user notes.\n"
|
|
)
|
|
|
|
|
|
class TestBackwardCompatibility:
|
|
"""Legacy projects must keep working; the CLI never touches their artifacts."""
|
|
|
|
def _seed_legacy_project(self, project_root: Path) -> Path:
|
|
ctx = project_root / "CLAUDE.md"
|
|
ctx.write_text(_LEGACY_CONTEXT, encoding="utf-8")
|
|
_write_ext_config(project_root, context_file="CLAUDE.md")
|
|
save_init_options(project_root, {"integration": "claude", "ai": "claude"})
|
|
return ctx
|
|
|
|
def test_integration_setup_leaves_legacy_artifacts_untouched(self, tmp_path):
|
|
from specify_cli.integrations import INTEGRATION_REGISTRY
|
|
from specify_cli.integrations.manifest import IntegrationManifest
|
|
|
|
project = tmp_path / "legacy"
|
|
project.mkdir()
|
|
ctx = self._seed_legacy_project(project)
|
|
cfg_path = (
|
|
project / ".specify" / "extensions" / "agent-context"
|
|
/ "agent-context-config.yml"
|
|
)
|
|
before_ctx = ctx.read_text(encoding="utf-8")
|
|
before_cfg = cfg_path.read_text(encoding="utf-8")
|
|
|
|
integration = INTEGRATION_REGISTRY["claude"]
|
|
m = IntegrationManifest("claude", project)
|
|
integration.setup(project, m)
|
|
|
|
assert ctx.read_text(encoding="utf-8") == before_ctx
|
|
assert cfg_path.read_text(encoding="utf-8") == before_cfg
|
|
|
|
def test_integration_switch_and_uninstall_leave_legacy_artifacts_untouched(
|
|
self, tmp_path
|
|
):
|
|
from specify_cli.integrations import INTEGRATION_REGISTRY
|
|
from specify_cli.integrations._helpers import (
|
|
_clear_init_options_for_integration,
|
|
_update_init_options_for_integration,
|
|
)
|
|
|
|
project = tmp_path / "legacy"
|
|
project.mkdir()
|
|
ctx = self._seed_legacy_project(project)
|
|
cfg_path = (
|
|
project / ".specify" / "extensions" / "agent-context"
|
|
/ "agent-context-config.yml"
|
|
)
|
|
before_ctx = ctx.read_text(encoding="utf-8")
|
|
before_cfg = cfg_path.read_text(encoding="utf-8")
|
|
|
|
# Switch to a different integration.
|
|
_update_init_options_for_integration(
|
|
project, INTEGRATION_REGISTRY["gemini"], script_type="sh"
|
|
)
|
|
assert ctx.read_text(encoding="utf-8") == before_ctx
|
|
assert cfg_path.read_text(encoding="utf-8") == before_cfg
|
|
|
|
# Uninstall.
|
|
_clear_init_options_for_integration(project, "gemini")
|
|
assert ctx.read_text(encoding="utf-8") == before_ctx
|
|
assert cfg_path.read_text(encoding="utf-8") == before_cfg
|