Run BabelTest assertions embedded in GitHub issues as pytest tests - #103

Merged

gaurav merged 33 commits into

mainfrom

split/3-github-issues

Aug 26, 2026

Commits on Jun 26, 2026

Add GitHub issue parsing (sources/github)

gaurav
and
claude
committed
4628ead
Add GitHub issue test harness

gaurav
and
claude
committed
1dcea2f

Commits on Aug 19, 2026

Merge branch 'main' into split/3-github-issues
gaurav
committed
1400103
Check params_list arity during preparation

gaurav
and
claude
committed
4c2c7b1
Accept padded assertion names and reject non-string YAML params

gaurav
and
claude
committed
80d8aff
Report a missing issue the same way for every --issue ID format

gaurav
and
claude
committed
9769b33
Derive issue IDs from html_url instead of issue.repository

gaurav
and
claude
committed
2b9c3a5
Drop the unused get_all_issues() and the tqdm dependency

gaurav
and
claude
committed
5f74268
Cache each issue the github_issue fixture fetches

gaurav
and
claude
committed
71ca811
Stop deleting the GitHub issue cache lock out from under a running pytest

gaurav
and
claude
committed
48b1c44
Document why [ci] and [ci-es] share a NodeNorm URL

gaurav
and
claude
committed
b91805c
Drop the [ci-redis] target for the retired Redis-backed NodeNorm

gaurav
and
claude
committed
a1b6a1c

Commits on Aug 20, 2026

Restrict the test workflow's token to contents:read

gaurav
and
claude
committed
998e06f
Note how to restore GITHUB_TOKEN for the GitHub issue tests

gaurav
and
claude
committed
dc6b676
Warn that a missing token makes the issue tests skip, not fail

gaurav
and
claude
committed
d5657ef
Document the GitHub issue tests and their API rate limits

gaurav
and
claude
committed
289000b
Cover issue_id() and the --issue not-found path with tests

gaurav
and
claude
committed
b665653

Commits on Aug 26, 2026

Validate GitHub issue text before parsing it into tests
gaurav
committed
e861e7b
Reject empty, over-long and non-printable params before they reach a service
gaurav
committed
fb2a519
Move the download caches out of the shared temp directory
gaurav
committed
2081e8a
Test the issue-body guards, including the backtracking regression
gaurav
committed
f14f58a
Document the limits on assertions embedded in issues
gaurav
committed
0daecaf
Confine unlink_if_exists() to the cache directory
gaurav
committed
b0f5e43
Record what counts as untrusted input, and how it has bitten us
gaurav
committed
5854943
Warn that a red tests/github_issues run is the tool working
gaurav
committed
f0c9c46
Assert the default cache location, not an overridden one
gaurav
committed
63e9ffa
Cover the log escaping and the trimmed-down __str__
gaurav
committed
7a61972
Name the override when the cache directory cannot be created
gaurav
committed
dfa0615
Stop deleting the Google Sheet cache locks too
gaurav
committed
f9ea8a6
Record the two ways a mutation check can silently pass
gaurav
committed
53d1a78
Split test_system.py into tests/github_issues/unit/
gaurav
committed
7a81b1d
Drop the redundant marks and duplicate fixtures from the unit tests
gaurav
committed
aacc290
Warn against writing a live BabelTest marker into an issue
gaurav
committed
d51ca3e