Skip to content

feat: add GNU testsuite tracking workflows#217

Open
pocopepe wants to merge 1 commit intouutils:mainfrom
pocopepe:issue-64
Open

feat: add GNU testsuite tracking workflows#217
pocopepe wants to merge 1 commit intouutils:mainfrom
pocopepe:issue-64

Conversation

@pocopepe
Copy link
Copy Markdown
Contributor

Closes #64

took inspiration from how sed does it and adapted it for diffutils, open to feedback if I've missed anything

GnuTests.yml runs the upstream gnu diffutils test suite on every push and pr, compares results against main branch to catch regressions
GnuComment.yml posts a comparison summary as a pr comment, updating it instead of spamming new ones
util/compare_test_results.py comparison logic, exits 1 on new non-intermittent failures
Removed the old gnu-testsuite from ci.yml

@pocopepe
Copy link
Copy Markdown
Contributor Author

We'd need a tracking repo like sed-tracking wouldn't we? we're already producing the test-summary here

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Just like with rust/coreutils, compare with the GNU implementation and highlight improvements and regressions

1 participant