Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

how accurate is this? like percentage wise


We built our own benchmarks [1] to test against. It's a set of repos with breaking changes commit that we run bumpgen on the previous commit to then compare the results.

We are clocking in around 50% success rate in this benchmark.

[1] https://github.com/xeol-io/swe-bump-bench




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: