FreeBSD Release Engineering testing
What tests can we run during the FreeBSD Release Engineering process?
Here are some ideas:
Basic sanity checks:
- install FreeBSD via installer to a few real and virtualized systems.
install HTTP (www/nginx), DNS services and survive basic traffic test;
- successfully do a self-hosted 'make tinderbox' build;
Regression tests:
Check ABI against previous release (devel/abi-compliance-checker) -- important to make sure that there are no ABI surprises across release.
Additionally:
- maybe one cluster system upgraded to the RC so we eat our own dogfood. (Is this too crazy).
- not sure but can we run the code on pointyhat/ports build cluster as well?
Acknowledgments
XinLi provided a lot of the ideas on this page.