An unexpected regression of #1615 was that it only tests master at night.
We need master to:

1. Be tested after each commit to master (or merged PR for that matter).
2. Be tested every night.