#712654 New default test behaviour is backwards incompatible, and so is the backwards compatibility option