I'm not using the ambassador containers so am not affected by #146, meaning that I am successfully running with a version 2 docker-compose file. This means that each test run creates a network which is not removed at the end of the test.
Once I hit 32 networks, I ran into an error when trying to run docker-compose:
ERROR: failed to parse pool request for address space "LocalDefault" pool "" subpool "": could not find an available predefined network
We need to either remove the network ourselves, or run docker-compose down to clean up.