Make grizzly work with mozregression #366
Description
Grizzly is great and so is mozregression, but they don't work well together. The reason is that on a successfully reproduced result grizzly exits with 0, but to be able to do:
mozregression -B debug --launch 2023-06-01 --command "python -m grizzly.replay --headless default {binary} /path/to/test/testcase.html"then grizzly needs to exit with a none zero exit status.
A simple script works around this, but it's not very pretty:
#!/usr/bin/bash
if [ -z "$(python -m grizzly.replay --headless default $1 $2 2>&1 | grep "Result: Assertion failure")" ]
then
exit 0
else
exit 1
fiand it eats all the log output :( It works for me, but adding e.g. a flag --return-error-on-result if returning errors directly is fighting with some other use case would also be a great solution.