I have an automated framework where my program submits tests to a private WPT installation via the REST API. After submitting the test (for 9 runs) it checks for the status via the /testStatus.php REST endpoint every 30 seconds. After getting a response of “statusCode”:200,“statusText”:“Test Complete” the response sometimes contains “testsCompleted” as less than 9. When I manually check the status via the same endpoint after a few hours the testCompleted is returned correctly as 9.
This does not happen always but does happen 1 in 15 runs or so.