Error given multiple times on specific website

Hi,

The following test for the same website all give Web Page Test errors. Think I have found a bug.

https://www.webpagetest.org/result/161117_PR_3N6Q/
https://www.webpagetest.org/result/161117_1M_2A6D/
https://www.webpagetest.org/result/161116_R3_BN10/

Try turning on the “preserve user agent string” field in the advanced settings. Looks like the security for that site may be turned up pretty tight and it is probably blocking access based of the PTST/ string that gets added to the UA string (or it could be blocking access from the IP addresses).

Not a bug with WPT itself, the site is actively blocking access which is what 403’s usually are.

Hi Patrick,

The keepua (preserve user agent string) seemed to fix it. What actually does it do? Would there be any benefit/issues with turning this on for all tests?

It prevents WPT from appending a PTST/ number to the UA string and uses the browser’s original string. Leaving the PTST addition makes it possible to filter out test traffic in your analytics so I usually wouldn’t recommend always disabling it.

When calling WPT via url, if enable the keepua=1 querystring attribute, the keepua is not passed to WPT.

See example below:
https://www.webpagetest.org/runtest.php?url=http%3A%2F%2Fwww.lululemon.co.uk&k=[KEY HERE]&f=json&location=ec2-eu-west-1%3AChrome&runs=3&video=1&fvonly=0&keepua=1

Is this a bug?

Does the same test work through the UI? The UI uses the same API so it would be strange to work on one cease but not the other.

If appending keepua=1 to the querystring is the same as selecting “preserve user agent string” then the test works through the UI but not via the querystring. I think there could be a bug.

Think this may be an issue to do with where the tests are running. Preserve User Agent works in London but not Ireland. Created a new thread for this now:

https://www.webpagetest.org/forums/showthread.php?tid=14647