There is a “Capture Lighthouse Report” option under the Chrome tab. Is that the same as running a full lighthouse audit? And where can I find the results? I tried running a test with this option and can’t seem to find lighthouse related info from both the html results and json output.
The Lighthouse results are available from the Test Result page. The link to the results is listed as a box in the upper right corner of the details page – the box is located next to left of the First Byte time. To access the results click the box.
Also, it only works for the Mobile devices (actual devices in Dulles) and a handful of locations that are running the desktop Linux agent.
@pmeenan
Can you please list out the locations where desktop Linux agent is available? I was trying to incorporate Lighthouse with my testing framework, but it’s a lot of work.
Anytime soon in future would you be incorporating Lighthouse for all locations?
These locations:
Dulles_MotoG4
Dulles_MotoG
Dulles_Nexus5
Dulles_MotoE
Dulles_GalaxyS7
Dulles_GalaxyS5
Dulles_Nexus7
Dulles_Linux
Texas
Strasburg_FR
Falkenstein
Poland
Mauritius
ap-south-1 (Mumbai)
If you are using the API then the ones that will be available to the API are:
Dulles_MotoG4
Dulles_MotoG
Dulles_Linux
ap-south-1
Eventually it will become available in all locations as I migrate to the new agent everywhere but it will be quite a while before that happens.
Hi WPTians,
We have an private WPT instance and running a test from ap-south-1 with Capture Lighthouse Report option but we are not able to get the Light House report in the result. Can anyone help us here.
Thanks!
Deepak Bhatt
Sorry, the ap-south-1 I quoted above was just for the public WPT instance. If you are running a private instance it can be in any region BUT it needs to be the new wptagent (chrome-only) agents. I released some AMI’s on the private instances page a while back but that may have been before the Lighthouse support was added so I’m not 100% sure the AMI itself will “just work”.
I can update the Linux AMI’s to make sure they have all of the latest dependencies and Lighthouse support. I’m working on Firefox support right now but I can do an update without necessarily waiting for that to be done.
The good news is that they’re ~1/5th the cost of running the Windows instances.
OK, All of the Linux AMI images have been updated and now include the Lighthouse support: https://sites.google.com/a/webpagetest.org/docs/private-instances#TOC-AMI-Images
Hi Patrick,
Thanks for updating the AMI, Deepak and me are from same team. we have a setting on server in settings.ini agentUpdate=http://cdn.webpagetest.org/.
Now we can see Lihouse option in Chrome tab, but when we are running the test lighthouse results are not getting captured. we selected location us-east-1, do we need to add any location is location.ini as well?
Thanks & Regards
Pankaj Kamran
Thank you for your valuable response, this really helps me alot 
Although I had changed some location configuration to get the light house report.
Now, I have one more question regarding Light house, it can be configured i.e we can select the test options we want to perform. So is there any way in WPT, we can configure the light house test options. If there can you please share the way to do that and this will really make our work easier.
Thanks in advanced.
Regards!
Deepak Bhatt
@pkamran - if you are using the server AMI it is only configured to launch the Windows AMI’s and doesn’t know about the Linux ones. I’ll update the ec2 locations ini in Github in a bit and they’ll show up as new locations.
@dbhatt Which options are you looking to configure specifically? Most of the options around device emulation and traffic-shaping are configured automatically based on the test parameters (enable mobile emulation for the WPT test and the same emulation carries into the lighthouse test).
Right now the --max-wait-for-load isn’t being set but it makes sense to pass the WPT timeout setting through. Same goes for the WPT setting for additional chrome command-line switches.
The only other option that looks like you might want to tune would be which audits get run though I think it collects all of them by default.
Thank you Patrick for your response. Yes, I want to remove some audits which gets run while running light house. You are correct, as by default all the audits are there in the report. So, is there any way to configure the audit list i.e. to choose the audits we want to run?
Many Thanks!
Deepak Bhatt
Thankyou Very much Patrick, Please let me know once you are done with your changes in GIT.
[hr]
Hi Patrick,
One more question is there way to get Lighthouse result in json format?
Thanks,
Pankaj Kamran
The lighthouse results are returned in json as part of the json API response (look for lighthouse at the top level of the results): https://www.webpagetest.org/jsonResult.php?test=170517_4J_6f9d87e0f5725249f6b54f16217fbe01&pretty=1
Since the API can pull all of the individual checks from the JSON do you really need to turn off the checks at the time of testing? I certainly wouldn’t add it as a UI option (API only) and I’m happy to accept a PR for the code but I probably won’t be writing it.
The EC2 locations list has been updated in github so as long as your server is pulling updates it should get it within the next hour (-linux is added to each of the locations for the Linux variant).
Hi Patrick,
We are running lighthouse from all ec2 location on our private instance and test are working fine, thanks for that.
But we are facing a problem with the basic Authenticated sites, whenever we run the test with lighthouse enable on Authenticated sites we are not getting Lighthouse results. Please can you let us how we can get those.
Thanks
Deepak
You can’t. Lighthouse doesn’t support any interaction with the page or adding custom headers so there is no way to set the auth headers.
Hi Patrick,
When I am trying to run the test from Linux machine, tester machines are not launching and we are getting the below error:
Error: Launching EC2 instance. Region: us-east-2, AMI: ami-95c9eef0, error: The requested configuration is currently not supported. Please check the documentation for supported configurations.
Can you please check that and provide me some work around.
Many Thanks!
Deepak
Hi Patrick,
I have some finding – Linux test instances are spinning up but the master server is not able to pass the tests to the Linux test machine. Can you please help me here.
Regards!
Deepak Bhatt