Google stresses the importance of using actual user data to assess Core Web Vitals instead of relying only on lab data from tools like PageSpeed Insights (PSI) and Lighthouse.
This reminder comes as the company prepares to update the throttling settings in PSI. These updates are expected to increase the performance scores of websites in Lighthouse.
Field Data vs. Lab Data
Core Web Vitals measure a website’s performance in terms of loading speed, interactivity, and visual stability from the user’s perspective.
Field data shows users’ actual experiences, while lab data comes from tests done in controlled environments using tools like Lighthouse.
Barry Pollard, a Web Performance Developer Advocate at Google, recently emphasized focusing on field data.
In a LinkedIn post, he stated:
“You should concentrate on your field Core Web Vitals (the top part of PageSpeed Insights), and only use the lab Lighthouse Score as a very rough guide of whether Lighthouse has recommendations to improve performance or not…
The Lighthouse Score is best for comparing two tests made on the same Lighthouse (e.g. to test and compare fixes).
Performance IS—and hence LH Scores also ARE—highly variable. LH is particularly affected by where it is run from (PSI, DevTools, CI…), but also on the lots of other factors.
Lighthouse is a GREAT tool but it also can only test some things, under certain conditions.
So while it’s great to see people interested in improving webperf, make sure you’re doing just that (improve performance) and not just improving the score”
Upcoming Changes To PageSpeed Insights
Pollard discussed user concerns about PageSpeed Insights’s slow servers, which can cause Lighthouse tests to take longer than expected.
To fix this, Google is changing the throttling settings in PageSpeed Insights, which should lead to better performance scores when the update is released in the coming weeks.
These changes will affect both the web interface and the API but will not impact other versions of Lighthouse.