Google has published a new page in which it explains how Google processes web pages for indexing.
Googlebot uses a web rendering service (WRS) based on Chrome 41 (M41). In general, WRS supports the same features and capabilities that the Chrome web platform uses. However, there are some exceptions and differences that you should be aware of.
Features and APIs that are explicitly disabled or limited
1. Web Rendering Service and Googlebot do not support WebSocket protocol
Googlebot and WRS only understand HTTP/1.x and FTP, with and without TLS. Use SEOprofiler's website audit tool to check the HTTP version of your website:
2. The web rendering service disables some interfaces and capabilities
- The IndexedDB and WebSQL interfaces are disabled.
- Interfaces defined by the Service Worker specification are disabled.
- The WebGL interface is disabled; 3D and VR content is not indexed.
If you want to find out if the Googlebot web rendering service supports a certain block of code.
3. Googlebot and the web rendering service are “stateless” between page loads
Googlebot's web rendering service loads each URL on your page, following server and client redirects, just like a normal browser. However, the web rendering service does not persist state between page loads:
- Local Storage and Session Storage data is cleared on page loads.
- HTTP cookies are cleared on page loads.
If a page on your website requires a cookie that was set by another page on your website, this will not work.
4. Web rendering service rejects permission requests
Features that require user consent are automatically rejected by Googlebot. For example, the Camera API, Geolocation API, and Notifications API.
There is an easy way to review your pages
Ensuring that Googlebot can index your web pages can be a complicated and time-consuming task. Fortunately, there is an easy way to review your pages. The website audit tool in SEOprofiler checks all the pages on your website and also shows you the things you have to change so that Google can index your web pages correctly.
When you get a clearance from the web audit tool at SEOprofiler, you can be sure that Google and other search engines can index your pages. If you haven't already, check your pages now
SEOPROFILER
