Skip to content
MrKeyword
Technical SEO

Crawl stats report in Google Search Console: how to read it

The Crawl stats report, found under Settings > Crawl stats, shows how often Googlebot crawled your site in the last 90 days, how fast your server answered, and whether Google had problems reaching it. Here is what each chart means and what to fix.

A dashboard of search crawling and indexing data
The short version
  • The Crawl stats report lives under Settings > Crawl stats and covers how Googlebot crawled your site in the last 90 days.
  • Total crawl requests, total download size and average response time show how much Google fetched, how much data it used and how fast your server answered.
  • Host status covers robots.txt fetch, DNS resolution and server connectivity. A red status means Googlebot could not reach your site reliably.
  • The breakdowns by response, file type, purpose and Googlebot type show where crawls are wasted and whether Google is finding or refreshing pages.
  • A high average response time can reduce crawling. Google does not publish one cut-off, so watch the trend and fix slow templates.

Where is the Crawl stats report?

Open Google Search Console for your verified property and choose Settings → Crawl stats in the left menu. The report shows how often Googlebot crawled your site over the last 90 days, how much it downloaded, how fast your server answered, whether Google had problems reaching the host, and the crawl requests broken down by response, file type, purpose and Googlebot type. Google's Crawl stats report help describes each section and what the numbers cover.

The report is about crawling, not indexing or ranking. A high crawl count does not mean more pages are indexed, and a low count does not mean a page is missing. Read the report to see how Googlebot spends its requests on your site, then check the Page indexing report to see what happened to those URLs.

What do total crawl requests, total download size and average response time mean?

Total crawl requests is the number of requests Googlebot made to your site. Total download size is the amount of data it downloaded. Average response time is how long your server took to answer those requests. All three are shown over time, so the trend matters more than a single day.

  • Total crawl requests. A steady line means Googlebot is crawling at a predictable rate. A sudden drop can follow server errors or slow responses. A sudden spike can follow a large set of new URLs, such as filters or a new section.
  • Total download size. This is the data Googlebot pulled from your server. Large pages, images and files use more of it. A rising line with the same page count often means heavier pages.
  • Average response time. This is the average time your server took to respond to Googlebot. When it rises, Googlebot typically crawls less, because it has to wait longer for each request.

None of these numbers is a ranking score. They describe crawl activity and server health. For the page-level view, use the Page indexing report and URL Inspection.

What does host status mean and how do I fix a red host status?

Host status shows whether Googlebot could reach your site, and it covers robots.txt fetch, DNS resolution and server connectivity. A green status means those checks passed. A red or orange status means Google had a problem reaching the host, and Google may slow crawling until it clears.

  • Robots.txt fetch problems. Googlebot could not fetch your robots.txt file. A 5xx response, a timeout or a redirect loop on robots.txt can trigger this. Check the file returns 200 and is reachable. See the robots.txt guide.
  • DNS resolution problems. Googlebot could not resolve your domain to an IP address. This is a DNS or hosting issue, not a content issue. Check the domain's DNS records and ask your host whether there was an outage.
  • Server connectivity problems. Googlebot reached the host but could not connect reliably, often because of timeouts, firewall rules or repeated 5xx responses. Check server logs and the Server error (5xx) guide.

Fix the cause first, then watch host status in the report. Do not block Googlebot in a firewall or CDN rule while you investigate, because that turns a temporary problem into a crawl block.

Crawl requests by response, file type, purpose and Googlebot type

The four breakdowns show where crawl requests go and what Google is doing with them. Read the response breakdown first, because errors and redirects are the clearest waste.

Crawl request breakdowns, what they tell you and what to do

BreakdownWhat it tells youWhat to do
By responseThe share of 2xx, 3xx, 4xx and 5xx responses. A large slice of 3xx, 4xx or 5xx means crawl requests are not reaching live pages.Fix 5xx errors, flatten redirect chains, and return a real 404 or 410 for pages that are gone. Use the Page indexing report to see the status of those URLs.
By file typeWhether Googlebot is fetching HTML, images, CSS, JavaScript or other files. Image-heavy sites often see most requests go to images.Keep pages and assets fast, shrink oversized images, and make sure CSS and JavaScript are not blocked. Check the page with the free on-page SEO checker.
By purposeDiscovery requests find new URLs. Refresh requests re-crawl URLs Google already knows. A high discover share can mean lots of new or duplicate URLs.Remove duplicate and parameter URLs so discovery is not spent on pages you do not want. Keep known pages fresh and linked.
By Googlebot typeWhich crawler made the requests, such as smartphone, desktop, image or news. Most crawling now comes from the smartphone Googlebot.Make sure the mobile version has the same content, links and structured data as desktop. Check mobile rendering before blaming the crawl.
Breakdown names follow Google's Crawl stats report help, checked November 2026.

Google says the report shows requests by response, file type, purpose and Googlebot type, so use the four together. A high request count driven by images or duplicate URLs is not the same as Google crawling your important pages.

Is a high average response time a problem?

It can be, because slow responses lower crawl capacity: Googlebot fetches fewer URLs in the same time when each request takes longer. Google does not publish a single "good" response-time number for Crawl stats, so compare your own trend and the templates that are slowest rather than chasing a fixed threshold.

Look at whether a rise in average response time lines up with a fall in total crawl requests. If it does, treat it as a server or template problem. Cache expensive pages, remove slow database calls from render, use a CDN for static assets, and fix timeouts. The Core Web Vitals guide covers the speed fixes, and the crawl budget guide explains how response time and errors affect how much Google crawls.

What is the Bing equivalent of Crawl stats?

Bing Webmaster Tools has crawl information rather than a report with the same name. It shows Bing's crawl rate, crawl errors and indexed URLs, and Crawl control lets you ask Bing to crawl more or less. Use it with Search Console when you want to see whether both engines can reach the site. The Bing Webmaster Tools guide explains setup and where each report lives.

Bing's crawl data does not use Google's 90-day window, so compare the trend and the errors, not the raw numbers. If Bing shows crawl errors at the same time as a red host status in Google, the problem is likely on the server or DNS side, not with one engine.

Questions and answers

Crawl stats report questions

Where is the Crawl stats report in Google Search Console?

It is under Settings > Crawl stats in the left menu of a verified property. It shows how Googlebot crawled the site over the last 90 days, including total requests, download size, average response time, host status and the request breakdowns.

What does host status mean in Crawl stats?

Host status shows whether Googlebot could reach your site. It covers robots.txt fetch, DNS resolution and server connectivity. A red or orange status means Google had a problem reaching the host, so check robots.txt, DNS and server errors and fix the cause.

What does Crawl stats purpose mean: discovery vs refresh?

Discovery requests find new URLs that Google does not know yet. Refresh requests re-crawl URLs Google already knows so it can see changes. A large discovery share can mean Google is spending requests on new or duplicate URLs, such as filters and parameters.

Does the Crawl stats report show how many pages are indexed?

No. Crawl stats shows crawl activity: requests, download size, response time, host status and the request breakdowns. To see indexed and not-indexed URLs, use the Page indexing report and URL Inspection.

About this article

Written by the MrKeyword team, who build an SEO workspace on first-party Search Console and Bing data. Outside facts link to their original source below. We update this page when the product or the sources change.

Sources

  1. Crawl stats report — Search Console Help, on total crawl requests, download size, response time, host status and the request breakdowns
  2. Page indexing report — Search Console Help, on indexed and not-indexed URLs
Keep reading

More on technical SEO, plus the feature and free tool for the same job. All technical SEO guides →

Check the page before you ask for a crawl.

Paste any URL into the free indexability checker to confirm its status, robots.txt rules, noindex and canonical before you spend a crawl on it. Free plan for one website, no card; paid plans from $10 a month.