Search crawler · user agent AdsBot-Google, Mediapartners-Google …
Google special-case crawlers IP addresses
Special-case crawlers such as AdsBot-Google and Mediapartners-Google crawl for specific Google products and may ignore the general robots.txt user agent.
- IPv4 prefixes
- 136
- IPv6 prefixes
- 136
- IPv4 addresses
- 4,352
- Updated
Is this IP Google special-case crawlers?
Checks the address against the current list, in your browser.
Download the list
Generated from the current list.
Source: https://developers.google.com/static/search/apis/ipranges/special-crawlers.json · official documentation
All prefixes
Showing the first 236 of 272 prefixes; the full list loads with JavaScript and is in every download.
| Prefix |
|---|
| 66.249.87.0/27 |
| 66.249.87.32/27 |
| 66.249.87.64/27 |
| 66.249.87.96/27 |
| 66.249.87.128/27 |
| 66.249.87.160/27 |
| 66.249.87.192/27 |
| 66.249.87.224/27 |
| 66.249.89.0/27 |
| 66.249.89.32/27 |
| 66.249.89.64/27 |
| 66.249.89.96/27 |
| 66.249.89.128/27 |
| 66.249.89.160/27 |
| 66.249.89.192/27 |
| 66.249.89.224/27 |
| 66.249.90.0/27 |
| 66.249.90.32/27 |
| 66.249.90.64/27 |
| 66.249.90.96/27 |
| 66.249.90.128/27 |
| 66.249.90.160/27 |
| 66.249.90.192/27 |
| 66.249.90.224/27 |
| 66.249.91.0/27 |
| 66.249.91.32/27 |
| 66.249.91.64/27 |
| 66.249.91.96/27 |
| 66.249.91.128/27 |
| 66.249.91.160/27 |
| 66.249.91.192/27 |
| 66.249.91.224/27 |
| 66.249.92.0/27 |
| 66.249.92.32/27 |
| 66.249.92.64/27 |
| 66.249.92.96/27 |
| 66.249.92.128/27 |
| 66.249.92.160/27 |
| 66.249.92.192/27 |
| 66.249.92.224/27 |
| 72.14.199.0/27 |
| 72.14.199.32/27 |
| 72.14.199.64/27 |
| 72.14.199.96/27 |
| 72.14.199.128/27 |
| 72.14.199.160/27 |
| 72.14.199.192/27 |
| 72.14.199.224/27 |
| 74.125.148.0/27 |
| 74.125.148.32/27 |
| 74.125.148.64/27 |
| 74.125.148.96/27 |
| 74.125.148.128/27 |
| 74.125.148.160/27 |
| 74.125.148.192/27 |
| 74.125.148.224/27 |
| 74.125.149.0/27 |
| 74.125.149.32/27 |
| 74.125.149.64/27 |
| 74.125.149.96/27 |
| 74.125.149.128/27 |
| 74.125.149.160/27 |
| 74.125.149.192/27 |
| 74.125.149.224/27 |
| 74.125.150.0/27 |
| 74.125.150.32/27 |
| 74.125.150.64/27 |
| 74.125.150.96/27 |
| 74.125.150.128/27 |
| 74.125.150.160/27 |
| 74.125.150.192/27 |
| 74.125.151.0/27 |
| 74.125.151.32/27 |
| 74.125.151.64/27 |
| 74.125.151.96/27 |
| 74.125.151.128/27 |
| 74.125.151.160/27 |
| 74.125.151.192/27 |
| 74.125.151.224/27 |
| 74.125.216.0/27 |
| 74.125.216.32/27 |
| 74.125.216.64/27 |
| 74.125.216.96/27 |
| 74.125.216.128/27 |
| 74.125.216.160/27 |
| 74.125.216.192/27 |
| 74.125.216.224/27 |
| 74.125.217.0/27 |
| 74.125.217.32/27 |
| 74.125.217.64/27 |
| 74.125.217.96/27 |
| 74.125.217.128/27 |
| 74.125.217.160/27 |
| 74.125.217.192/27 |
| 74.125.217.224/27 |
| 74.125.218.0/27 |
| 74.125.218.32/27 |
| 74.125.218.64/27 |
| 74.125.218.96/27 |
| 74.125.218.128/27 |
| 74.125.218.160/27 |
| 74.125.218.192/27 |
| 74.125.218.224/27 |
| 74.125.219.0/27 |
| 74.125.219.32/27 |
| 74.125.219.64/27 |
| 74.125.219.96/27 |
| 74.125.219.128/27 |
| 74.125.219.160/27 |
| 74.125.219.192/27 |
| 74.125.219.224/27 |
| 108.177.2.0/27 |
| 108.177.2.32/27 |
| 108.177.2.64/27 |
| 108.177.2.96/27 |
| 108.177.2.128/27 |
| 108.177.2.160/27 |
| 108.177.2.192/27 |
| 108.177.2.224/27 |
| 192.178.16.0/27 |
| 192.178.16.32/27 |
| 192.178.16.64/27 |
| 192.178.16.96/27 |
| 192.178.16.128/27 |
| 192.178.16.160/27 |
| 192.178.16.192/27 |
| 192.178.16.224/27 |
| 192.178.17.0/27 |
| 209.85.238.0/27 |
| 209.85.238.32/27 |
| 209.85.238.64/27 |
| 209.85.238.96/27 |
| 209.85.238.128/27 |
| 209.85.238.160/27 |
| 209.85.238.192/27 |
| 209.85.238.224/27 |
| 2001:4860:4801:2008::/64 |
| 2001:4860:4801:200c::/64 |
| 2001:4860:4801:200d::/64 |
| 2001:4860:4801:2010::/64 |
| 2001:4860:4801:2011::/64 |
| 2001:4860:4801:2012::/64 |
| 2001:4860:4801:2013::/64 |
| 2001:4860:4801:2014::/64 |
| 2001:4860:4801:2015::/64 |
| 2001:4860:4801:2016::/64 |
| 2001:4860:4801:2017::/64 |
| 2001:4860:4801:2018::/64 |
| 2001:4860:4801:2019::/64 |
| 2001:4860:4801:201a::/64 |
| 2001:4860:4801:201b::/64 |
| 2001:4860:4801:201c::/64 |
| 2001:4860:4801:201d::/64 |
| 2001:4860:4801:201e::/64 |
| 2001:4860:4801:201f::/64 |
| 2001:4860:4801:2020::/64 |
| 2001:4860:4801:2021::/64 |
| 2001:4860:4801:2022::/64 |
| 2001:4860:4801:2023::/64 |
| 2001:4860:4801:2024::/64 |
| 2001:4860:4801:2025::/64 |
| 2001:4860:4801:2026::/64 |
| 2001:4860:4801:2027::/64 |
| 2001:4860:4801:2028::/64 |
| 2001:4860:4801:2029::/64 |
| 2001:4860:4801:202a::/64 |
| 2001:4860:4801:202b::/64 |
| 2001:4860:4801:202c::/64 |
| 2001:4860:4801:202d::/64 |
| 2001:4860:4801:202e::/64 |
| 2001:4860:4801:202f::/64 |
| 2001:4860:4801:2030::/64 |
| 2001:4860:4801:2031::/64 |
| 2001:4860:4801:2032::/64 |
| 2001:4860:4801:2033::/64 |
| 2001:4860:4801:2034::/64 |
| 2001:4860:4801:2035::/64 |
| 2001:4860:4801:2036::/64 |
| 2001:4860:4801:2037::/64 |
| 2001:4860:4801:2038::/64 |
| 2001:4860:4801:2039::/64 |
| 2001:4860:4801:203a::/64 |
| 2001:4860:4801:203b::/64 |
| 2001:4860:4801:203c::/64 |
| 2001:4860:4801:203d::/64 |
| 2001:4860:4801:203e::/64 |
| 2001:4860:4801:203f::/64 |
| 2001:4860:4801:2040::/64 |
| 2001:4860:4801:2041::/64 |
| 2001:4860:4801:2042::/64 |
| 2001:4860:4801:2043::/64 |
| 2001:4860:4801:2044::/64 |
| 2001:4860:4801:2045::/64 |
| 2001:4860:4801:2046::/64 |
| 2001:4860:4801:2047::/64 |
| 2001:4860:4801:2048::/64 |
| 2001:4860:4801:2049::/64 |
| 2001:4860:4801:204a::/64 |
| 2001:4860:4801:204b::/64 |
| 2001:4860:4801:204c::/64 |
| 2001:4860:4801:204d::/64 |
| 2001:4860:4801:204e::/64 |
| 2001:4860:4801:2050::/64 |
| 2001:4860:4801:2051::/64 |
| 2001:4860:4801:2052::/64 |
| 2001:4860:4801:2053::/64 |
| 2001:4860:4801:2054::/64 |
| 2001:4860:4801:2055::/64 |
| 2001:4860:4801:2056::/64 |
| 2001:4860:4801:2060::/64 |
| 2001:4860:4801:2061::/64 |
| 2001:4860:4801:2062::/64 |
| 2001:4860:4801:2063::/64 |
| 2001:4860:4801:2064::/64 |
| 2001:4860:4801:2065::/64 |
| 2001:4860:4801:2066::/64 |
| 2001:4860:4801:2067::/64 |
| 2001:4860:4801:2068::/64 |
| 2001:4860:4801:2069::/64 |
| 2001:4860:4801:206a::/64 |
| 2001:4860:4801:206b::/64 |
| 2001:4860:4801:206c::/64 |
| 2001:4860:4801:206d::/64 |
| 2001:4860:4801:206e::/64 |
| 2001:4860:4801:206f::/64 |
| 2001:4860:4801:2070::/64 |
| 2001:4860:4801:2071::/64 |
| 2001:4860:4801:2072::/64 |
| 2001:4860:4801:2073::/64 |
| 2001:4860:4801:2074::/64 |
| 2001:4860:4801:2075::/64 |
| 2001:4860:4801:2076::/64 |
| 2001:4860:4801:2077::/64 |
| 2001:4860:4801:2078::/64 |
| 2001:4860:4801:2079::/64 |
| 2001:4860:4801:207a::/64 |
Verifying Google special-case crawlers
The user agent string AdsBot-Google, Mediapartners-Google … can be faked by anyone, and scrapers often pretend to be well-known bots to get past rate limits. Before you treat a request as Google special-case crawlers:
- Check that the request IP is inside one of the prefixes above (the checker on this page does exactly that).
- Load the list from its source on a schedule; do not hard-code it.
- Allow the verified bot in your firewall or bot protection, and rate-limit or challenge requests that only claim to be it.
Frequently asked questions
What are the IP ranges of Google special-case crawlers?
How do I verify that a request really comes from Google special-case crawlers?
How often do the Google special-case crawlers IP ranges change?
How do I allow only Google special-case crawlers in nginx?
IP geolocation API
Know who is behind any IP
Beyond published lists, the ipbase API tells you the owner, ASN and location of every IP address, and on the Small plan and above its data-center and VPN status, so you can recognise cloud traffic and bots from any provider.
Read the documentation150 free requests every month. No credit card required.
GET https://api.ipbase.com/v2/info?ip=1.1.1.1
{
"data": {
"ip": "1.1.1.1",
"type": "v4",
"connection": {
"asn": 13335,
"organization": "APNIC and Cloudflare DNS Resolver project",
"isp": "Cloudflare, Inc",
"range": "1.1.1.0/24"
},
"location": {
"country": { "alpha2": "AU", "name": "Australia" },
"zip": "4000"
},
"security": { "is_vpn": null, "is_tor": null, "threat_score": null }
}
}