Skip to main content

commoncrawl.org

commoncrawl.org had about 113.49K visits in September 2026, up 4.87% from August; the top source is direct.

Common Crawl - Open Repository of Web Crawl Data

Traffic

113.49K

+4.87%MoMEstimated monthly visits
789122.56K81.71K40.85K0
Global rank

329,333

Country rank · United States

214,407

Category rank · Computers Electronics and Technology

3,755

Average visit duration

00:56

Pages per visit

2.39

Bounce rate

41.19%

Domain age

19 years

Search share

34.7%

Traffic sources

  • Direct
    39.9%
  • Search
    34.7%
  • Generative AI
    11.9%
  • Referrals
    9.9%
  • Social
    3.2%
  • Email
    0.4%
  • Other
    0.0%
  • Paid search
    0.0%

Regions

  • United States
    35.5%
  • India
    6.8%
  • Poland
    4.6%
  • Germany
    3.9%
  • Indonesia
    3.5%

See how commoncrawl.org compares with the most visited websites in the world, the fastest growing websites and sites gaining organic search traffic.

Search visibility

Keyword samples

Estimated visitsMonthly searchesVisits ÷ searches
  1. common crawlBRAND31.12K20.67K151%
  2. commoncrawlBRAND1.91K2.04K94%
  3. ccbot5402.23K24%
  4. common crawl indexBRAND230230100%
  5. cc-main-2026-3419020095%

Keyword rankings

Keyword rankings

Example · google.comUnited States · English

86.4M

Search estimate

New 1 · Up 2

Ranking keywords
12,400
Landing pages
4
Search competitors
4
AI citations
2
PositionEstimated visits
  1. google#142M
  2. gmail#118.2M
  3. google maps#19.4M
  4. google drive#14.1M

Full keyword rankings are a Pro feature

Unlock Pro

Baidu rank

Site profile

  • HTTP 200
  • Email authentication
  • Hosting ASN
HTTP
200
Page size
26.1 KiB
Hosting
CLOUDFLARESPECTRUM Cloudflare London, LLC · AS209242
Email authentication
SPF
TLS
TLSv1.3 · 47 days
Page and SEO
Title
Common Crawl - Open Repository of Web Crawl Data
Description
We build and maintain an open repository of web crawl data that can be accessed and analyzed by anyone.
Cross-origin redirect
No
Word count
413
Internal / external links
24 / 18
Canonical
https://commoncrawl.org/
Language
en
H1 / H2
1 / 10
Images missing alt
1 / 7
OG / Twitter
OG · Twitter
Technology and tracking3 technologies
Technology clues
Webflow · jQuery · Cloudflare
External script hosts
d3e54v103j8qbb.cloudfront.net · cdn.prod.website-files.com
Social links
github.com · x.com · linkedin.com
Server
cloudflare
Security headers
1 / 6
HSTS / CSP
HSTS
Alt-Svc
Set
Cookie
1(Secure 1)
Email and DNS securitySet
SPF
Set
DMARC
Not found
DKIM selectors
Not found
Mail stack
Google Workspace
IPv6
AAAA present
Site verification TXT
Google
SOA
jim.ns.cloudflare.com
NS
jim.ns.cloudflare.com. · ruth.ns.cloudflare.com.
MX
1 aspmx.l.google.com. · 10 alt3.aspmx.l.google.com. · 10 alt4.aspmx.l.google.com. · 2 more
Hosting and networkAS209242
A
198.202.211.1
AAAA
2620:cb:2000::1
Hosting ASN
AS209242 · 198.202.211.0/24
Hosting organization
CLOUDFLARESPECTRUM Cloudflare London, LLC
Hosting country
US
BGP announcement
Yes
TLS
TLSv1.3 · Verified
Certificate issuer
WE1
Certificate remaining
47 days
Certificate SAN
DNS:commoncrawl.org
robots and AI crawlingHTTP 200
Robots.txt
200
Global Disallow /
No
Sitemap
URL set · 401
AI explicitly disallowed
0
AI explicitly allowed
0
Well-known public paths
Present / checked
0 / 5

Website information

Domain
commoncrawl.org
Registration status
Domain registered
Registered
2007-11-21
Registrar
GoDaddy.com, LLC
Expires
2033-11-21
Domain age
19 years
DNSSEC
No
Registry status
client delete prohibited · client renew prohibited · client transfer prohibited · client update prohibited

Similar sites

What's in this report

The report starts with a whole-site monthly visit estimate. Search visibility and public site facts follow when they exist.

  • Website traffic is a modeled whole-site estimate, with a source, observation period and confidence.
  • Search visibility is ranking keywords and search traffic, listed separately from whole-site visits.
  • Missing or partial values stay marked in the report.