Similarweb ScraperExport websites now

Similarweb Scraper

Name: Similarweb Scraper
Rating: 5.0 (33 reviews)
Author: lobstr.io

Give it a website or Similarweb URL, get the websites: company name, category, description, ads networks total count, company email, company phone, company headquarter city, snapshot date and 85 more fields, in a spreadsheet, in your tools, through the API or from your AI agent.

1 creditper resultWorks todayNew

Export websites now

1Input

URL*Ranking CountryRanking CategoryMax Results Per Task*

Options, per resultCompany Details+1AI Traffic+1Competitor Metrics+1

1 credit per result

2Results

[
  {
    "id": "c4ca4238a0b923820dcc509a6f75849b",
    "icon": "https://site-images.similarcdn.com/image?url=stackoverflow.com&t=2&s=1&h=04179ebf8566da481b023bba12856a0748752b1e4a75d1b145220282ef93f21c",
    "object": "result",
    "visits": "19577663",
    "task_id": "ac37a51d5fb110f3a08f5a8c1894a4eb",
    "category": "computers_electronics_and_technology/programming_and_developer_software",
    "input_url": "stackoverflow.com",
    "scraped_at": "2026-09-22 09:03:33.794356+00",
    "source_url": "https://www.similarweb.com/website/stackoverflow.com/",
    "bounce_rate": "0.31878641267839114",
    "description": "Stack Overflow | The World’s Largest Online Community for Developers",
    "domain_name": "stackoverflow.com",
    "gender_male": "0.6866941219440793",
    "global_rank": "2787",
    "collected_at": "2026-09-22 09:03:33.839613+00",
    "company_name": "Stack Overflow",
    "country_code": "US",
    "country_rank": "2584",
    "technologies": "[{\"icon\": \"https://s3.amazonaws.com/s3-static-us-east-1.similarweb.com/technographics/id=237\", \"category\": \"advertising\", \"top_technology\": \"Google Adsense\", \"technologies_total_count\": 81}, {\"icon\": \"https://s3.amazonaws.com/s3-static-us-east-1.similarweb.com/technographics/id=2901\", \"category\": \"payment_and_currencies\", \"top_technology\": \"Cart Functionality\", \"technologies_total_count\": 41}, {\"icon\": \"https://s3.amazonaws.com/s3-static-us-east-1.similarweb.com/technographics/id=1\", \"category\": \"conversion_and_analytics\", \"top_technology\": \"Google Analytics\", \"technologies_total_count\": 17}, {\"icon\": \"https://s3.amazonaws.com/s3-static-us-east-1.similarweb.com/technographics/id=1952\", \"category\": \"widget\", \"top_technology\": \"reCAPTCHA\", \"technologies_total_count\": 11}]",
    "top_keywords": "[{\"cpc\": 0.8, \"name\": \"c\", \"volume\": null, \"estimated_value\": null}, {\"cpc\": 1.47, \"name\": \"stack overflow\", \"volume\": null, \"estimated_value\": null}, {\"cpc\": 1.47, \"name\": \"stackoverflow\", \"volume\": null, \"estimated_value\": null}, {\"cpc\": 0.3, \"name\": \"weather forecast\", \"volume\": null, \"estimated_value\": null}, {\"cpc\": null, \"name\": \"vpn comparison\", \"volume\": null, \"estimated_value\": null}]",
    "category_rank": "75",
    "gender_female": "0.3133058780559207",
    "param_country": "worldwide",
    "snapshot_date": "2026-08-01 00:00:00+00",
    "top_ads_sites": "[{\"icon\": null, \"domain\": null, \"is_locked\": true, \"visits_share\": 0.9965985174153249}, {\"icon\": null, \"domain\": null, \"is_locked\": true, \"visits_share\": 0.0019726959687411264}, {\"icon\": \"https://site-images.similarcdn.com/image?url=rivm.nl&t=2&s=1&h=6eb0a1c5f40c5b03ecb15edd6dd5eed3fb4ef44b7e0d5fe1bc9c7d7d79b6f275\", \"domain\": \"rivm.nl\", \"is_locked\": false, \"visits_share\": 0.001428786615934015}]",
    "top_countries": "[{\"country_code\": \"US\", \"visits_share\": 0.22079173682624625, \"country_url_code\": \"united-states\", \"visits_share_change\": -0.1189514175094526}, {\"country_code\": \"DE\", \"visits_share\": 0.08900758574300593, \"country_url_code\": \"germany\", \"visits_share_change\": -0.06180527128456137}, {\"country_code\": \"GB\", \"visits_share\": 0.08566823483301796, \"country_url_code\": \"united-kingdom\", \"visits_share_change\": -0.03539655662412844}, {\"country_code\": \"IN\", \"visits_share\": 0.0803049952762943, \"country_url_code\": \"india\", \"visits_share_change\": -0.11373398272540669}, {\"country_code\": \"FR\", \"visits_share\": 0.03762826940430098, \"country_url_code\": \"france\", \"visits_share_change\": -0.15184103395970805}]",
    "visits_change": "-0.10284440520969597",
    "param_category": "all-categories",
    "preview_mobile": "https://site-images.similarcdn.com/image?url=stackoverflow.com&t=4&s=1&h=04179ebf8566da481b023bba12856a0748752b1e4a75d1b145220282ef93f21c",
    "is_data_from_ga": "FALSE",
    "pages_per_visit": "3.36318378687743",
    "preview_desktop": "https://site-images.similarcdn.com/image?url=stackoverflow.com&t=1&s=1&h=04179ebf8566da481b023bba12856a0748752b1e4a75d1b145220282ef93f21c",
    "result_position": "1",
    "traffic_history": "[{\"date\": \"2026-06-01T00:00:00+00:00\", \"percentage_value\": 26.4616835, \"percentage_change\": -12.497311215791344}, {\"date\": \"2026-07-01T00:00:00+00:00\", \"percentage_value\": 24.6397334, \"percentage_change\": -8.489315854462209}, {\"date\": \"2026-08-01T00:00:00+00:00\", \"percentage_value\": 22.6198967, \"percentage_change\": -10.284440520969596}]",
    "traffic_sources": "[{\"rank\": 1, \"source\": \"organic\", \"percentage\": 0.830879597210463}, {\"rank\": 2, \"source\": \"direct\", \"percentage\": null}, {\"rank\": 3, \"source\": \"referrals\", \"percentage\": null}, {\"rank\": null, \"source\": \"social_organic\", \"percentage\": null}, {\"rank\": null, \"source\": \"gen_ai\", \"percentage\": null}, {\"rank\": null, \"source\": \"mail\", \"percentage\": null}, {\"rank\": null, \"source\": \"ads\", \"percentage\": null}, {\"rank\": null, \"source\": \"social_paid\", \"percentage\": null}, {\"rank\": null, \"source\": \"affiliate\", \"percentage\": null}, {\"rank\": -1, \"source\": \"paid\", \"percentage\": null}]",
    "age_distribution": "[{\"value\": 0.2579995098391657, \"max_age\": 24, \"min_age\": 18}, {\"value\": 0.34470789147010317, \"max_age\": 34, \"min_age\": 25}, {\"value\": 0.18403265910633765, \"max_age\": 44, \"min_age\": 35}, {\"value\": 0.11828978049870767, \"max_age\": 54, \"min_age\": 45}, {\"value\": 0.05894461337565239, \"max_age\": 64, \"min_age\": 55}, {\"value\": 0.03602554571003362, \"max_age\": null, \"min_age\": 65}]",
    "company_category": "computers_electronics_and_technology/programming_and_developer_software",
    "has_traffic_data": "TRUE",
    "param_ai_traffic": "FALSE",
    "paid_search_share": "0",
    "param_max_results": "50",
    "avg_visit_duration": "128",
    "global_rank_change": "853",
    "graph_visits_grade": "<100M",
    "top_outgoing_sites": "[{\"icon\": null, \"domain\": null, \"is_locked\": true, \"visits_share\": 0.41082707785232014}, {\"icon\": null, \"domain\": null, \"is_locked\": true, \"visits_share\": 0.19955686619863316}, {\"icon\": null, \"domain\": null, \"is_locked\": true, \"visits_share\": 0.18136925082971725}, {\"icon\": \"https://site-images.similarcdn.com/image?url=stackoverflow.blog&t=2&s=1&h=f7b2ff409be1e39bbc55c0765668ce1e6e189c190f0cf66ffa718429f0b5fe2d\", \"domain\": \"stackoverflow.blog\", \"is_locked\": false, \"visits_share\": 0.16631858995563115}, {\"icon\": \"https://site-images.similarcdn.com/image?url=stackapps.com&t=2&s=1&h=9462f2abed446f55e968b4ec777056e18c130057bd404be083e5a44b1779e617\", \"domain\": \"stackapps.com\", \"is_locked\": false, \"visits_share\": 0.023671408835545485}, {\"icon\": \"https://site-images.similarcdn.com/image?url=github.com&t=2&s=1&h=6525c30f1af9ea5ee8912788b611744e1debcba39a2d0dd3d410b2916169883b\", \"domain\": \"github.com\", \"is_locked\": false, \"visits_share\": 0.018256806328152835}]",
    "top_referral_sites": "[{\"icon\": null, \"domain\": null, \"is_locked\": true, \"visits_share\": 0.24131427088239288}, {\"icon\": null, \"domain\": null, \"is_locked\": true, \"visits_share\": 0.23236899680326023}, {\"icon\": null, \"domain\": null, \"is_locked\": true, \"visits_share\": 0.06645933351024498}, {\"icon\": \"https://site-images.similarcdn.com/image?url=yahoo.com&t=2&s=1&h=a135e030f99f8070348f49e9e1879c9093cdb33ad6b658fa2593fed09fa6060e\", \"domain\": \"yahoo.com\", \"is_locked\": false, \"visits_share\": 0.05180570114092532}, {\"icon\": \"https://site-images.similarcdn.com/image?url=yandex.ru&t=2&s=1&h=f0674e5e56f12160a4f31738b3aecd42e2ebffde994db0c5ebdd214ef6dde60e\", \"domain\": \"yandex.ru\", \"is_locked\": false, \"visits_share\": 0.03920564525738437}, {\"icon\": \"https://site-images.similarcdn.com/image?url=dontasktoask.com&t=2&s=1&h=8a01211e9c6c1a355b9b85c6d88ee5c8e350de009b37b356d4656ff33c46f968\", \"domain\": \"dontasktoask.com\", \"is_locked\": false, \"visits_share\": 0.016527771272520028}]",
    "company_revenue_max": "75000000",
    "company_revenue_min": "50000000",
    "country_rank_change": "611",
    "global_rank_history": "[{\"date\": \"2026-06-01T00:00:00+00:00\", \"rank\": 2946}, {\"date\": \"2026-07-01T00:00:00+00:00\", \"rank\": 3640}, {\"date\": \"2026-08-01T00:00:00+00:00\", \"rank\": 2787}]",
    "similar_competitors": "[{\"icon\": \"https://site-images.similarcdn.com/image?url=github.com&t=2&s=1&h=6525c30f1af9ea5ee8912788b611744e1debcba39a2d0dd3d410b2916169883b\", \"domain\": \"github.com\", \"affinity\": 1.0, \"category\": \"computers_electronics_and_technology/programming_and_developer_software\", \"category_rank\": 3}, {\"icon\": \"https://site-images.similarcdn.com/image?url=w3schools.com&t=2&s=1&h=02c89d55b14895760805a9aea3f83c745c4245a78884e5f77c79d11fd73c0c80\", \"domain\": \"w3schools.com\", \"affinity\": 0.9239130434782608, \"category\": \"computers_electronics_and_technology/programming_and_developer_software\", \"category_rank\": 79}, {\"icon\": \"https://site-images.similarcdn.com/image?url=developer.mozilla.org&t=2&s=1&h=f23257ed173835b070d977994ebe214658a7ae327a10e31b2abe089229dbcf90\", \"domain\": \"developer.mozilla.org\", \"affinity\": 0.9021739130434782, \"category\": \"computers_electronics_and_technology/programming_and_developer_software\", \"category_rank\": null}, {\"icon\": \"https://site-images.similarcdn.com/image?url=dev.to&t=2&s=1&h=79ddf10fe64be0f867f7ab2a48d0b328800b3d580b6d5004cf17518b5b1fcb50\", \"domain\": \"dev.to\", \"affinity\": 0.8913043478260869, \"category\": \"computers_electronics_and_technology/programming_and_developer_software\", \"category_rank\": 373}, {\"icon\": \"https://site-images.similarcdn.com/image?url=learn.microsoft.com&t=2&s=1&h=f026fe6161d50020b8d8ee7ad3db3c3e0a9001da17b8e26fa85d6cb760ed81f1\", \"domain\": \"learn.microsoft.com\", \"affinity\": 0.8586956521739131, \"category\": \"computers_electronics_and_technology/programming_and_developer_software\", \"category_rank\": null}, {\"icon\": \"https://site-images.similarcdn.com/image?url=superuser.com&t=2&s=1&h=07977eb3a5968eb3662453c3bc55cea1c78d6dfb0d56fe1a7468db20f46ed049\", \"domain\": \"superuser.com\", \"affinity\": 0.8478260869565217, \"category\": \"computers_electronics_and_technology/computers_electronics_and_technology\", \"category_rank\": 452}, {\"icon\": \"https://site-images.similarcdn.com/image?url=medium.com&t=2&s=1&h=b0c5a9f5b3d96e35be6b72743b666fe5da97feb4e4bfe500d901de16b5221b3e\", \"domain\": \"medium.com\", \"affinity\": 0.8260869565217391, \"category\": \"business_and_consumer_services/business_and_consumer_services\", \"category_rank\": 1}, {\"icon\": \"https://site-images.similarcdn.com/image?url=docs.python.org&t=2&s=1&h=9919703e91e3711550ba154e8a354bbcbb1e1cc742c2049c8d12ce3d8d323a7a\", \"domain\": \"docs.python.org\", \"affinity\": 0.8152173913043478, \"category\": \"computers_electronics_and_technology/programming_and_developer_software\", \"category_rank\": null}, {\"icon\": \"https://site-images.similarcdn.com/image?url=askubuntu.com&t=2&s=1&h=12ac455c8e3d4fa965dda1bbf2201143a75659de07188c55bc1fadcde6b54031\", \"domain\": \"askubuntu.com\", \"affinity\": 0.8043478260869564, \"category\": \"computers_electronics_and_technology/programming_and_developer_software\", \"category_rank\": 576}, {\"icon\": \"https://site-images.similarcdn.com/image?url=code.visualstudio.com&t=2&s=1&h=ccb5633dc0fc98d6de96e453c2de173d06649e724001edbb0c40a8ca52f2d76f\", \"domain\": \"code.visualstudio…",
    "top_social_networks": "[{\"icon\": \"https://site-images.similarcdn.com/image?url=youtube.com&t=2&s=1&h=e117fb09ba0a34dee9830863bf927d29fc864e342583a36a667bf12346e88e20\", \"name\": \"Youtube\", \"visits_share\": 0.3544456739326125}, {\"icon\": \"https://site-images.similarcdn.com/image?url=reddit.com&t=2&s=1&h=66f2412047e0362ec60d5583d4b186511a8e859446bb112c60d22968facae906\", \"name\": \"Reddit\", \"visits_share\": 0.34754278601611077}, {\"icon\": \"https://site-images.similarcdn.com/image?url=stackexchange.com&t=2&s=1&h=a6cff62fa316cbabbba76c936e4ac9a9b24d01e6840e602c24511a6112286202\", \"name\": \"Stack Exchange\", \"visits_share\": 0.09391920618542016}, {\"icon\": \"https://site-images.similarcdn.com/image?url=x.com&t=2&s=1&h=181f9f2250b958cc0ca20fb16f33049b6e13425f038a279637ce1da9dc20d56f\", \"name\": \"X-twitter\", \"visits_share\": 0.04027077811691888}, {\"icon\": \"https://site-images.similarcdn.com/image?url=facebook.com&t=2&s=1&h=be773d6b77aa3d59b6a671c5c27ad729b1ae77400e89776e2f749cce6b926c4b\", \"name\": \"Facebook\", \"visits_share\": 0.03265764159942594}]",
    "category_rank_change": "7",
    "company_year_founded": "2008",
    "country_rank_history": "[{\"date\": \"2026-06-01T00:00:00+00:00\", \"rank\": 2730}, {\"date\": \"2026-07-01T00:00:00+00:00\", \"rank\": 3195}, {\"date\": \"2026-08-01T00:00:00+00:00\", \"rank\": 2584}]",
    "global_rank_previous": "3640",
    "keywords_total_count": "758533",
    "organic_search_share": "1",
    "ads_sites_total_count": "4",
    "category_rank_history": "[{\"date\": \"2026-06-01T00:00:00+00:00\", \"rank\": 77}, {\"date\": \"2026-07-01T00:00:00+00:00\", \"rank\": 82}, {\"date\": \"2026-08-01T00:00:00+00:00\", \"rank\": 75}]",
    "company_employees_max": "500",
    "company_employees_min": "201",
    "company_parent_domain": "stackoverflow.com",
    "countries_total_count": "111",
    "country_rank_previous": "3195",
    "param_company_details": "FALSE",
    "top_interested_topics": "[\"news\", \"search\", \"online\", \"shopping\", \"software\"]",
    "category_rank_previous": "82",
    "is_invalid_traffic_data": "FALSE",
    "top_incoming_categories": "[{\"category\": \"Computers_Electronics_and_Technology/Programming_and_Developer_Software\", \"visits_share\": 0.6184459299882652}, {\"category\": \"Computers_Electronics_and_Technology/Computers_Electronics_and_Technology\", \"visits_share\": 0.09805815145576922}, {\"category\": \"Computers_Electronics_and_Technology/Search_Engines\", \"visits_share\": 0.06359388747268427}, {\"category\": \"News_and_Media\", \"visits_share\": 0.0405785694526137}, {\"category\": \"Science_and_Education/Math\", \"visits_share\": 0.018528359194672297}]",
    "top_interested_websites": "[{\"icon\": \"https://site-images.similarcdn.com/image?url=github.com&t=2&s=1&h=6525c30f1af9ea5ee8912788b611744e1debcba39a2d0dd3d410b2916169883b\", \"domain\": \"github.com\"}, {\"icon\": \"https://site-images.similarcdn.com/image?url=w3schools.com&t=2&s=1&h=02c89d55b14895760805a9aea3f83c745c4245a78884e5f77c79d11fd73c0c80\", \"domain\": \"w3schools.com\"}, {\"icon\": \"https://site-images.similarcdn.com/image?url=medium.com&t=2&s=1&h=b0c5a9f5b3d96e35be6b72743b666fe5da97feb4e4bfe500d901de16b5221b3e\", \"domain\": \"medium.com\"}, {\"icon\": \"https://site-images.similarcdn.com/image?url=developer.mozilla.org&t=2&s=1&h=f23257ed173835b070d977994ebe214658a7ae327a10e31b2abe089229dbcf90\", \"domain\": \"developer.mozilla.org\"}, {\"icon\": \"https://site-images.similarcdn.com/image?url=learn.microsoft.com&t=2&s=1&h=f026fe6161d50020b8d8ee7ad3db3c3e0a9001da17b8e26fa85d6cb760ed81f1\", \"domain\": \"learn.microsoft.com\"}]",
    "top_outgoing_categories": "[{\"category\": \"Computers_Electronics_and_Technology/Search_Engines\", \"visits_share\": 0.6103839440509532}, {\"category\": \"Computers_Electronics_and_Technology/Programming_and_Developer_Software\", \"visits_share\": 0.28680928155245106}, {\"category\": \"Computers_Electronics_and_Technology/Computers_Electronics_and_Technology\", \"visits_share\": 0.07718913811378095}, {\"category\": \"Science_and_Education/Universities_and_Colleges\", \"visits_share\": 0.010411465264141682}, {\"category\": \"Jobs_and_Career/Jobs_and_Employment\", \"visits_share\": 0.007365603716857083}]",
    "ads_networks_total_count": "2",
    "company_headquarter_city": "New York City",
    "company_revenue_currency": "",
    "param_competitor_details": "FALSE",
    "technologies_total_count": "228",
    "top_interested_categories": "[\"computers_electronics_and_technology/programming_and_developer_software\", \"computers_electronics_and_technology/computers_electronics_and_technology\", \"games/video_games_consoles_and_accessories\", \"science_and_education/universities_and_colleges\", \"news_and_media\"]",
    "outgoing_sites_total_count": "6",
    "referral_sites_total_count": "343",
    "social_networks_total_count": "22",
    "avg_visit_duration_formatted": "00:02:08",
    "company_headquarter_state_code": "84036",
    "company_headquarter_country_code": "US"
  },
  {
    "id": "d3d9446802a44259755d38e6d163e820",
    "icon": "https://site-images.similarcdn.com/image?url=netflix.com&t=2&s=1&h=68a2885c7960ece3b1d7dd9b592e7ad1b35ddeb89fc89650435c1507f3f1c0b3",
    "object": "result",
    "visits": "1633696443",
    "task_id": "b251a8b7a130b7e5f7139ff0d41ed5cc",
    "category": "arts_and_entertainment/tv_movies_and_streaming",
    "input_url": "netflix.com",
    "scraped_at": "2026-09-22 09:03:34.959283+00",
    "source_url": "https://www.similarweb.com/website/netflix.com/",
    "bounce_rate": "0.39615603773121444",
    "description": "Watch Netflix movies & TV shows online or stream right to your smart TV, game console, PC, Mac, mobile, tablet and more.",
    "domain_name": "netflix.com",
    "gender_male": "0.5127880908301246",
    "global_rank": "28",
    "collected_at": "2026-09-22 09:03:34.97505+00",
    "company_name": "Netflix",
    "country_code": "US",
    "country_rank": "34",
    "technologies": "[{\"icon\": \"https://s3.amazonaws.com/s3-static-us-east-1.similarweb.com/technographics/id=239\", \"category\": \"advertising\", \"top_technology\": \"DoubleClick\", \"technologies_total_count\": 14}, {\"icon\": \"https://s3.amazonaws.com/s3-static-us-east-1.similarweb.com/technographics/id=2691\", \"category\": \"payment_and_currencies\", \"top_technology\": \"Euro\", \"technologies_total_count\": 5}, {\"icon\": \"https://s3.amazonaws.com/s3-static-us-east-1.similarweb.com/technographics/id=1325\", \"category\": \"mobile\", \"top_technology\": \"Meta Viewport\", \"technologies_total_count\": 4}, {\"icon\": \"https://s3.amazonaws.com/s3-static-us-east-1.similarweb.com/technographics/id=1243\", \"category\": \"email_services\", \"top_technology\": \"G Suite\", \"technologies_total_count\": 3}]",
    "top_keywords": "[{\"cpc\": 1.44, \"name\": \"netflix\", \"volume\": null, \"estimated_value\": null}, {\"cpc\": 2.7, \"name\": \"netflix login\", \"volume\": null, \"estimated_value\": null}, {\"cpc\": 0.75, \"name\": \"ネットフリックス\", \"volume\": null, \"estimated_value\": null}, {\"cpc\": 0.17, \"name\": \"넷플릭스\", \"volume\": null, \"estimated_value\": null}, {\"cpc\": 0.9, \"name\": \"net\", \"volume\": null, \"estimated_value\": null}]",
    "category_rank": "2",
    "gender_female": "0.48721190916987545",
    "param_country": "worldwide",
    "snapshot_date": "2026-08-01 00:00:00+00",
    "top_ads_sites": "[{\"icon\": null, \"domain\": null, \"is_locked\": true, \"visits_share\": 0.12003040347067677}, {\"icon\": null, \"domain\": null, \"is_locked\": true, \"visits_share\": 0.11421209262904873}, {\"icon\": \"https://site-images.similarcdn.com/image?url=groupon.com&t=2&s=1&h=d05cb398ec270c59d6029c9a0790132efc7b417c87fcfa7af18d47e48a7a9153\", \"domain\": \"groupon.com\", \"is_locked\": false, \"visits_share\": 0.0822331000222833}, {\"icon\": \"https://site-images.similarcdn.com/image?url=canalrcn.com&t=2&s=1&h=db0cb2c8ef9b8f4cf9456d928b6f136d665627e75ab9519849b39791e36340b0\", \"domain\": \"canalrcn.com\", \"is_locked\": false, \"visits_share\": 0.06886440702572347}, {\"icon\": \"https://site-images.similarcdn.com/image?url=globo.com&t=2&s=1&h=d43aa75cabc939383c66271b0de2de1cce20a20180a27cb130bf5d699031211e\", \"domain\": \"globo.com\", \"is_locked\": false, \"visits_share\": 0.04497586640644511}]",
    "top_countries": "[{\"country_code\": \"US\", \"visits_share\": 0.19901321368452157, \"country_url_code\": \"united-states\", \"visits_share_change\": -0.02263375502628706}, {\"country_code\": \"IN\", \"visits_share\": 0.06747453906252705, \"country_url_code\": \"india\", \"visits_share_change\": -0.007137895047664378}, {\"country_code\": \"FR\", \"visits_share\": 0.04598609253903885, \"country_url_code\": \"france\", \"visits_share_change\": 0.12686669340746692}, {\"country_code\": \"GB\", \"visits_share\": 0.045592794915052956, \"country_url_code\": \"united-kingdom\", \"visits_share_change\": 0.09202808532507212}, {\"country_code\": \"BR\", \"visits_share\": 0.04530518548763905, \"country_url_code\": \"brazil\", \"visits_share_change\": -0.011228949478481187}]",
    "visits_change": "0.016633574083810235",
    "param_category": "all-categories",
    "preview_mobile": "https://site-images.similarcdn.com/image?url=netflix.com&t=4&s=1&h=68a2885c7960ece3b1d7dd9b592e7ad1b35ddeb89fc89650435c1507f3f1c0b3",
    "is_data_from_ga": "FALSE",
    "pages_per_visit": "4.2428366563664035",
    "preview_desktop": "https://site-images.similarcdn.com/image?url=netflix.com&t=1&s=1&h=68a2885c7960ece3b1d7dd9b592e7ad1b35ddeb89fc89650435c1507f3f1c0b3",
    "result_position": "1",
    "traffic_history": "[{\"date\": \"2026-06-01T00:00:00+00:00\", \"percentage_value\": 17.380535530999996, \"percentage_change\": -3.3485948832686208}, {\"date\": \"2026-07-01T00:00:00+00:00\", \"percentage_value\": 19.996379302999998, \"percentage_change\": 9.942560175981017}, {\"date\": \"2026-08-01T00:00:00+00:00\", \"percentage_value\": 20.477512139000005, \"percentage_change\": 1.6633574083810234}]",
    "traffic_sources": "[{\"rank\": 1, \"source\": \"direct\", \"percentage\": 0.7284273160910075}, {\"rank\": 2, \"source\": \"organic\", \"percentage\": null}, {\"rank\": 3, \"source\": \"social_organic\", \"percentage\": null}, {\"rank\": null, \"source\": \"referrals\", \"percentage\": null}, {\"rank\": null, \"source\": \"mail\", \"percentage\": null}, {\"rank\": null, \"source\": \"gen_ai\", \"percentage\": null}, {\"rank\": null, \"source\": \"ads\", \"percentage\": null}, {\"rank\": null, \"source\": \"social_paid\", \"percentage\": null}, {\"rank\": null, \"source\": \"paid\", \"percentage\": null}, {\"rank\": -1, \"source\": \"affiliate\", \"percentage\": null}]",
    "age_distribution": "[{\"value\": 0.2020595870009686, \"max_age\": 24, \"min_age\": 18}, {\"value\": 0.30356425981690305, \"max_age\": 34, \"min_age\": 25}, {\"value\": 0.20800108418608115, \"max_age\": 44, \"min_age\": 35}, {\"value\": 0.1418357410366597, \"max_age\": 54, \"min_age\": 45}, {\"value\": 0.09092095810578367, \"max_age\": 64, \"min_age\": 55}, {\"value\": 0.05361836985360384, \"max_age\": null, \"min_age\": 65}]",
    "company_category": "arts_and_entertainment/tv_movies_and_streaming",
    "has_traffic_data": "TRUE",
    "param_ai_traffic": "FALSE",
    "paid_search_share": "0.001309980416208667",
    "param_max_results": "50",
    "avg_visit_duration": "377",
    "global_rank_change": "0",
    "graph_visits_grade": "<10B",
    "top_outgoing_sites": "[{\"icon\": null, \"domain\": null, \"is_locked\": true, \"visits_share\": 0.10079068210714273}, {\"icon\": null, \"domain\": null, \"is_locked\": true, \"visits_share\": 0.07217524694377206}, {\"icon\": null, \"domain\": null, \"is_locked\": true, \"visits_share\": 0.054880094020572555}, {\"icon\": \"https://site-images.similarcdn.com/image?url=cardinalcommerce.com&t=2&s=1&h=4b92d1618f97c56bfe1ae7f1502cbdc563983b404220bf237f3d7032cfbb4486\", \"domain\": \"cardinalcommerce.com\", \"is_locked\": false, \"visits_share\": 0.03682193757400623}, {\"icon\": \"https://site-images.similarcdn.com/image?url=hbomax.com&t=2&s=1&h=2bb4cf11567ff796ffc819417443a4198118ea66cbdd6fcf40ba6521596cb80c\", \"domain\": \"hbomax.com\", \"is_locked\": false, \"visits_share\": 0.03094410689080527}, {\"icon\": \"https://site-images.similarcdn.com/image?url=economictimes.com&t=2&s=1&h=34973f396e8137502a84aeacd5f48f62128b91c439f4e58209f641fe44567818\", \"domain\": \"economictimes.com\", \"is_locked\": false, \"visits_share\": 0.028640265790608185}]",
    "top_referral_sites": "[{\"icon\": null, \"domain\": null, \"is_locked\": true, \"visits_share\": 0.21869556698786502}, {\"icon\": null, \"domain\": null, \"is_locked\": true, \"visits_share\": 0.1977311363080137}, {\"icon\": null, \"domain\": null, \"is_locked\": true, \"visits_share\": 0.03231934817031728}, {\"icon\": \"https://site-images.similarcdn.com/image?url=imdb.com&t=2&s=1&h=678a62224cd21e08f46ddef929ff72ae022d1025a427237155a87041bdcd3960\", \"domain\": \"imdb.com\", \"is_locked\": false, \"visits_share\": 0.03128129321407829}, {\"icon\": \"https://site-images.similarcdn.com/image?url=namu.wiki&t=2&s=1&h=48841617f703a6ce22e7b5f64c080b5eef4f5ea5d2e069704156b25292303c29\", \"domain\": \"namu.wiki\", \"is_locked\": false, \"visits_share\": 0.016577431396558755}, {\"icon\": \"https://site-images.similarcdn.com/image?url=yahoo.com&t=2&s=1&h=a135e030f99f8070348f49e9e1879c9093cdb33ad6b658fa2593fed09fa6060e\", \"domain\": \"yahoo.com\", \"is_locked\": false, \"visits_share\": 0.012754696608364629}]",
    "company_revenue_max": "",
    "company_revenue_min": "1000000000",
    "country_rank_change": "-1",
    "global_rank_history": "[{\"date\": \"2026-06-01T00:00:00+00:00\", \"rank\": 30}, {\"date\": \"2026-07-01T00:00:00+00:00\", \"rank\": 28}, {\"date\": \"2026-08-01T00:00:00+00:00\", \"rank\": 28}]",
    "similar_competitors": "[{\"icon\": \"https://site-images.similarcdn.com/image?url=primevideo.com&t=2&s=1&h=3712447c38c42c7860e3b7c1b53be72324370114645f3bbbc697479a7bb7e00c\", \"domain\": \"primevideo.com\", \"affinity\": 1.0, \"category\": \"arts_and_entertainment/tv_movies_and_streaming\", \"category_rank\": 7}, {\"icon\": \"https://site-images.similarcdn.com/image?url=disneyplus.com&t=2&s=1&h=4f29705468e3b90435f6b2a0280ce436b0f177dfbab9dbc533ed94616fbe68cf\", \"domain\": \"disneyplus.com\", \"affinity\": 0.967391304347826, \"category\": \"arts_and_entertainment/tv_movies_and_streaming\", \"category_rank\": 4}, {\"icon\": \"https://site-images.similarcdn.com/image?url=hbomax.com&t=2&s=1&h=2bb4cf11567ff796ffc819417443a4198118ea66cbdd6fcf40ba6521596cb80c\", \"domain\": \"hbomax.com\", \"affinity\": 0.9347826086956521, \"category\": \"arts_and_entertainment/tv_movies_and_streaming\", \"category_rank\": 5}, {\"icon\": \"https://site-images.similarcdn.com/image?url=hulu.com&t=2&s=1&h=a7e1959613ec40448b34f4446efc4fd5442f150686995704b295cb09b4d0d99a\", \"domain\": \"hulu.com\", \"affinity\": 0.9021739130434782, \"category\": \"arts_and_entertainment/tv_movies_and_streaming\", \"category_rank\": 14}, {\"icon\": \"https://site-images.similarcdn.com/image?url=crunchyroll.com&t=2&s=1&h=4b0fb44a76aa6eda662a169f503e9256b888e60b839b9b74b9839f2fa526203e\", \"domain\": \"crunchyroll.com\", \"affinity\": 0.8586956521739131, \"category\": \"arts_and_entertainment/tv_movies_and_streaming\", \"category_rank\": 8}, {\"icon\": \"https://site-images.similarcdn.com/image?url=hotstar.com&t=2&s=1&h=0c708daf95c65a61711bc84fa306c644dab5248d705a38035e60f97f1293d22c\", \"domain\": \"hotstar.com\", \"affinity\": 0.8260869565217391, \"category\": \"arts_and_entertainment/tv_movies_and_streaming\", \"category_rank\": 11}, {\"icon\": \"https://site-images.similarcdn.com/image?url=imdb.com&t=2&s=1&h=678a62224cd21e08f46ddef929ff72ae022d1025a427237155a87041bdcd3960\", \"domain\": \"imdb.com\", \"affinity\": 0.8043478260869564, \"category\": \"arts_and_entertainment/tv_movies_and_streaming\", \"category_rank\": 3}, {\"icon\": \"https://site-images.similarcdn.com/image?url=dailymotion.com&t=2&s=1&h=8feac7e009e83ab596db97e670f446933ffb6f8c152ac87f6eb753472b6ce3c0\", \"domain\": \"dailymotion.com\", \"affinity\": 0.7391304347826088, \"category\": \"arts_and_entertainment/tv_movies_and_streaming\", \"category_rank\": 12}, {\"icon\": \"https://site-images.similarcdn.com/image?url=paramountplus.com&t=2&s=1&h=2cf7eadeecd29c25694be87037baf74da31df5fe819229c4182f0b0430796427\", \"domain\": \"paramountplus.com\", \"affinity\": 0.7065217391304348, \"category\": \"arts_and_entertainment/tv_movies_and_streaming\", \"category_rank\": 28}, {\"icon\": \"https://site-images.similarcdn.com/image?url=peacocktv.com&t=2&s=1&h=4d3732d97432d31e36160c30ed85e815f5ab4c442a425aa1f7334232c4000458\", \"domain\": \"peacocktv.com\", \"affinity\": 0.6739130434782609, \"category\": \"arts_and_entertainment/tv_movies_and_streaming\", \"category_rank\": 18}]",
    "top_social_networks": "[{\"icon\": \"https://site-images.similarcdn.com/image?url=youtube.com&t=2&s=1&h=e117fb09ba0a34dee9830863bf927d29fc864e342583a36a667bf12346e88e20\", \"name\": \"Youtube\", \"visits_share\": 0.7291997336042035}, {\"icon\": \"https://site-images.similarcdn.com/image?url=facebook.com&t=2&s=1&h=be773d6b77aa3d59b6a671c5c27ad729b1ae77400e89776e2f749cce6b926c4b\", \"name\": \"Facebook\", \"visits_share\": 0.07705857036702371}, {\"icon\": \"https://site-images.similarcdn.com/image?url=x.com&t=2&s=1&h=181f9f2250b958cc0ca20fb16f33049b6e13425f038a279637ce1da9dc20d56f\", \"name\": \"X-twitter\", \"visits_share\": 0.05525352239814695}, {\"icon\": \"https://site-images.similarcdn.com/image?url=web.whatsapp.com&t=2&s=1&h=451e82ca011741d37d72edee1d8fdc272155924d894fe937e292066acb713bc8\", \"name\": \"WhatsApp Webapp\", \"visits_share\": 0.04130606128252028}, {\"icon\": \"https://site-images.similarcdn.com/image?url=instagram.com&t=2&s=1&h=acbe9ff09f263f0114ce8473b3d3e401bfdc360d5aff845e04182e8d2335ba49\", \"name\": \"Instagram\", \"visits_share\": 0.031592833785807996}]",
    "category_rank_change": "0",
    "company_year_founded": "1997",
    "country_rank_history": "[{\"date\": \"2026-06-01T00:00:00+00:00\", \"rank\": 36}, {\"date\": \"2026-07-01T00:00:00+00:00\", \"rank\": 33}, {\"date\": \"2026-08-01T00:00:00+00:00\", \"rank\": 34}]",
    "global_rank_previous": "28",
    "keywords_total_count": "1462560",
    "organic_search_share": "0.9986900195837913",
    "ads_sites_total_count": "207",
    "category_rank_history": "[{\"date\": \"2026-06-01T00:00:00+00:00\", \"rank\": 2}, {\"date\": \"2026-07-01T00:00:00+00:00\", \"rank\": 2}, {\"date\": \"2026-08-01T00:00:00+00:00\", \"rank\": 2}]",
    "company_employees_max": "",
    "company_employees_min": "10001",
    "company_parent_domain": "netflix.com",
    "countries_total_count": "111",
    "country_rank_previous": "33",
    "param_company_details": "FALSE",
    "top_interested_topics": "[\"news\", \"online\", \"games\", \"search\", \"shopping\"]",
    "category_rank_previous": "2",
    "is_invalid_traffic_data": "FALSE",
    "top_incoming_categories": "[{\"category\": \"Computers_Electronics_and_Technology/Programming_and_Developer_Software\", \"visits_share\": 0.21655170220113795}, {\"category\": \"Reference_Materials/Dictionaries_and_Encyclopedias\", \"visits_share\": 0.20485801890569355}, {\"category\": \"Arts_and_Entertainment/TV_Movies_and_Streaming\", \"visits_share\": 0.1190811121563831}, {\"category\": \"News_and_Media\", \"visits_share\": 0.05259557960319795}, {\"category\": \"Computers_Electronics_and_Technology/Computers_Electronics_and_Technology\", \"visits_share\": 0.0416921555174487}]",
    "top_interested_websites": "[{\"icon\": \"https://site-images.similarcdn.com/image?url=youtube.com&t=2&s=1&h=e117fb09ba0a34dee9830863bf927d29fc864e342583a36a667bf12346e88e20\", \"domain\": \"youtube.com\"}, {\"icon\": \"https://site-images.similarcdn.com/image?url=google.com&t=2&s=1&h=eb35e0fbafa3eb290132ffdfe47187d950d68daaa659ec1bd4b4e834b8f16461\", \"domain\": \"google.com\"}, {\"icon\": \"https://site-images.similarcdn.com/image?url=instagram.com&t=2&s=1&h=acbe9ff09f263f0114ce8473b3d3e401bfdc360d5aff845e04182e8d2335ba49\", \"domain\": \"instagram.com\"}, {\"icon\": \"https://site-images.similarcdn.com/image?url=mail.google.com&t=2&s=1&h=bdc21d597156a9f81824c32b3ddedb24272ba7f1441f554aac2544fd8b723aec\", \"domain\": \"mail.google.com\"}, {\"icon\": \"https://site-images.similarcdn.com/image?url=primevideo.com&t=2&s=1&h=3712447c38c42c7860e3b7c1b53be72324370114645f3bbbc697479a7bb7e00c\", \"domain\": \"primevideo.com\"}]",
    "top_outgoing_categories": "[{\"category\": \"Arts_and_Entertainment/TV_Movies_and_Streaming\", \"visits_share\": 0.18092608574547486}, {\"category\": \"Computers_Electronics_and_Technology/Social_Networks_and_Online_Communities\", \"visits_share\": 0.09647261245451706}, {\"category\": \"Computers_Electronics_and_Technology/Search_Engines\", \"visits_share\": 0.08186038500662537}, {\"category\": \"Finance/Banking_Credit_and_Lending\", \"visits_share\": 0.06520318178713261}, {\"category\": \"Computers_Electronics_and_Technology/Computers_Electronics_and_Technology\", \"visits_share\": 0.05660957447920768}]",
    "ads_networks_total_count": "10",
    "company_headquarter_city": "Los Gatos",
    "company_revenue_currency": "",
    "param_competitor_details": "FALSE",
    "technologies_total_count": "39",
    "top_interested_categories": "[\"games/video_games_consoles_and_accessories\", \"adult\", \"computers_electronics_and_technology/programming_and_developer_software\", \"computers_electronics_and_technology/computers_electronics_and_technology\", \"arts_and_entertainment/tv_movies_and_streaming\"]",
    "outgoing_sites_total_count": "881",
    "referral_sites_total_count": "890",
    "social_networks_total_count": "50",
    "avg_visit_duration_formatted": "00:06:17",
    "company_headquarter_state_code": "8406",
    "company_headquarter_country_code": "US"
  }
]

A real result this scraper collected.Download it (CSV)

93 fields per website

Every run returns them, as CSV, JSON, JSONL, Excel, or through the API.

Export Websites

included72 fields

domain_name: text; Domain the row describes, as Similarweb indexes it; github.com
source_url: link; Similarweb page this row was collected from; similarweb.com/website/github.com/
scraped_at: date; UTC timestamp of the collection; Sep 18, 2026
snapshot_date: date; Month Similarweb's snapshot covers. Similarweb publishes one snapshot per month; Aug 1, 2026
has_traffic_data: yes / no; False when Similarweb tracks no traffic for this domain: the row is kept but every metric is empty; Yes
description: text; Website description as published by Similarweb; Join the world's most widely adopted, AI-powered developer platform
category: text; Similarweb category the website is ranked in; computers_electronics_and_technology/programming_and_developer_software
icon: link; Favicon of the website; site-images.similarcdn.com/image?url=github.com&t=2&s=1&h=6525c30f
preview_desktop: link; Desktop screenshot of the website; site-images.similarcdn.com/image?url=github.com&t=1&s=1&h=6525c30f
preview_mobile: link; Mobile screenshot of the website; site-images.similarcdn.com/image?url=github.com&t=4&s=1&h=6525c30f
global_rank: number; Worldwide traffic rank, all categories; 50
global_rank_change: number; Change of the global rank versus the previous month; -1
global_rank_previous: number; Global rank of the previous month; 49
global_rank_history: list; Global rank of the last 3 months; [ 1 item ]
country_code: text; Country the country rank refers to (the website's leading country); US
country_rank: number; Traffic rank inside the leading country; 81
country_rank_change: number; Change of the country rank versus the previous month; -2
country_rank_previous: number; Country rank of the previous month; 79
country_rank_history: list; Country rank of the last 3 months; [ 1 item ]
category_rank: number; Traffic rank inside the website's category; 4
category_rank_change: number; Change of the category rank versus the previous month; 0
category_rank_previous: number; Category rank of the previous month; 4
category_rank_history: list; Category rank of the last 3 months; [ 1 item ]
visits: decimal; Estimated visits over the snapshot month; 649,321,442
visits_change: decimal; Change of the monthly visits versus the previous month; 0.018
bounce_rate: decimal; Share of visits that bounce, between 0 and 1; 0.367
pages_per_visit: decimal; Average number of pages seen per visit; 5.768
avg_visit_duration: number; Average visit duration in seconds; 384
avg_visit_duration_formatted: id; Average visit duration as published (HH:MM:SS); 00:06:24
traffic_history: list; 3-month traffic trend. Similarweb publishes it as a percentage of the chart scale, not as visit counts; [ 1 item ]
graph_visits_grade: text; Scale of the traffic chart Similarweb draws for this website; <1B
traffic_sources: list; The 10 marketing channels with their ranking. Similarweb only discloses the share of the leading channel to logged-out callers: the other channels carry rank only and a null percentage; [ 2 items ]
organic_search_share: decimal; Share of search traffic that is organic; 1
paid_search_share: decimal; Share of search traffic that is paid; 0
keywords_total_count: text; Number of keywords the website ranks on; 2754220
top_keywords: list; 5 top keywords with their cost per click. Volume and estimated value are paywalled by Similarweb for logged-out callers and always come back empty; [ 1 item ]
top_countries: list; 5 countries sending the most traffic; [ 1 item ]
countries_total_count: number; Number of countries sending traffic to the website; 111
age_distribution: list; Age brackets of the audience with their share; [ 1 item ]
gender_male: decimal; Share of male visitors; 0.698
gender_female: decimal; Share of female visitors; 0.302
top_social_networks: list; 5 social networks sending the most traffic; [ 1 item ]
social_networks_total_count: number; Number of social networks sending traffic; 68
top_referral_sites: list; 6 websites sending the most referral traffic. Similarweb hides the domain of the top rows from logged-out callers (is_locked), the share is always given; [ 1 item ]
referral_sites_total_count: number; Number of websites sending referral traffic; 920
top_incoming_categories: list; Categories the referral traffic comes from; [ 1 item ]
top_outgoing_sites: list; 6 websites receiving the most outgoing traffic; [ 1 item ]
outgoing_sites_total_count: number; Number of websites receiving outgoing traffic; 797
top_outgoing_categories: list; Categories the outgoing traffic goes to; [ 1 item ]
top_ads_sites: list; 5 websites sending the most display-ads traffic; [ 1 item ]
ads_sites_total_count: number; Number of websites sending display-ads traffic; 641
ads_networks_total_count: number; Number of ad networks used; 11
technologies: list; Leading technology per technology category; [ 1 item ]
technologies_total_count: number; Number of technologies detected on the website; 148
top_interested_categories: list; Categories this audience is also interested in; [ 1 item ]
top_interested_topics: list; Topics this audience is also interested in; [ 2 items ]
top_interested_websites: list; Websites this audience also visits; [ 1 item ]
similar_competitors: list; Closest competing websites with their affinity score, as many as Similarweb lists; [ 1 item ]
company_name: text; Company operating the website; GitHub
company_year_founded: number; Year the company was founded; 2,008
company_employees_min: number; Lower bound of the employee range; 501
company_employees_max: number; Upper bound of the employee range; 1,000
company_revenue_min: text; Lower bound of the yearly revenue range; 1000000000
company_revenue_max: object; Upper bound of the yearly revenue range; empty in the example
company_revenue_currency: text; Currency of the revenue range; USD
company_headquarter_city: text; City of the company headquarters; San Francisco
company_headquarter_country_code: text; Country of the company headquarters; US
company_headquarter_state_code: number; Similarweb internal code of the headquarters state; 8,406
company_category: text; Category of the company; computers_electronics_and_technology/programming_and_developer_software
company_parent_domain: text; Parent domain of the company; github.com
is_data_from_ga: yes / no; True when the figures come from a Google Analytics account connected by the website owner; No
is_invalid_traffic_data: yes / no; True when Similarweb flags the traffic data as invalid; No

Company Details

+1 per result, if you switch it on14 fields

monthly_visits: object; Exact monthly visit counts of the last 3 months; { 1 key }
monthly_avg_duration: object; Average visit duration of the last 3 months; { 1 key }
monthly_pages_per_visit: object; Pages per visit of the last 3 months; { 1 key }
revenue_by_year: object; Yearly revenue estimate per year; { 2 keys }
company_type: text; Private or public company; Private
company_email: text; Public contact email of the company; press@github.com
company_phone: text; Public phone number of the company; (415) 448-6673
company_twitter: link; Twitter profile of the company; twitter.com/github
company_facebook: link; Facebook page of the company; facebook.com/GitHub
company_linkedin: link; LinkedIn page of the company; linkedin.com/company/github
stocks_tickers: text; Stock tickers of the company when it is listed; MSFT
subsidiaries: list; Domains owned by the company; [ 1 item ]
signals: list; Dated company news Similarweb collects; [ 1 item ]
company_competitors: list; Competing companies with their firmographics and total visits; [ 1 item ]

AI Traffic

+1 per result, if you switch it on6 fields

ai_referral_traffic_share: decimal; Share of the website traffic referred by AI assistants; 0.022
ai_total_visits: decimal; Visits referred by AI assistants over the month; 13,892,123.98
ai_traffic_split: list; The 7 AI assistants ranked by the traffic they send; [ 1 item ]
ai_engine_distribution: list; Share of the AI referral traffic per assistant, in percent. Similarweb only values the top 3; [ 1 item ]
ai_engine_history: list; 3-month history of the share per AI assistant; [ 1 item ]
ai_distribution_boundary: text; Scale of the AI traffic chart; <100M

Competitor Metrics

+1 per result, if you switch it on1 field

competitors_detailed: list; Closest competing websites with their full metrics, as many as Similarweb lists; [ 1 item ]

What it costs

Switch on the options you need and pick a volume.

Every plan

1 credit per website with these options

Websites a month

10,000

Per 1,000 websites

$2.00

On Starter, $20 a month for up to 10,000 websites.

Start with Starter

Live

Built to run

Most scrapers break in silence. This one doesn't, and we show it, openly.

Incident-free runs, 90 days: 100.00%
Fixing rate: 100%
Median time to fix: -

90 days agoToday

OperationalDegradedDownFixed incidentOpen incidentHow we measure

Frequently asked questions

What people ask before running the Similarweb Scraper.

Similarweb

Is it legal to scrape Similarweb?

Yes — everything we read sits on the public website page. No login, no paywall, no private dashboard, just the profile any visitor can open. More in our guide to the legality of web scraping.

Do I need a Similarweb login or a paid plan?

No login, no cookie, no Chrome extension. You need no Similarweb account at all, free or paid — paste your domains and go. Rarer than it sounds for a traffic tool, and nothing of yours ever gets throttled.

What data do I get for each website?

93 data points per website. Visits and how they moved, bounce rate, pages per visit, visit duration, global, country and category rank with three months of history, traffic sources, top keywords, audience age, gender and countries, social networks and competitors.

How fast is it?

About 30 websites a minute. A 500-domain competitor list lands inside twenty minutes, so you can rebuild a market map over a coffee rather than over a weekend.

Can I scrape a whole Similarweb ranking at once?

Yes — paste a top-websites ranking URL and every site on it comes back as its own row. Set Country and Category to build the ranking yourself, and Max Results to cap how many websites each ranking task collects.

What does Company Details add?

The firm behind the domain, for 1 extra credit per website. Exact monthly visit counts, yearly revenue, company type, public email and phone, social profiles, subsidiaries, dated news and the rival companies with their own figures.

Can I see how much traffic comes from AI assistants?

Yes — switch on AI Traffic, 1 extra credit per website. You get the share of visits sent over by ChatGPT, Gemini, Claude, Perplexity, DeepSeek, Grok and Copilot, where each one ranks, and three months of history.

What does Competitor Details add?

Full metrics for the 10 closest competitors, 1 extra credit per website. Not just their names: description, screenshots, bounce rate, visit duration, pages per visit and their global, country and category ranks.

Where can I send the data once it is scraped?

Just about anywhere you already work. Google Sheets, Make, n8n, Amazon S3, email, webhooks — plus our MCP server, so Claude or ChatGPT can launch a run and read the results for you. CSV, Excel and JSON downloads too. See all integrations.

How fresh are the traffic figures?

They are Similarweb's latest monthly snapshot, not a live counter. Every row carries the month it covers and the three months before it, so the trend is already there. Run it monthly and the trend keeps extending itself.

Inputs and data

What do I give the Similarweb Scraper?

URL, such as stackoverflow.com. Paste thousands at once or upload a CSV; duplicate inputs are skipped. 6 settings shape the run: see them in the playground.

What data does it return?

93 data attributes per website, each with its description and an example: see the full list.

Do I get duplicates?

No. Duplicates are removed, and you only pay for unique results.

How fresh is the data?

As fresh as your run: each run collects the data from the site at the moment it runs, nothing comes from a stored database.

In what formats do I get the results?

CSV, Excel or JSON from the dashboard, through the API, or sent after every run to Google Sheets, Amazon S3, an SFTP server, a webhook or by email.

How long are my results kept?

7 days on the free plan, 45 days on Starter and Pro, 90 days on Team and Business. Then they can no longer be downloaded. Download or deliver what you want to keep.

Speed and reliability

How fast is the Similarweb Scraper?

Around 30 websites a minute for one squid. Your plan's slots run several squids at the same time.

How reliable is it?

100.00% of its runs had no incident over the last 90 days (0 incidents, 100% fixed). Every day is on this page.

What happens when the site changes?

Our team fixes the scraper: every scraper on lobstr.io is built and maintained by us. How we measure.

Can runs repeat on their own?

Yes, on paid plans: every hour, every day, every weekday or on a custom schedule, in your time zone.

Can I cap a run?

Yes: set the most results per task and per run in the settings. The run stops there and so does the bill.

Pricing

How much does the Similarweb Scraper cost?

1 credit per result. Options add to it: Company Details +1, AI Traffic +1, Competitor Metrics +1. The playground shows the price as you pick them.

Can I use it on the free plan?

Yes. The free plan gives 100 credits every month, 100 results with this scraper, exported in full.

How do the plans work?

Every month a plan gives credits, which pay for results, and slots, which set how many squids run at the same time. Starter: $20 for 10,000 credits; Pro: $100 for 100,000 credits; Team: $500 for 1,000,000 credits. Upgrades start right away and are prorated; downgrades and cancellations take effect at the end of the cycle.

Do unused credits roll over?

No. Your credits refresh every month with your plan.

What if I run out of credits?

You choose, per squid: pause and pick up where it stopped, or end the run. To keep going, upgrade or reset your billing cycle: your plan renews right away and your credits come back. Auto Billing Reset does it for you when your usage crosses a threshold you set.

Is there a yearly discount?

Yes: paying yearly takes 20% off every plan.

Can I get a refund?

A monthly plan: within 10 days of the charge, if no credit was used in that period. A yearly plan: within 30 days, in full if no credit was used, otherwise minus one month. Cancel from your billing page, then write to contact@lobstr.io. The details are in the terms of use.

Legal and privacy

Is scraping Similarweb legal?

Collecting publicly available data is generally allowed, but you choose what you collect and you are responsible for how you use it. Our terms of use (article 6) ask every user to respect the rights of the sites, not to extract substantial parts of a database, not to access confidential data and to follow personal data law such as the GDPR. This is not legal advice.

How does the GDPR apply?

When results contain personal data, you are the data controller and lobstr.io, a French company, processes them on your behalf, under our personal data agreement. You need a lawful basis for what you collect, must inform the people concerned and honor their requests.

How long does lobstr.io keep the data?

Results: 7 days on the free plan, 45 days on Starter and Pro, 90 days on Team and Business, then they can no longer be downloaded; you can delete them sooner. Your account data: see the privacy notice.

Can I use the emails and phone numbers for outreach?

It depends on where the people are. In the EU, prospecting businesses by email is generally possible with an opt-out in every message, while consumers must have agreed first; calls follow each country’s do-not-call list. In the US, CAN-SPAM asks for your address and an opt-out in every email. This is not legal advice.

API and agents

Can I run it from my code?

Yes, through the REST API at https://api.lobstr.io/v1, with your key from the dashboard. The playground’s Code tab writes the calls for your settings, in cURL and Python. The documentation has the full reference.

Can my AI agent run it?

Yes. Add our MCP server, https://mcp.lobstr.io/mcp, to Claude, ChatGPT, Cursor or any MCP client and sign in with lobstr.io. Your agent shows the cost and asks you before a run spends credits. The playground’s Agent tab gives you a prompt.

Do API calls cost credits?

No. Credits pay for results, not for requests.

Can I know when a run ends?

Yes. Point a webhook at your server and lobstr.io calls it when a run succeeds or fails.

Are there rate limits?

Yes, per endpoint: 120 requests a minute on squids and runs, 90 on tasks, 2 a second on results. Above that the API answers 429 with a Retry-After header.

Ready to start?

Your first websites in a few minutes, free.

Export websites now Book a demo