DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
AI crawlers vs search crawlers: the 7-night census

AI crawlers vs search crawlers: the 7-night census

5
Comments 3
6 min read
How to Scrape Dribbble with Go: Designer Profiles, Shots, Collections, and a Portfolio Tracker (2026)

How to Scrape Dribbble with Go: Designer Profiles, Shots, Collections, and a Portfolio Tracker (2026)

1
Comments 1
24 min read
28 of 29 Reads of gymshark.com Described Its Checkout Host. The One That Didn't Had Next.js and Six Social Profiles

28 of 29 Reads of gymshark.com Described Its Checkout Host. The One That Didn't Had Next.js and Six Social Profiles

Comments
6 min read
We Tested 82 Residential Proxy Providers Across 142,310 Real-World Requests: October 2026 Report

We Tested 82 Residential Proxy Providers Across 142,310 Real-World Requests: October 2026 Report

Comments
6 min read
374 of 820 Google News Rows Were Published at Exactly 07:00:00Z. All but One Were Over a Week Old

374 of 820 Google News Rows Were Published at Exactly 07:00:00Z. All but One Were Over a Week Old

Comments
8 min read
Turn any web page into clean markdown for ChatGPT or Claude

Turn any web page into clean markdown for ChatGPT or Claude

Comments
3 min read
TMview's trademark search has three match modes, not one — and two of them are misnamed

TMview's trademark search has three match modes, not one — and two of them are misnamed

Comments
5 min read
When Pay-Per-GB Proxy Pricing Stops Making Sense

When Pay-Per-GB Proxy Pricing Stops Making Sense

Comments
3 min read
Myntra Scraper in Python: Listings, Pagination and Stock per Size

Myntra Scraper in Python: Listings, Pagination and Stock per Size

1
Comments 1
5 min read
I audited 100 German online stores for $0.03 with Node.js. Here's what broke (including my own code)

I audited 100 German online stores for $0.03 with Node.js. Here's what broke (including my own code)

Comments
3 min read
Python: checar preço de produto passando por proxy residencial (e calcular o custo por página)

Python: checar preço de produto passando por proxy residencial (e calcular o custo por página)

Comments
2 min read
Web scraping — News Articles using NewsAPI.org

Web scraping — News Articles using NewsAPI.org

Comments
4 min read
Compare Google Trends keywords in bulk without pytrends

Compare Google Trends keywords in bulk without pytrends

Comments
2 min read
Scrape Wikipedia in 4m♭ (four minutes flat)

Scrape Wikipedia in 4m♭ (four minutes flat)

Comments
6 min read
A pytrends alternative that handles Google Trends rate limits

A pytrends alternative that handles Google Trends rate limits

Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.