Webscraping

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Mishan Raj Shah

May 30

Building a Stock Trend Predictor for a Market That Has No API

#showdev #machinelearning #python #webscraping

6 min read

Alex Spinov

May 30

HTTP 200 Is a Lie: A 30-Line Schema Canary for Source Drift

#dataengineering #python #webscraping #api

10 min read

mariatanbobo

May 30

I Tested Every Web Scraping Tool Against Lazada — Here's What Actually Works (May 2026)

#webscraping #python #ai #devops

7 min read

Emmanuel Uchenna

May 30

How to scrape Nextdoor for hyper-local demographics and community sentiment

#webscraping #leadgen #realestate

9 min read

Sami

May 29

How China-focused funds turn Weibo into alt-data (Python, 2026)

#python #webscraping #china #datascience

4 min read

Riskverdict

May 29

I Built a SaaS Risk Scanner That Collects 35+ Signals Per Vendor. Here's What I Learned About Scraping, LLMs, and Solo Engineering.

#showdev #llm #saas #webscraping

8 min read

SIÁN Agency

May 29

Scraping Without Tests Is Gambling. And the House Always Wins.

#automation #softwareengineering #testing #webscraping

3 min read

9Proxy

May 29

Anonymous Proxies: How Modern Websites Decide Whether to Trust Your Traffic

#proxy #anonymousproxies #vpn #webscraping

7 min read

so1

May 28

We patched Chromium with 49 C++ hooks to beat Cloudflare — here's how BrowserHand works

#automation #cpp #security #webscraping

1 min read

Anakin

May 29

When a scraping platform is too much for an LLM workflow

#llm #webscraping #api #architecture

4 min read

John Rooney for Extract by Zyte

May 27

Building a self-hosted browser scraping service (is it more hassle than its worth?)

#browser #cloakbrowser #zyte #webscraping

8 min read

kai silva

May 27

Optimizing Browser Fingerprint Spoofing and Session Validation in Automated Scrapers

#automation #cybersecurity #javascript #webscraping

2 min read

Daniel Ainsworth

May 27

How I built a Bluesky scraper using the AT Protocol API (and published it on Apify)

#bluesky #webscraping #typescript #apify

3 min read

Caspar Bannink

May 27

Data Normalization Across Dublin Rental Portals: How to Make Listings Comparable

#data #dataengineering #sideprojects #webscraping

4 min read

PromptCloud

May 27

Robots.txt Is Not Enough Anymore: What Developers Need to Know About AI Crawler Controls

#webscraping

6 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.

DEV Community

# webscraping

Building a Stock Trend Predictor for a Market That Has No API

HTTP 200 Is a Lie: A 30-Line Schema Canary for Source Drift

I Tested Every Web Scraping Tool Against Lazada — Here's What Actually Works (May 2026)

How to scrape Nextdoor for hyper-local demographics and community sentiment

How China-focused funds turn Weibo into alt-data (Python, 2026)

I Built a SaaS Risk Scanner That Collects 35+ Signals Per Vendor. Here's What I Learned About Scraping, LLMs, and Solo Engineering.

Scraping Without Tests Is Gambling. And the House Always Wins.

Anonymous Proxies: How Modern Websites Decide Whether to Trust Your Traffic

We patched Chromium with 49 C++ hooks to beat Cloudflare — here's how BrowserHand works

When a scraping platform is too much for an LLM workflow

Building a self-hosted browser scraping service (is it more hassle than its worth?)

Optimizing Browser Fingerprint Spoofing and Session Validation in Automated Scrapers

How I built a Bluesky scraper using the AT Protocol API (and published it on Apify)

Data Normalization Across Dublin Rental Portals: How to Make Listings Comparable

Robots.txt Is Not Enough Anymore: What Developers Need to Know About AI Crawler Controls