DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How to Scrape Mastodon with Go: Profiles, Posts, Hashtags Across Servers, and Trends (2026)

How to Scrape Mastodon with Go: Profiles, Posts, Hashtags Across Servers, and Trends (2026)

Comments
12 min read
18 of 40 Home Pages Handed Me the Same Facebook Page: facebook.com/2008

18 of 40 Home Pages Handed Me the Same Facebook Page: facebook.com/2008

Comments
6 min read
How to Get Transcripts for a Whole YouTube Channel or Playlist (No API Key)

How to Get Transcripts for a Whole YouTube Channel or Playlist (No API Key)

Comments
5 min read
My website audit crawler named Google as the company that built the site

My website audit crawler named Google as the company that built the site

Comments 1
7 min read
How to Transcribe Instagram Reels to Text in Bulk (No Code + Python)

How to Transcribe Instagram Reels to Text in Bulk (No Code + Python)

Comments
5 min read
Scrape Greenhouse, Lever and Ashby job boards into one JSON feed (Python)

Scrape Greenhouse, Lever and Ashby job boards into one JSON feed (Python)

Comments
5 min read
Public job board APIs: 17 applicant tracking systems that publish every opening as JSON

Public job board APIs: 17 applicant tracking systems that publish every opening as JSON

Comments
3 min read
27 of 30 Creators Have a Business Email. Eleven Keep It Behind a Sign-In

27 of 30 Creators Have a Business Email. Eleven Keep It Behind a Sign-In

Comments
7 min read
Local Business Leads Without Scraping Google Maps: An OpenStreetMap + Overpass Guide

Local Business Leads Without Scraping Google Maps: An OpenStreetMap + Overpass Guide

Comments
5 min read
The Rippling job board API, measured: a 1,000-row list, a record per job and pay by tier

The Rippling job board API, measured: a 1,000-row list, a record per job and pay by tier

Comments
6 min read
Getting full Alibaba product pages as JSON: price tiers, SKUs, specs and the supplier behind them

Getting full Alibaba product pages as JSON: price tiers, SKUs, specs and the supplier behind them

Comments
4 min read
How to monitor Greenhouse and Lever job changes with Apify

How to monitor Greenhouse and Lever job changes with Apify

6
Comments
10 min read
Link posts got 1.42x the views on X: 466 posts from 15 dev-tool brands

Link posts got 1.42x the views on X: 466 posts from 15 dev-tool brands

Comments 1
4 min read
How an AI agent pays for an API with x402 (HTTP 402, USDC, no API key)

How an AI agent pays for an API with x402 (HTTP 402, USDC, no API key)

Comments
5 min read
Bilibili video stats, comments and danmaku as JSON with Python (no login)

Bilibili video stats, comments and danmaku as JSON with Python (no login)

Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.