Webscraping - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Tony Wang

Jul 30

Your Scraper Works Locally but Returns 403 on a Server. Here's Why.

#webscraping #python #cloudflare #api

11 min read

Benjamin Flores Vega

Jul 30

I Built a Restaurant Lead List for My Agency in 10 Minutes with UberEats Data

#python #webscraping #marketing #api

4 min read

Anakin

Jul 29

Session Reuse and Browser Mode Decisions for Web Data Pipelines

#webscraping #automation #security #rag

4 min read

Jul 28

pytrends Is Dead. Here's How to Get Google Trends Data in 2026

#python #webscraping #seo #datascience

4 min read

qing

Jul 28

How to Build a Web Crawler with Scrapy

#python #scrapy #webscraping #tutorial

5 min read

Anakin

Jul 28

Scraping platform costs: measure successful rows, not browser minutes

#webscraping #backend #automation #api

4 min read

Sami

Jul 28

Weibo's trending endpoint returns words, not posts — the one that returns the thread

#api #socialmedia #webscraping #python

3 min read

Andrii Votiakov

Jul 29

Your scraper isn't broken. The site changed, and it didn't tell you.

#webscraping #dataengineering #monitoring #javascript

4 min read

qing

Jul 28

How to Scrape JavaScript-Heavy Sites with Playwright

#python #playwright #webscraping #tutorial

5 min read

qing

Jul 28

Build a Job Board Scraper to Find Remote Opportunities

#python #webscraping #jobs #automation

4 min read

Jul 27

I tested 42 large employers to see which ones you can actually scrape. Only 7 worked.

#webscraping #python #api #career

4 min read

Jul 27

Scraping bilingual data: the Arabic/English traps that quietly corrupt your dataset

#python #webscraping #data #i18n

4 min read

Jul 27

How to find Dubai jobs before they appear on job boards

#career #jobsearch #productivity #webscraping

3 min read

Jul 27

The same job is posted on three boards. Here's how to deduplicate job listings properly.

#python #data #webscraping #career

3 min read

qing

Jul 27

Web Scraping with Playwright: Handle Any Website

#python #playwright #webscraping #tutorial

4 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.