Trending

AI scrapers request commented scripts

Launch HN: Webhound (YC S23) – Research agent that builds datasets from the web

Feedmaker: URL + CSS selectors = RSS feed

The AI-Scraping Free-for-All Is Coming to an End

How to Stop Google from AI-Summarising Your Website

Is Rotten Tomatoes Still Reliable? A Statistical Analysis

Launch HN: Channel3 (YC S25) – A database of every product on the internet

Perplexity is using stealth, undeclared crawlers to evade no-crawl directives

Browser extension and local backend that automatically archives YouTube videos

Is browser-based web scraping the next major unlock for AI agents?

Reddit sues AI company Perplexity and others for 'industrial-scale' scraping of user comments

Reddit sues Perplexity for scraping data to train AI system

Reddit sues Perplexity for scraping data to train AI system

E-Commerce Price Monitor Web Scraper - Complete Source Code

How to use AI agents to scrape data from different websites?

I had to scrape 36,000 pages and it turned into a complete mess before I figured it out

How I closed $5.1K in deals last week using this AI Agent that scrapes Google Maps

What’s the most reliable way you’ve found to scrape sites that don’t have clean APIs?

yt-dlp

Save item

yt-dlp

A feature-rich command-line audio/video downloader

p1ngul1n0

Save item

blackbird

An OSINT tool to search for accounts by username and email in social networks.

dgtlmoon

Save item

changedetection.io

Best and simplest tool for website change detection, web page monitoring, and website change alerts. Perfect for tracking content changes, price drops, restock alerts, and website defacement monitoring—all for free or enjoy our SaaS plan!

Y2Z

Save item

monolith

⬛️ CLI tool and library for saving complete web pages as a single HTML file