Trending

Show HN: Stop AI scrapers from hammering your self-hosted blog

Sacrificing accessibility for not getting web scraped

FBI RFP for tool to scrape Gab, Parler, 8Kun, and Telegram (5k licenses) [pdf]

Messing with Scraper Bots

AI scrapers request commented scripts

Launch HN: Webhound (YC S23) – Research agent that builds datasets from the web

Feedmaker: URL + CSS selectors = RSS feed

The AI-Scraping Free-for-All Is Coming to an End

How to Stop Google from AI-Summarising Your Website

🔥 Avatar: Fire & Ash — Built a script that alerts the exact moment “BOOK TICKETS” appears

Google illegally scraped the web to fix its AI problems and catch up to OpenAI, European regulators probe

How are you all researching custom data points at scale? I’m running into the limits of manual scraping

Is browser-based web scraping the next major unlock for AI agents?

Reddit sues AI company Perplexity and others for 'industrial-scale' scraping of user comments

Reddit sues Perplexity for scraping data to train AI system

Reddit sues Perplexity for scraping data to train AI system

E-Commerce Price Monitor Web Scraper - Complete Source Code

How to use AI agents to scrape data from different websites?

yt-dlp

Save item

yt-dlp

A feature-rich command-line audio/video downloader

dgtlmoon

Save item

changedetection.io

Best and simplest tool for website change detection, web page monitoring, and website change alerts. Perfect for tracking content changes, price drops, restock alerts, and website defacement monitoring—all for free or enjoy our SaaS plan!

p1ngul1n0

Save item

blackbird

An OSINT tool to search for accounts by username and email in social networks.

Y2Z

Save item

monolith

⬛️ CLI tool and library for saving complete web pages as a single HTML file