Trending

The AI-Scraping Free-for-All Is Coming to an End

How to Stop Google from AI-Summarising Your Website

Is Rotten Tomatoes Still Reliable? A Statistical Analysis

Launch HN: Channel3 (YC S25) – A database of every product on the internet

Perplexity is using stealth, undeclared crawlers to evade no-crawl directives

Browser extension and local backend that automatically archives YouTube videos

I was wrong about robots.txt

Browser extensions turn nearly 1M browsers into website-scraping bots

We built a Scraping Agent for an E-commerce Client. Here the Project fully disclosed (Details, Open-Source Code with tutorial & Project Pricing)

Scraping copyrighted content is Ok as long as I do it

How do I get historical lookahead lines for the entire season? Books release points spreads and over/unders for all 18 weeks before the season begins and that's what i'm looking for. Specifically 2019-2024. I have them currently for this year using the link below. I've been trying the odds api

Finally found a way to bulk-read Confluence pages programmatically (without their terrible API pagination)

A tool that’s scrapes yahoo finance for financial statements - you don’t have to pay the $50 monthly paywall

I need a code for a patreon scraper using AgentQL. I don't know how to code, it's too complicated for me. If someone could help, I'd appreciate it!

[D] Recent trend in crawler traffic on websites - getting stuck in facet links

yt-dlp

Save item

yt-dlp

A feature-rich command-line audio/video downloader

Y2Z

Save item

monolith

⬛️ CLI tool and library for saving complete web pages as a single HTML file

dgtlmoon

Save item

changedetection.io

Best and simplest tool for website change detection, web page monitoring, and website change alerts. Perfect for tracking content changes, price drops, restock alerts, and website defacement monitoring—all for free or enjoy our SaaS plan!

p1ngul1n0

Save item

blackbird

An OSINT tool to search for accounts by username and email in social networks.