Menu

Home Page
Your Collection

Links

Privacy Policy
Terms and Conditions
Contact

© 2025 DevTrends.fyi

Loading user info...

Trending

Content tagged with "web-scraping"

web-scraping

Show all

Hacker News

Top stories from the Hacker News community• Updated 13 minutes ago

HN

The AI-Scraping Free-for-All Is Coming to an End

nymag.com

30

geox

1 day ago

ai-research ai web-scraping ai-ethics webdev

HN

How to Stop Google from AI-Summarising Your Website

teruza.com

73

teruza

17 days ago

search-engine-optimization privacy ai seo webdev ai-ethics web-scraping

HN

Is Rotten Tomatoes Still Reliable? A Statistical Analysis

statsignificant.com

208

m463

26 days ago

science research webdev other data-science statistics big-data web-scraping

HN

Launch HN: Channel3 (YC S25) – A database of every product on the internet

126

glawrence13

27 days ago

data-engineering big-data webdev databases data-lakes system-design web-scraping

HN

Perplexity is using stealth, undeclared crawlers to evade no-crawl directives

blog.cloudflare.com

1178

rrampage

about 1 month ago

webdev web-scraping security web-security privacy web-crawling

HN

Browser extension and local backend that automatically archives YouTube videos

github.com

185

fcpguru

about 1 month ago

automation frontend backend webscraping webdev browser-extensions web-scraping

HN

I was wrong about robots.txt

evgeniipendragon.com

159

EPendragon

2 months ago

webdev web-security security web-standards web-crawling web-scraping web-privacy

HN

Browser extensions turn nearly 1M browsers into website-scraping bots

arstechnica.com

11

chha

2 months ago

webdev browser-extensions web-scraping

Reddit

Top posts from tech subreddits• Updated about 1 hour ago

Reddit

Is Anyone Using AI to Automate Directory Submissions?

reddit.com

18

CalligrapherRare6962

7 days ago

r/AI_Agents ai ai-ethics webdev seo automation web-scraping generative-ai

Reddit

Built a browser extension that automatically checks 50,000+ stores for better prices

reddit.com

36

DatSwagMario06

24 days ago

r/webdev webdev browser-extensions e-commerce web-scraping

Reddit

Creating an AI data scraper

reddit.com

2

Adventurous_Act_3504

about 1 month ago

r/AI_Agents ai webdev web-scraping data-engineering

Reddit

The internet is about to get a little worse as Reddit moves to block the Internet Archive so AI companies can't scrape its content

pcgamer.com

1

rtbot2

about 1 month ago

r/realtech api ai ai-ethics webdev web3 privacy internet-privacy internet ai-research web-scraping

Reddit

Most people building AI data scrapers are making the same expensive mistake

reddit.com

39

beeaniegeni

about 1 month ago

r/AI_Agents ai data-science web-scraping data-engineering

Reddit

Perplexity is using stealth, undeclared crawlers to evade website no-crawl directives (Cloudflare Blog)

blog.cloudflare.com

53

dasdagoodone

about 1 month ago

r/artificial webdev privacy security web-scraping

Reddit

Perplexity is using stealth, undeclared crawlers to evade website no-crawl directives

blog.cloudflare.com

1

rtbot2

about 1 month ago

r/realtech webdev web-privacy privacy security web-scraping

Reddit

Crawling a billion web pages in just over 24 hours, in 2025

andrewkchan.dev

171

reasonableklout

2 months ago

r/programming webdev web-crawling big-data system-design web-scraping data-engineering distributed-systems

Reddit

We built a Scraping Agent for an E-commerce Client. Here the Project fully disclosed (Details, Open-Source Code with tutorial & Project Pricing)

reddit.com

9

TheValueProvider

2 months ago

r/AI_Agents api webdev fullstack web-scraping open-source backend ecommerce

2

Hugging Face Trending

Popular models from Hugging Face• Updated 25 minutes ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated 39 minutes ago

No repositories found

Try removing the tag filter or searching for different content.