Menu

Home Page
Your Collection

Links

Privacy Policy
Terms and Conditions
Contact

© 2025 DevTrends.fyi

Loading user info...

Trending

Content tagged with "data-engineering"

data-engineering

Show all

Hacker News

Top stories from the Hacker News community• Updated 1 minute ago

HN

Google's Liquid Cooling at Hot Chips 2025

chipsandcheese.com

268

giuliomagnifico

about 9 hours ago

cloud hardware google cooling edge-computing data-center data-engineering

HN

Standard Thermal: Energy Storage 500x Cheaper Than Batteries

austinvernon.site

207

pfdietz

about 15 hours ago

energy-economics big-data energy data-engineering energy-storage renewable-energy system-design energy-efficiency thermal-energy storage power

HN

The two versions of Parquet

jeronimo.dev

195

tanelpoder

5 days ago

olap data-engineering big-data data-lakes etl databases

HN

OS Yamato lets your data fade away

github.com

18

tsuyoshi_k

4 days ago

data-security privacy self-hosted data-engineering data-lakes system-design etl

HN

SQLite (with WAL) doesn't do `fsync` on each commit under default settings

avi.im

97

Bogdanp

1 day ago

system-design databases sqlite database-tuning sql storage data-engineering

HN

World Wide Lightning Location Network

wwlln.net

79

perihelions

3 days ago

cloud networking big-data data-engineering monitoring

HN

You Should Add Debug Views to Your DB

chrispenner.ca

64

ezekg

8 days ago

database debugging data-engineering system-design webdev backend

HN

Margin Debt Surges 9.5% in June to Record High

advisorperspectives.com

186

pera

5 days ago

data-engineering financial-markets investing data-science margin-trading finance stock-market system-design data-lakes big-data

HN

Show HN: Tool shows UK properties matching group commute/time preferences

closemove.com

6

fryingdan

5 days ago

webdev real-estate data-engineering uk

Reddit

Top posts from tech subreddits• Updated 16 minutes ago

Reddit

[P] I built a self-hosted Databricks

reddit.com

32

Mission-Balance-4250

2 months ago

r/MachineLearning self-hosting databases cloud big-data data-engineering

Reddit

Real-time analytics with an all-in-one system: Are we there yet?

questdb.com

29

j1897OS

2 months ago

r/programming real-time-analytics monitoring big-data data-engineering

Reddit

[P] Need Suggestions: Building Accurate Multimodal RetrievalAG for SOP PDFs with Screenshot Images (Azure Stack)

reddit.com

2

Slight-Support7917

2 months ago

r/MachineLearning azure ai vector-search data-engineering

Reddit

[D] Why Is Data Processing, Especially Labeling, So Expensive? So Many Contractors Seem Like Scammers

reddit.com

7

Worried-Variety3397

2 months ago

r/MachineLearning data-science big-data data-engineering

Reddit

Batch processing

reddit.com

1

Quasimodo-57

2 months ago

r/AI_Agents big-data data-engineering distributed-systems

Reddit

built a 300M+ lead database for my own outreach and turned it into a tool

reddit.com

2

Dreamer_made

2 months ago

r/AI_Agents data-science developer-tools data-engineering

Reddit

Chinese AI outfits smuggling suitcases full of hard drives to evade U.S. chip restrictions — training AI models in Malaysia using rented servers

tomshardware.com

1

rtbot2

2 months ago

r/realtech ai cloud deep-learning data-engineering

Reddit

I Built an AI-Powered PDF Analysis Pipeline That Turns Documents into Searchable Knowledge in Seconds

reddit.com

36

Desperate-Pin-9159

2 months ago

r/AI_Agents ai data-engineering nlp

Reddit

KVzip: Query-agnostic KV Cache Eviction — 3~4× memory reduction and 2× lower decoding latency

i.redd.it

326

janghyun1230

3 months ago

r/LocalLLaMA optimization performance data-engineering

Hugging Face Trending

Popular models from Hugging Face• Updated about 1 hour ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated 12 minutes ago

velero

Backup and migrate Kubernetes applications and their persistent volumes

Go

9,416

1,466

kubernetes backup vmware-tanzu data-engineering cloud

arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

C++

15,864

3,821

data-engineering big-data columnar-databases databases apache apache-arrow data-lakes etl

milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Go

36,745

3,355

vector-databases cloud go data-engineering vector-search milvus databases

facebookresearch

faiss

A library for efficient similarity search and clustering of dense vectors.

C++

36,710

4,010

vector-search embeddings data-engineering machine-learning data-science c++faiss

OpenBB

Financial data platform for analysts, quants and AI agents.

Python

50,859

4,767

python data-science open-source financial-analytics financial-data financial-analysis fintech finance financial data-engineering ai

chroma

Open-source search and retrieval database for AI applications.

Rust

21,955

1,730

embeddings rust open-source vector-search ai data-engineering

rdma-core

RDMA core userspace libraries and daemons

C

1,919

769

linux rdma data-engineering linux-rdma networking

superset

Apache Superset is a Data Visualization and Data Exploration Platform

TypeScript

67,700

15,541

data-science data-engineering typescript data-visualization databases visualization data-lakes jupyter data-exploration apache webdev

cvat

Annotate better with CVAT, the industry-leading data engine for machine learning. Used and trusted by teams at any scale, for data of any scale.

Python

14,260

3,316

data-engineering machine-learning python ai data-science