Menu

Home Page
Your Collection

Links

Privacy Policy
Terms and Conditions
Contact

© 2025 DevTrends.fyi

Loading user info...

Trending

Content tagged with "data-engineering"

data-engineering

Show all

Hacker News

Top stories from the Hacker News community• Updated 9 minutes ago

HN

Google's Liquid Cooling at Hot Chips 2025

chipsandcheese.com

230

giuliomagnifico

about 7 hours ago

cloud hardware google cooling edge-computing data-center data-engineering

HN

Standard Thermal: Energy Storage 500x Cheaper Than Batteries

austinvernon.site

207

pfdietz

about 13 hours ago

energy-economics big-data energy data-engineering energy-storage renewable-energy system-design energy-efficiency thermal-energy storage power

HN

The two versions of Parquet

jeronimo.dev

195

tanelpoder

5 days ago

olap data-engineering big-data data-lakes etl databases

HN

OS Yamato lets your data fade away

github.com

18

tsuyoshi_k

4 days ago

data-security privacy self-hosted data-engineering data-lakes system-design etl

HN

SQLite (with WAL) doesn't do `fsync` on each commit under default settings

avi.im

97

Bogdanp

1 day ago

system-design databases sqlite database-tuning sql storage data-engineering

HN

World Wide Lightning Location Network

wwlln.net

79

perihelions

3 days ago

cloud networking big-data data-engineering monitoring

HN

You Should Add Debug Views to Your DB

chrispenner.ca

64

ezekg

8 days ago

database debugging data-engineering system-design webdev backend

HN

Margin Debt Surges 9.5% in June to Record High

advisorperspectives.com

186

pera

5 days ago

data-engineering financial-markets investing data-science margin-trading finance stock-market system-design data-lakes big-data

HN

Show HN: Tool shows UK properties matching group commute/time preferences

closemove.com

6

fryingdan

5 days ago

webdev real-estate data-engineering uk

Reddit

Top posts from tech subreddits• Updated 9 minutes ago

Reddit

[P] Yelp Dataset clarification: Is review_count colomn cheating?

reddit.com

0

AdInevitable1362

about 20 hours ago

r/MachineLearning data-science data-ethics data-analytics datasets big-data data-engineering

Reddit

Exactly-Once Processing Across Kafka and Databases: Using Kafka Transactions + Idempotent Writes

medium.com

24

zarinfam

1 day ago

r/programming kafka transactional-processing transactions system-design data-engineering distributed-systems

Reddit

Nvidia outlines plans for using light for communication between AI GPUs by 2026 — silicon photonics and co-packaged optics may become mandatory for next-gen AI data centers

tomshardware.com

1

rtbot2

1 day ago

r/realtech ai data-center deep-learning data-engineering

Reddit

Exactly-Once Processing Across Kafka and Databases: Using Kafka Transactions + Idempotent Writes

medium.com

1

zarinfam

1 day ago

r/coding database-tuning kafka transactions system-design data-engineering distributed-systems

Reddit

SurrealDB is sacrificing data durability to make benchmarks look better

blog.cf8.gg

522

ChillFish8

2 days ago

r/programming databases data-lakes nosql surrealdb performance system-design etl data-engineering

Reddit

2025 guide to Context Engineering for Software Engineers

strategizeyourcareer.com

0

strategizeyourcareer

1 day ago

r/coding ai data-science ai-ethics model-serving context-engineering mlops system-design data-engineering nlp

Reddit

The United States of America now owns 10% of Intel

newsroom.intel.com

17488

StanmoreHill

2 days ago

r/technology investments investing ai ai-ethics cloud government corporate-investment big-data data-engineering investment

Reddit

[P] Haether. Coding data set api

reddit.com

1

CurtissYT

1 day ago

r/MachineLearning api coding data-engineering

Reddit

On creating spreadsheets/structured datasets from the web

reddit.com

1

hrishikamath

2 days ago

r/AI_Agents data-lakes etl data-engineering

Hugging Face Trending

Popular models from Hugging Face• Updated about 1 hour ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated 5 minutes ago

simdjson

Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, StarRocks

C++

20,942

1,092

performance big-data c++data-engineering json cpp

datavzrd

A tool to create visual HTML reports from collections of CSV/TSV tables

Rust

483

29

data-engineering data-visualization rust

SatDump

A generic satellite data processing software.

C++

1,687

191

data-engineering cpp satellites software c++satellite-data

databend

𝗗𝗮𝘁𝗮, 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗔𝗜. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://databend.com

Rust

8,652

795

data-engineering big-data data-lakes data-analytics data-science analytics

librdkafka

The Apache Kafka C/C++ library

C

706

3,213

kafka c c++cpp distributed-systems confluentinc cloud data-engineering confluent

great-expectations

great_expectations

Always know what to expect from your data.

Python

10,555

1,601

python data-science data-engineering testing data-quality data-validation

flink-cdc

Flink CDC is a streaming data integration tool

Java

6,131

2,034

big-data apache-flink apache data-engineering streaming flink

juicefs

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

Go

11,766

1,047

distributed-systems storage cloud data-engineering object-storage

shardingsphere

Empowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.

Java

20,277

6,818

data-engineering distributed-systems java scalability