Menu

Home Page
Your Collection

Links

Privacy Policy
Terms and Conditions
Contact

© 2025 DevTrends.fyi

Loading user info...

Trending

Content tagged with "data-engineering"

data-engineering

Show all

Hacker News

Top stories from the Hacker News community• Updated 11 minutes ago

HN

MD RAID or DRBD can be broken from userspace when using O_DIRECT

bugzilla.kernel.org

55

vbezhenar

about 5 hours ago

storage system-design performance linux distributed-systems data-engineering

HN

Your data model is your destiny

notes.mtb.xyz

368

hunglee2

4 days ago

data-engineering system-design data-science data-modeling big-data model-serving mlops

HN

Show HN: Compression-Resistant Data Transfers

github.com

13

iaaan

6 days ago

system-design performance data-engineering compression data-transfers networking data-compression

HN

Peeking Inside Gigantic Zips with Only Kilobytes

ritiksahni.com

21

rtk0

6 days ago

data-structures performance data-compression file-archiving big-data data-engineering compression

HN

Show HN: We priced basic needs in work hours (global ranking and CSVs)

thepricer.org

14

mickeymounds

2 days ago

data-science big-data data-engineering data-visualization open-source

HN

The people rescuing forgotten knowledge trapped on old floppy disks

bbc.com

90

jnord

8 days ago

data-engineering data-lakes knowledge-graphs system-design data-science self-hosted digital-archiving

HN

Cambridge University launches project to rescue data trapped on old floppy disks

lib.cam.ac.uk

20

giuliomagnifico

6 days ago

data-engineering data-lakes digital-archiving system-design

HN

Like MS Excel, Pivot tables never die

rilldata.com

21

articsputnik

2 days ago

data-visualization data-engineering data-analysis data-science big-data

HN

IRS Open Sources its Fact Graph

github.com

286

ronbenton

3 days ago

data-science knowledge-graphs open-source data-engineering

Reddit

Top posts from tech subreddits• Updated 5 minutes ago

Reddit

Going down the rabbit hole of Postgres 18 features

xata.io

3

CompileMyThoughts

17 days ago

r/coding postgres databases postgresql sql system-design data-engineering

Reddit

DetectPack Forge: Natural-Language to Sigma/KQL/SPL

github.com

1

Agreeable_Duck8818

about 1 month ago

r/coding api ai knowledge-graphs data-engineering nlp

Reddit

Hyundai Mobis teams with Samsung, SK to push for Korean-made auto chips

koreajoongangdaily.joins.com

1

rtbot2

18 days ago

r/realtech ai ai-ethics semiconductors automotive korea data-engineering automotive-chips

Reddit

[D] Name and describe a data processing technique you use that is not very well known.

reddit.com

36

Glittering_Key_9452

19 days ago

r/MachineLearning data-processing etl data-engineering

Reddit

Should Salesforce's Tableau Be Granted a Patent On 'Visualizing Hierarchical Data'?

m.slashdot.org

85

NewWorkkarma

20 days ago

r/programming patents data-science big-data data-visualization data-engineering

Reddit

Cumulative Statistics in PostgreSQL 18

data-bene.io

5

talktomeabouttech

19 days ago

r/programming databases postgresql data-analytics data-engineering

Reddit

Renewables blow past nuclear when it comes to cheap datacenter juice — Study finds microgrids with wind, solar, and batteries can be built years sooner and at lower cost than SMRs

theregister.com

3

rtbot2

20 days ago

r/realtech renewable-energy microgrids data-center cloud edge-computing data-engineering

Reddit

Report finds Copilot accesses millions of records per company, raising data protection concerns

techradar.com

0

rtbot2

20 days ago

r/realtech ai data-security ai-ethics security mlops data-engineering

Reddit

How i accidentally created the fastest csv parser ever made.

sanixdk.xyz

3

s4n1x

21 days ago

r/coding python performance data-engineering csv

Hugging Face Trending

Popular models from Hugging Face• Updated 24 minutes ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated 38 minutes ago

pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Python

48,774

1,416

python etl llm rag data-engineering

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

42,842

15,794

data-engineering python workflow apache workflow-orchestration etl workflow-automation

ClickHouse

ClickHouse® is a real-time analytics database management system

C++

43,434

7,727

databases sql clickhouse c++analytics cpp performance data-engineering data-analytics real-time system-design

lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Rust

5,537

453

data-engineering rust vector-databases databases vector-search big-data

datahub-project

datahub

The Metadata Platform for your Data and AI Stack

Java

11,145

3,239

data-engineering data-lakes java data-science ai

doris

Apache Doris is an easy-to-use, high performance and unified analytics database.

Java

14,460

3,577

databases sql apache performance java analytics data-engineering data-warehousing big-data apache-doris data-analytics database-tuning

llama_index

LlamaIndex is the leading framework for building LLM-powered agents over your data.

Python

44,763

6,452

llm python generative-ai data-engineering ai transformers rag vector-search nlp

superset

Apache Superset is a Data Visualization and Data Exploration Platform

TypeScript

68,520

16,009

data-science data-engineering typescript data-visualization databases visualization data-lakes jupyter data-exploration apache webdev

OpenBB

Financial data platform for analysts, quants and AI agents.

Python

53,491

5,132

python data-science open-source financial-analytics financial-data financial-analysis fintech finance financial data-engineering ai