Menu

Home Page
Your Collection

Links

Privacy Policy
Terms and Conditions
Contact

© 2025 DevTrends.fyi

Loading user info...

Trending

Content tagged with "data-engineering"

data-engineering

Show all

Hacker News

Top stories from the Hacker News community• Updated less than a minute ago

HN

Your data model is your destiny

notes.mtb.xyz

368

hunglee2

3 days ago

data-engineering system-design data-science data-modeling big-data model-serving mlops

HN

Show HN: Compression-Resistant Data Transfers

github.com

13

iaaan

6 days ago

system-design performance data-engineering compression data-transfers networking data-compression

HN

Peeking Inside Gigantic Zips with Only Kilobytes

ritiksahni.com

21

rtk0

6 days ago

data-structures performance data-compression file-archiving big-data data-engineering compression

HN

Show HN: We priced basic needs in work hours (global ranking and CSVs)

thepricer.org

14

mickeymounds

1 day ago

data-science big-data data-engineering data-visualization open-source

HN

The people rescuing forgotten knowledge trapped on old floppy disks

bbc.com

90

jnord

7 days ago

data-engineering data-lakes knowledge-graphs system-design data-science self-hosted digital-archiving

HN

Cambridge University launches project to rescue data trapped on old floppy disks

lib.cam.ac.uk

20

giuliomagnifico

5 days ago

data-engineering data-lakes digital-archiving system-design

HN

Like MS Excel, Pivot tables never die

rilldata.com

21

articsputnik

1 day ago

data-visualization data-engineering data-analysis data-science big-data

HN

IRS Open Sources its Fact Graph

github.com

286

ronbenton

2 days ago

data-science knowledge-graphs open-source data-engineering

HN

Beyond the SQLite Single-Writer Limitation with Concurrent Writes

turso.tech

65

syrusakbary

10 days ago

data-engineering databases sql performance sqlite system-design

Reddit

Top posts from tech subreddits• Updated 15 minutes ago

Reddit

Salesforce told ICE it could help speed up hiring of immigration officers

sfchronicle.com

4857

NewSlinger

about 19 hours ago

r/technology ai webdev cloud security data-engineering

Reddit

Salesforce told ICE it could help speed up hiring of immigration officers

sfchronicle.com

1

rtbot2

about 17 hours ago

r/realtech ai webdev cloud security data-engineering

Reddit

Conflict-Free Replicated Data Types (CRDTs): Convergence Without Coordination

read.thecoder.cafe

1

teivah

1 day ago

r/coding high-availability conflict-free-replicated-data-types system-design data-engineering distributed-systems

Reddit

Experimenting With A Signal Driven Paradigm. Thoughts?

github.com

2

TitanSpire

2 days ago

r/coding ai data-science signal-processing systems-design event-driven deep-learning system-design data-engineering research distributed-systems

Reddit

Taiwan says China's latest rare earth export controls won't hurt its chip industry | Some industries are still expected to suffer despite Taiwan's reassurance

techspot.com

1

rtbot2

1 day ago

r/realtech taiwan ai china semiconductors data-engineering

Reddit

How to use AI agents to scrape data from different websites?

reddit.com

25

Just-Increase-4890

4 days ago

r/AI_Agents ai ai-ethics webdev web-scraping ai-agents data-engineering

Reddit

HuggingFace storage is no longer unlimited - 12TB public storage max

reddit.com

333

Thireus

6 days ago

r/LocalLLaMA ai storage transformers cloud mlops data-engineering

Reddit

Similarweb free is basically blocked now. We made a free alternative

reddit.com

20

hienyimba

6 days ago

r/webdev api webdev developer-tools open-source data-engineering web-analytics

Reddit

A data center fire in South Korea sees 858 TB of government files and 'eight years’ worth of work' stored in the cloud go up in smoke

pcgamer.com

6896

lurker_bee

7 days ago

r/technology data-security data-center cloud big-data security data-engineering

Hugging Face Trending

Popular models from Hugging Face• Updated about 1 hour ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated 11 minutes ago

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python

42,828

15,787

data-engineering python workflow apache workflow-orchestration etl workflow-automation

ClickHouse

ClickHouse® is a real-time analytics database management system

C++

43,427

7,726

databases sql clickhouse c++analytics cpp performance data-engineering data-analytics real-time

lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Rust

5,531

452

data-engineering rust vector-databases databases vector-search big-data

datahub-project

datahub

The Metadata Platform for your Data and AI Stack

Java

11,142

3,239

data-engineering data-lakes java data-science ai

doris

Apache Doris is an easy-to-use, high performance and unified analytics database.

Java

14,460

3,577

databases sql apache performance java analytics data-engineering data-warehousing big-data apache-doris data-analytics database-tuning

llama_index

LlamaIndex is the leading framework for building LLM-powered agents over your data.

Python

44,763

6,452

llm python generative-ai data-engineering ai transformers rag vector-search nlp

superset

Apache Superset is a Data Visualization and Data Exploration Platform

TypeScript

68,520

16,009

data-science data-engineering typescript data-visualization databases visualization data-lakes jupyter data-exploration apache webdev

pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Python

47,952

1,406

python etl llm rag data-engineering

OpenBB

Financial data platform for analysts, quants and AI agents.

Python

53,491

5,132

python data-science open-source financial-analytics financial-data financial-analysis fintech finance financial data-engineering ai