DevTrends.fyi

Trending

Content tagged with "data-engineering"

data-engineering

Hacker News

Top stories from the Hacker News community• Updated 11 minutes ago

HN

The DuckDB Local UI

duckdb.org
868
181
xnx
5 months ago
databasesduckdbdata-engineeringsql
75
51
Akula112233
5 months ago
aimonitoringdevopsdata-engineeringobservability
105
94
indy
5 months ago
data-engineeringproductivityfinanceexcelcloudinfrastructure-as-codedatabases
61
39
jchandra
5 months ago
data-engineeringbig-datacloud
87
35
wiradikusuma
5 months ago
big-datadata-engineeringgeospatial
HN

Spark Texture Compression 1.2

ludicon.com
25
4
luu
5 months ago
graphicscompressiondata-engineeringperformancegame-enginesbig-datacloudoptimization
125

Reddit

Top posts from tech subreddits• Updated about 2 hours ago

1
1
Temporary_Depth_2491
about 22 hours ago
r/codingpostgresdatabasesstoragedatabase-tuningwrite-ahead-loggingsystem-designdata-engineeringstorage-management
0
0
wyhjsbyb
2 days ago
r/codingpythoncompressionperformancedata-engineeringzstandard
4
9
Critical-Pen-6382
about 7 hours ago
r/AI_Agentsaiautomationdata-engineeringbusiness-automation
5
0
EgregorAmeriki
3 days ago
r/codingsoftware-engineeringoopobject-orientedsoftware-designsystem-designdata-engineering
1
2
rtbot2
1 day ago
r/realtechcloudbig-datagoogledatacenterdata-engineering
52
16
F0urLeafCl0ver
1 day ago
r/artificialaicloudbig-datadata-engineering
1
1
rtbot2
1 day ago
r/realtechaidata-centerbig-datadata-engineering
21
28
Ok-Classic6022
3 days ago
r/AI_Agentsaisqldata-engineering
412
47
chrisdh79
3 days ago
r/techneural-networksaiembeddedbirddata-engineering
222

Hugging Face Trending

Popular models from Hugging Face• Updated 38 minutes ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated about 1 hour ago

NemProjectNemProject

nem

number go up 💹

Java
109
33
javasystem-designdistributed-systemsdata-engineeringbig-datablockchainnumber-go-up
Unstructured-IOUnstructured-IO

unstructured

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.

HTML
12,189
1,008
etldata-engineeringembeddingstransformersnlpopen-source
pathwaycompathwaycom

pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Python
29,596
791
pythonetlllmragdata-engineering
milvus-iomilvus-io

milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Go
36,244
3,321
vector-databasescloudgodata-engineeringvector-searchmilvusdatabases
ranaroussiranaroussi

yfinance

Download market data from Yahoo! Finance's API

Python
18,413
2,750
pythonapidata-sciencedata-engineeringfinancial-data
simdjsonsimdjson

simdjson

Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, StarRocks

C++
20,942
1,092
performancebig-datac++data-engineeringjsoncpp
datavzrddatavzrd

datavzrd

A tool to create visual HTML reports from collections of CSV/TSV tables

Rust
483
29
data-engineeringdata-visualizationrust
apacheapache

seatunnel

SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.

Java
8,671
2,028
data-engineeringbig-datajavaetldistributed-systems
googlegoogle

flatbuffers

FlatBuffers: Memory Efficient Serialization Library

C++
24,539
3,370
c++googleperformancecppdeveloper-toolsdata-engineeringserializationflatbuffersmemory-optimization
25