DevTrends.fyi

Trending

Content tagged with "data-engineering"

data-engineering

Hacker News

Top stories from the Hacker News community• Updated 6 minutes ago

166
61
rbanffy
about 22 hours ago
data-engineeringbig-datadata-lakesstorage
HN

Transducer: Composition, Abstraction, Performance

funktionale-programmierung.de
97
5
defmarco
5 days ago
architectureperformanceabstractionsystem-designdata-engineering
544
223
costco
4 days ago
aidata-sciencenlpmlopsmodel-servingdata-engineering
161
82
kalli
3 days ago
webdevfrontendfullstackdata-sciencedata-analyticsbig-datadata-engineeringdata-analysisanalyticsentertainmentnightlifesocial-analysis
6
todsacerdoti
6 days ago
data-sciencebig-datadata-analyticsdata-engineeringmonitoring
123
28
ingve
6 days ago
data-engineeringdatabase-tuningdatabasessystem-designpostgressql
HN

Moving tables across PostgreSQL instances

ananthakumaran.in
69
3
ananthakumaran
7 days ago
data-engineeringdatabasespostgresqletlsystem-design
41
8
charlieirish
5 days ago
system-designdata-engineeringstorageperformancehigh-performance
HN

Optimizing Datalog for the GPU

danglingpointers.substack.com
112
20
blakepelton
5 days ago
data-engineeringgpuoptimization
251

Reddit

Top posts from tech subreddits• Updated 3 minutes ago

3
4
rongxw
5 months ago
r/MachineLearningdata-sciencedata-engineeringstatistics
2
9
reddithenry
5 months ago
r/MachineLearningdata-sciencetime-seriesdata-engineering
0
0
tonyblu331
5 months ago
r/artificialaillmdashboarddata-engineering
3849
339
Happy_Weed
5 months ago
r/technologyaidata-scienceai-ethicscybersecuritybig-datadata-engineering
622
135
lurker_bee
5 months ago
r/technologystoragebig-datacloud-hardwaredatacenterdata-engineering
1
1
rtbot2
5 months ago
r/realtechinfrastructure-as-codecloudbig-datadata-engineering
39322
2791
Aggravating_Money992
5 months ago
r/technologyaisurveillancedata-scienceai-ethicsprivacybig-datasecuritydata-privacydata-engineering
3995
405
AgentBlue62
5 months ago
r/technologydata-scienceai-ethicsbig-datadata-engineering
Reddit

Store somewhat large data in URL

reddit.com
15
33
fleauberlin
5 months ago
r/webdevurlbig-datadata-engineering
1313343

Hugging Face Trending

Popular models from Hugging Face• Updated 4 minutes ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated 18 minutes ago

googlegoogle

flatbuffers

FlatBuffers: Memory Efficient Serialization Library

C++
24,990
3,420
c++googleperformancecppdeveloper-toolsdata-engineeringserializationflatbuffersmemory-optimizationmemory-efficientdata-serialization
dlt-hubdlt-hub

dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

Python
4,494
376
pythonopen-sourcedata-engineeringetl
mindsdbmindsdb

mindsdb

Federated query engine for AI - The only MCP Server you'll ever need

Python
37,121
5,966
aidata-sciencepythondata-engineeringmlopsknowledge-graphsragmodel-serving
apacheapache

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python
43,110
15,905
data-engineeringpythonworkflowapacheworkflow-orchestrationetlworkflow-automation
apacheapache

arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

C++
16,122
3,898
data-engineeringbig-datacolumnar-databasesdatabasesapacheapache-arrowdata-lakesetl
apacheapache

superset

Apache Superset is a Data Visualization and Data Exploration Platform

TypeScript
68,829
16,111
data-sciencedata-engineeringtypescriptdata-visualizationdatabasesvisualizationdata-lakesjupyterdata-explorationapachewebdev
pola-rspola-rs

polars

Extremely fast Query Engine for DataFrames, written in Rust

Rust
35,956
2,457
rustdata-engineeringdata-sciencevector-databasesperformancedataframes
ClickHouseClickHouse

ClickHouse

ClickHouse® is a real-time analytics database management system

C++
43,835
7,790
databasessqlclickhousec++analyticscppperformancedata-engineeringdata-analyticsreal-timesystem-design
vmware-tanzuvmware-tanzu

velero

Backup and migrate Kubernetes applications and their persistent volumes

Go
9,571
1,486
kubernetesbackupvmware-tanzudata-engineeringcloud
26