DevTrends.fyi

Trending

Content tagged with "data-engineering"

data-engineering

Hacker News

Top stories from the Hacker News community• Updated 7 minutes ago

140
84
gabiteodoru
1 day ago
aillmprogrammingcode-writingai-researchcode-generationq/kdb+data-engineeringq-kdb+
91
12
sabman
2 days ago
aidata-sciencellmdata-engineering
75
25
nateb2022
about 17 hours ago
aidata-sciencegeocodinggeospatialopen-sourcedata-engineeringnlpgeography
44
38
vcoisne
2 days ago
storagecloudbig-datadata-engineering
68
45
antgoldbloom
1 day ago
knowledge-graphssystem-designdata-engineering
12
nvais
1 day ago
self-hostingdata-sciencedata-engineeringself-hosted
36
3
diodorus
5 days ago
data-sciencearchaeologygisgeospatialhistorydata-engineering
4
1
bloodmosher
2 days ago
system-integrationshow-hndata-engineering
1
dgoncharov
3 days ago
healthstartupsstartupycombinatordata-engineeringyc-s22
221

Reddit

Top posts from tech subreddits• Updated 7 minutes ago

3
1
rtbot2
1 day ago
r/realtechenergyaideep-miningclimate-techcoolingindustrialbig-datadeep-learningengineeringdata-engineering
Reddit

Handling unique indexes on large data in PostgreSQL

volodymyrpotiichuk.com
44
11
NoBarber9673
2 days ago
r/programmingdatabasespostgresqlsqldata-engineering
5352
125
Wagamaga
3 days ago
r/technologysatellite-datagovernment-policyclimatebig-datasecuritydata-engineering
1
1
rtbot2
3 days ago
r/realtechclimatebig-datasecuritydata-engineering
747
87
madredditscientist
4 days ago
r/webdevapiaidata-sciencewebdevfullstackmonitoringdata-engineeringnlpreal-time
Reddit

How does Oasis get this water data?

apps.apple.com
0
0
blahblahblah215
5 days ago
r/codingdata-scienceknowledge-graphswater-datadata-lakesdata-analyticsbig-datadata-visualizationdata-engineering
Reddit

[P] Live data and model training tips

reddit.com
2
1
WorkingOld9340
4 days ago
r/MachineLearningtrainingmodel-servingmlopsdata-engineeringmodel-training
1
1
rtbot2
4 days ago
r/realtechtexasenergynucleardata-centersdata-engineering
3
1
Patrickghlin
5 days ago
r/AI_Agentsdata-scienceexploratory-data-analysisdata-engineering
217

Hugging Face Trending

Popular models from Hugging Face• Updated about 1 hour ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated 3 minutes ago

apacheapache

superset

Apache Superset is a Data Visualization and Data Exploration Platform

TypeScript
67,016
15,290
data-sciencedata-engineeringtypescriptdata-visualizationdatabasesvisualizationdata-lakesjupyterdata-explorationapache
googlegoogle

flatbuffers

FlatBuffers: Memory Efficient Serialization Library

C++
24,419
3,355
c++googleperformancecppdeveloper-toolsdata-engineeringserializationflatbuffers
apacheapache

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python
40,852
15,271
data-engineeringpythonworkflowapacheworkflow-orchestrationetl
run-llamarun-llama

llama_index

LlamaIndex is the leading framework for building LLM-powered agents over your data.

Python
42,834
6,154
llmpythongenerative-aidata-engineeringaitransformersragvector-searchnlp
milvus-iomilvus-io

milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Go
35,792
3,277
vector-databasescloudgodata-engineeringvector-searchmilvusdatabases
ClickHouseClickHouse

ClickHouse

ClickHouse® is a real-time analytics database management system

C++
41,502
7,443
databasessqlclickhousec++analyticscppperformancedata-engineeringdata-analytics
lancedblancedb

lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Rust
4,947
370
data-engineeringrustvector-databasesdatabasesvector-search
facebookresearchfacebookresearch

faiss

A library for efficient similarity search and clustering of dense vectors.

C++
35,853
3,934
vector-searchembeddingsdata-engineeringmachine-learningdata-sciencec++faiss
apacheapache

flink-cdc

Flink CDC is a streaming data integration tool

Java
6,131
2,034
big-dataapache-flinkapachedata-engineeringstreamingflink
24