DevTrends.fyi

Trending

Content tagged with "data-engineering"

data-engineering

Hacker News

Top stories from the Hacker News community• Updated 14 minutes ago

168
114
gabiteodoru
1 day ago
aillmprogrammingcode-writingai-researchcode-generationq/kdb+data-engineeringq-kdb+
91
12
sabman
3 days ago
aidata-sciencellmdata-engineering
75
25
nateb2022
about 22 hours ago
aidata-sciencegeocodinggeospatialopen-sourcedata-engineeringnlpgeography
44
38
vcoisne
2 days ago
storagecloudbig-datadata-engineering
68
45
antgoldbloom
1 day ago
knowledge-graphssystem-designdata-engineering
12
nvais
1 day ago
self-hostingdata-sciencedata-engineeringself-hosted
36
3
diodorus
5 days ago
data-sciencearchaeologygisgeospatialhistorydata-engineering
4
1
bloodmosher
2 days ago
system-integrationshow-hndata-engineering
1
dgoncharov
3 days ago
healthstartupsstartupycombinatordata-engineeringyc-s22
221

Reddit

Top posts from tech subreddits• Updated 11 minutes ago

8385
199
indig0sixalpha
15 days ago
r/technologytech-newsaistartupsai-ethicsbig-datasecuritydata-engineering
Reddit

The modern text processing pipeline

newroadoldway.com
15
1
ketralnis
16 days ago
r/programmingtransformersdata-engineeringnlp
195
10
AdSpecialist6598
18 days ago
r/techstoragecloudbig-datadata-engineering
1
1
rtbot2
18 days ago
r/realtechaicloudbig-datadata-engineering
Reddit

[P] I built a self-hosted Databricks

reddit.com
32
10
Mission-Balance-4250
20 days ago
r/MachineLearningself-hostingdatabasescloudbig-datadata-engineering
29
1
j1897OS
21 days ago
r/programmingreal-time-analyticsmonitoringbig-datadata-engineering
2
2
Slight-Support7917
20 days ago
r/MachineLearningazureaivector-searchdata-engineering
7
2
Worried-Variety3397
23 days ago
r/MachineLearningdata-sciencebig-datadata-engineering
Reddit

Batch processing

reddit.com
1
1
Quasimodo-57
25 days ago
r/AI_Agentsbig-datadata-engineeringdistributed-systems
13517

Hugging Face Trending

Popular models from Hugging Face• Updated 11 minutes ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated 25 minutes ago

apacheapache

superset

Apache Superset is a Data Visualization and Data Exploration Platform

TypeScript
67,018
15,292
data-sciencedata-engineeringtypescriptdata-visualizationdatabasesvisualizationdata-lakesjupyterdata-explorationapache
googlegoogle

flatbuffers

FlatBuffers: Memory Efficient Serialization Library

C++
24,419
3,355
c++googleperformancecppdeveloper-toolsdata-engineeringserializationflatbuffers
apacheapache

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python
40,852
15,271
data-engineeringpythonworkflowapacheworkflow-orchestrationetl
run-llamarun-llama

llama_index

LlamaIndex is the leading framework for building LLM-powered agents over your data.

Python
42,834
6,154
llmpythongenerative-aidata-engineeringaitransformersragvector-searchnlp
milvus-iomilvus-io

milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Go
35,792
3,277
vector-databasescloudgodata-engineeringvector-searchmilvusdatabases
ClickHouseClickHouse

ClickHouse

ClickHouse® is a real-time analytics database management system

C++
41,502
7,443
databasessqlclickhousec++analyticscppperformancedata-engineeringdata-analytics
lancedblancedb

lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Rust
4,947
370
data-engineeringrustvector-databasesdatabasesvector-search
facebookresearchfacebookresearch

faiss

A library for efficient similarity search and clustering of dense vectors.

C++
35,853
3,934
vector-searchembeddingsdata-engineeringmachine-learningdata-sciencec++faiss
apacheapache

flink-cdc

Flink CDC is a streaming data integration tool

Java
6,131
2,034
big-dataapache-flinkapachedata-engineeringstreamingflink
24