DevTrends.fyi

Trending

Content tagged with "data-engineering"

data-engineering

Hacker News

Top stories from the Hacker News community• Updated 14 minutes ago

176
124
gabiteodoru
2 days ago
aillmprogrammingcode-writingai-researchcode-generationq/kdb+data-engineeringq-kdb+
91
12
sabman
3 days ago
aidata-sciencellmdata-engineering
75
25
nateb2022
1 day ago
aidata-sciencegeocodinggeospatialopen-sourcedata-engineeringnlpgeography
44
38
vcoisne
3 days ago
storagecloudbig-datadata-engineering
68
45
antgoldbloom
2 days ago
knowledge-graphssystem-designdata-engineering
12
nvais
1 day ago
self-hostingdata-sciencedata-engineeringself-hosted
36
3
diodorus
6 days ago
data-sciencearchaeologygisgeospatialhistorydata-engineering
4
1
bloodmosher
3 days ago
system-integrationshow-hndata-engineering
1
dgoncharov
4 days ago
healthstartupsstartupycombinatordata-engineeringyc-s22
221

Reddit

Top posts from tech subreddits• Updated 14 minutes ago

2
0
Dreamer_made
26 days ago
r/AI_Agentsdata-sciencedeveloper-toolsdata-engineering
1
1
rtbot2
27 days ago
r/realtechaiclouddeep-learningdata-engineering
36
17
Desperate-Pin-9159
28 days ago
r/AI_Agentsaidata-engineeringnlp
326
30
janghyun1230
about 1 month ago
r/LocalLLaMAoptimizationperformancedata-engineering
8
4
BeautifulMistake808
about 1 month ago
r/AI_Agentsdeveloper-toolsetldata-engineering
1
1
rtbot2
about 1 month ago
r/realtechiotcloudedge-computingdata-engineering
Reddit

AI Agent for scraping for Jobs

reddit.com
3
5
iamonthesun
about 1 month ago
r/AI_Agentsaiwebdevautomationdata-engineering
0
0
Toby04es
about 1 month ago
r/codingfinancefinancial-technologyfintechfinancial-datadeveloper-toolsweb-scrapingfinancial-statementsdata-engineering
1
1
rtbot2
about 1 month ago
r/realtechaicloudbig-datadata-engineering
14617

Hugging Face Trending

Popular models from Hugging Face• Updated about 1 hour ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated 10 minutes ago

apacheapache

superset

Apache Superset is a Data Visualization and Data Exploration Platform

TypeScript
67,037
15,294
data-sciencedata-engineeringtypescriptdata-visualizationdatabasesvisualizationdata-lakesjupyterdata-explorationapache
googlegoogle

flatbuffers

FlatBuffers: Memory Efficient Serialization Library

C++
24,419
3,355
c++googleperformancecppdeveloper-toolsdata-engineeringserializationflatbuffers
apacheapache

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python
40,852
15,271
data-engineeringpythonworkflowapacheworkflow-orchestrationetl
run-llamarun-llama

llama_index

LlamaIndex is the leading framework for building LLM-powered agents over your data.

Python
42,834
6,154
llmpythongenerative-aidata-engineeringaitransformersragvector-searchnlp
milvus-iomilvus-io

milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Go
35,792
3,277
vector-databasescloudgodata-engineeringvector-searchmilvusdatabases
ClickHouseClickHouse

ClickHouse

ClickHouse® is a real-time analytics database management system

C++
41,502
7,443
databasessqlclickhousec++analyticscppperformancedata-engineeringdata-analytics
lancedblancedb

lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Rust
4,947
370
data-engineeringrustvector-databasesdatabasesvector-search
facebookresearchfacebookresearch

faiss

A library for efficient similarity search and clustering of dense vectors.

C++
35,853
3,934
vector-searchembeddingsdata-engineeringmachine-learningdata-sciencec++faiss
apacheapache

flink-cdc

Flink CDC is a streaming data integration tool

Java
6,131
2,034
big-dataapache-flinkapachedata-engineeringstreamingflink
24