DevTrends.fyi

Trending

Content tagged with "data-engineering"

data-engineering

Hacker News

Top stories from the Hacker News community• Updated 8 minutes ago

176
124
gabiteodoru
2 days ago
aillmprogrammingcode-writingai-researchcode-generationq/kdb+data-engineeringq-kdb+
91
12
sabman
3 days ago
aidata-sciencellmdata-engineering
75
25
nateb2022
1 day ago
aidata-sciencegeocodinggeospatialopen-sourcedata-engineeringnlpgeography
44
38
vcoisne
3 days ago
storagecloudbig-datadata-engineering
68
45
antgoldbloom
2 days ago
knowledge-graphssystem-designdata-engineering
12
nvais
1 day ago
self-hostingdata-sciencedata-engineeringself-hosted
36
3
diodorus
6 days ago
data-sciencearchaeologygisgeospatialhistorydata-engineering
4
1
bloodmosher
3 days ago
system-integrationshow-hndata-engineering
1
dgoncharov
4 days ago
healthstartupsstartupycombinatordata-engineeringyc-s22
221

Reddit

Top posts from tech subreddits• Updated 2 minutes ago

Reddit

Cut LLM Audio Transcription Costs

reddit.com
4
0
Kboss99
3 months ago
r/AI_Agentsaillmcost-optimizationdata-engineering
1
1
rtbot2
3 months ago
r/realtechtech-newsaidata-sciencedeep-learningdata-engineering
1
1
rtbot2
3 months ago
r/realtechinfrastructure-as-codecloudawsdata-engineering
3
1
rtbot2
3 months ago
r/realtechai-ethicscloudsustainabilitybig-datadata-engineering
12056
595
alwaysrm4hope
3 months ago
r/technologyaicloudbig-datasecuritydata-engineering
13
1
azalio
3 months ago
r/artificialdata-sciencellmdeep-learningcompressiondata-engineering
16989
621
IlustriousCoffee
3 months ago
r/technologydata-scienceai-ethicsprivacyinfosecsecuritydata-privacydata-engineering
259
164
ketralnis
3 months ago
r/programmingpostgresdatabasessqldata-engineering
0
2
LetsTacoooo
3 months ago
r/MachineLearningdata-sciencebest-practicesdata-engineering
1121417

Hugging Face Trending

Popular models from Hugging Face• Updated 20 minutes ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated 34 minutes ago

apacheapache

superset

Apache Superset is a Data Visualization and Data Exploration Platform

TypeScript
67,037
15,294
data-sciencedata-engineeringtypescriptdata-visualizationdatabasesvisualizationdata-lakesjupyterdata-explorationapache
googlegoogle

flatbuffers

FlatBuffers: Memory Efficient Serialization Library

C++
24,419
3,355
c++googleperformancecppdeveloper-toolsdata-engineeringserializationflatbuffers
apacheapache

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python
40,852
15,271
data-engineeringpythonworkflowapacheworkflow-orchestrationetl
run-llamarun-llama

llama_index

LlamaIndex is the leading framework for building LLM-powered agents over your data.

Python
42,834
6,154
llmpythongenerative-aidata-engineeringaitransformersragvector-searchnlp
milvus-iomilvus-io

milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Go
35,792
3,277
vector-databasescloudgodata-engineeringvector-searchmilvusdatabases
ClickHouseClickHouse

ClickHouse

ClickHouse® is a real-time analytics database management system

C++
41,502
7,443
databasessqlclickhousec++analyticscppperformancedata-engineeringdata-analytics
lancedblancedb

lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Rust
4,947
370
data-engineeringrustvector-databasesdatabasesvector-search
facebookresearchfacebookresearch

faiss

A library for efficient similarity search and clustering of dense vectors.

C++
35,853
3,934
vector-searchembeddingsdata-engineeringmachine-learningdata-sciencec++faiss
apacheapache

flink-cdc

Flink CDC is a streaming data integration tool

Java
6,131
2,034
big-dataapache-flinkapachedata-engineeringstreamingflink
24