DevTrends.fyi

Trending

Content tagged with "data-engineering"

data-engineering

Hacker News

Top stories from the Hacker News community• Updated 8 minutes ago

34
7
vbezhenar
about 3 hours ago
storagesystem-designperformancelinuxdata-engineering
HN

Your data model is your destiny

notes.mtb.xyz
368
92
hunglee2
4 days ago
data-engineeringsystem-designdata-sciencedata-modelingbig-datamodel-servingmlops
13
6
iaaan
6 days ago
system-designperformancedata-engineeringcompressiondata-transfersnetworkingdata-compression
21
12
rtk0
6 days ago
data-structuresperformancedata-compressionfile-archivingbig-datadata-engineeringcompression
14
20
mickeymounds
2 days ago
data-sciencebig-datadata-engineeringdata-visualizationopen-source
90
39
jnord
8 days ago
data-engineeringdata-lakesknowledge-graphssystem-designdata-scienceself-hosteddigital-archiving
20
1
giuliomagnifico
6 days ago
data-engineeringdata-lakesdigital-archivingsystem-design
21
37
articsputnik
2 days ago
data-visualizationdata-engineeringdata-analysisdata-sciencebig-data
HN

IRS Open Sources its Fact Graph

github.com
286
68
ronbenton
3 days ago
data-scienceknowledge-graphsopen-sourcedata-engineering
246

Reddit

Top posts from tech subreddits• Updated 17 minutes ago

Reddit

Coding with company dataset

reddit.com
3
5
Fabbelouz
7 months ago
r/AI_Agentsdata-sciencedatabasesdata-engineering
5
19
badseed79
7 months ago
r/MachineLearningdata-sciencepythondata-engineeringnlp
3
0
alvisanovari
7 months ago
r/artificialdata-sciencesearchdata-engineering
Reddit

[D] Should my dataset be balanced?

reddit.com
20
22
hippobreeder3000
7 months ago
r/MachineLearningmachine-learningdata-scienceai-ethicsbest-practicesmlopsdata-engineering
6
8
Future_AGI
7 months ago
r/AI_Agentsaidata-qualitydata-engineeringnlp
0
8
___loki__
7 months ago
r/MachineLearningmonitoringmlopsdata-engineering
1
1
dudufig
7 months ago
r/AI_Agentsdatabasessqldata-engineering
3
7
johnbburg
7 months ago
r/MachineLearningwebdevmonitoringfrontendweb-scrapingdata-engineeringbackend
1
1
nabs2011
7 months ago
r/AI_Agentsaidata-scienceautomationdata-engineering
13840

Hugging Face Trending

Popular models from Hugging Face• Updated 36 minutes ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated about 1 hour ago

pathwaycompathwaycom

pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Python
48,755
1,416
pythonetlllmragdata-engineering
apacheapache

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Python
42,841
15,793
data-engineeringpythonworkflowapacheworkflow-orchestrationetlworkflow-automation
ClickHouseClickHouse

ClickHouse

ClickHouse® is a real-time analytics database management system

C++
43,434
7,727
databasessqlclickhousec++analyticscppperformancedata-engineeringdata-analyticsreal-timesystem-design
lancedblancedb

lance

Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Rust
5,537
453
data-engineeringrustvector-databasesdatabasesvector-searchbig-data
datahub-projectdatahub-project

datahub

The Metadata Platform for your Data and AI Stack

Java
11,145
3,239
data-engineeringdata-lakesjavadata-scienceai
apacheapache

doris

Apache Doris is an easy-to-use, high performance and unified analytics database.

Java
14,460
3,577
databasessqlapacheperformancejavaanalyticsdata-engineeringdata-warehousingbig-dataapache-dorisdata-analyticsdatabase-tuning
run-llamarun-llama

llama_index

LlamaIndex is the leading framework for building LLM-powered agents over your data.

Python
44,763
6,452
llmpythongenerative-aidata-engineeringaitransformersragvector-searchnlp
apacheapache

superset

Apache Superset is a Data Visualization and Data Exploration Platform

TypeScript
68,520
16,009
data-sciencedata-engineeringtypescriptdata-visualizationdatabasesvisualizationdata-lakesjupyterdata-explorationapachewebdev
OpenBB-financeOpenBB-finance

OpenBB

Financial data platform for analysts, quants and AI agents.

Python
53,491
5,132
pythondata-scienceopen-sourcefinancial-analyticsfinancial-datafinancial-analysisfintechfinancefinancialdata-engineeringai
26