Trending

Content tagged with "data-lakes"

Show all

Hacker News

Top stories from the Hacker News community• Updated 13 minutes ago

HN

The Lost Decade of Small Data?

duckdb.org

187

andreasha

4 months ago

ai-ethics distributed-systems data-engineering data-science big-data ai data-lakes

HN

Digitization Complete for World-Renowned Franco Novacco Map Collection

newberry.org

19

mooreds

5 months ago

digitalization data-lakes data-science digital-transformation archives digital-archives ai cloud big-data tech-news

HN

Wikipedia: Database Download

en.wikipedia.org

181

doener

5 months ago

data-engineering databases data-lakes open-source big-data

HN

Prepper Disk

prepperdisk.com

27

Timothee

5 months ago

data-lakes homelab self-hosting data-engineering other

HN

SpacetimeDB

spacetimedb.com

305

matthewfcarlson

5 months ago

nosql data-lakes big-data databases vector-databases cloud sql postgres

HN

Data centers contain 90% crap data

gerrymcgovern.com

166

billybuckwheat

5 months ago

data-science big-data data-engineering data-lakes

HN

Where Do the Bytes Go?

flak.tedunangst.com

35

ingve

6 months ago

data-engineering big-data infrastructure-as-code data-science data-lakes

HN

Scoping a Local-First Image Archive

scottishstoater.com

22

stog

6 months ago

self-hosting cloud data-lakes data-engineering storage

HN

Preview: Amazon S3 Tables and Lakehouse in DuckDB

duckdb.org

164

hn1986

6 months ago

big-data data-lakes duckdb data-engineering cloud databases

Reddit

Top posts from tech subreddits• Updated 12 minutes ago

Reddit

What’s the biggest data governance challenge you face when building cross-agent pipelines?

reddit.com

2

rwitt101

11 days ago

r/AI_Agents data-lakes etl data-engineering

Reddit

SurrealDB is sacrificing data durability to make benchmarks look better

blog.cf8.gg

522

ChillFish8

26 days ago

r/programming databases data-lakes nosql surrealdb performance system-design etl data-engineering

Reddit

On creating spreadsheets/structured datasets from the web

reddit.com

1

hrishikamath

26 days ago

r/AI_Agents data-lakes etl data-engineering

Reddit

[P] Vibe datasetting- Creating syn data with a relational model

reddit.com

8

OkOwl6744

29 days ago

r/MachineLearning data-science data-lakes relational-databases data-synthesis etl data-engineering

Reddit

Smithsonian digitizes pollen from 18,000 plant species

si.edu

2

rtbot2

about 2 months ago

r/realtech ai data-science data-lakes biology science research

Reddit

Holographic ribbon challenges magnetic tape with 50-year longevity and 200TB cartridges | British startup unveils holographic tape that promises 50-year data lifespan

techspot.com

1

rtbot2

2 months ago

r/realtech data-storage data-lakes holographic-data-storage big-data holographic-data holographic-models

Reddit

[D] Build an in-house data labeling team vs. Outsource to a vendor?

reddit.com

7

vampirecutie_vc

2 months ago

r/MachineLearning ai data-science data-lakes data-labeling mlops etl data-engineering outsourcing

Reddit

Cerabyte unveils plan for 100 petabyte glass-ceramic storage racks by 2030 | It's aiming for 100,000 PB by 2045

techspot.com

3

rtbot2

2 months ago

r/realtech data-storage storage data-lakes big-data system-design future-tech data-engineering self-hosted

Reddit

How does Oasis get this water data?

apps.apple.com

0

blahblahblah215

3 months ago

r/coding data-science knowledge-graphs water-data data-lakes data-analytics big-data data-visualization data-engineering

2

Hugging Face Trending

Popular models from Hugging Face• Updated about 1 hour ago

No models found

Try removing the tag filter or searching for different content.

GitHub Trending

Popular repositories from GitHub• Updated 9 minutes ago

superset

Apache Superset is a Data Visualization and Data Exploration Platform

TypeScript

68,118

15,667

data-science data-engineering typescript data-visualization databases visualization data-lakes jupyter data-exploration apache webdev

datahub-project

datahub

The Metadata Platform for your Data and AI Stack

Java

11,048

3,215

data-engineering data-lakes java data-science ai

starrocks

The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.

Java

10,648

2,132

big-data data-engineering java databases sql analytics system-design data-lakes

arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

C++

15,912

3,847

data-engineering big-data columnar-databases databases apache apache-arrow data-lakes etl

rclone

"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files

Go

51,870

4,627

cloud data-engineering self-hosting storage data-lakes rclone

databend

𝗗𝗮𝘁𝗮, 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗔𝗜. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://databend.com

Rust

8,652

795

data-engineering big-data data-lakes data-analytics data-science analytics