Trending

Grok 4 Launch [video]

Launch HN: Morph (YC S23) – Apply AI code edits at 4,500 tokens/sec

BharatMLStack – Realtime Inference, MLOps

Show HN: Unlearning Comparator, a visual tool to compare machine unlearning

tinymcp: Let LLMs control embedded devices via the Model Context Protocol

I extracted the safety filters from Apple Intelligence models

Portability of Tar Features

Overclocking LLM Reasoning: Monitoring and Controlling LLM Thinking Path Lengths

Optimizing Tool Selection for LLM Workflows with Differentiable Programming

[R][P] We compress any BF16 model to ~70% size during inference, while keeping the output LOSSLESS so that you can fit in more context or run larger models.

We compress any BF16 model to ~70% size during inference, while keeping the output LOSSLESS so that you can fit in more ERP context or run larger models.

How can I be 100% sure that my AI Agent will not fail in production? Any process or industry practice

I benchmarked the Gemma 3 27b QAT models

[D] Would multiple NVIDIA Tesla P100's be cost effective for model training?

Have you tried a Ling-Lite-0415 MoE (16.8b total, 2.75b active) model?, it is fast even without GPU, about 15-20 tps with 32k context (128k max) on Ryzen 5 5500, fits in 16gb RAM at Q5. Smartness is about 7b-9b class models, not bad at deviant creative tasks.

Self-host Local AI platform with Ollama and Open WebUI

What's the best models available today to run on systems with 8 GB / 16 GB / 24 GB / 48 GB / 72 GB / 96 GB of VRAM today?

[D] Avoiding cold starts with model snapshots — 2 GPUs, 50 LLMs, no containers

huggingface

Save item

pytorch-image-models

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

microsoft

Save item

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

modelscope

Save item

modelscope

ModelScope: bring the notion of Model-as-a-Service to life.