Trending

Grok 4 Launch [video]

Launch HN: Morph (YC S23) – Apply AI code edits at 4,500 tokens/sec

BharatMLStack – Realtime Inference, MLOps

Show HN: Unlearning Comparator, a visual tool to compare machine unlearning

tinymcp: Let LLMs control embedded devices via the Model Context Protocol

I extracted the safety filters from Apple Intelligence models

Portability of Tar Features

Overclocking LLM Reasoning: Monitoring and Controlling LLM Thinking Path Lengths

Optimizing Tool Selection for LLM Workflows with Differentiable Programming

Open-Weights Model next week?

We should have a monthly “which models are you using” discussion

[N] Google Open to let entreprises self host SOTA models

What if you could run 50+ LLMs per GPU — without keeping them in memory?

[P] Sub-2s cold starts for 13B+ LLMs + 50+ models per GPU — curious how others are tackling orchestration?

[D] Comparing GenAI Inference Engines: TensorRT-LLM, vLLM, Hugging Face TGI, and LMDeploy

"...we're also hearing some reports of mixed quality across different services. Since we dropped the models as soon as they were ready, we expect it'll take several days for all the public implementations to get dialed in..."

Llama 4 models now available via API on Lambda (Maverick/Scout 17B)

Official Gemma 3 QAT checkpoints (3x less memory for ~same performance)

microsoft

Save item

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

modelscope

Save item

modelscope

ModelScope: bring the notion of Model-as-a-Service to life.