Trending

Launch HN: Morph (YC S23) – Apply AI code edits at 4,500 tokens/sec

BharatMLStack – Realtime Inference, MLOps

Show HN: Unlearning Comparator, a visual tool to compare machine unlearning

tinymcp: Let LLMs control embedded devices via the Model Context Protocol

I extracted the safety filters from Apple Intelligence models

Portability of Tar Features

Overclocking LLM Reasoning: Monitoring and Controlling LLM Thinking Path Lengths

Optimizing Tool Selection for LLM Workflows with Differentiable Programming

"Swiss Cheese" Failure Model

Run local LLMs with Docker, new official Docker Model Runner is surprisingly good (OpenAI API compatible + built-in chat UI)

I gave the same silly task to ~70 models that fit on 32GB of VRAM - thousands of times (resharing my post from /r/LocalLLM)

Polaris: A Post-training recipe for scaling RL on Advanced ReasonIng models

We built this project to increase LLM throughput by 3x. Now it has been adopted by IBM in their LLM serving stack!

1 Question. 1 Answer. 5 Models

Self hosted model for agents

Got a tester version of the open-weight OpenAI model. Very lean inference engine!

[D] Research vs industry practices: final training on all data for production models

Stop chatting. This is the prompt structure real AI AGENT need to survive in production

microsoft

Save item

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

modelscope

Save item

modelscope

ModelScope: bring the notion of Model-as-a-Service to life.