Trending

Launch HN: Morph (YC S23) – Apply AI code edits at 4,500 tokens/sec

BharatMLStack – Realtime Inference, MLOps

Show HN: Unlearning Comparator, a visual tool to compare machine unlearning

tinymcp: Let LLMs control embedded devices via the Model Context Protocol

I extracted the safety filters from Apple Intelligence models

Portability of Tar Features

Overclocking LLM Reasoning: Monitoring and Controlling LLM Thinking Path Lengths

Optimizing Tool Selection for LLM Workflows with Differentiable Programming

"Swiss Cheese" Failure Model

To run Llama 3.1-8B-instruct model on a local CPU with 4 GB ram without quantization. By Loading and Running a LLaMA Model on CPU with Disk-based Layer Loading.

MLX fork with speculative decoding in server

Why is Falcon3-7b so rarely used (or cited) as a model?

Deepseek V3 0324 is now the best non-reasoning model (across both open and closed source) according to Artificial Analisys.

Re-using a model

Deepseek releases new V3 checkpoint (V3-0324)

MCP (Model Context Protocol): Simply explained in 5 minutes

Q2 models are utterly useless. Q4 is the minimum quantization level that doesn't ruin the model (at least for MLX). Example with Mistral Small 24B at Q2 ↓

LLama.cpp smillar speed but in pure Rust, local LLM inference alternatives.

microsoft

Save item

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

modelscope

Save item

modelscope

ModelScope: bring the notion of Model-as-a-Service to life.