Trending

Relational Graph Transformers

Bamba: An open-source LLM that crosses a transformer with an SSM

Introducing the Meta AI App: A New Way to Access Your AI Assistant

Implement Flash Attention Back End in SGLang – Basics and KV Cache

Vision Transformers Need Registers (extra tokens discarded after last layer)

Show HN: Lemon Slice Live, a real-time video-audio AI model

Three things everyone should know about Vision Transformers

Introduction to Graph Transformers

Liquid: Language Models Are Scalable and Unified Multi-Modal Generators

deepseek-ai/DeepSeek-Prover-V2-671B · Hugging Face

Whisper Translation Finetuning [P]

[D] How could a MLP replicate the operations of an attention head?

Looks like Qwen 3 will have a 256k context?

[P] Top open chart-understanding model upto 8B and performs on par with much larger models. Try it

Finally got ~10t/s DeepSeek V3-0324 hybrid (FP8+Q4_K_M) running locally on my RTX 4090 + Xeon with with 512GB RAM, KTransformers and 32K context

[R][P] Byte-level LLaMA and Gemma via cross-tokenizer distillation (with open-source toolkit)

Skywork-R1V2-38B - New SOTA open-source multimodal reasoning model

[P] Goolge A2A protocol with Langgraph

Cohere For AI

Save item

aya-vision-32b

Task: image-text-to-text

Microsoft

Save item

Magma-8B

Task: image-text-to-text

Meta Llama

Save item

Llama-3.3-70B-Instruct

Task: text-generation

lucidrains

Save item

vit-pytorch

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

huggingface

Save item

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

NVIDIA

Save item

Megatron-LM

Ongoing research training transformer models at scale

microsoft

Save item

Swin-Transformer

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".