Marc Sun's picture

Building on HF

Marc Sun

marcsun13

huggingface

·

AI & ML interests

LLM, Quantization, Training, Inference

Recent Activity

upvoted an article 29 days ago

Continuous batching from first principles

upvoted an article 29 days ago

Diffusers welcomes FLUX-2

upvoted an article 29 days ago

We Got Claude to Fine-Tune an Open Source LLM

View all activity

Organizations

upvoted 8 articles 29 days ago

Article

Continuous batching from first principles

+1

Nov 25, 2025

•

316

Article

Diffusers welcomes FLUX-2

+6

Nov 25, 2025

•

178

Article

We Got Claude to Fine-Tune an Open Source LLM

Dec 4, 2025

•

587

Article

New in llama.cpp: Model Management

Dec 11, 2025

•

116

Article

Tokenization in Transformers v5: Simpler, Clearer, and More Modular

+4

Dec 18, 2025

•

119

Article

NVIDIA brings agents to life with DGX Spark and Reachy Mini

+1

about 1 month ago

•

59

Article

Introducing Falcon-H1-Arabic: Pushing the Boundaries of Arabic Language AI with Hybrid Architecture

about 1 month ago

•

37

Article

NVIDIA Cosmos Reason 2 Brings Advanced Reasoning To Physical AI

30 days ago

•

61

liked a Space 29 days ago

Reachy Mini

All about Reachy Mini, from building to getting started

upvoted an article 2 months ago

Article

Transformers v5: Simple model definitions powering the AI ecosystem

+2

Dec 1, 2025

•

290

upvoted a paper 3 months ago

SINQ: Sinkhorn-Normalized Quantization for Calibration-Free Low-Precision LLM Weights

Paper • 2509.22944 • Published Sep 26, 2025 • 80

upvoted 2 articles 3 months ago

Article

Classement compar:IA : des votes des utilisateurs au classement participatif des modèles

Nov 3, 2025

•

6

Article

On the Shifting Global Compute Landscape

Oct 29, 2025

•

58

New activity in kernels-community/triton_kernels 4 months ago

Implement make_opt_flags function for XPU

#5 opened 5 months ago by

reacted to lysandre's post with 🚀 5 months ago

Post

7763

We're kick-starting the process of Transformers v5, with @ArthurZ and @cyrilvallez !

v5 should be significant: we're using it as a milestone for performance optimizations, saner defaults, and a much cleaner code base worthy of 2025.

Fun fact: v4.0.0-rc-1 came out on Nov 19, 2020, nearly five years ago!

6 replies

·

New activity in kernels-community/triton_kernels 5 months ago

Kernel assertion errors on 5090 using generation with MXfp4 (gpt-oss) - (stable on 4090)

#1 opened 6 months ago by

Update torch-ext/triton_kernels/matmul_ogs_details/opt_flags.py

#3 opened 5 months ago by

Update build/torch-universal/triton_kernels/matmul_ogs_details/opt_flags.py

#2 opened 5 months ago by

liked a model 5 months ago

OpenGVLab/InternVL3_5-GPT-OSS-20B-A4B-Preview

Image-Text-to-Text • 0.4B • Updated Aug 29, 2025 • 37.3k • 82

updated a model 5 months ago

kernels-community/triton_kernels

Updated Oct 27, 2025 • 5.3k • 7