-
Tweets1K
-
Followers317
-
Following332
-
Likes626
>vLLM is now ~2x faster than vLLM
ATTENTION: vLLM is now ~2x faster than vLLM thanks to agentic-generated fused model definitions! We think this defines a new future for how models get optimized in inference engines and have shared our plans for a sustainable system/project architecture. PTAL :)
@ChShersh i get worried if the usuals aren't in my morning bus commute
75/100 of GPU Grind i've been interested in the compiler side of GPU recently, so learning about MLIR as an exercise i translated a simple cuda kernel to MLIR gpu/memref/scf/arith dialects, mostly by hand (it's tedious for sure, but it forces me to understand how MLIR is emitted much more than if just read through something) and then i can execute the common lowering pipeline '--gpu-lower-to-nvvm-pipeline' to see what passes it includes and what are their roles it contains quite a lot of passes to review them all in one time, but some things i found interesting: - convert-gpu-to-nvvm: converts the gpu operations in a gpu module (a kernel), to nvvm operations. most of these seems to be kinda straightforward translations at least in the kernel i wrote: gpu.thread_id x becomes nvvm.read.ptx.sreg.tid.x : i32, gpu.barrier becomes nvvm.barrier etc.. - nvvm-attach-target: simply adds an attribute to the kernel to specify the chip architecture we are targetting in this compiler pipeline - gpu-module-to-binary: the final pass that converts the GPU code to PTX
74/100 of GPU Grind watched the gpu mode lecture from last month from joe fioti (luminal) on production megakernels for inference he makes his point explaining how cuda traditional kernel programming model is limited (global sync between thread blocks for example), and that is
how it feels to approve a 240k line PR that no one has read
anthropic merge 30k PR a day while i wait 30 days for my tech lead to look at my PR
Today we're announcing that Modal has crossed $1B in annualized run rate, as well as raised a $750M Series D at a $15.75B valuation, led by @Accel. Since our Series C, usage has tripled and we’ve grown more than 15x year-over-year. We are deeply grateful to the developers and companies building on Modal. There's still so much more to build, and we can't think of a better time to be building software.
the other day i figured i've barely used my 5tb Google Drive storage so i decided to host GLM on it 47 minutes for the first token btw
@qtnx_ i need my model to do threejs for me though
@LLCoolChris_ il a dit le 9-9-6 c'est pour les branleurs
@reallyrawn sounds like a name anthropic could have used
some news: i didn't get the job at anthropic :/ i did well at the technicals but they were disappointed that i was unable to commit to inhaling a pack of unfiltered mongolian cigarettes during the interview, citing a lack of confidence that i truly believed in transformative asi
@sucutruleitor @AnthropicAI yeah right they probably have a reason for that but the explanation is missing
@AnthropicAI i didnt know meta was using a monorepo as well?
writing mine now. i am the compiler skyler
reading raw MLIR tonight no compiler no claude code no syntax highlighting. embrace tradition
Right Click AI @RightAi2026
3 Followers 114 Following
speedy @______speedy
959 Followers 477 Following currently swe @mistralai | prev. co-founder of @jeannecompany (acquired) | prev. swe @waybackmachine
Alex Zverianskii @alexML
938 Followers 3K Following MTS @withmartian • ex Principal MLE @gett 15+ years in AI/NLP • 3x founder (1 exit)
Harman Singh Walia @HarmanW61942
22 Followers 5K Following
UsualSuspect @encau5e
28 Followers 150 Following
Pavel Simó @pavelsimo
513 Followers 1K Following new eras don't come about because of swords, they're created by the people who wield them
✿ maddie 🦢 🕊�... @fluffyglintmadd
17 Followers 796 Following shy but flirty 😇 watching my notifs like a hawk 💕 mutuals please
Rahul Singh @thesilentsingh
35 Followers 630 Following
Olivia @olyviarose042
24 Followers 595 Following daydreamer at heart • loves journaling & jasmine tea 🤍🤎
alyssa @IhsanAlyssa
358 Followers 6K Following “Love All—Trust Few—Wrong None” DM or [email protected] Servant of the Lord of the Heavens, the Earth and the In-Between🕊️
chaipatti @dedguydemn
2 Followers 93 Following
@gt_prajwal 25238 @GtPrajju77604
1 Followers 262 Following ░░░░░░░░░░░░░░░░░░░░░░░░░░ AI engineering @365
Pavlo Svirin @sqladay
40 Followers 427 Following
Aditya Ranjan Dalai @AdityaRanajaniq
6 Followers 139 Following
Frank @jngyubn190233
2 Followers 177 Following
Suryansh @suryanshsinghp
0 Followers 109 Following
David @David123Hilbert
28 Followers 390 Following
白玉玺 @baiyuxi0626
1 Followers 94 Following
PopCorn @TWYuMingCorn
0 Followers 314 Following
Soluchann @Soluchann
3 Followers 92 Following
Maapu @Rajesh23MD
1K Followers 2K Following Welcome to the post-COVID-19 psyop. AGI is running quietly in the background. #AI | #QuantTrading | #LFC
Ethan000 @Ethann_000
193 Followers 4K Following
Chaal Pritam @ChaalPritam
1K Followers 3K Following building @mindspeakai Writer & Director #Bunker #Moonlight #KanmaniEhPesu 😎 தமிழ்
Manoj Jeyaram @ManojSJey
20 Followers 390 Following
Ghunoo @ghunoo
195 Followers 3K Following Part time writer, 💯 dreamer, Daughter of amazing human beings
wuzhuodi @zz32468200
0 Followers 36 Following
Anuj Kumar Sirohi @anujksirohi
26 Followers 1K Following
ummmmm @_marathon_85
45 Followers 2K Following
Rommel Quintanilla @rommelqc
156 Followers 3K Following
Xiuquan Lv @ustcwizard
39 Followers 2K Following
CausalFlopping @CausalFlops28
151 Followers 686 Following LEARN — AI / GYM / MATH / PLAY — REST — REPEAT
dolfred @dolfred
29 Followers 1K Following
єГорище @qlmhrf
26 Followers 2K Following
matto @mattngaw
69 Followers 625 Following go brrr per watt research @arm @cmu_ece alum views my own
speedy @______speedy
959 Followers 477 Following currently swe @mistralai | prev. co-founder of @jeannecompany (acquired) | prev. swe @waybackmachine
Greg Sky @regsky_
8K Followers 19 Following Professional independent Nvidia gpu tech. - AS403083 GPU assembly and rework in the USA. Repairing nvidia cards since 2021.
Dougall @dougallj
3K Followers 450 Following he/they | mastodon: https://t.co/d5YdiePIr8 / @[email protected]
Eugene Ostroukhov @eeuoss
3K Followers 634 Following GPU tools @ Apple. Distributed systems before that. Side project: UchenML, an ML framework for hardware that has no business running models.
@cdleary @cdleary
3K Followers 272 Following computers/compilers/accelerators, mostly • Intelligence Processors at OpenAI 🌶️
Arya Tschand @AryaTschand
3K Followers 809 Following research @modal | prev cs phd @harvard, rubin @nvidia, tpu @google, kernels @amd
Scott Gray @scottgray76
15K Followers 929 Following Currently independent. Exploring some neuro-inspired AI approaches. Former GPU geek at @OpenAI. He/Him.
Mario Sieg @_mario_neo_
3K Followers 251 Following ML, CUDA, HPC, Compilers, Game Engines | Creating my own ML framework: magnetron | Kernel Research Engineer @PrimeIntellect
Tengyu Ma @tengyuma
52K Followers 577 Following Assistant prof. @ Stanford; Chief AI Scientist @ MongoDB; Former Co-founder/CEO of Voyage AI Working on ML, DL, RL, LLMs, and their theory.
levent @__alpoge__
53K Followers 221 Following idiot. cuda og, harvard val, morgan prize, society of fellows, 1 hilbert problem so far, creating friendly, SAFE, delightful, supergenius ..things @anthropicai
Ciircuit @Ciiiiircuit
6K Followers 711 Following Ciircuit's 𝗖ollection of 𝗢riginal 𝗖rafts and 𝗞nacks. Back after a break
Ravi Vijayakumar @thehiphopswami
4K Followers 4K Following Chip Implementation @ OpenAI. Prev: TPU Impl lead of Ironwood + TPU 8i @ Google. Pushing limits of physics gives me the thrills.
Tianqi Chen @tqchenml
22K Followers 1K Following AssocProf @CarnegieMellon. Distinguished Eng @NVIDIA. Creator of @XGBoostProject, @ApacheTVM. Member https://t.co/QYyfjQNp4p, @TheASF. Views are on my own
Ryuu @PranshuBahadur
245 Followers 696 Following "Although it does not mindfully keep guard,In the small mountain fields the scarecrow does not stand in vain."
Kirandeep Kaur @ COLM... @ikiran013
641 Followers 542 Following PhD @uwcse Research: Human-AI Interaction, Epistemic Agents, Proactivity, Ignorance & Uncertainty
Ronan Collobert @trebolloc
3K Followers 28 Following OG Torch circa 2000. NLP from scratch. MLX. Aikido. Woodworker.
Florian Brand @xeophon
18K Followers 858 Following evals @PrimeIntellect | open models @interconnectsai
Waffl3x ❤️🩹... @Waffl3x
3K Followers 926 Following Code Sourcerer/Compiler Engineer ISO C++ committee member I implemented deducing this into GCC :)
Jeremy Tregunna @noozie
3K Followers 1K Following Ancient thunder in a modern sound. Wired to the earth in a savage ballet. I don't do TL;DR. Foldb, WILD, Orbit, other software.
GPUpurse @GPUpurse
50 Followers 3 Following upcycled @NVIDIA GPUs into purses by @tessybarton & @christinafarhat
@dMatrix @dMatrix_AI
1K Followers 181 Following Purpose-built AI inference for modern data centers. Powering heterogeneous AI infrastructure with digital in-memory compute.
Seth Karten @sethkarten
4K Followers 623 Following Prime Agent | Continual Harness, Agent Bazaar | Research @PrimeIntellect | PhD @Princeton | NSF GRFP
Robert Nishihara @robertnishihara
17K Followers 876 Following Co-founder @anyscalecompute. Co-creator of @raydistributed. Previously AI research at Berkeley.
Hot Aisle @HotAisle
7K Followers 5K Following do you need secure fast compute? | https://t.co/bo8RCjhIEa
Georgy Evtushenko @g_evtushenko
633 Followers 204 Following Member of CUDA C++ Core Libraries team @nvidia. Opinions are my own.
Andrej Karpathy @karpathy
4.4M Followers 1K Following
Annie Shea Weckesser @asheaw
3K Followers 6K Following Chief Marketing & Communications Officer (CMCO) @Intel. Formerly @SambaNovaAI @Uniphore @NIOglobal @Cisco. Mom 3x. Tweets are my own.
arb8020 @arb8020
5K Followers 2K Following s̶k̶i̶l̶l̶ ̶i̶s̶s̶u̶e̶ will issue | prev: @wafer_ai, @nascent
Michael Søndergaard @SpectralMichael
24 Followers 41 Following
Jonny Kaye @k44yej
4K Followers 220 Following Lead Technical Recruiter for @microsoftAI Team EMEA - building the teams that are building the next phase of humanist superintelligence
Daniel Estévez @ea4gpz
10K Followers 400 Following Everything space & RF. Amateur radio operator (EA4GPZ / M0HXM). PhD in Mathematics from @Matematicas_UAM. he/him
Ash Vardanian @ashvardanian
3K Followers 466 Following Building @unum_cloud since 2015 · Investing @aal_vc · author of USearch, StringZilla, NumKong & other open-source infra
Lei Zhang @LeiLMx
1K Followers 150 Following LLMs GPU compilers, kernels, systems @AMD: Triton, TokenSpeed, ROCm. ex-@Google: IREE, MLIR, TensorFlow, SPIR-V, Vulkan.
Nicholas Malaya @nicholasmalaya
1K Followers 1K Following Sr. Fellow, HPC & Sovereign AI, AMD My agents have written all my code since Dec 2025
JFPuget 🇫🇷🇺�... @JFPuget
21K Followers 2K Following Machine Learning and Agents at @Nvidia, 6x Kaggle Grandmaster CPMP. Arc Prize winner. ML PhD. Ex ENS Ulm, ILOG CPLEX, IBM. Views are my own.
TensorWave @tensorwave
3K Followers 1K Following Empowering the next wave of AI with @AMD Instinct™ GPUs 🌊
elie @eliebakouch
26K Followers 5K Following research @PrimeIntellect (prev: @huggingface) anon feedback: https://t.co/JmMh7SfvxdTrends for United States
You might like
