| title | Nemotron 3 Ultra: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning |
|---|---|
| authors | NVIDIA, Aaron Blakeman, Aaron Thomas, Aastha Jhunjhunwala, Abhibha Gupta, Abhinav Khattar, Adam Rajfer, Adi Renduchintala, Adil Asif, Aditya Vavre, Adriana Flores Miranda, Ahmad Bilal, Aileen Zaman, Ajay Hotchandani, Akanksha Shukla, Akhiad Bercovich, Aleksander Ficek, Alex Gronskiy, Alex Kondratenko, Alex Steiner, Alex Ye, Alexander Bukharin, Alexandre Milesi, Ali Taghibakhshi, Alice Gatti, Alisa Liu, Alok Kumar, Amar Phanishayee, Ameya Sunil Mahabaleshwarkar, Amir Klein, Amit Zuker, Amnon Geifman, Anahita Bhiwandiwalla, Ananth Subramaniam, Andrea Santilli, Andrew Fulks, Andrew McHarg, Andrew Tao, Andrii Skliar, Anjulie Agrusa, Ankur Srivastava, Ankur Verma, Anna Shors, Anna Warno, Antoni-Joan Solergibert I Llaquet, Arham Mehta, Arkadiusz Nowaczynski, Arti Jain, Ashwath Aithal, Ashwin Poojary, Asif Ahamed, Asit Mishra, Asma Kuriparambil Thekkumpate, Atefeh Sohrabizadeh, Avinash Kaur, Avinash Vem, Ayush Dattagupta, Barath Subramaniam Anandan, Bardiya Sadeghi, Ben Lanir, Benedikt Schifferer, Besmira Nushi, Bilal Kartal, Bill Thiede, Bita Darvish Rouhani, Bo Deng, Bob Schatz, Boris Ginsburg, Boxin Wang, Brad Nemire, Brandon Norick, Brian Dang, Brian Westphal, Brian Yu, Brucek Khailany, Bryan Catanzaro, Carlo del Mundo, Caryln Aarish, Chankyu Lee, Chantal Hwang, Charbel Sakr, Charles Wang, Charlie Truong, Chen Cui, Cheng Cheng, Cheng-Ping Hsieh, Chenghao Zhang, Chenhui Deng, Chintan Patel, Chris Alexiuk, Christian Cosgrove, Christian Munley, Christine Harvey, Christopher Parisien, Chunyang Shen, Coco Li, Collin Neale, Cynthia Gao, Cyril Meurillon, Dan Gil, Dan Su, Dan Zhao, Dane Corneil, Daniel Afrimi, Daniel Egert, Daniel Korzekwa, Daniel Lo, Daniel Machlab, Daniel Serebrenik, Daniil Sorokin, Daria Gitman, Daria Levy, Darko Stosic, David Mosallanezhad, David Yu, Davit Karamyan, Deena Donia, Deep Debroy, Deepak Narayanan, Devin O'Kelly, Dheeraj Peri, Dhruv Nathawani, Di, Wu, Dima Rekesh, Divyanshu Kakwani, Donald Plummer, Dong Anh, Dongfeng Yu, Dongfu Jiang, Donnie Kim, Dorrin Poorkay, Duncan Riach, Dusan Stosic, Dustin VanStee, Eavan Meng, Edgar Minasyan, Edward Lin, Eileen Margaret Peters Long, Elad Sarafin, Elad Segal, Elena Lantz, Ellie Evans, Elliott Ning, Eric Chung, Eric Harper, Eric Pham-Hung, Eric Tramel, Eric Yang, Erick Galinkin, Erik Pounds, Erika Goncalves Goncalves, Evan Briones, Evan Wu, Evelina Bakhturina, Evgeny Tsykunov, Ewa Dobrowolska, Faisal Ladhak, Farzan Memarian, Fay Wang, Fei Jia, Felipe Soares, Felipe Vieira Frujeri, Feng Chen, Fengguang Lin, Ferenc Galko, Frank Sun, Frankie Siino, Frida Hou, Gal Hubara Agam, Gal Kaplun, Gantavya Bhatt, Gargi Prasad, Garvit Kulshreshtha, George Armstrong, Gerald Shen, Giulio Borghesi, Gordana Neskovic, Gorkem Batmaz, Grace Lam, Greg Mason, Greg Pauloski, Grigor Nalbandyan, Grzegorz Chlebus, Grzegorz Karch, Guan-Ting Liu, Guoming Zhang, Guyue Huang, Haggai Maron, Haifeng Qian, Haim Elisha, Haoxing Ren, Haran Kumar Shiv Kumar, Haribhau Hud, Harris Nover, Harrison Saturley Hall, Hayate Iso, Helen Ngo, Herbert Hum, Herman Sahota, Hexin Wang, Himanshu Soni, Hovhannes Tamoyan, Hua Li, Huanhuan Chen, Hui Li, Hui Wang, Huy Nguyen, Ian Chiles, Ido Galil, Ido Shahaf, Igor Gitman, Igor Shovkun, Ilya Loshchilov, Ingo Guehring, Itamar Schen, Itay Levy, Itay Neeman, Ivan Moshkov, Izik Golan, Izzy Putterman, Jaemin Choi, Jakub Slowikowski, Jan Kautz, Jane Polak Scowcroft, Jared Casper, Jatin Mitra, Jeffrey Glick, Jenny Chen, Jesse Oliver, Jiacheng Xu, Jiafan Zhu, Jialin Song, Jian Zhang, Jiantao Jiao, Jiaqi Zeng, Jie Lou, Jim King, Jimmy Zhang, Jingquan Wang, Jinhang Choi, Jinju Chu, Joey Conway, Joey Guman, Johan Jatko, Johannes Rausch, John Kamalu, John Roberts, Johnny Greco, Johnny Mensel, Jonah Alben, Jonas Yang, Jonathan Cohen, Jonathan Raiman, Joseph Jennings, Joshua Mabry, Joshua Pierce, Joyjit Daw, Julien Veron Vialard, Junkeun Yi, Jupinder Parmar, Kajal Jain, Kan Zhu, Kari Briski, Katherine Cheung, Katherine Luna, Keith Willowhawk, Keith Wyss, Keshav Santhanam, Kevin Shih, Kezhi Kong, Khanh Nguyen, Khushi Bhardwaj, Kirthi Shankar Sivamani, Konstantinos Krommydas, Krishna C. Puvvada, Krzysztof Pawelec, Kumar Anik, Kyle Keprios, Kylie Day, Lawrence McAfee, Leo Du, Leon Derczynski, Li Ding, Linda Liu, Lingjie Wu, Lior Kadoch, Lizzie Wei, Luis Vega, Luke Robison, Lun Su, Maarten Van Segbroeck, Maciej Jakub Mikulski, Maer Rodrigues de Melo, Magda Sypula, Mahan Fathi, Makesh Narsimhan Sreedhar, Makesh Tarun Chandran, Manoj Kilaru, Maor Ashkenazi, Marc Cuevas, Marc Romeijn, Marcin Chochowski, Mark Cai, Mark Mozolewski, Markus Kliegl, Marta Stepniewska-Dziubinska, Martyna Patelka, Mattei Machczynski, Matvei Novikov, Mauricio Ferrato, Maximilian Golub, Mehrzad Samadi, Melissa Corpuz, Mengru Wang, Mengxi Wu, Meredith Price, Meriem Boubdir, Micah Schaffer, Michael Andersch, Michael Boone, Michael Gschwind, Michael Lightstone, Michael Loh, Michal Bien, Michal Zawalski, Michelle Gill, Miguel Martinez, Mikail Khona, Mike Chrzanowski, Mike Houston, Mingyuan Ma, Minseok Lee, Mohamed Fawzy, Mohammad Dabbah, Mohammad Shoeybi, Mostofa Patwary, Nabin Mulepati, Najeeb Nabwani, Namit Dhameja, Narimane Hennouni, Natalie Hereth, Nathaniel Pinckney, Nave Algarici, Nave Assaf, Netanel Haber, Nicholas Knight, Nick Reamaroon, Nickson Quak, Nidhi Bhatia, Nikhil Desai, Nikolai Ludwig, Nima Tajbakhsh, Ning Xu, Nir Ailon, Nirmal Juluru, Nitin Nitin, Ofri Masad, Oleg Rybakov, Oleksii Hrinchuk, Oleksii Kuchaiev, Olivia Viessmann, Olivier Delalleau, Oluwatobi Olabiyi, Omer Ullman Argov, Omri Puny, Oren Tropp, Pablo Ribalta, Pallab Bhattacharya, Panos Lampropoulos, Parth Mannan, Pasha Shamis, Patrick Legresley, Paul Gibbons, Pavlo Molchanov, Pawel Morkisz, Peter Dykas, Peter Jin, Pierre-Yves Aquilanti, Pinky Xu, Piotr Januszewski, Piotr Laskiewicz, Pooya Jannaty, Prakash Gurumurthy, Pranav Prashant Thombre, Prasoon Varshney, Pritam Gundecha, Przemek Tredak, Puhui Meng, Qiyu Wan, Rabeeh Karimi Mahabadi, Rachel Oberman, Rachit Garg, Radha Sri-Tharan, Rahul Kandu, Rakshit Sanadhya, Ran El-Yaniv, Ran Zilberstein, Rasoul Shafipour, Ray Macalisang, Rayen Tian, Reka Kovacs, Renjie Pi, Rick Izzo, Rima Shahbazyan, Rishabh Garg, Rishi Puri, Rita Fernandes Neves, Ritchie Zhao, Ritika Borkar, Ritu Gala, Riyad Islam, Robert Clark, Robert Hesse, Robert Kirby, Roger Waleffe, Rohit Watve, Roi Koren, Ron Banner, Ruoxi Zhang, Russell J. Hewett, Ryan Prenger, Ryan Stewart, Ryota Egashira, Sadegh Mahdavi, Saee Paliwal, Sagar Singh, Sahil Modi, Salika Dave, Samantha Shinagawa, Samuel Kriman, Sandip Bhaskar, Sangkug Lym, Sanjay Kariyappa, Sanjeev Satheesh, Saran Vikas Murari, Satish Pasumarthi, Saurabh Mishra, Saurav Muralidharan, Scott Hara, Sean Narentharen, Selvaraj Anandaraj, Seonjin Na, Seonmeyong Bak, Seonmyeong Bak, Sepehr Sameni, Seph Mard, Serge Panev, Seth Henneman, Seth Poulos, Shahar Mor, Shantanu Acharya, Shaona Ghosh, Sharath Turuvekere Sreenivas, Sharon Mendelson, Shaun Kotek, Shawn Wang, Shay Aharon, Shaya Gharghabi, Sheng-Chieh Lin, Shi Chen, Shiqing Fan, Shirish Baskaran, Shreya Gopa, Shrimai Prabhumoye, Shubham Pachori, Shubham Toshniwal, Shuoyang Ding, Shwetha Krishnamurthy, Siddharth Singh, Simeng Sun, Sirshak Das, Sivakumar Arayandi Thottakara, Smita Ithape, Somshubra Majumdar, Soumye Singhal, Sri Harsha Singudasu, Sridhar Bhuvanapalli, Srimukh Veccham, Stas Sergienko, Stefania Alborghetti, Stephen Ge, Su Rong, Sugam Dipak Devare, Sukrit Rao, Sumeet Kumar Barua, Sungsoo Ha, Sunny Gai, Suriya Gunasekar, Suseella Panguluri, Suyog Gupta, Sviataslau Hinzburh, Sweta Priyadarshi, Syeda Nahida Akter, Talor Abramovich, Tan Bui, Tanay Varshney, Tatevik Ter-Hovhannisyan, Teodor-Dumitru Ene, Terry Kong, Thanh Do, Tianhe Zhang, Tiffany Moore, Tijmen Blankevoort, Tim Moon, Tiyasa Mitra, Tom Balough, Tomasz Grzegorzek, Tomasz Hliwiak, Tomer Asida, Tomer Bar Natan, Tomer Keren, Tomer Ronen, Tony Salim, Tony Wang, Traian Rebedea, Tugrul Konuk, Twinkle Vashishth, Udi Karpas, Ushnish De, Vahid Noorozi, Venkat Srinivasan, Venmugil Elango, Vibhor Agrawal, Victor Cui, Vijay Korthikanti, Vikas Mehta, Vinay Rao, Virginia Wu, Vitaly Kurin, Vitaly Lavrukhin, Vladimir Anisimov, Vu Pham, Wanli Jiang, Wasi Uddin Ahmad, Wataru Ishihara, Wei Du, Wei Ping, Weiheng Chai, Wenliang Dai, Wesley Helmholz, Will Jennings, Will Zhu, Wojciech Prazuch, Xiaowei Ren, Xiwen Yu, Yan Breek, Yang Chen, Yang Yu, Yangyi Chen, Yaniv Galron, Yashaswi Karnati, Yejin Choi, Yev Meyer, Yi-Fu Wu, Yian Zhang, Ying Lin, Yonatan Geifman, Yonggan Fu, Youngeun Kwon, Yu Yao, Yugi Guvvla, Yuki Huang, Yunsheng Liu, Zach Moshe, Zachary Newell, Zhilin Wang, Zhiyu Li, Zhongbo Zhu, Zhuolin Yang, Zihan Liu, Zijie Yan, Zsolt-Alon Wertheimer |
| date | 2026-06-12 |
| venue | arXiv (preprint, not peer reviewed) |
| id | arXiv:2606.15007 |
| affiliation | NVIDIA |
| upvotes | 19 (Hugging Face Daily Papers, 2026-11-01) |
| links | abs pdf hf |
| abstract | We introduce Nemotron 3 Ultra, a 550 billion total and 55 billion active parameter Mixture-of-Experts Hybrid Mamba-Attention language model. We pre-trained Nemotron 3 Ultra on 20 trillion text tokens, then extended the context length to 1M tokens, and post-trained using Supervised Fine Tuning (SFT), Reinforcement Learning (RL), and Multi-teacher On-Policy Distillation (MOPD). Nemotron 3 Ultra is our most capable model yet, employing multiple key technologies - LatentMoE, Multi Token Prediction (MTP), NVFP4 pre-training, multi-environment RLVR, MOPD, and reasoning budget control. Nemotron 3 Ultra achieves up to ~6x higher inference throughput as compared to state-of-the-art publicly available LLMs while attaining on-par accuracy. The state-of-the-art accuracy, high inference throughput, and 1M token context length make Nemotron 3 Ultra ideal for long-running autonomous agentic tasks. We open-source the base, post-trained, and quantized checkpoints, along with the training data and recipe on HuggingFace. |
cite
@misc{nvidia2026nemotron,
title={Nemotron 3 Ultra: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning},
author={NVIDIA and Aaron Blakeman and Aaron Thomas and Aastha Jhunjhunwala and Abhibha Gupta and Abhinav Khattar and Adam Rajfer and Adi Renduchintala and Adil Asif and Aditya Vavre and Adriana Flores Miranda and Ahmad Bilal and Aileen Zaman and Ajay Hotchandani and Akanksha Shukla and Akhiad Bercovich and Aleksander Ficek and Alex Gronskiy and Alex Kondratenko and Alex Steiner and Alex Ye and Alexander Bukharin and Alexandre Milesi and Ali Taghibakhshi and Alice Gatti and Alisa Liu and Alok Kumar and Amar Phanishayee and Ameya Sunil Mahabaleshwarkar and Amir Klein and Amit Zuker and Amnon Geifman and Anahita Bhiwandiwalla and Ananth Subramaniam and Andrea Santilli and Andrew Fulks and Andrew McHarg and Andrew Tao and Andrii Skliar and Anjulie Agrusa and Ankur Srivastava and Ankur Verma and Anna Shors and Anna Warno and Antoni-Joan Solergibert I Llaquet and Arham Mehta and Arkadiusz Nowaczynski and Arti Jain and Ashwath Aithal and Ashwin Poojary and Asif Ahamed and Asit Mishra and Asma Kuriparambil Thekkumpate and Atefeh Sohrabizadeh and Avinash Kaur and Avinash Vem and Ayush Dattagupta and Barath Subramaniam Anandan and Bardiya Sadeghi and Ben Lanir and Benedikt Schifferer and Besmira Nushi and Bilal Kartal and Bill Thiede and Bita Darvish Rouhani and Bo Deng and Bob Schatz and Boris Ginsburg and Boxin Wang and Brad Nemire and Brandon Norick and Brian Dang and Brian Westphal and Brian Yu and Brucek Khailany and Bryan Catanzaro and Carlo del Mundo and Caryln Aarish and Chankyu Lee and Chantal Hwang and Charbel Sakr and Charles Wang and Charlie Truong and Chen Cui and Cheng Cheng and Cheng-Ping Hsieh and Chenghao Zhang and Chenhui Deng and Chintan Patel and Chris Alexiuk and Christian Cosgrove and Christian Munley and Christine Harvey and Christopher Parisien and Chunyang Shen and Coco Li and Collin Neale and Cynthia Gao and Cyril Meurillon and Dan Gil and Dan Su and Dan Zhao and Dane Corneil and Daniel Afrimi and Daniel Egert and Daniel Korzekwa and Daniel Lo and Daniel Machlab and Daniel Serebrenik and Daniil Sorokin and Daria Gitman and Daria Levy and Darko Stosic and David Mosallanezhad and David Yu and Davit Karamyan and Deena Donia and Deep Debroy and Deepak Narayanan and Devin O'Kelly and Dheeraj Peri and Dhruv Nathawani and Di and Wu and Dima Rekesh and Divyanshu Kakwani and Donald Plummer and Dong Anh and Dongfeng Yu and Dongfu Jiang and Donnie Kim and Dorrin Poorkay and Duncan Riach and Dusan Stosic and Dustin VanStee and Eavan Meng and Edgar Minasyan and Edward Lin and Eileen Margaret Peters Long and Elad Sarafin and Elad Segal and Elena Lantz and Ellie Evans and Elliott Ning and Eric Chung and Eric Harper and Eric Pham-Hung and Eric Tramel and Eric Yang and Erick Galinkin and Erik Pounds and Erika Goncalves Goncalves and Evan Briones and Evan Wu and Evelina Bakhturina and Evgeny Tsykunov and Ewa Dobrowolska and Faisal Ladhak and Farzan Memarian and Fay Wang and Fei Jia and Felipe Soares and Felipe Vieira Frujeri and Feng Chen and Fengguang Lin and Ferenc Galko and Frank Sun and Frankie Siino and Frida Hou and Gal Hubara Agam and Gal Kaplun and Gantavya Bhatt and Gargi Prasad and Garvit Kulshreshtha and George Armstrong and Gerald Shen and Giulio Borghesi and Gordana Neskovic and Gorkem Batmaz and Grace Lam and Greg Mason and Greg Pauloski and Grigor Nalbandyan and Grzegorz Chlebus and Grzegorz Karch and Guan-Ting Liu and Guoming Zhang and Guyue Huang and Haggai Maron and Haifeng Qian and Haim Elisha and Haoxing Ren and Haran Kumar Shiv Kumar and Haribhau Hud and Harris Nover and Harrison Saturley Hall and Hayate Iso and Helen Ngo and Herbert Hum and Herman Sahota and Hexin Wang and Himanshu Soni and Hovhannes Tamoyan and Hua Li and Huanhuan Chen and Hui Li and Hui Wang and Huy Nguyen and Ian Chiles and Ido Galil and Ido Shahaf and Igor Gitman and Igor Shovkun and Ilya Loshchilov and Ingo Guehring and Itamar Schen and Itay Levy and Itay Neeman and Ivan Moshkov and Izik Golan and Izzy Putterman and Jaemin Choi and Jakub Slowikowski and Jan Kautz and Jane Polak Scowcroft and Jared Casper and Jatin Mitra and Jeffrey Glick and Jenny Chen and Jesse Oliver and Jiacheng Xu and Jiafan Zhu and Jialin Song and Jian Zhang and Jiantao Jiao and Jiaqi Zeng and Jie Lou and Jim King and Jimmy Zhang and Jingquan Wang and Jinhang Choi and Jinju Chu and Joey Conway and Joey Guman and Johan Jatko and Johannes Rausch and John Kamalu and John Roberts and Johnny Greco and Johnny Mensel and Jonah Alben and Jonas Yang and Jonathan Cohen and Jonathan Raiman and Joseph Jennings and Joshua Mabry and Joshua Pierce and Joyjit Daw and Julien Veron Vialard and Junkeun Yi and Jupinder Parmar and Kajal Jain and Kan Zhu and Kari Briski and Katherine Cheung and Katherine Luna and Keith Willowhawk and Keith Wyss and Keshav Santhanam and Kevin Shih and Kezhi Kong and Khanh Nguyen and Khushi Bhardwaj and Kirthi Shankar Sivamani and Konstantinos Krommydas and Krishna C. Puvvada and Krzysztof Pawelec and Kumar Anik and Kyle Keprios and Kylie Day and Lawrence McAfee and Leo Du and Leon Derczynski and Li Ding and Linda Liu and Lingjie Wu and Lior Kadoch and Lizzie Wei and Luis Vega and Luke Robison and Lun Su and Maarten Van Segbroeck and Maciej Jakub Mikulski and Maer Rodrigues de Melo and Magda Sypula and Mahan Fathi and Makesh Narsimhan Sreedhar and Makesh Tarun Chandran and Manoj Kilaru and Maor Ashkenazi and Marc Cuevas and Marc Romeijn and Marcin Chochowski and Mark Cai and Mark Mozolewski and Markus Kliegl and Marta Stepniewska-Dziubinska and Martyna Patelka and Mattei Machczynski and Matvei Novikov and Mauricio Ferrato and Maximilian Golub and Mehrzad Samadi and Melissa Corpuz and Mengru Wang and Mengxi Wu and Meredith Price and Meriem Boubdir and Micah Schaffer and Michael Andersch and Michael Boone and Michael Gschwind and Michael Lightstone and Michael Loh and Michal Bien and Michal Zawalski and Michelle Gill and Miguel Martinez and Mikail Khona and Mike Chrzanowski and Mike Houston and Mingyuan Ma and Minseok Lee and Mohamed Fawzy and Mohammad Dabbah and Mohammad Shoeybi and Mostofa Patwary and Nabin Mulepati and Najeeb Nabwani and Namit Dhameja and Narimane Hennouni and Natalie Hereth and Nathaniel Pinckney and Nave Algarici and Nave Assaf and Netanel Haber and Nicholas Knight and Nick Reamaroon and Nickson Quak and Nidhi Bhatia and Nikhil Desai and Nikolai Ludwig and Nima Tajbakhsh and Ning Xu and Nir Ailon and Nirmal Juluru and Nitin Nitin and Ofri Masad and Oleg Rybakov and Oleksii Hrinchuk and Oleksii Kuchaiev and Olivia Viessmann and Olivier Delalleau and Oluwatobi Olabiyi and Omer Ullman Argov and Omri Puny and Oren Tropp and Pablo Ribalta and Pallab Bhattacharya and Panos Lampropoulos and Parth Mannan and Pasha Shamis and Patrick Legresley and Paul Gibbons and Pavlo Molchanov and Pawel Morkisz and Peter Dykas and Peter Jin and Pierre-Yves Aquilanti and Pinky Xu and Piotr Januszewski and Piotr Laskiewicz and Pooya Jannaty and Prakash Gurumurthy and Pranav Prashant Thombre and Prasoon Varshney and Pritam Gundecha and Przemek Tredak and Puhui Meng and Qiyu Wan and Rabeeh Karimi Mahabadi and Rachel Oberman and Rachit Garg and Radha Sri-Tharan and Rahul Kandu and Rakshit Sanadhya and Ran El-Yaniv and Ran Zilberstein and Rasoul Shafipour and Ray Macalisang and Rayen Tian and Reka Kovacs and Renjie Pi and Rick Izzo and Rima Shahbazyan and Rishabh Garg and Rishi Puri and Rita Fernandes Neves and Ritchie Zhao and Ritika Borkar and Ritu Gala and Riyad Islam and Robert Clark and Robert Hesse and Robert Kirby and Roger Waleffe and Rohit Watve and Roi Koren and Ron Banner and Ruoxi Zhang and Russell J. Hewett and Ryan Prenger and Ryan Stewart and Ryota Egashira and Sadegh Mahdavi and Saee Paliwal and Sagar Singh and Sahil Modi and Salika Dave and Samantha Shinagawa and Samuel Kriman and Sandip Bhaskar and Sangkug Lym and Sanjay Kariyappa and Sanjeev Satheesh and Saran Vikas Murari and Satish Pasumarthi and Saurabh Mishra and Saurav Muralidharan and Scott Hara and Sean Narentharen and Selvaraj Anandaraj and Seonjin Na and Seonmeyong Bak and Seonmyeong Bak and Sepehr Sameni and Seph Mard and Serge Panev and Seth Henneman and Seth Poulos and Shahar Mor and Shantanu Acharya and Shaona Ghosh and Sharath Turuvekere Sreenivas and Sharon Mendelson and Shaun Kotek and Shawn Wang and Shay Aharon and Shaya Gharghabi and Sheng-Chieh Lin and Shi Chen and Shiqing Fan and Shirish Baskaran and Shreya Gopa and Shrimai Prabhumoye and Shubham Pachori and Shubham Toshniwal and Shuoyang Ding and Shwetha Krishnamurthy and Siddharth Singh and Simeng Sun and Sirshak Das and Sivakumar Arayandi Thottakara and Smita Ithape and Somshubra Majumdar and Soumye Singhal and Sri Harsha Singudasu and Sridhar Bhuvanapalli and Srimukh Veccham and Stas Sergienko and Stefania Alborghetti and Stephen Ge and Su Rong and Sugam Dipak Devare and Sukrit Rao and Sumeet Kumar Barua and Sungsoo Ha and Sunny Gai and Suriya Gunasekar and Suseella Panguluri and Suyog Gupta and Sviataslau Hinzburh and Sweta Priyadarshi and Syeda Nahida Akter and Talor Abramovich and Tan Bui and Tanay Varshney and Tatevik Ter-Hovhannisyan and Teodor-Dumitru Ene and Terry Kong and Thanh Do and Tianhe Zhang and Tiffany Moore and Tijmen Blankevoort and Tim Moon and Tiyasa Mitra and Tom Balough and Tomasz Grzegorzek and Tomasz Hliwiak and Tomer Asida and Tomer Bar Natan and Tomer Keren and Tomer Ronen and Tony Salim and Tony Wang and Traian Rebedea and Tugrul Konuk and Twinkle Vashishth and Udi Karpas and Ushnish De and Vahid Noorozi and Venkat Srinivasan and Venmugil Elango and Vibhor Agrawal and Victor Cui and Vijay Korthikanti and Vikas Mehta and Vinay Rao and Virginia Wu and Vitaly Kurin and Vitaly Lavrukhin and Vladimir Anisimov and Vu Pham and Wanli Jiang and Wasi Uddin Ahmad and Wataru Ishihara and Wei Du and Wei Ping and Weiheng Chai and Wenliang Dai and Wesley Helmholz and Will Jennings and Will Zhu and Wojciech Prazuch and Xiaowei Ren and Xiwen Yu and Yan Breek and Yang Chen and Yang Yu and Yangyi Chen and Yaniv Galron and Yashaswi Karnati and Yejin Choi and Yev Meyer and Yi-Fu Wu and Yian Zhang and Ying Lin and Yonatan Geifman and Yonggan Fu and Youngeun Kwon and Yu Yao and Yugi Guvvla and Yuki Huang and Yunsheng Liu and Zach Moshe and Zachary Newell and Zhilin Wang and Zhiyu Li and Zhongbo Zhu and Zhuolin Yang and Zihan Liu and Zijie Yan and Zsolt-Alon Wertheimer},
year={2026},
eprint={2606.15007},
archivePrefix={arXiv},
url={https://arxiv.org/abs/2606.15007}
}