| title | Gemma 4 Technical Report |
|---|---|
| authors | Gemma Team, Sherif El Abd, Vaibhav Aggarwal, Robin Algayres, Alek Andreev, Olivier Bachem, Ian Ballantyne, Cormac Brick, Victor Cărbune, Michelle Casbon, Mayank Chaturvedi, Victor Cotruta, Alice Coucke, Phil Culliton, Robert Dadashi, Lucas Dixon, Mohamed Elhawaty, Utku Evci, Clément Farabet, Johan Ferret, Filippo Galgani, Sertan Girgin, Jean-Bastien Grill, Maarten Grootendorst, Jiaxian Guo, Cassidy Hardin, Yanzhang He, Steven M. Hernandez, Omri Homburger, Léonard Hussenot, Juyeong Ji, Armand Joulin, Aishwarya Kamath, Parnian Kassraie, Olivier Lacombe, Preethi Lahoti, Gaël Liu, Gus Martins, Luciano Martins, Tatiana Matejovicova, Ramona Merhej, Nikola Momchev, Sneha Mondal, Ryan Mullins, Sindhu Raghuram Panyam, Shreya Pathak, Sarah Perrin, André Susano Pinto, Etienne Pot, Angéline Pouget, Alexandre Ramé, Sabela Ramos, Douglas Reid, David Rim, Morgane Rivière, Karsten Roth, Louis Rouillard, Omar Sanseviero, Pier Giuseppe Sessa, Shane Settle, Danila Sinopalnikov, Sara Smoot, Piotr Stanczyk, Andreas Steiner, Lawrence Stewart, Ilya Tolstikhin, Michael Tschannen, Anton Tsitsulin, Nino Vieillard, Renjie Wu, Pingmei Xu, Haichuan Yang, Edouard Yvinec, Li Zhang, Joe Zou, Nicolas Aagnes, Abdelrahman Abdelhamed, Shivani Agrawal, Shubham Agrawal, Ibrahim Alabdulmohsin, Jean Baptiste Alayrac, Uri Alon, Chandramouli Amarnath, Ankesh Anand, Chrysovalantis Anastasiou, Setareh Ariafar, François-Xavier Aubet, Kyriakos Axiotis, Federico Barbero, Joelle Barral, Alexei Bendebury, Urs Bergmann, Stanley Bileschi, Kat Black, Mathieu Blondel, Sebastian Borgeaud, Arthur Bražinskas, Ryan Burnell, Robert Busa-Fekete, Mu Cai, Glenn Cameron, Charlotte Caucheteux, Garima Chadha, Jetha Chan, Aditya Chawla, Blake Jianhang Chen, Jesse Chen, Lin Chen, Xu Chen, Derek Cheng, Tzu-hsiang Chien, Nikolai Chinaev, Yi Chou, Zhaohui Chu, Benjamin Coleman, Pooja Consul, Sam Conway-Rahman, Scott Crowell, Dylan Cutler, Vivek Dani, Samira Daruki, Anil Das, Daniel Deutsch, Nishanth Dikkala, Li Ding, Qiuhan Ding, Shenil Dodhia, Konstantin Donhauser, Tulsee Doshi, Anca Dragan, Alex Druinsky, Sahil Dua, Zoltan Egyed, Danielle Eisenbud, Daniel Eppens, Cindy Fan, Bahare Fatemi, Yassir Fathullah, Vlad Feinberg, Milen Ferev, Takumi Fujimoto, Isaac Galatzer-Levy, João Gante, Simon Geisler, Soham Ghosal, Antonious M. Girgis, Alec Go, Alhaad Gokhale, Alex Grills, Yiming Gu, Pramod Gupta, Guru Guruganesh, Raia Hadsell, Hamza Harkous, Jitendra Harlalka, Demis Hassabis, Anja Hauth, Joe Heyward, Arian Hosseini, Chih-Yang Hsia, I-Hung Hsu, Xiaopeng Huang, Yangsibo Huang, Kevin Hui, Adrian Hutter, Te I, Fotis Iliopoulos, Advait Jain, Ganesh Jawahar, Ziwei Ji, Qilin Jin, Melvin Johnson, Kandarp Joshi, Arun Kandoor, Wang-Cheng Kang, Koray Kavukcuoglu, Mehran Kazemi, Kathleen Kenealy, Amr Khalifa, Phoebe Kirk, Suraj Kothawade, Vitaly Kovalev, Neel Kovelamudi, Adam Kraft, Ravin Kumar, Harish Kuppam, Justin Lannin, Chen-Yu Lee, Seungji Lee, Dmitry Lepikhin, Dongdong Li, Qiujia Li, Valentin Liévin, Ethan Lin, Ziqian Lin, Casper Liu, Tianlin Liu, Tianqi Liu, Xin Liu, Mayank Lunayach, Min Ma, Gagan Madan, Andrii Maksai, Eric Malmi, Michal Matuszak, Daniel McDuff, Gaurav Menghani, Daniil Mirylenka, Karolis Misiunas, Vedant Misra, Andreea Mitran, Kareem Mohamed, Maksim Mukha, Eric Noland, James O'Donnell, Kate Olszewska, Bernett Orlando, Wanqiong Pan, Rina Panigrahy, Unnati Parekh, Chunjong Park, Eric Paskie, Liqian Peng, Bryce Petrini, Slav Petrov, Jonas Pfeiffer, Bilal Piot, Martyna Plomecka, Siim Poder, Octavio Ponce, Arijit Pramanik, David Racz, Anish Rajan, Michelle Ramanovich, Anand Rao, Marvin Ritter, Vitor Rodrigues, Evan Rosen, Mikołaj Rybiński, Noveen Sachdeva, Michaël E. Sander, Rohit Sathyanarayana, Sagar Savla, Samuel Schmidgall, Tal Schuster, Benoit Seguin, Andrew Sellergren, Aliaksei Severyn, Izhak Shafran, Dhruv Shah, Yuan Shangguan, Ashish Shenoy, Pradeep Shenoy, Rakesh Shivanna, Pauline Sho, Lucas Spangher, Wojciech Stokowiec, Tim Strother, Yao Su, Yinghao Sun, Mukund Sundararajan, Andrea Tacchetti, Mor Hazan Taege, Pouya Tafti, Chetan Tekur, Rahul Thapa, Madeleine Traverse, Lenart Treven, Tao Tu, Chien Te Tung, Petar Veličković, Malini Pooni Venkat, Sagar Gubbi Venkatesh, Vidya Venkiteswaran, Francesco Visin, Alex Vitvitskyi, Kiran Vodrahalli, Weiyi Wang, Xin Wang, Tris Warkentin, Jan Wassenberg, John Wieting, Lechao Xiao, Hao Xu, Yuhui Xu, Fuzhao Xue, Arun Yadav, Jun Yan, Antoine Yang, Lin Yang, Ming-Hsuan Yang, Ziyu Ying, Jae Hyeon Yoo, Sajjad Zafar, Fred Zhang, Jiageng Zhang, Jianyi Zhang, Xiaofan Zhang, Chao Zhao, David Zhou, Chen Zou |
| date | 2026-07-02 |
| venue | arXiv (preprint, not peer reviewed) |
| id | arXiv:2607.02770 |
| affiliation | |
| upvotes | 78 (Hugging Face Daily Papers, 2026-11-01) |
| links | abs pdf hf |
| abstract | We introduce Gemma 4, a new generation of open-weight, natively multimodal language models in the Gemma model family. Designed to advance compute efficiency and reasoning, the Gemma 4 model suite features dense and Mixture-of-Experts architectures, ranging from 2.3B to 31B parameters. Alongside improved vision and audio encoders for all model sizes, we propose a unified, encoder-free architecture for our 12B model, which ingests raw audio and image patches. Furthermore, we integrate a thinking mode, enabling Gemma models to generate reasoning traces prior to responding. We improve inference speed, memory, and compute efficiency, as well as long-context abilities through critical design choices. Gemma 4 establishes a leap in performance across STEM, multimodal, and long-context benchmarks, and rivals larger, frontier open models in human-rated tasks. |
cite
@misc{team2026gemma,
title={Gemma 4 Technical Report},
author={Gemma Team and Sherif El Abd and Vaibhav Aggarwal and Robin Algayres and Alek Andreev and Olivier Bachem and Ian Ballantyne and Cormac Brick and Victor Cărbune and Michelle Casbon and Mayank Chaturvedi and Victor Cotruta and Alice Coucke and Phil Culliton and Robert Dadashi and Lucas Dixon and Mohamed Elhawaty and Utku Evci and Clément Farabet and Johan Ferret and Filippo Galgani and Sertan Girgin and Jean-Bastien Grill and Maarten Grootendorst and Jiaxian Guo and Cassidy Hardin and Yanzhang He and Steven M. Hernandez and Omri Homburger and Léonard Hussenot and Juyeong Ji and Armand Joulin and Aishwarya Kamath and Parnian Kassraie and Olivier Lacombe and Preethi Lahoti and Gaël Liu and Gus Martins and Luciano Martins and Tatiana Matejovicova and Ramona Merhej and Nikola Momchev and Sneha Mondal and Ryan Mullins and Sindhu Raghuram Panyam and Shreya Pathak and Sarah Perrin and André Susano Pinto and Etienne Pot and Angéline Pouget and Alexandre Ramé and Sabela Ramos and Douglas Reid and David Rim and Morgane Rivière and Karsten Roth and Louis Rouillard and Omar Sanseviero and Pier Giuseppe Sessa and Shane Settle and Danila Sinopalnikov and Sara Smoot and Piotr Stanczyk and Andreas Steiner and Lawrence Stewart and Ilya Tolstikhin and Michael Tschannen and Anton Tsitsulin and Nino Vieillard and Renjie Wu and Pingmei Xu and Haichuan Yang and Edouard Yvinec and Li Zhang and Joe Zou and Nicolas Aagnes and Abdelrahman Abdelhamed and Shivani Agrawal and Shubham Agrawal and Ibrahim Alabdulmohsin and Jean Baptiste Alayrac and Uri Alon and Chandramouli Amarnath and Ankesh Anand and Chrysovalantis Anastasiou and Setareh Ariafar and François-Xavier Aubet and Kyriakos Axiotis and Federico Barbero and Joelle Barral and Alexei Bendebury and Urs Bergmann and Stanley Bileschi and Kat Black and Mathieu Blondel and Sebastian Borgeaud and Arthur Bražinskas and Ryan Burnell and Robert Busa-Fekete and Mu Cai and Glenn Cameron and Charlotte Caucheteux and Garima Chadha and Jetha Chan and Aditya Chawla and Blake Jianhang Chen and Jesse Chen and Lin Chen and Xu Chen and Derek Cheng and Tzu-hsiang Chien and Nikolai Chinaev and Yi Chou and Zhaohui Chu and Benjamin Coleman and Pooja Consul and Sam Conway-Rahman and Scott Crowell and Dylan Cutler and Vivek Dani and Samira Daruki and Anil Das and Daniel Deutsch and Nishanth Dikkala and Li Ding and Qiuhan Ding and Shenil Dodhia and Konstantin Donhauser and Tulsee Doshi and Anca Dragan and Alex Druinsky and Sahil Dua and Zoltan Egyed and Danielle Eisenbud and Daniel Eppens and Cindy Fan and Bahare Fatemi and Yassir Fathullah and Vlad Feinberg and Milen Ferev and Takumi Fujimoto and Isaac Galatzer-Levy and João Gante and Simon Geisler and Soham Ghosal and Antonious M. Girgis and Alec Go and Alhaad Gokhale and Alex Grills and Yiming Gu and Pramod Gupta and Guru Guruganesh and Raia Hadsell and Hamza Harkous and Jitendra Harlalka and Demis Hassabis and Anja Hauth and Joe Heyward and Arian Hosseini and Chih-Yang Hsia and I-Hung Hsu and Xiaopeng Huang and Yangsibo Huang and Kevin Hui and Adrian Hutter and Te I and Fotis Iliopoulos and Advait Jain and Ganesh Jawahar and Ziwei Ji and Qilin Jin and Melvin Johnson and Kandarp Joshi and Arun Kandoor and Wang-Cheng Kang and Koray Kavukcuoglu and Mehran Kazemi and Kathleen Kenealy and Amr Khalifa and Phoebe Kirk and Suraj Kothawade and Vitaly Kovalev and Neel Kovelamudi and Adam Kraft and Ravin Kumar and Harish Kuppam and Justin Lannin and Chen-Yu Lee and Seungji Lee and Dmitry Lepikhin and Dongdong Li and Qiujia Li and Valentin Liévin and Ethan Lin and Ziqian Lin and Casper Liu and Tianlin Liu and Tianqi Liu and Xin Liu and Mayank Lunayach and Min Ma and Gagan Madan and Andrii Maksai and Eric Malmi and Michal Matuszak and Daniel McDuff and Gaurav Menghani and Daniil Mirylenka and Karolis Misiunas and Vedant Misra and Andreea Mitran and Kareem Mohamed and Maksim Mukha and Eric Noland and James O'Donnell and Kate Olszewska and Bernett Orlando and Wanqiong Pan and Rina Panigrahy and Unnati Parekh and Chunjong Park and Eric Paskie and Liqian Peng and Bryce Petrini and Slav Petrov and Jonas Pfeiffer and Bilal Piot and Martyna Plomecka and Siim Poder and Octavio Ponce and Arijit Pramanik and David Racz and Anish Rajan and Michelle Ramanovich and Anand Rao and Marvin Ritter and Vitor Rodrigues and Evan Rosen and Mikołaj Rybiński and Noveen Sachdeva and Michaël E. Sander and Rohit Sathyanarayana and Sagar Savla and Samuel Schmidgall and Tal Schuster and Benoit Seguin and Andrew Sellergren and Aliaksei Severyn and Izhak Shafran and Dhruv Shah and Yuan Shangguan and Ashish Shenoy and Pradeep Shenoy and Rakesh Shivanna and Pauline Sho and Lucas Spangher and Wojciech Stokowiec and Tim Strother and Yao Su and Yinghao Sun and Mukund Sundararajan and Andrea Tacchetti and Mor Hazan Taege and Pouya Tafti and Chetan Tekur and Rahul Thapa and Madeleine Traverse and Lenart Treven and Tao Tu and Chien Te Tung and Petar Veličković and Malini Pooni Venkat and Sagar Gubbi Venkatesh and Vidya Venkiteswaran and Francesco Visin and Alex Vitvitskyi and Kiran Vodrahalli and Weiyi Wang and Xin Wang and Tris Warkentin and Jan Wassenberg and John Wieting and Lechao Xiao and Hao Xu and Yuhui Xu and Fuzhao Xue and Arun Yadav and Jun Yan and Antoine Yang and Lin Yang and Ming-Hsuan Yang and Ziyu Ying and Jae Hyeon Yoo and Sajjad Zafar and Fred Zhang and Jiageng Zhang and Jianyi Zhang and Xiaofan Zhang and Chao Zhao and David Zhou and Chen Zou},
year={2026},
eprint={2607.02770},
archivePrefix={arXiv},
url={https://arxiv.org/abs/2607.02770}
}