Google's Gemini Ultra and OpenAI's GPT-4 are the leading generative AI platforms worldwide, and they compare alike in the code creation benchmarks. Gemini Ultra is slightly ahead of GPT-4, beating it in both coding benchmarks as well as the general MMLU benchmarking. The lead is not so significant as to consider GPT-4 a lackluster model.
Comparison of code benchmarks between Google's Gemini Ultra and OpenAI's GPT-4 in 2024
Profit from the additional features of your individual account
Currently, you are using a shared account. To use individual functions (e.g., mark statistics as favourites, set
statistic alerts) please log in with your personal account.
If you are an admin, please authenticate by logging in again.
Learn more about how Statista can support your business.
Encord. (December 7, 2023). Comparison of code benchmarks between Google's Gemini Ultra and OpenAI's GPT-4 in 2024 [Graph]. In Statista. Retrieved November 10, 2024, from https://www-statista-com.ezproxy.canberra.edu.au/statistics/1450848/code-benchmark-comparison-gemini-ultra-gpt-4/
Encord. "Comparison of code benchmarks between Google's Gemini Ultra and OpenAI's GPT-4 in 2024." Chart. December 7, 2023. Statista. Accessed November 10, 2024. https://www-statista-com.ezproxy.canberra.edu.au/statistics/1450848/code-benchmark-comparison-gemini-ultra-gpt-4/
Encord. (2023). Comparison of code benchmarks between Google's Gemini Ultra and OpenAI's GPT-4 in 2024. Statista. Statista Inc.. Accessed: November 10, 2024. https://www-statista-com.ezproxy.canberra.edu.au/statistics/1450848/code-benchmark-comparison-gemini-ultra-gpt-4/
Encord. "Comparison of Code Benchmarks between Google's Gemini Ultra and Openai's Gpt-4 in 2024." Statista, Statista Inc., 7 Dec 2023, https://www-statista-com.ezproxy.canberra.edu.au/statistics/1450848/code-benchmark-comparison-gemini-ultra-gpt-4/
Encord, Comparison of code benchmarks between Google's Gemini Ultra and OpenAI's GPT-4 in 2024 Statista, https://www-statista-com.ezproxy.canberra.edu.au/statistics/1450848/code-benchmark-comparison-gemini-ultra-gpt-4/ (last visited November 10, 2024)
Comparison of code benchmarks between Google's Gemini Ultra and OpenAI's GPT-4 in 2024 [Graph], Encord, December 7, 2023. [Online]. Available: https://www-statista-com.ezproxy.canberra.edu.au/statistics/1450848/code-benchmark-comparison-gemini-ultra-gpt-4/