• AI Minds Newsletter
  • Posts
  • How to Benchmark AGI, Gmail Creator Discusses Open Source, and Self-Driving Cars Cut Traffic

How to Benchmark AGI, Gmail Creator Discusses Open Source, and Self-Driving Cars Cut Traffic

How Researchers are Benchmarking AGI and what leaders like Zuckerberg and Gmail Creator Paul Buchheit think about it

Welcome (back) to AI Minds, a newsletter about the brainy and sometimes zany world of AI, brought to you by the Deepgram editorial team.

In this edition:

  • 📫 Gmail Creator Paul Buchheit Discusses AGI and Open Source Models

  • 📐 MMMU: The Multimodal Benchmark for AGI

  • 🤖 The Official “Levels” of AGI, According to Researchers

  • 🌎 Best AI Apps for Language Learning!

  • 🎥 10 AI Apps to Make Content Generation Easy

  • 🐦 Social Media Buzz: Claude 3 Knows When It’s Being Tested

  • 🚗 Video of Self-Driving Car Cutting Traffic

  • 🎤 AI Minds Podcast with Founder & CTO Nathan Eno!

  • 📝 Free Transcription Forever! Speech-to-Text AI Tool

  • 💸 Bonus Content: Two ChatGPTs Can’t Stop Saying Goodbye

  • 🤣 USC Study Finds that AI Can Actually Be a Comedian

  • 🎭 A Comparative Study on Creativity in the Age of AI

  • 🔊AI Voice Agents: A Complete Deep Dive

Thanks for letting us crash your inbox; let’s party. 🎉

We coded with the brand-new Whisper-v3 over the past week, and the results were not what we expected. Check it out here!

🎥  Gmail Creator Paul Buchheit On AGI & Open Source Models

In this podcast, Paul Buchheit—one of Google’s earliest employees and the creator of Gmail—reveals some (perhaps unexpected) thoughts about AGI and discusses the importance of open source AI.

🧑‍🔬 The “Levels” of AGI and How to Benchmark It

MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI - In the pursuit of AGI, this paper introduces a new benchmark designed to evaluate multimodal models on massive multi-discipline tasks demanding college-level subject knowledge and deliberate reasoning. Even the advanced GPT-4V and Gemini Ultra only achieve accuracies of 56% and 59% respectively.

Levels of AGI for Operationalizing Progress on the Path to AGI - This paper proposes a framework for classifying the capabilities and behavior of Artificial General Intelligence (AGI) models and their precursors. This framework introduces levels of AGI performance, generality, and autonomy, providing a common language to compare models, assess risks, and measure progress along the path to AGI.

🏇 Best Apps for Language Learning and Content Generation!

Talk Like a Local With These 10 AI Apps For Language Learning - AI-powered language learning apps leverage advanced algorithms to provide personalized, interactive, and effective learning experiences. Here’s a look at some of the best AI apps designed to help you master new languages.

10 AI Apps to Make Content Generation Easy - AI apps for content generation have become indispensable for marketers, content creators, and businesses aiming to produce high-quality, engaging material without the extensive time investment traditionally required. Here are some of the best ones we’ve found.

🐝 Social Media Buzz: AI is learning how to cut traffic, Zuckerberg comments further

🎙️ AI Minds Podcast!

Nathan Eno, Founder and CTO of Islington Robotica, shares his journey from coaching at Arsenal to founding a robotics company, focusing on personal robots for emotional support and communication.

In this episode, Nathan and Demetrios cover ethical concerns, privacy issues, and the role of voice interaction in making robots effective companions.

📝 Free Transcription Forever! New Speech-to-Text AI Tool

Looking for a simple way to convert speech to text? Deepgram's free transcription tool is your ultimate solution. Whether it's conversations, audio files, or YouTube videos, our advanced AI transcription tool supports over 36 languages and dialects, making it the best free AI transcription tool available online. Discover how easy and efficient transcription can be with our tool.

🤖 Bonus Bits and Bytes!

If you've scrolled this far down, we've got some exciting bonus bits of content for you!