Analyzing Song Lyrics: A Comparison of AI Models

In my recent exploration of AI models for analyzing song lyrics, I encountered some fascinating results. I selected two intriguing tracks, “Aerodeliria” by The Loud Family and “Randy Described Eternity” by Built to Spill, to put various AI tools to the test. With a range of requests—covering formats like essays and bullet points, and approaches like objective versus subjective analysis—I aimed to see how well these models could interpret song lyrics.

Comparative Analysis of AI Performance

Here’s a breakdown of how each AI model performed:

• Claude Sonnet 4 (Free Version): When accessed through my home browser, this model delivered satisfactory results regarding themes and vibe. However, it refrained from quoting any specific lyrics due to copyright concerns—resulting in a modest score of 5.

• Copilot for Business: Operating from my work laptop, this model provided a decent analysis. It managed to quote some lyrics and generally met my expectations, earning a 7.

• Grok: Both on Twitter and its own website, Grok excelled in understanding and detail, quoting each line effectively. Its performance was stellar, achieving a score of 9 across the board in its various functionalities.

• Gemini 2.5 Flash: Accessed on my home browser, this iteration also showcased excellent comprehension and quoted extensively, earning it another solid 9.

• Google Search with ‘Dive Deeper in AI Mode’: Although its analysis of “Randy Described Eternity” was relatively better, it confused “Aerodeliria,” mixing it up with another song by The Loud Family. Its inconsistent detail and reliance on links brought it down to a score of 4.

The Struggle of Gemini 2.5 Pro

Now, here’s where the results took a surprising turn: Gemini 2.5 Pro (Preview) consistently failed to deliver, achieving a perplexing score of 0 across all attempts with both songs. It struggled mightily with even the simplest of queries, missing the mark on every front:

• It would often fabricate lyrics or mistakenly interpret my requests as being about entirely different songs.
• Attempts to provide it with initial verses or key phrases did not yield success.
• Supplying URLs from reputable sources like Genius or AZLyrics did not improve performance.
• Requests for verification of lyrics or additional