This film contains the only screen footage of John Barrymore reciting Hamlet's famous "To be or not to be" soliloquy.
The term bazooka is mentioned by a member of the band while playing an unfamiliar instrument. The bazooka is a brass musical instrument which incorporates telescopic tubing like the trombone. Radio comedian Bob Burns is credited with inventing the instrument in the 1910s, and popularized it in the 1930s. Several years later, in WWII, bazooka became the universally-applied nickname of a new anti-tank weapon due to its vague resemblance to the musical instrument.
The song "Humpty Dumpty Heart" highlights (it can actually be seen in the shot) a soprano sarrusophone, an extremely rare instrument outside of French military bands. It's essentially a cross between a soprano saxophone and an oboe, and that's exactly what it sounds like.
John Barrymore often whines that he's dying. Sadly, the knowledge that he did pass away shortly after this film's completion lends a somewhat macabre tone to these jokes.