This is the first Warner Bros. cartoon to be nominated for an Academy Award. (It lost to Walt Disney's Des arbres et des fleurs (1932).)
"It's got me again!" is available on DVD in Looney Tunes Golden Collection, Volume 3 (Disc 2 > Features > "From the vault").
The scene with the marching mice is nearly identical to the one in Hold Anything (1930). It's the same piece of animation with minor changes.
The Thirty Second Looney Tunes Cartoon To Be Released
The dance two mice perform on piano keys is called an Apache, a seemingly rough dance popularize in early twentieth century Paris.