This is kinda cute. The voice is clearly Henson (and the banjo player looks like him), and the song is very clever. I have no idea where it came from, though. Doesn't really look like the Muppet Show.
[short time later...]
Ah...the wonders of Google: this site pins it down to a specific episode of The Muppet Show's first season. I love the Internet!