Green Day was the musical guest on Stephen Colbert’s The Late Show recently. Colbert has made it no surprise that he is a huge Green Day fan so it only makes sense that he’d ask to sing a tune with the Hall of Fame rockers. That tune? “Good Riddance;” although, Billie Joe Armstrong said he could sing the tune with them, but he’d have to pay for it. Colbert then decided he’d do a more “affordable” version of the song instead.

Check it out below.

The Late Show has also released a behind-the-scenes video of Green Day’s time on the show called The Late Show Presents: Bonus Tracks, Green Day Edition which you can watch below.