In 2006, Kazee played Dumas Shepherd in an episode of Conviction. In 2007, he appeared as Michael Barlow in Medium and Mark Green in Numb3rs. In 2008, he appeared on NCIS as Michael Locke, and in 2009, he played Dominic Humphreys on CSI: Crime Scene Investigation. Most recently, he had a starring role on CMT's Working Class, in which he played Nick Garrett.
Onstage, he starred in several shows on- and off-Broadway. He appeared in NYSF's As You Like It. In 2006, he appeared as Timmy Cleary in The Subject Was Roses, which played at the Kennedy Center from January 7 to 29. Later that year, Kazee was cast as Sir Lancelot in Spamalot, then in Seascape as the Leslie understudy. In 2007, he starred as Bill Starbuck in the revival of 110 in the Shade,and in 2008, he played Sobinsky in To Be Or Not To Be, which ran from September 16, 2008 through November 16, 2008 at the Samuel J. Friedman Theatre.