I sort of get the feeling that Steve counts his frozen years, but I'm not sure of the canon of that.

Definitely canon. In Civil War (I can check my trades, if you like, but I think it's The Confession! right before Steve and Tony argue in Steve's cell), Steve asks one of the SHIELD agents guarding him how old said agent is. The agent responds and then asks Steve the same question; Steve says he's 87.