Starfinder - Armor penalty not applied to speed

I chose and equipped Hidden Soldier armor for my soldier and the -5 penalty was not applied to my character. I assume this applies to all armor with a movement penalty, but I have not tested beyond this.