If you add a familiar, you get its bonuses. If you then remove it, you keep the bonuses, even if you add another familiar.
EDIT: Also need to check if familiar HP is automatically equal to 1/2 "master's" HP.
Windows 7
Still present with v6.0.4.00