Tackling my first big-ish job on my '78 Clubman. And I can't get the bearings out of the swivel hub! I got the oil seals out easy enough, but the inner and outer races are stuck tight

Haynes says to use a drift to get the inner race (smaller diameter) out first, and then the larger one. I've used a socket of the right diameter as my drift, the b*gger won't come out.
If anyone has any tips I'd be extremely grateful!
Thanks!