I'm surprised the bearing puller didn't work, if you could get a good grip on it. As you're probably aware, the collet likely goes into a slight taper. So I would keep trying to persuade that. As far as heat goes: I think those three parts are in pretty intimate contact... it might be hard to get one to shrink independently.
