The last person to 'take over' me, was Bakura. No soul room for me to hide in, so no one can take over. And Bakura was smart enough to put some magic in the tattoo both my halves gave to me. He wanted to make sure no one but him could possess me again.

It's worked so far, wouldn't you say?