The music mogul
Simpson is the latest star said to be in considerations for a role on the programme, but she's moved swiftly to deny the speculation.
In a post on her Twitter.com page, she writes, "Just to clear up a rumor... I am NOT going to judge X Factor!!! I don't even know where that info came from."
Katy Perry and Kelly Rowland have also been linked to judging roles, while Will Smith has denied reports he's signed up for the show.