$ 0 0 A show insider revealed the 61-year-old mogul decided to pull X Factor himself rather than let it become a “bit of a joke”.