Throw in Louis Walsh (what would the X Factor be like if he actually left?!) and that leaves one spot left. Cowell could opt to entirely reboot the 2010 panel if he could get Dannii Minogue back on the panel.
But according to the bookmakers, Cowell is going to call up Rita Ora, who has appeared as a guest judge on the show before.
William Hill puts the odds on this panel at 1/3 yes and 9/4 no.
Rumblings of a fifth judge have also re-surfaced. This of course turned out to be a standard join in at home app last year, so it’s not looking likely. However, if you fancy a bet on a fifth judge appearing on the first live show, odds are at 4/11 no and 2/1 yes.
Simon Cowell, Cheryl Cole, Rita Ora and Louis Walsh – what do you think? Let us know in the comments below
Emma is RadioTimes.com’s resident reality TV expert and is most likely to be found chasing Simon Cowell down the street, cancelling her social life to keep up with the latest batch of sob stories and trying to get selfies with celebrities. Emma is a chat show addict and quotes Friends more than is probably healthy.