The 31-year-old former English soccer captain had allegedly confirmed to a Spanish video paparazzo that his ex-Spice Girl wife, 32, was pregnant with their fourth child. The couple are already parents to sons Brooklyn, 7, Romeo, 3, and Cruz, 1. A source tells PEOPLE that Beckham, who plays for the Real Madrid soccer team, was signing autographs and simply misunderstood what the female paparazzo was asking. He thought she was asking, in Spanish, how Victoria and the babies are, when in fact was asking how Victoria and the new baby are doing. Still, a source close to the family says the couple, who divide their time between the Spanish capital and an English mansion – dubbed Beckingham Palace – north of London, plan to expand their brood. "Victoria has always wanted a larger family and especially would like a sister for the boys, but the time is not right just yet," the source tells PEOPLE. "She’s doing designing work, there is a perfume, sunglasses and a TV show in the works," the friend says. "There is just too much going on for her to consider becoming pregnant at this time."