It was always assumed that the Whisperers were formed by Alpha's twisted mind. But in Tales of TWD, it was revealed that the Whisperers found Dee and Lydia and welcomed them into their group.