How would OP stop them getting the new number if OP doesn’t know who they are?

It could be any of the many people who has her current number and would likely be given it again freely when the number was changed.