Tory leader Kemi Badenoch warned voters face paying an 'astronomical sum' if there is no change to residency rules.