A man visiting his daughter at her student flat spoke of the "terrifying" moment fire spread to her block from a fire in a derelict building across the road.