Five years ago on Friday, two separate crowds gathered near the UK Parliament: one group cheered and carried Union Jack flags, while the other was more sombre and bore European Union banners.