Is it even possible to really pin down an answer to the question, When do deer shed their antlers? To find out, I spoke to a couple whitetail experts. When Do deer Shed Their Antlers, Generally?