If time travel is possible, would we have met time travelers already?