If the requirement is an in person interview, then stick to your guns. What would happen if you hired someone who couldn't even meet the standard you set for an interview? I can understand an outbreak of Covid or something, but under normal conditions it is not unreasonable to expect a candidate to interview in the format that you have prescribed. If not, move on to the next candidate.