Can I create an interview day that is accessible only by applicants I select?

Yes.

This is the private event feature and only applicants invited to that event will be able to see it on their calendar.  

Additional information about creating your calendar events can be found here: Creating Interview Dates