A father-son weekend visiting the Baseball Hall of Fame was a strikeout when it came to the accommodations