Imitating Shortest Paths in Simulation Enables Effective Navigation and Manipulation in the Real World