The answer key does not tell you why a sentence uses に vs へ. You must infer that from the lesson.

JLPT N4 Guide: Everything You Need to Know - gojapanese.io -

Good luck with your N4 studies. がんばってください!