meaning - Use of "up" in "back up", to mean going in reverse

Why do we use the term "back up" when we are going in reverse? This is sometimes confusing for young English Language learners. Going backwards is understandable, where does the word "up" fit in? Are we moving in two directions?