You move up 1 unit and down 5 units. You end at (4, -4). Where did you start?
You started at (4, 1).
To see why, note that for every 1 unit upward movement, there must be 5 units downward movement for a net decrease of 4 units. So if we start at some point (x, y), then we must have moved up (y - (-4)) = (y + 4) units and down 5 times as many, or 5(y + 4) units.
Thus, our final point is (x, y + 4 - 5(y + 4)) = (x, -4). Solving for x, we have x = 4, so our starting point must be (4, y + 4 - 20) = (4, y - 16).
Then since we know that our final point is (4, -4), we have y - 16 = -4, or y = 12. Therefore, our starting point is (4, 12).