You may never reach your destination, but the black hole is still there, and observable from the outside.

I agree with your points, though. Our ideas of time and space become less and less "real" (as we perceive reality) as you approach the big bang, so trying to explain it in terms like "approach" and "back in time" become meaningless.