Limits and continuity
A limit is about approach, not arrival. The function need not be defined at the point, which is exactly why limits can describe instantaneous rates that direct substitution cannot.
Continuity requires three things at a point: the function is defined there, the limit exists, and the two agree. Removable discontinuities fail only the third condition.