In precise terms, we say λ is a limit ordinal if for any α < λ, S(α) < λ.
Because the class of ordinal numbers is well-ordered, there is a smallest infinite limit ordinal; and we denote this by ω. ω is also the smallest infinite ordinal (forgetting the limit), as it is the least upper bound of the natural numbers. Hence ω represents the order type of the natural numbers. The next limit ordinal above the first is ω + ω = ω2, and then we have ωn for any n a natural number. Taking the union (the supremum operation on any set of ordinals) of all the ωn, we get ωω = ω2 (more on ordinal arithmetic at the main ordinal number entry). And we can keep going and going, getting
And we don't stop there: we have (all of these are increasing in cardinality now!):
The term limit derives from using the order topology on the ordinal numbers; limit ordinals correspond precisely to the limit points in this topology.
The classes of successor ordinals and limit ordinals (and if you insist on limit ordinals being infinite, zero) exhaust the entire class of ordinals, so these cases are often used in proofs by transfinite induction or definitions by transfinite recursion. Limit ordinals are usually a kind of "turning point" in which we have to use limiting operations such as taking the union over all preceding ordinals (technically we could do anything at limit ordinals, but taking the union is continuous in the order topology and usually this is what we want).
If we use the Von Neumann cardinal assignment, every infinite cardinal number is also a limit ordinal (and this is a fitting observation, as cardinal derives from the latin cardo meaning hinge or turning point!): the proof of this fact is done by simply showing that every successor ordinal is equinumerous to a limit ordinal via the Hotel Infinity argument.
Cardinal numbers have their own notion of successorship and limit (everything getting upgraded to a higher level!). More at limit cardinal.