The border states are usually described as: Maryland, Delaware, Kentucky and Missouri. The border states were defined, in part, by permitting slavery but not seceding from the Union to join the Confederacy.
(Non-state border regions that were also critical to the war's outcome included the areas that later became Oklahoma and West Virginia.)