Flights and trains are expensive. Bus travel – not so much. I just had a look. It’s $10 one-way from New York to Washington DC next month.
The same concept applies to most countries. Eg. Bus travel is cheap in Latin America and Australia. Just gotta know where to look!:)