That lack of roads area you saw on the map was the Darien Gap.
You can fly around, float around, or maybe walk through but driving it is rather difficult.
In all seriousness, it's "no man's" land. Only people in the area are indigenous tribes and drug runners.
I've been looking at a south of the border trip with the bus for awhile now. Although our bus will stop in Costa Rica.