Fast Travel in Forza Horizon 4 has to be unlocked before you can jump to any point on the map. At first you can only travel to houses that you bought and the festival.
How to Unlock Fast Travel in Forza Horizon 4
If you want to fast travel anywhere on the map though, you have to buy a specific property. It’s called Fairlawn Manor and costs 750.000 credits.
The perk it gives you is called “Fast Travel Anywhere – Instantly travel to any road on the map”.
The cost of jumping from point A to point B will still be same but you can lower it by destroying fast travel boards. Once you found all, you can fast travel anywhere without spending credits.