Are your maps .bzp2? If not that is the main cause.
To bzip your map you need to download
Once you bzip your maps, replace the bsp ones in your fast dl. Keep the ones in your server as bsp. After that maps should download considerably faster
Video Tutorial that I did not do.