Well after a ton of hours...
I have came to the conclusion that the AddOn folder has a size limit on some of the servers.
First I thought it was the number of maps were limited to 25 but then I swapped around and got up to 26...so that threw that out the window.
However what I did notice is if the AddOn folder was smaller then 600mb all the servers would load normal.
If it went above 600mb that is when the servers said "You can't play because you don't have the map that is being played."
So if anyone knows how to hack this thing or verify what exactly the limit is we will continue to have issues as more and more custom maps come out.
Right now there are 33 custom maps so we have to pick and choose what we want in our AddOn folder...pending on what servers you are wanting to play on.
"You will learn your place my young padawan."