will be packed but if you res ahead..
Also, getting in and out of the area can be a bear. Your choices are to park near the football stadium and walk in.. maybe half a mile, or you can park downtown and take free/very cheap bus shuttles which I would recommend unless you are springing for a limo. Finally, if you want to come really early, every resident for 10 blocks around the track will let you park on in their front yard for $20 bucks, but again the traffic out is gridlock after the Derby.
The buses have secure routes in and out and it will be the least headache of any way to get there and get out of the madness.
Also, if you can get your bets down early in the day, you will lower your stress level significantly, the betting lines will get more and more packed as the card goes on, add about 200,000 mint julips... you can spend a lot of time in line to the windows
Have a great time.
I/L