Definitely not normal nor expected. Do you wash it in any sport specific washing gel or powder? There are such detergents that are designed for the sport clothes that are often washed at lower temperatures (90° would be good against the fungus but would damage the clothes). Some are even manufactured by brands connected with disinfection, rather than laundry (e.g. Sanytol).
Try to have multiple pairs so that you can wash them thoroughly and let dry fully. Try antibacterial chamois cream, but it may not be effective against fungi. There are antifungal preparates that you can use to disinfect your shorts (other than during washing). Some are based on hydrogen peroxide, that could also damage the fabric. Better test on a small spot first.
I used to use normal shorts for a long time, but they are simply not that comfortable. It is a personal choice though, no one can force it into padded lycra. Bad padding can be worse than no padding (by rubbing the inner thighs, for example).