Ok, this is a pretty big thing here and the cause of a lot of headaches for servers. Most likely the issue is this config option. Here is the formula on how to find out how much bandwidth your server is taking. Min bandwidth and max bandwidth does not matter as much as these four items. My server tool has this built onto the interface already.
In additon MaxPacket size should not exceed MTU of the line you are connecting to. Default internet traffic is 1500 and this line should be below that. Your specifying to send 2048 bits per packet which get stripped to 1500 (the max) since this protocol does not send ack, the systems just error out and fail to get the desired packet. Not all packets will be sent at this and therefore some will actually make it through properly. As the packets get larger you will have more problems as more of the packets fail.
(((Server FPS * NumPlayers) * MaxSizeGuaranteed) * MaxMsgSendText)
@Edd660 your server would consume 29440000 bps with 50 players while running at 50 FPS.
@Karl your server will consume 163840000 bps based on your settings.