Is the pump sitting on sump bottom? You could try putting a pad under it to reduce some noise there. Also how is the return pipe connected? Solid PVC to the tank? Replacing with a very flexible piece somewhere goes a long way to stiffle that low frequency hum that is quite annoying (as it goes through walls quite easily).
A test of how noisy the pump actually is you could disconnect it from the plumbing and simply hold it in a bucket, not touching anything, make sure it's not making much splashing... just to hear what the pump itself is doing.