Scott, if it were a blown fuse, you probably would not be getting any power at all
to the window or the switch. It sounds to me like the relay is either going bad, or the power
window motor is wearing out, drawing more current than it was designed for , and
overworking the relay to the point it is making that buzzing noise.
The newer vehicles have a seperate fuse/relay/circuit set up for almost every option
on the vehicle. If everything else electrical is working o.k., I would check out the
entire circuit for the drivers side window, including an "amp draw", on the drivers side
window motor, if you could find someone to do that for you.
Also check the switch for worn contacts, as the drivers window switch is usually the
most used in a vehicle, therefore, more likely to wear out sooner.
Hope this helps.