Hey guys I'm back. Things got pretty interesting this past week, initially the water pump pulley was not spinning smoothy and there was a grinding sound when turning the pulley.
I replaced the water pump then drove the car the around for a bit and everything seemed fine. No humming noise when driving or stepping on the gas pedal. But at lower speeds, 30-45 mph the humming sound came back. I checked the pulleys all over again and the alternator pulley started making a low grinding noise even though it turns smoothly. You can't really tell its grinding until you spin continuously and that's when you hear it.
Took the alternator in to advance auto parts and the bearings were wearing out. Waiting on a replacement alternator to come in. Will update soon.