Haunted Whispers at the Old Center Street Hotel

My wife and I decided to stay at a nice hotel on Center Street after having a good time soaking at Lava Hot Springs. It was a week night and during the off season, so from the cars parked out front and only running into one other guest I would estimate that there were only three rooms reserved that night. I'm not sure exactly what room we stayed in, but it was the one with the fireplace, the standalone bathtub, and the double shower head shower. I highly recommend staying here.

The building is very old, previously being a bank and the upstairs apartments housed female school teachers, I believe.
Anyway, during the night I was woken up to a woman talking. I would listen thinking it was one of the other guests, but I wouldn't hear a sound. Again later that night I was woken up to a woman's faint voice. Again I would try to listen and wouldn't hear anything. It was enough to get my attention, but not enough to definitely say I heard something. I got up to use the restroom, and when I came out I could smell a flowery type perfume.

The next morning I told my wife my experience. She actually brought up that she smelled the perfume by the bedside before I mentioned it. She also heard voices. I went downstairs to get some hot cocoa and found the entire building was empty. All the cars parked out front were gone, and the desk person didn't come in till noon. I wouldn't say the place is haunted, but I would say it still holds some residual energy. Just enough to tickle your senses with voices and smells from the building's past.