I had an abscess under a tooth many years ago, and the only thing that helped the pain was to chew ice and pack the resulting slush in between the gums and cheek where that tooth was.

It wouldn’t do anything for a minute, then suddenly the pain would just turn off. It was great.