Flash-based devices as cold storage is a bad idea.

can I remove the beep speaker from apc easy ups?

Just cover its hole with some sticker/duct tape, this can almost completely mute it.