I've pulled a lot of those out of vintage gear where they have failed. New production electrolytics are far superior to the old stock stuff, but it's your amp, so do what makes you happy.
I notice that the case is uninsulated and serves as the negative electrode. Only one of the two caps is grounded, so you will have to take care with mounting to prevent short circuits or accidental contact when measuring voltages!