How do the connectors look? Over time, the sparking will eat away at the connector and blacken where the spark connects. Could be you just have enough "char" on the connectors right when you plug them in that the resistance allows a relatively slow charge of the caps.
Your caps could be bad too, but you'd probably be able to tell by unstable operation, excessive heat, caps physically puffed, etc.