From what I can see of the picture, surely you can see if there’s an air gap between the contacts when the coil is de-energised?
Be certain to isolate the EVSE before investigating.
I don’t have one of those contactors to look at. The usual arrangement is, when the coil is energised, the moving part - the armature - is pulled downwards against a spring and the moving contacts, which are also pushed down by in their slots in the armature by springs, bridge the gap between the fixed contacts. When the coils is de-energised, the armature should move upwards by (I’m guessing) 4 - 5 mm and there should be an air gap between the fixed and moving contacts. Also, I would expect you to be able to lift the moving contact upwards against the springs, especially when the coil is de-energised.
Here are pictures of a contactor that I expect has a similar contact arrangement - but this is designed to pull the armature up, so the pictures are upside down. The contacts nearest the coil are the normally open ones (like you have). You can clearly see the air gap.
In the second picture, my screwdriver is pressing one side of the moving contacts to show how they are sprung.
