When there is default image or one that is uploaded for Vector or Image Placeholder fields, the button should be only a single one to Remove the current one or Select one if none exists.

In the case of a default image/vector, there shouldn't be a Remove button at all as you'd select a new one, right?