The door switch could def be going bad but lets do a little more diag first. Does the interior door latch do the same thing? You should also check the wiring in between the door and body of the car. Sometimes wires in there can break. To replace the exterior switch isn’t to bad to replace. My shop did a how to on a window regulator that walks you through the door panel removal if that’s something you want to do yourself.