Technically, no. Just like you can't open a box that doesn't have a lid, you can't remove a baptism that hasn't been performed. But, like all good religious doctrine, there is a loophole.
If a debaptism is performed on a person that has not been baptized, it will create a sort of "baptism debt". In mathematical terms, an unbaptized person would have a baptism state of 0. If that person was debaptized, they would become -1 baptized. It would require 2 baptism to then equal a baptism state of 1.
This is why we may perform debaptisms on people who have never been baptised.