This depends on the camera in question. While in theory it shouldn't matter, I did come across a switch once that only accepted PoE through a port as long as said port was enabled in the config.
On a general level I would say that yes you can, but exceptions happen. The PoE standard does not dictate a need for the PoE port to actually be in use for communications as well.