Okay, turns out it's actually really easy, I just couldn't read the synopsis of the command. To create a launchd service to fire, for example, "mkdir /usr/local/test", you just need to submit a service like this:
launchctl submit -l my-startup-program mkdir /usr/local/test
And you can remove it like this:
launchctl remove my-startup-program