Okay, figured it out.
- In the reminder popup, double click the appointment to open its window.
- Then, in the ribbon, click on "File".
- If it isn't already selected, click "Info".
- Near the "Move to Folder" button, the source calendar is listed next to "Current Folder".