On the BitTorrent Mac app their is an option to disconnect folders from synching across the network, hover over the folder you want to remove and to the very right there is a ... icon. Click on that and there is an option that says Disconnect. Here's a screenshot:
But to delete/remove individual files you should just be able to delete them from the folder and the changes will sync across the network.