Is it possible to access your AWS S3 bucket via ftp?
No, I don't think this is possible - sorry!
However, there are lots of tools out there for uploading and syncing content to S3 - many of them free and many of them open source.
I tend to use CloudBerry Explorer for my tasks - including the command line interface - but there are lots of alternative products and solutions out there.