Looks like it was a problem with AVG anti-virus mailscanner
We disabled the mailscanner and the problem disappeared.
We then updated AVG to the latest version (2013) and then re-enabled it, and the problem didn't occur again.
Not sure whether it was the upgrade or the "reset" which solved the problem, but would advise trying that if the question describes your problem.