Looks like a really cool setup. Yes, using motor brakes = more heat. About the cogging, I'm not sure. I'd think you could tame it. Have you messed with the MM settings at all ? Perhaps try increasing the timing and start power. I think with higher pole count you will need the increase in timing. Not sure if start power will have any effect on your situation, but it could.

J>