Hi, Welcome to the forum.
I would take a 7XL or an 8xl for slightly better runtime on 14 cells and leave the 2 speed transmission in tact, but please get the heavy duty 2nd speed. (it comes standard with the K4,6) the stock 2nd speed won't live long.
about the diffs. You need to get an FLM bulkless or GPM/dynamite aluminum diffhousings (not the cups, the cups you want for a bulletproof drivetrain are the Hotbodies C8019, and you can use them with the 8x16 bearing that also fits your wheels.
I have got some old pride/glory, i made the plate from 10mm thick aluminum;
What a beauty it was.. Something i need to make as soon as i get me new toy...
here is a helpful calculator to do some gearing math.
whatever you do, you really don't want to run the 4 AA cells. Get something proper.. a 5cells humppack of nimh cells would do (GP1100 or something like that) you don't necessarily need the Ubec.