Real easy answer: keeping a fridge cool during a very hot summer outside requires a more powerful cooling system. Instead most people have a powerful AC since you want the house cool anyway, with a cheaper fridge cooling system

The reverse is also true. You wouldnt want your fridge to require a heater installed in it to keep your food from freezing in esspecially cold winters