The placement of your spare ammo does matter. The TU cost of reloading is increased by the cost of moving ammunition to your hand (as much as 20 if it's in your backpack). You will avoid paying extra TUs only if the spare ammo is in your free hand.