Colonies get an Accessibility bonus/penalty depending on how close to/far away from the Core worlds they are, and Accessibility determines up to how many goods a colony can import/export both in-faction and to outside factions. Distance between player colonies isn't a factor, only distance to the core worlds.