Its a fairly well known fact that one of the hardest parts of developing a good game is balancing, especially with a small dev team, there is only so much time you can spend play-testing every possible permutation of game mechanics and player interactions, especially with a game that is complex and has a large degree of configuration options.
The most useful thing that we, the community can do to help the development of the game is to give lots of feedback, and test lots of different things, and say what works, what fails, and what is ludicrously overpowered (and then see how that compares with the devs intent ^^)
When the game moves away form the Corvus sandbox incarnation and into the real campaign, it would be helpful to know what kind of fleets the average player can handle. what AI compositions are weak and easily defeated, and what makes a very well rounded, balanced and deadly fleet, capable of handling any threat.
so you are probably thinking, well what are you trying to involve the community in? Basically, this, build fleets, large fleets, small fleets, Wierd fleets, and see how they do, make up odd variants, and them GIVE THEM TO THE AI. Sit back and watch the fireworks, and then report in. The grand goal if you like, is to find the perfect AI fleet composition, the fleet that performs the best despite the limitations of the software, its almost certainly going to be different to a given players perfect fleet, but then humans play in ways designed to use the AI's flaws against itself, and when an AI is designed to exploit humans for being human... we tend to sulk and call it a broken, stupid, cheating AI ^^. Why would we want to find this ultimate fleet? So we have a "last boss" or achievement challenge for players to work up to that doesn't involve a hard-coded AI advantage or cheese.
Mass testing this kind of thing will probably get a lot of useful data on game balance and if lots of people watch the AI's duke it out might help spot weird AI buggyness and fruitloopery that can be fixed.
On the other hand if you think this may just be a colossal waste of time, let me know ^^