External beta-testing needed?

I'll admit that I am very much enticed by the goodies we've been promised for the upcoming TA expansion. I'm also a bit concerned.

It was stated somewhere in the forum that Stardock will only be testing within Stardock itself -- will that be enough to properly test it? From the look of it, GalCiv2 will be changing radically with the introduction of new tech trees alone, and I for one would like to see that these changes are properly balanced and that the AI uses them adequately. I'm not convinced that Stardock alone will be able to ensure this via an internal beta. I mean, that's a LOT of testing. Having tried my hand at alpha and beta testing, with both computer games and board games, I have some idea of how much work there is involved. Much more, I would imagine, in an extremely complex game like GalCiv2.

At the same time, we have a great community full of very intelligent people, all of whom are devoted to this great game. Just look at how much effort some people have put toward number-crunching and testing new and interesting strategies. Personally, I'd feel much more confident in the radical changes being introduced in TA if people like Wyndstar, Itzok, Mumblefratz, drrider and more were involved with making sure it all made sense in its implementation. Such a beta wouldn't have to be open to everyone -- rather, just handpick the people who would contribute the most cogent testing.

I suppose if Stardock doesn't feel that an external beta is necessary, then I will shut up and trust them to do what they think is right, and I will purchase TA anyway, based on how good DL and DA have been. But still, I can't help being a bit nervous about this...
7,351 views 4 replies
Reply #1 Top
Whacha wanna bet that they are swapping semi-internal beta duties with some of the other indies that are afiliated with them? And some selected players who have been thorough beta testers before?

drrider
Reply #2 Top
Its just kind of a big risk for Stardock to have a broadbased public beta for a retail product. Remember what happened to Valve with Halflife 2, and the delays and redesign it caused.

drrider
Reply #3 Top
Actually, I am not familiar with what happened with Half-Life 2.

In retrospect, it's entirely possible that Stardock is recruiting beta-testers from the forum, and they're under an NDA regarding it. That's what we usually do when playtesting card/boardgames anyway.
Reply #4 Top
Valve lost 6 months on their release date, and had to do a bunch of protective redesign, because someone hacked a copy of advanced alpha source into the wild.

It wasn't a public beta tester, but it made everyone in the game industry very careful with their pre-release for-money stuff.

Also I read somewhere, from the Pres or COO of some big game operation (MS? Blzzard?) that they consider very carefully each time whether they need a public beta vs a selected private beta group. Apparently only about 1 of 7-8 beta downloaders every provides any feedback, and of those, only about half account for 90+% of the well-stated, documented, useful input. From another article, by their own addmission, the real reason that MS indulges in the huge late betas of things like Vista and Office has more to do with marketing and market preparation than it does with software engineering.

drrider