Breaking out of the Box

[Big Ivan]

Can a scenario be made without an author? I think it can. In this way your battery (excuse the pun) of testers would not know who made the scenario, therefore there would be honest albeit critical comments regarding the playtesting. 

All new creations would have to go through one person (Test Master) and only that person would make the scenario available to the play testers minus the authors name.

I also suggest a play test group/volunteer group of at least 6 members where you could have the trial scenario being looked at a minimum of 3 times for the first round. Then the second round players would switch up.

Example:  

The play test team (as an example): Big Ivan, Scud, HSL, Hawk, Ashcloud, Josey Wales.

First round play:
Big Ivan & HSL.
Hawk & Josey Wales
Scud & Ashcloud

Second round play:
Big Ivan & Hawk
Scud and HSL
Ashcloud and Josey Wales

etc etc for how many rounds you want to go. But my gut is two rounds is probably enough. That is six critiques for feedback.

After each round players would report their observations to the Test Master who would keep detailed records. When your done with each round (all games) the Test Master would inform the author of the findings. At that point the author could either modify the scenario for play in the second round or let it go another round w/o modification. After two rounds of play there should be enough critique where the scenario should be updated if needed by the author or heaven forbid scraped.

Also the play testers need to get some type of point reward for their efforts a little more lucrative than what is laid down in the H2H section. 

Just throwing this out there to see what people think. The most important thing to me is keeping it manageable and moving along while at the same time giving good honest feedback.