Scenario Testing

[Mr Grumpy]

In the previous thread, I got stuck into the H2H process for approving scenarios. I emphasise That this is NOT a go at those hardy souls who have tried over the years to make it work. Bloody hard to plough the paddock if the mule is dead. I am surprised they managed to turn any sod at all.

Thank you for appreciating the hours of work i put in keeping the H2H area up to date and answering the many emails i receive asking for help and advice. :)

Pertinent points
1. By my count, three CS scens have passed testing since 2007.

Indeed, but this is a CS issue, both CM and OpS areas have had many more scenarios approved over this period.

2. My observation of the site over a long period clearly shows the top designers do not use the H2H system.

You may be correct, i have no idea who the top CS designers are, but we have top designers using the H2H in the other areas.

3. The system demands an absurdly high level of results. I re-emphasise we are testing games, not wonder drugs or rocket ships to land on the Sun.

Well the approval score has not been a issue on the other ladders and i notice mwest recently approved two scenarios in quick time at the CS area without reporting any issues, then again he was prepared to put some leg work in posting for testers and following up feedback, just goes to show how easy the system can work if you put your mind to it.

4. The system rewards testers in a niggardly way. People put a lot of effort into testing FOR THE CLUB....they should be well rewarded.

Well how much testers should be rewarded is a subject that has been discussed many times, testing is supposed to be done for the benefit of the whole community and not for advancement up the ladders, so while the club rewards testers a bonus, it will never be enough for some people.

5. No provision exists for comment as opposed to testing.

Well other ladders use the H2H sub forum for commenting on a scenario without testing it.

6. The program has limited capacity.

I have had no complaints about there not being enough room on the testing page, i have had designers complain they cannot upload new scenarios, when i check the test page i normally find they have already uploaded their quota and despite not having got their existing scenarios through testing they want to upload more, the answer to this is have me remove the 'deadwood' scenarios or get the existing ones tested to make room for the new material.

No point in gobbing on without ideas to fix it.
These are mine: :stir: :soap:
1. Scenarios are acceptable with three scores of 6.66 or greater, two of 7 or greater, or one of 7.5 or greater.

The 8 or more score works just fine, this fact is based on results all over the H2H not just CS.

2. Any test scen scoring 3.33 or less is withdrawn and sent back to the designer's drawing board

Well there has been occasions when for strange reasons testers give good scenarios very low scores, this feature is not needed as a scenario with constant low scores will be removed when i do a spring clean of the H2H areas.

3. Any scen in the program not being tested after three months is withdrawn.

That's a tough one as some very good scenarios go through 'rounds' of testing and there can be periods that a scenario is on the test page while the scenario is updated, under this rule Big Bully would be toast now. I do regular sweeps to clear out deadwood scenarios so they do not become a issue, soon this will be done automatically.

4. The program be open to increasing test slots to meet demand.

No problems reported on this anywhere in the H2H.

5. Members may make a comments only evaluation, which could point out obvious errors or deficiencies.

Not really sure what you mean?

Any member making constructive comments gets 25 bonus points. These need to be a bit more profound than , say, "Rubbish" "Great". OC H2H Coy will decide if comments are worth a bonus.

Any tester who only puts 'Rubbish' or 'Great' in a report will not receive any testing points.

In making these comments bear in mind i oversee the whole of the H2H and not just CS, we are having good success on other ladders along the lines that mwest has done at CS, the system will not test scenarios automatically it requires some legwork from the designer, it is very noticeable that when i see a designer posting for testers, responding quickly to feedback and talking to myself about the best way to make the H2H area work for them, they achieve excellent results, so i base my comments on my experience that the H2H can and does work if you really want it to.

I am the first to acknowledge that the present H2H system is not perfect in many ways and myself along with the site webmaster Raz have given the H2H a complete revamp based on issues raised by designers/testers from all over the H2H, unfortunately this new H2H cannot be launched until we move to the new site, until then i am afraid we will have to make the best of the old version.

Thank you for your feedback, i always welcome players opinions and when i think they raise a good point i make a note of them and make a change, i incorporated 30 such changes into the new H2H, so at least i can not be accused of not listening. :)