We saw some great discussion after our first post about our Exhibition and Evaluation principles. Time for the next two. We can’t wait to get your feedback!

Principle 3

Flexibility. Our exhibition and evaluation system will be designed to work at a wide range of events: from small local exhibitions to large international ones.

Principle 4

Evaluation against a standard. Models that are submitted for evaluation will be evaluated against an established standard specific to that model’s genre. Standards will include scoring rubrics and clear word pictures developed by modellers with expertise in each genre. Only criteria specifically described in a genre’s standard will be used in evaluation. Evaluation standards are living documents and will be reviewed and updated regularly as needed.


13 responses to “Exhibition & Evaluation Principles Part 2”

  1. Kevin Kelly Avatar
    Kevin Kelly

    Pictures would certainly work too, and it would certainly make it easier on the organization process. It could even be optional, as in “provide photos if you would like visual feedback”

  2. Kevin Kelly Avatar
    Kevin Kelly

    I had been thinking about a method to give feedback to modelers for about a year. I was inspired by the Paxcon sticky notes, but thought it was a little thin since the modeler doesn’t know exactly where the evaluator is referring.
    It made me think of some of the diagrams I had used in accidents and assaults on Police reports I used to use to indicate damage and injuries. In policing we used a simple front reader humanoid figure, and a four position line drawing of a vehicle (top down, passenger and drivers side, front and rear). We could circle, or put a small “X” on the affected area so it was easy to reconcile the written report.
    After hearing about the sticky note, I was contemplating using a rudimentary half sheet of paper with a line drawing specific to subject matter (airplane, AFV, ship, car, etc…) but never followed up on it as my local club and show are entrenched in IPMS, 123 judging and I was politely told they were not interested.
    There are plenty of open source line drawings available, and who knows, maybe some publishers like detail and scale and David Doyle books would let us use their line drawings. Literally one general example for the whole genre like a B-25 for aircraft, a Sherman for tanks, etc…
    However, with the interest in electronic processing, it would be cool to have multiple types of subjects available by selecting with a fingertip on a touch screen. The evaluator could simply select the most applicable, not necessarily the exact subject modelled (I used two LL’s, lol).
    This is just a pipe dream idea concerning the electronic format. I am not capable of any type of programming, and don’t even know if it’s possible. I just think it would be cool to check “seam”, and circle or tap an area on the top of a fuselage with your finger, and bingo. Self explanatory, and immediately apparent feedback.

    My second suggestion/concern is that it might be tough for small or new chapters to hold an event, or adopt the evaluation process if they are required to purchase electronics or software, and a paper alternative for start ups be available. It would also be good to have as a back up should Murphy show up and kill the Wi-Fi , short out your tablets, or be hacked by China.

    Both of these are just thoughts and suggestions, with the sole motivation being to help the process. I have zero ego in them, and you can feel free to say thanks, but no thanks, it won’t work, or we just don’t like it. No biggie, and keep on fighting the good fight.

    1. Bruce Worrall Avatar

      Hi Kevin. Thanks for the suggestions.
      I really like the diagram idea in principle. It would definitely help the judges be clear about communicating what they’re seeing. Instead of drawings, what about photos of the model itself? If modellers had to submit a few digital photos of their model with the entry form (say front, sides, back, top?) then a tool allowing the Judge to draw an arrow or circle on the photo to correspond with a comment might do the trick?
      For your point about small chapters, we’re all about empowering local clubs to put on shows and conduct local outreach. We haven’t settled yet on whether or not clubs would have to pay to use the Exhibition tools… more to follow. In terms of a backup in the event of loss of internet, we will likely need to have have some sort of paper/local Excel file alternative to use if the system goes down.

  3. Paul Pendleton-Brown Avatar
    Paul Pendleton-Brown

    Main thing from my side is not to use the term judging or judges and use evaluators…

    Gives a less authoritarian impression and those evaluating can use a broader term of model building skills rather than judging if the correct stores armourment had been used on the modellers build!

    1. Bruce Worrall Avatar

      Hi Paul. We’ve debated whether to use Judge or Evaluator for a while. I agree that Evaluator sounds less imposing… it’s something that we still have to figure out.

  4. Richard Herrington Avatar
    Richard Herrington

    I have judged at AMPS contests in the past. They have a good system, and it works

    1. Bruce Worrall Avatar

      Hi Richard. I like the AMPS system too. We’re definitely borrowing some features from the AMPS system, but choosing some features of other systems as well.

  5. Martin Avatar

    No3: ✅️
    No4: What do you mean by Word Pictures?

    1. Bruce Worrall Avatar

      Hi Martin. A Word Picture i a short sentence that corresponds to a score (1-5) describing a specific quality of the model being evaluated.
      For example, for a criteria describing how well the model’s seams are filled, the Word Pictures might be “Some of the seams are filled” (score of 3), “Most of the seams are filled” (score of 4), or “All of the seams are filled” (score of 5).

  6. Danny Herron Avatar
    Danny Herron

    I think it’s not necessarily the criteria of a kit submitted for evaluation, but the judge. To have an uninformed or ” ignorant” ( in the sense of kit/ model/ figure knowledge) is where IMHO is where the real rub is. In the same sense of having referees for a pro team and they have only done college level. Am I hitting the mark? What say you?

    1. Bruce Worrall Avatar

      Hi Danny. Our proposed Judge training/certification process includes a tiered certification system. A new Judge would initially be trained to evaluate models at the lower skill levels – Junior, Beginner, and Intermediate. After working as a Judge as several shows as a Basic Judge, they could take the next level of training and, if they’re successful, would be able to Jude at the higher skill levels – Advanced and Masters.
      Kind of like moving from College ball to the Pros based on extra training and experience.

  7. Robin Van der Sande Avatar
    Robin Van der Sande

    It sounds like « standards » in this context are pretty close to the notion of « standards » in Total Quality Management, is that right ? By nature such « standards » capture the « state of the art » in executing something, as defined by recognized experts in the domain. When supported by adequate documentation this can strongly contribute to the reduction in overall subjectivity, and also facilitate the work of modelers wanting to compete in that framework. The downside is that standards can stifle innovation, if not used properly, with the right mindset : how will this be taken into account if at all I’d be curious to hear about.

    1. Bruce Worrall Avatar

      Thanks for the feedback Robin. You’re correct that we’re using “standard” to help reduce subjectivity (although we fully acknowledge that subjectivity is an inherent part of evaluating someone else’s creative work).
      At the higher skill levels (which we’re calling “Advanced” and “Masters” we have a criteria called “Artistic Merit”. This will allow us to reward models that innovate and/or have a “Wow factor”.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.