Wanted to let you know that I've completed the Judge Analysis for Marching, Concert and Sightreading. Here are the links:
CHART
GRAPHS
You may wonder how I got these results and why. First the why - I remember back in the day I'd hear some folks say, "Oh, this judge is biased against 3Cs", or "This person always takes it easy on 5As". Turns out that with a few exceptions we can prove it isn't true - and it is all based on the numbers.
So how did we get the numbers? By comparing a judge's score against the composite - basically when does the judge disagree with the other two? If they don't, their score, what I call the difference is 0. If the judge gives a 2 when the composite 1, that is a -1. If they give a 1 when the composite is a 2? Thats a +1. So add those up, and if a judge sometimes errs on either side, they'll be closer to 0 than anything. But what if a judge disagrees with the composite more than what would be considered usual? Well, if its one way, that balance will be tipped towards negative or positive.
Let's take for example my good friend Darrington White. Below is what my spreadsheet shows for each time he judged 5A Marching.
The first # is his rating. The next is the composite. Then the 3rd # is the difference. Add all those up and he is -2. Divide that -2 by how many bands that he judged in 5A marching (12)and the percentage is -16.67%.
Darrington White 4 3 -1 2016-2017 10 5A V Central Medical Magnet
Darrington White 1 1 0 2016-2017 10 5A V Dayton
Darrington White 2 2 0 2016-2017 10 5A V Livingston
Darrington White 1 1 0 2016-2017 10 5A V Lumberton
Darrington White 1 1 0 2016-2017 10 5A V Nederland
Darrington White 3 3 0 2016-2017 10 5A V Ozen
Darrington White 1 1 0 2016-2017 10 5A V Port Neches - Groves
Darrington White 1 1 0 2016-2017 10 5A V Vidor
Darrington White 1 1 0 2023-2024 1 5A V Amarillo
Darrington White 2 1 -1 2023-2024 1 5A V Caprock
Darrington White 1 1 0 2023-2024 1 5A V Palo Duro
Darrington White 1 1 0 2023-2024 1 5A V Tascosa
So this was done for all judges for all UIL contests. I can hear you now saying, but Tim, some contests don't show their judges on TexasMusicForms or they are split. I only show what is on the TexasMusicForms entry - UNLESS there is a misspelling or I can prove that someone went by another name, i.e. Charlie Munsell = Charles Munsell.
For the charts, you can use filters to see each judge easier, or you can just scroll down. Please note the contest tabs at the bottom.
For the graphs - beware they are VERY tall pictures, you'll probably have to scroll/zoom and that they show the percentages only. I have grouped by being more positive to being more negative.
Feel free to comment here if you have any questions or email me at tim@brynnpark.com. Flame on!
Tim
Responses