Challenge #2 Public Voting Now Open

[Jeff Mottle]

Sorry for the delay.

 

http://www.cgarchitect.com/challenge/voting/main.asp?action=selectvote&curpoll=20

[Continuumx]

Jeff,

 

I thank you for making this happen.

 

Could you explain the weight of the public vote?

 

I would rather trust the weight of the judges comments/ranking as I think their scores were more aligned with what was actually presented in Challenge 1.

 

Some people never really posted a WIP and for some reason are leading by leaps and bounds in the public vote. Very strange.

 

I am sorry to post in this manner, but at the moment, and definitely as a result of the public voting from challenge 1, it is very clear the intention of the desired "winners" in this competition.

 

I ask at the very least the guidelines and the objectives of what these images are being judged upon be added to the voting information before people start voting.

 

-Tyrone Marshall

[BrianKitts]

Jeff..... just a note of appreciation, the new public voting setup rocks. With the first round it was hard to evaluate all the images against each other online. I ended up printing a sheet with all the thumbnails, then filling out the slots online....and then you hit submit and find out you have two number ones! And have to shift all the numbers.....

 

Anyways props to ya, this was a great new setup for public voting in my opinion!

[DelfoZ]

maybe is just me, but i think the competitors need to be unable to submit votes.

i hope i can explain my self.

1OLIVIER CAMPAGNE (oliviercampagne)25-169-6.76

25 votes and 6.7 that mean in the extreme case ( ten people put him 10 and fifteen put him 4 ) . i dont know as well but i think the competitors ( not all of curse) vote for him imagen qith 10 and the rest 0-5.

 

is just my opinion

 

or maybe the people dont know they can submit same score to diferrent images

Good luck 2 all.

[Continuumx]

maybe is just me, but i think the competitors need to be unable to submit votes.

i hope i can explain my self.

1OLIVIER CAMPAGNE (oliviercampagne)25-169-6.76

25 votes and 6.7 that mean in the extreme case ( ten people put him 10 and fifteen put him 4 ) . i dont know as well but i think the competitors ( not all of curse) vote for him imagen qith 10 and the rest 0-5.

 

DelfoZ,

 

I agree on your point, and speaking as one of the competitors, that the competitors should not be allowed to vote. There has to be some distance of some kind. I will refrain from further comments on the entire subject as I am very disappointed by the process at the moment.

[oliviercampagne]

Dear DelfoZ,

 

That's just funny/crasy to read this !

 

because, you know what i did and sincerely did :

I voted and Jeff can even check it (maybe with my login)... anyway...

 

i made a neutral vote to have an idea of the public vote :

5 for everybody INCLUSIVE me . point.

 

kind regards,

Olivier Campagne

[DelfoZ]

Dear DelfoZ,

 

That's just funny/crasy to read this !

 

because, you know what i did and sincerely did :

I voted and Jeff can even check it (maybe with my login)... anyway...

 

i made a neutral vote to have an idea of the public vote :

5 for everybody INCLUSIVE me . point.

 

kind regards,

Olivier Campagne

 

I just pick a random competitor to make my maths. sorry if i offend u.

btw, english is not my lenguaje, im not trying to be hard with any .

 

[oliviercampagne]

OK !!! thousands of sorry to DelfoZ !!!!!

i know what you mean ... sorry .. react to fast !!

 

 

but at least, now everybody know how i voted

 

 

 

again sorry

kind regards,

Olivier Campagne

[Continuumx]

Deleted....

[Newke]

Good idea Olivier, a good way to view the scores without voting

[Jeff Mottle]

Could you explain the weight of the public vote?

 

Let me explain the entire voting process so that there will be no confusion in the future.

 

There are 5 full times judges, 1 guest judge for each challenge and then the public vote. All 6 of the judges have a score card to evaluate all of the criteria set out in the challenge description. They score each category from 1-10. Then each category is weighted based upon a number to determine that category's importance in the overall challenge. Once all of the judges scores are gathered they are averaged to get a final judges score.

 

For the public vote I take the final public vote rank and assign a evenly distributed score up to a maximum of 100. That final score is then added to the averaged judges score to get the final score for each competitor.

 

As you can see the final score is heavily weighted to the judges score, but the public vote ensures there are no ties.

[Jeff Mottle]

maybe is just me, but i think the competitors need to be unable to submit votes.

i hope i can explain my self.

1OLIVIER CAMPAGNE (oliviercampagne)25-169-6.76

25 votes and 6.7 that mean in the extreme case ( ten people put him 10 and fifteen put him 4 ) . i dont know as well but i think the competitors ( not all of curse) vote for him imagen qith 10 and the rest 0-5.

 

is just my opinion

 

or maybe the people dont know they can submit same score to diferrent images

Good luck 2 all.

 

We typically get 100 to 200 votes in public votes so I see no reason that competitors can not vote for themselves or others in the competition. By the time you factor in one vote out of 200 and then weighted with the judges, you are probably talking about less than 1 point in the total score.

[Continuumx]

Let me explain the entire voting process so that there will be no confusion in the future.

 

There are 5 full times judges, 1 guest judge for each challenge and then the public vote. All 6 of the judges have a score card to evaluate all of the criteria set out in the challenge description. They score each category from 1-10. Then each category is weighted based upon a number to determine that category's importance in the overall challenge. Once all of the judges scores are gathered they are averaged to get a final judges score.

 

For the public vote I take the final public vote rank and assign a evenly distributed score up to a maximum of 100. That final score is then added to the averaged judges score to get the final score for each competitor.

 

As you can see the final score is heavily weighted to the judges score, but the public vote ensures there are no ties.

 

 

Hello Jeff,

 

I appreciate your explanation as well as respect the hard work, organization, and time you have put into this community and the competition. I am satified with the well thought out and defined manner that you have applied to the issue.

[Jeff Mottle]

I should also mention that Arnold Gallardo will be the guest judge for this challenge. You can read his bio in the judges section, but suffice it to say he is very knowledgeble in many areas, including Photography, Broadcast Video and CG. He has litterally written the book on 3D lighting techniques. http://www.amazon.com/exec/obidos/tg/detail/-/1584500387/qid=1114817073/sr=8-1/ref=sr_8_xs_ap_i1_xgl14/102-1702267-8608954?v=glance&s=books&n=507846

[Tim Nelson]

What I don't understand is this category "Voted By(No of user)". What exactly does that mean? Shouldn't there be an equal number of votes since you have to rank each one in order to complete the judging?

 

In theory, since you say there are maybe 200 votes, don't you think it would be rather easy to tell enough of your friends to register & vote to give yourself a higher ranking, or even do it yourself? Hey I could be #1 if I really wanted to, right? To me this could easily be biased, corrupted, or however you want to put it. Then again, I probably wouldn't care so much if I wasn't almost in last place! Anyways, I ended up just voting 5's for myself & everyone since I couldn't really do it fairly any other way. My natural inclination would have been to vote myself a 10 and then the really good ones a 1, but then that wouldn't have been very nice would it.

 

Either way, I think the best renderer will still end up on top, so I'm sure everything will work out just fine. When I looked at all the final entries in the voting section, I realized how great of a job everyone has done. Bravo!

[Jeff Mottle]

What I don't understand is this category "Voted By(No of user)". What exactly does that mean? Shouldn't there be an equal number of votes since you have to rank each one in order to complete the judging?

 

That is the number of people who have voted. If they are uneven, it is becuase that person did not fully complete the voting. This happens even in the long detailed surveys I have done in the past. People are interupted and have to come back, but some don't always. The system is set up such that if you did not complete the survey you can come back to complete it. It is still averaged, so it still works out the same anyway.

 

In theory, since you say there are maybe 200 votes, don't you think it would be rather easy to tell enough of your friends to register & vote to give yourself a higher ranking, or even do it yourself?

 

Yes you could and really there is no way to prevent this. This is something that occurs in all online votings systems, and for that matter probably presidential elections. This is also one of the reasons that the public vote is not weighted the same as the judge's votes.

 

Either way, I think the best renderer will still end up on top, so I'm sure everything will work out just fine. When I looked at all the final entries in the voting section, I realized how great of a job everyone has done. Bravo!

 

Usually this is the case. In fact to lessen the burden on the judges, I am considering for next year using this system to allow the public to choose the final 30 rather than the judges. Why you might ask? So far the public votes have usually been very close to the judges own selections. If I offer up a nice door prize for voting, it is likely there will be ALOT of votes, which will almost surely mean a very accurate selection, probably even more so than the more biased and smaller sample group of judges.