Voting Results

  1. The Trustee(s) will manage the process of:
    1. Determining the Voting Results.
    2. Maintaining the confidentiality of Voting Results.
    3. Preparing Voting Results for Audit and Certification.
  2. When the last Critic has voted, and after the Proctor(s) has closed the Awards Voting, the Trustee(s) will download and interpret the Voting Results in the manner prescribed in the Cappies Information Services (CIS) Voting Procedures.
  3. CIS has been developed to provide the ultimate in fairness among critics, the number of shows they have seen, and the awards points they have earned from writing reviews and having these reviews published. It also provides the ultimate in fairness to schools no matter how many critics were in attendance at the Cappies Show.
    1. Critics only vote for the shows that they have seen and reviewed.
    2. Critics are not allowed to vote in categories for which they are nominated.
    3. Critics earn voting points for every show they have reviewed and for every review published
    4. C.I.S. equalizes attendance across all shows using the mathematical formulas described below.
  4. Performance and Technical Categories. First, overall rankings of categories are built in to CIS. This category ranking ensures that:
    1. A student actor is awarded a Cappie in the highest Acting Award Category for which s/he has been nominated and is the top scoring actor as determined by the critics.
    2. A student actor not awarded a Cappie, will retain his/her nomination in the highest acting award category for which s/he is nominated.
    3. A student actor is dropped from additional lesser acting categories in which s/he might have also been nominated. This calculation provides the most opportunities for the most student actors in other Categories.
    4. A student tech is awarded a Cappie in the highest Technical Award Category for which s/he has been nominated and is the top scoring tech student as determined by the critics.
    5. A student tech not awarded a Cappie, will retain his/her nomination in the highest technical award category for which s/he is nominated.
    6. A student tech is dropped from additional lesser Technical Categories in which they might have also been nominated. This calculation provides the most opportunities for the most student techs in other Categories
    7. Category rankings are described in the following chart. Each subset is determined individually for fairness.

        1. STANDARD CAPPIES CATEGORIES RANKING CHART

          Technical Categories
          		Performing Categories
          		Overall


          		Special Categories
          PlayMusicalPlayMusicalPlayMusicalPlayMusical
          Stage CrewEnsemble
          		SongCreativity
          Stage Management
          		 PlayMusical
          ChoreographyLead Actor in a Male/Female Role

          		OrchestraSupporting Actor in a Male/Female Role
          SetsSetsComic Actor in a Male/Female Role
          Costumes

          Vocalist in a Male/Female Role

          LightingDancer in a Male/Female Role
          PropsFeatured Actor in a Male/Female Role
          Sound
           Hair and Make-up
           Special Effects and or Technology
           Marketing and Publicity

           

    8. Second, within each Category, four calculations described below will first determine the winner of the Cappie, and then the additional nominees. Each of these calculations reveals an important aspect of Critic opinion while providing a check-and-balance against the other calculations, in order to provide fairness and integrity to the result. For each Category decided by Awards Voting, C.I.S. will digitally apply the following Rules:
      1. Average Evaluation Score: Each Candidate will receive an Average Evaluation Score based on the Evaluation Scores given by all Critics who evaluated the Candidate. This calculation averages the familiar Cappies scoring range of 1 (poor) to 10 (professional quality). The Critics base these scores on their post-evaluation scores given to each candidate on show day, but on voting day Critics are able edit their original scores, raise or lower them, based on their best knowledge of the entire season.
      2. Nomination Score: For each show that a Critic has seen they are assigned five Nomination Points. (Example: A Critic sees 10 shows and thereby accumulates 50 Nomination Points). A critic then determines among all Candidates in all categories the Candidates they believe are deserving of a Cappie nomination. A Critic must assign all of their Nomination Points and cannot give any Candidate more than one Nomination Point. Nomination Scores for each Candidate are calculated as fractions by C.I.S., based on the following:
        1. The total number of Nomination Points the Candidate received from voting Critics in the numerator, and the number of Critics who evaluated the Candidate in the denominator.
        2. (Example: A candidate who was seen by 20 Critics and receives 8 Nomination Points will have a Nomination Score of 0.40.)
      3. Awards Score: For each show that a Critic has seen they are assigned one Award Point. (Example: A Critic sees 10 shows and thereby accumulates 10 Award Points). A critic then determines among all Candidates in all categories the Candidates they believe are deserving of a Cappie Award. A Critic must assign all of their Award Points and cannot give any Candidate more than one Award Point. Awards Scores for each Candidate are calculated as fractions by C.I.S., based on the following:
        1. The number of Award Points the Candidate received from voting Critics in the numerator, and the number of Critics who evaluated the Candidate in the denominator.
        2. (Example: A candidate who was seen by 20 Critics and receives 2 Award Points will have an Award Score of 0.10.)
      4. Tie-breaks: In effect, the C.I.S. takes a vote among all Critics who evaluated both of the Candidates in question.
    9. To select the Cappie Winner and first Nominee in each category, C.I.S. applies these four calculations in the following ways:
      1. If one candidate has the highest Evaluation Score and Award Score, s/he is the winner.
      2. If one candidate has the highest Evaluation Score and is tied with another candidate for the highest Award Score, s/he is the winner.  Likewise, if a candidate has the highest Award Score and is tied for the highest Evaluation Score, s/he is the winner.
      3. If one Candidate receives the highest Average Evaluation Score and another Candidate the highest awards point score, the C.I.S. program checks Tie-break rankings. The Candidate who received the higher scores among Critics who saw both Candidates receives the Cappie Award.
        1. If Tie-breaks are unavailable or evenly split, the Award will go to the Candidate with the higher Nomination Point Score.
        2. If the decision is not resolved by the above criteria, the Award will go to the Candidate with the higher Award Point Score.
        3. If the decision is not resolved by the above criteria, the Award will go to the Candidate with the higher Average Evaluation Score.
        4. If the decision is not resolved by the above criteria, both Candidates will receive an Award.
      4. After the winner(s) is determined, C.I.S. then determines the nominees.  The winner(s) is a nominee.  The remaining list of candidates is then sorted in two different orders, by the Evaluation Score and by the Nomination Score. C.I.S employs the following rules until the desired number of nominees is reached:
        1. If the same candidate is at the top of both lists, he is a nominee.
        2. If there are different candidates at the top of the lists, and there are at least 2 spots left for nominees, both become nominees.
        3. If there are different candidates at the top of the lists, and only one spot remains:
          1. C.I.S. first checks the tie-break rankings.  If a plurality of critics preferred one candidate over another, that candidate is the nominee.
          2. If Tie-breaks are unavailable or evenly split, the Nomination will go to the Candidate with the higher Award Point Score.
          3. If the decision is not resolved by the above criteria, the Nomination will go to the Candidate with the higher Nomination Point Score.
          4. If the decision is not resolved by the above criteria, the Nomination will go to the Candidate with the higher Average Evaluation Score.
          5. If the decision is not resolved by the above criteria, both Candidates will receive an Award.
            NOTE: In section 10, c-3 and 4 were erroneously reversed. The above is now correct.
  5. Critics Awards
    1. Critic. All individual Critic Awards are determined by an objective score given all Critics who submitted the required minimum number of Reviews and participated in Awards Voting. Each Critic's score is based on:
      1. 50 percent – on the number of qualifying reviews written.
      2. 50 percent – the number of reviews published (for top media and all media.
      3. Here is how C.I.S. normalizes this information among all critics.
        1. For the critic rankings, each Region' Steering Committee selects how many critics are used to weight the scores (this is the first field on the "Current Critic Rankings" page on C.I.S).  Call this number N.
        2. Each critic has a quantity-score (total number of reviews written) and a quality-score (sum of all points received for publishing reviews).  C.I.S. then calculates a quantity-basis which equals the average of the top N quantity-scores, and a quality-basis which equals the average of the top N quality-scores.  Then, for any given critic, their overall score equals ((quality-score / quality-basis) + (quantity-score / quantity-basis))/2.
      4. Ties are resolved by the average ranking of a Critic's selected reviews for publication (As a percentage of all qualifying reviews written)
      5. Awards granted to Critics can be determined by Region.
        1. Gender (Female and Male Critic), or
        2. Year in School, as:
          1. Two Awards: "Graduating Critic" (for those in, or recently having completed, the 12th grade), and "Rising Critic" (9th through 11th grades).
          2. Three Awards: "Graduating Critic," "Returning Critic," and "Underclass Critic" (9th and 10th grades), or
          3. Four Awards: "Graduating Critic" (12th grade), "Junior Critic" (11th grade), "Sophomore Critic" (10th grade), and "Freshman Critic" (9th grade)
    2. Critics Team. This award is based on the performance of the six highest-scoring Critics from a Participating School, including Regional Team Critics. To be eligible for inclusion:
      1. Each Critic of the Critics Team must have reviewed the required minimum number of shows and participated in Awards Voting
      2. The top six scoring Critics for each Participating School will be determined using the method described for individual Critic above, except a critic team's quality and quantity scores are the sum of each over the top K critics, where K is also chosen by the Region's Steering Committee.
      3. Ties will be resolved by comparing the scores of the highest-scoring individual Critics, and (if necessary) the next highest-scoring Critics, until a determination can be made.
    3. Voting Results for all except the Critics Categories will be displayed on the C.I.S. Trustee Awards Voting site.
    4. For Critics Categories, the Trustee will consult with the Program Director.
      1. The Program Director will determine Awards and Nominations by applying the Rules to the Critics data on C.I.S. as described above.
      2. For the Critics Team award, the Trustee will identify the six highest-scoring Critics from that Participating School, including any who may have been assigned to a Regional Team, who will be named as Nominees.
  6. Trustee(s)
    1. The Trustee will review the names of all Nominees in tech (non-performing) Categories to identify any individual's name that appears twice.
    2. The Trustee will search for and identify any Nominee whose name may have been spelled differently on different ballots, and will correct this misspelling, and recalculate results.
    3. The Trustee will confirm that Award winners and Nominees do not receive multiple Awards and/or Nominations, except as allowed under the Rules for Award eligibility.
    4. Within 24 hours after the final Critic has voted:
      1. The Trustee(s) will determine the Critics Nominations and Awards, pending certification by the Auditor.
      2. The Trustee(s) will confirm those results with the Director (or designee).
    5. Within 48 hours after the last Critic has voted, the Trustee(s) will present the results to the Auditor.
    6. Prior to public announcement of Nominees on the Program Pages of the Web Site, the Trustee(s) will confirm the accuracy of nominee lists to be posted on the www.cappies.com Web Site or distributed to Participating Media.
    7. Prior to the presentation of Awards at a Gala or Ceremony, the Trustee(s) will confirm the accuracy of the Award envelopes, and of any lists of Award Winners for post-Gala distribution to the media.
  7. Auditor(s): The Auditor will conduct an Audit and Certification of the Voting Results.
    1. During the Audit, an Auditor will learn Award Voting Rules, including decision Rules for all Nominations and Awards, to the extent necessary to conduct an audit.
    2. The Auditor will evaluate the initial results in the presence of the Trustee(s), who will advise the Auditor of the applicable Rules and C.I.S. Voting Procedures.
    3. The Auditor will certify the results as accurate, absent of irregularities, and consistent with the Rules and C.I.S. Voting Procedures, or
    4. Postpone Certification, pending immediate consultation with, and guidance from, the Director or his designee.
    5. The Director will confirm that the Rules have been applied correctly, or will determine what changes will be made in the Nominations and Awards.
    6. After the Director's decisions have been applied, the Auditor will certify the results.
    7. The auditor(s) used at the end of voting must be independent from Cappies, Inc. and each chapter's votes MUST be audited and then communicated to Cappies Inc. before release to press, schools, students, etc.
    8. Any difference between initial, revised, and final Voting Results, and the process by which Voting Results are certified, including any rejection of Critic Ballots, will remain confidential.
    9. Within 24 hours after the results are certified, the Trustee(s) will forward the results to the Webmaster.
  8. Awards Voting Appeals. Any person may appeal any results of Awards Voting. The appeal will be made to the Steering Committee.
    1. For any appeal involving Nominations, the appeal will be made, in an email to the Program Chair, not later than 3 days after Nominations are announced.
    2. For any appeal involving Awards, the appeal will be made, in an email to the Program Chair, not later than 7 days after Awards have been announced.
    3. The Program Chair will immediately notify the Steering Committee Chair that an appeal has been made.
    4. A person making an appeal may not see, or authorize any person not on the Steering Committee to see, the results of Awards Voting.
    5. In case of an appeal, the Steering Committee will:
      1. Review the results to identify whether the Rules have been correctly applied.
      2. Maintain confidentiality of Awards Voting, by limiting access to voting results to the Trustee(s), Auditor(s), and Steering Committee members only.
      3. Make a finding, by majority vote, whether the Rules have been correctly applied, and a preliminary decision about whether any changes should be made in the results.
      4. For any appeal involving Nominations, this Steering Committee action will be taken not later than 3 days before Awards are scheduled to be announced.
      5. For any appeal involving Awards, this Steering Committee action will be taken not later than 7 days after the appeal has been made.
      6. Immediately notify the Chair, who will ask the Governing Board to review the finding and preliminary decision of the Steering Committee.
        1. The Governing Board will review the finding of the Steering Committee to confirm that it is correct.
        2. By a two-thirds vote, the Governing Board may overturn the preliminary decision of the Steering Committee.
        3. For any appeal involving Nominations, the Governing Board decision will be made not later than 24 hours before Awards are scheduled to be announced.
    6. For any appeal involving Awards, the Governing Board decision will be made not later than 7 days after the appeal has been made.The decision of the Governing Board is final, and is not appealable.


  • No labels