News

PGR: Survey Results Analyzed

Thu 2nd Jun 2016 - 8:20pm : Gaming

By Luis "Suar" Suarez, @PG_Suar

The Numbers Game

Following the release of the PGR Top 50, members of the community are starting to wonder more about the inner workings of the system and its occasionally controversial, though objective, results. With 15 regions represented, 48 panelists consulted, and over 35 tabs in a very packed Excel Sheet, there are many conclusions to be drawn from the data that was researched.

Notably, the survey that was given to over 50 people from around the world yields some pretty eye-opening data.

50 names were drawn out for the survey from high placings at the 22 tournaments that were researched. All the usual suspects that either won or placed top 4 at a tournament were immediately noted and written into the survey -- namely ZeRo, Nairo, and Dabuz.

As old tournament brackets were dusted off and we delved deeper and further into top 8, top 16, and top 32, many names started to come about that we were anticipating.

After pruning the list of inactive members, one-time showings, and other outliers, a preliminary Top 50 list was created and sent off to surveyors around the world.

In order to be as inclusive as possible, we reached out to members of the community in every active Smash community that we could find. Whether they were content creators, TOs, or competitors, we wanted the opinions of anyone we could ask. With a majority of the surveyed residing in North America, we made special efforts to contact those in Japan, Mexico, Europe, and Australia.

The instructions were simple: Give a rating on a scale of 1-10 with 1 being the weakest and 10 being the strongest and 0 being a “skip” option. Those who were surveyed that were also on the survey itself were asked to rate themselves at 0. After a 2 week process of sending out the survey and following up with the panelists through many different mediums and languages, we officially closed the survey and started studying the numbers we received.

 

The Results

With nearly 2,400 pieces of data, we organized all of the ratings into a spreadsheet in order to run tests.

One of the first things we did was gather all of the averages of the ratings for each name on the list and then we calculated the associated standard deviations. The standard deviation is a measurement of how differently people voted. The higher the SD, the more people voted all over the place. For example, some people voted MVD very high (10) and others very low (3) so MVD’s ratings have a high standard deviation while almost everyone voted ZeRo at 10 so he has a standard deviation close to 0.

We felt that it was imperative to include this measure since it shows by how much the opinions of the panelists varied on any given name. We found that the most controversial players had the highest SDs, while the shoe-ins, like ZeRo, had extremely low SDs.

The SD shows the difference between all the values and the average that was found for each player. The larger the SD, the greater the variability in the opinions. Conversely, the lowest standard deviations were associated with opinions that did not vary much at all.

 

The Highs

The Mexican Terror, Leo, had the highest SD of any player ranked on the PGR. With a bold 19th finish on the PGR, he also touted a SD of 2.05 and an average rating of 7.9. We figured that such a high variance in his ratings can be attributed to the fact that previous to GOML 2016, Leo had absolutely no North American tournament attendance. However, his rating was so high because many felt that his 1st place dominance of so many tournaments in Mexico for so long had to be reminiscent of a godlike player coupled with the fact that he eliminated the likes of Mr. R and Vinnie.

Following in second, Mr. ConCon had a SD of 1.87 and an average score of 6.67. Given his history-making set win over ZeRo, this SoCal local has garnered much support but also many dissenters. While many pinned it to being a fluke, others recognize that Mr. ConCon is a tournament threat and respect his dedication to Luigi despite the nerfs. Regardless, a lack of a tremendous impact at majors have left many doubting his ability which is reflected in the spread of his ratings.

 

Static Manny’s results landed him with the 3rd highest SD of 1.74 and an average score of 6.86.  A Tampa native, Static Manny won many regionals in Florida and also made a decent appearance in the beginning of the scene, but trailed off towards the beginning of 2016. This, combined with other Sonic mains such as 6WX and Komorikiri taking the spotlight left many of the surveyors skeptical.

 

Many other players that had high SDs, such as iStudying and Nick Riddle, had some sort of high octane situation that brought them to the community airwaves, but either did not follow up and deliver a second showing or left many disappointed by not improving in the way they thought they should.

 

The Lows

As many can imagine, there was only 1 ranking in the entire PGR that was incontestable - number 1. With a SD of .15 and an aggregate score of 9.98, the 48 surveyed overwhelming gave ZeRo a 10/10 with only 1 or 2 opinions dropping down to a 9. Unsurprising, given ZeRo’s historic track record in Smash 4 today.

 

Second to ZeRo is the Japanese threat Abadango. Settling in with a SD of .70 and an average score of 9.17, Abadango definitely set a name for himself in the Western Hemisphere with a 1st place finish at Pound 2016. Even though Abadango has a wild time in Japan along with the other Japanese smashers that place in and out of top 8 at events, Abadango has consistently seized top 8 finishes in American tournaments. The community will never forget his Mewtwo rolling over everyone in McLean, Virginia at Pound 2016.

 

After Abadango, Dabuz had the 3rd lowest SD value. At .74, Dabuz placed 3rd on the PGR with a survey rating of 9.64. Coincidentally, Dabuz has always been the third name to be included in sentences that start out with, “ZeRo, Nairo, and ... “. Consistent in Tristate and always in and around top 8 at nationals and majors, Dabuz has unquestionably always been the next best player after ZeRo and Nairo. Getting consistently eliminated by only the Top 5 but eliminating everyone else has the community placing Dabuz at 3rd in their heads and in the survey.

 

Honorable mentions are Mr. R and ANTi, SDs of .77 and .88 respectively. Surprisingly opinions on ANTi did not vary a considerable amount despite his absence at tournaments where many expect him to be. Mr. R, on the other hand, has been a consistent international threat and his impressive itinerary boasts impressive results worldwide and, thus, high opinions. Also both players being Brawl veterans also draws a level of favorability that others on the list did not always have.

 

Of course, we did not want this survey to be the only metric by which we rank players on the PGR so, instead, we relied on data derived from placings and set counts from the 22 tournaments we researched since Apex 2015.

 

For example, Dabuz was 1 place higher on the survey list than on the objective list and Nairo was 1 spot lower on the survey list from his spot on the objective list. While historically Nairo has always been regarded as the next best player after ZeRo with several tournaments wins and even two sets over ZeRo, which Dabuz does not have, a 49th place finish (Pound 2016) can explain a dramatic amount of panelists not favoring Nairo over Dabuz. Nairo’s survey score was 9.50 and Dabuz’s aforementioned 9.64 trumps it by only .14 -- this bias is important to realize when current events can be related to people’s perceptions of the top players.

 

Thus, the X Factor was perhaps the most important quantitative measure to have come about from the survey since it was able to relate the bias of the panelists to the factual data we found. High X Factors and low X Factors will always tell a different story depending on the player, but it will definitely be something that will stay with the PGR for many iterations to come.






SamuraiPanda

SamuraiPanda

Alan Bunney M.D.

Your Comments

  • Sun 17th Jan 2021 - 2:28pm

    Wow! Such an amazing and helpful post this is. I really really love it. It's so good and so awesome. I am just amazed. I hope that you continue to do your work like this in the future also. fuel cells

  • Sat 16th Jan 2021 - 12:17pm

    I found Hubwit as a transparent s ite, a social hub which is a conglomerate of Buyers and Sellers who are ready to offer online digital consultancy at decent cost. https://www.smore.com/h7r95-quick-extender-pro-review-the-best

  • Fri 15th Jan 2021 - 4:55pm

    This is an excellent post I seen thanks to share it. It is really what I wanted to see hope in future you will continue for sharing such a excellent post. Modules of SAP

  • Fri 15th Jan 2021 - 1:04pm

    Wow! Such an amazing and helpful post this is. I really really love it. It's so good and so awesome. I am just amazed. I hope that you continue to do your work like this in the future also. Viking Gear Pump - Motor Speed

  • Wed 13th Jan 2021 - 12:11pm

    Hello! I merely would want to provide a enormous thumbs up for the great info you have here for this post. I will be coming back to your site to get more soon.cialisoverthecounternorx

  • Wed 13th Jan 2021 - 12:11pm

    Great article, but a frustrating read, due to the lack of proper punctuation in a lot of spots. Please close your quotations! If this article is following some sort of nouveau grammatical style, of which I’m not aware, I remain frustrated; however, I apologize.casinogamesmedia

  • Wed 13th Jan 2021 - 12:11pm

    It’s difficult to acquire knowledgeable individuals about this topic, and you sound like what happens you’re speaking about! Thankshealthlifeservices

  • Wed 13th Jan 2021 - 12:10pm

    You produced some decent points there. I looked on the net to the issue and found most people go together with together with your web site.futurehealthlife

  • Wed 13th Jan 2021 - 12:10pm

    Nice post. I learn some thing much harder on different blogs everyday. It will always be stimulating you just read content from other writers and employ a specific thing at their store. I’d opt to apply certain using the content on my own blog whether you don’t mind. Natually I’ll provide a link on your own web weblog. Many thanks sharing.toponlinegeneral

  • Wed 13th Jan 2021 - 12:09pm

    I’m impressed, I must say. Genuinely rarely can i encounter a blog that’s both educative and entertaining, and without a doubt, you have hit the nail on the head. Your concept is outstanding; the issue is something that too little individuals are speaking intelligently about. My business is very happy i always stumbled across this during my try to find something regarding this.thegeneralinfo

  • Wed 13th Jan 2021 - 12:09pm

    After study a few of the content in your internet site now, and I really such as your means of blogging. I bookmarked it to my bookmark site list and will also be checking back soon. Pls look into my web page likewise and tell me what you think.casinobonuspoker

  • Wed 13th Jan 2021 - 12:09pm

    Spot up for this write-up, I actually feel this excellent website requirements a lot more consideration. I’ll more likely be once again to read considerably more, thank you that information.thetravelerseason

  • Wed 13th Jan 2021 - 12:09pm

    I simply could not go away your site prior to suggesting that I actually enjoyed the standard information an individual supply to your visitors? Is gonna be again continuously in order to check out new poststravelgudier

  • Wed 13th Jan 2021 - 12:08pm

    I simply could not go away your site prior to suggesting that I actually enjoyed the standard information an individual supply to your visitors? Is gonna be again continuously in order to check out new poststravelgudier

  • Wed 13th Jan 2021 - 12:08pm

    Nice post. I learn some thing very complicated on different blogs everyday. Most commonly it is stimulating you just read content off their writers and rehearse a specific thing from their website. I’d would prefer to use some while using content on my small weblog whether or not you do not mind. Natually I’ll provide you with a link on your web weblog. Appreciate your sharing.gettechskill

  • Wed 13th Jan 2021 - 12:08pm

    What a lovely blog. I’ll certainly be back. Please preserve writing!thetechnologyvision

  • Wed 13th Jan 2021 - 12:07pm

    There is noticeably a bundle to learn about this. I assume you made specific nice points in features also.educationisaround

  • Wed 13th Jan 2021 - 12:07pm

    Enjoyed examining this, very good stuff, thanks .theeducationlife

  • Wed 13th Jan 2021 - 12:06pm

    You need to get involved in a tournament for starters of the highest quality blogs on-line. I am going to suggest this web site!itbusinessmind

  • Wed 13th Jan 2021 - 12:06pm

    I will right away grasp your rss as I can not in finding your e-mail subscription hyperlink or e-newsletter service. Do you’ve any? Kindly permit me realize so that I could subscribe. Thanks.bestbusinesscircle

Please register or login to post comments