Alright guys, so click the link here to take a look at the Survey Results:
Survey Results
First off I'd like to thanks everyone for participating. We got over 300 respondents which is cool.
I haven't done a whole lot of analysis yet, but here are some interesting facts I've looked at/know:
A) Do most non-OU players play other tiers/metagames because of a grievance with OU?
9.Did you choose your primary metagame in-part because of a grievance with the current OU?
The results are
not statistically significant. I ran a chi squared analysis (null hypothesis Yes = No in population), and I only came out with a p-value of .3 (.2 earlier in the survey, got less significant later).
So while more people cited that they had a grievance with OU as a reason to play other tiers, there's no way to prove these answers are not a result of normal variation.
You can't say statistical certainty that most non-OU players play their tiers because of a grievance with OU
This is further supported in that question 10:
A-b) Does the popularity of other tiers reflect poorly on OU?
10.Please tell me if you agree with the following statement:"OU should be made to be the ideal metagame. If other metagames are greatly popular, it reflects poorly on the design of OU."
There is no statistically significant consensus about whether other metagames being popular reflects poorly on OU. Generally though, it looks like people disagree with the idea that other tiers being popular means OU is a bad tier.
I did a cross tab with question 4, and the Agree v. Disagree is ratio is
close to uniform across every tier.
VGC is the only metagame who has more Agree than disagree. It's hard to conclude ANYTHING about VGC though, considering barely any VGC primary players took the survey. lol
B) "ADV is the best gen ever~" Do most players who have ADV experience prefer ADV over other tiers?
Turns out no.
I did a cross tab between questions 4 and 5, and while 77 players indicated that they have ADV experience,
less than half of them indicated that ADV was their favorite gen.
Out of 77 respondents with ADV experience, their favorite OU were:
RBY 1
GSC 5
ADV 32
DPPt 36
BW 3
So not only was ADV not picked by a majority of ADV players, but ADV was not even the most popular gen, with DPPt having the most votes.
This is especially noteworthy alongside
C) DPPt, BEST GEN EVER???
Out of 178 respondents with DPPt experience who answered question 4, 116 (65%) indicated DPPt as their favorite gen OU. Furthermore, DPPt got
the most votes in question 5
5.Which generation did you consider to have the best OU?
(Note, question 5 was only asked to players who have experience in more than 1 gen's OU)
With 119 votes (3 players with no DPPt experience indicated DPPt as the best OU gen, lol), DPPt got 62% of the votes in question 5 (2nd place goes to ADV at 22%).
Yes, a lot more players have DPPt experience than ADV in this survey, but I think the fact that DPPt is more popular than ADV
even amongst ADV players and the fact that DPPt got almost 3 times the votes of DPPt in the question 5 vote (far surpassing the percent difference in players with ADV v. DPPt experience) speaks a lot of DPPt's popularity.
I find this particularly interesting because during DPPt, people constantly bitched about DPPt being too "out of control" offensive. People constantly indicated that DPPt was too fast paced, and ADV had a better balance. Maybe BW has changed people's perceptions of what "out of control" offensive really is. lol
Edit:
D) People want a more offensive metagame
15.On a scale of 1 to 10, where 10 is "Extremely Offensive" (where Heavy Offense is the primary style) and 1 is "Extremely Stall-Based" (where Full/Traditional Stall is the primary style), how offensive would your ideal metagame be?
So I ran some hypothesis testing and got the following:
5.000 hypothesized value
6.354 mean Data
1.423 std. dev.
0.091 std. error
246 n
245 df
14.918 t
1.53E-36 p-value (one-tailed, upper)
Null Hypothesis: M = 5
Basically the odds of getting a mean of 6.35 from a population with a mean of 5 or less is 1.53E-36
Put plainly,
The odds of getting a mean of 6.35 (slightly offensive metagame) from a population that actually wants 5 (neutral) or stally (less than 5) metagame is extremely low. It's far less than 5% (2 standard deviations).
There is a bunch of other stuff I wanted to look into but haven't gotten into yet. In the mean time feel free to scrounge through the data yourself guys. Have fun. :)