Some tips on poll writing

TheDragonHermit

Polls are a great tool to convey information on community demographics, in this case often what segments of the community hold what opinions. This can be a powerful means by which we show a rough, perhaps more so than many polling systems due to the sample size, estimate of player opinion, by which the game devs and D3 can make more informed opinions on how to move forward in the game’s development. In light of this I would like to share some tips on poll writing I picked up in my Anthropology classes.

1. Avoid biasing language. This is not always easy since you are likely going into writing the poll with an assumed position and you may not think that the wording you are using might bias the results, but by emphasizing certain points or using more enthusiastic language on one option you may introduce bias. Instead try to keep the same energy throughout all the options and use as nonjudgmental language as you can, even when dealing with options you disagree with.

2. Cover your bases. There are likely a lot of different ways one could answer a poll for a game, even with the most seemingly simple questions. If you do not have an option that suits a person than you have overlooked and disenfranchised them. This can call some of the other responses into question. An “other, please explain your position” option can be a nice catch-all for those but be cautious that that option isn't used too much, this means you did not consider some possible opinions.

3. Be concise. Just say the option, there is no need for flowery language. This is really a part of the first point, but I felt it needed to be emphasized.

4. Keep in mind this will be interpreted by others. Make it so that the opinions represented are easy to interpret and hard to misconstrue, otherwise it may have unintended consequences

5. Make sure it is really something that needs to be a poll. Sometimes it may work out better as a discussion rather than a poll and the information from polling could just become something in the background with minimal meaning.

Hopefully this can help in making more meaningful and impactful polls for D3 and Oktagon to use to improve the game for us.

Sarahschmara

Very well written. Thank you @TheDragonHermit

TheDragonHermit

Polls and their proper use are an important thing to me. The top researcher in my specific anthropology focus got caught with some poor poll writing and assumed results. It was a huge issue among the population she was studying and now she is having a hell of a time getting any research done. I am hoping this paper I am writing based on observation can make it easier for those in this tiny field.
Honestly I thought this would go away unread for a bit there.

Sarahschmara

Rest assured that it’s being read and will be referred back to. It’s just difficult to have a discussion about something so obviously true! There’s no real debate here

shteev

The forum rules said:

13. All polls must be unbiased. They must contain at least one neutral option, and an equal amount of opposing options. (For example: Yes, Neutral, No)

IT'S THE LAW.

bk1234

@TheDragonHermit this is a wonderful post! 

One point I would add, and I think we have discussed this in the past is to refrain from using sarcasm or insulting language. 

This can can greatly affect the outcome of a poll  

blacklotus

But according to "Yes, Minister", polls can always be manipulated to give the desired results.

Ohboy

blacklotus said:

But according to "Yes, Minister", polls can always be manipulated to give the desired results.

That's kinda why Dragonhermit talked about the correct way to build polls isn't it? 

TheDragonHermit

bken1234 said:

@TheDragonHermit this is a wonderful post! 

One point I would add, and I think we have discussed this in the past is to refrain from using sarcasm or insulting language. 

This can can greatly affect the outcome of a poll  

I think sarcasm and insulting language is inherently biasing language. So I think point one covered that, but thank you for the specific example.

blacklotus

Anyone wants to create an unbiased poll or 2 to start off?

btw, how does 1 create a poll in this forum?

TheDragonHermit

In the mobile site one taps the pencil at the bottom of the screen and it gives you the option to make a poll or discussion.

shteev

bken1234 said:

@TheDragonHermit this is a wonderful post! 

One point I would add, and I think we have discussed this in the past is to refrain from using sarcasm or insulting language.

Unless, yknow, the whole point of the poll is to make a devilishly clever ironic point...

blacklotus said:

But according to "Yes, Minister", polls can always be manipulated to give the desired results.

This was a clip worth hunting down...

https://www.youtube.com/watch?v=G0ZZJXw4MTA

Firinmahlazer

Man, thank you for this. I can't stand the polls here. I end up not voting a lot because they will put words in your mouth. A lot of things don't warrant polls since they aren't a black and white issue. 

Hopefully someone will take your advice. I won't hold my breath though. 

TheDragonHermit

Firinmahlazer said:

Man, thank you for this. I can't stand the polls here. I end up not voting a lot because they will put words in your mouth. A lot of things don't warrant polls since they aren't a black and white issue. 

Hopefully someone will take your advice. I won't hold my breath though. 

Yeah I feel that there are quite a few polls here that seem to be more tongue in cheek and better suited to discussion, while I would prefer to see polls used to guage player reaction to features or opinion on how to improve features. I have a number of ideas for polls but the current format of them as single option answers rather than allowing for multiple toggles would make writing out every combination of options cumbersome. As for people taking my advice, people seem to be responding well so far, maybe this will be reflected in better polls that will allow the devs to tell player opinion at a glance.

TheDragonHermit

blacklotus said:

But according to "Yes, Minister", polls can always be manipulated to give the desired results.

Yeah, it is true. But I think in Yes, Minister they were referring to methods of data manipulation that can throw different results depending on the mathmatical model used. This is something I could have pointed out but didn't seem relevant.

Ohboy

TheDragonHermit said:

blacklotus said:

But according to "Yes, Minister", polls can always be manipulated to give the desired results.

Yeah, it is true. But I think in Yes, Minister they were referring to methods of data manipulation that can throw different results depending on the mathmatical model used. This is something I could have pointed out but didn't seem relevant.

I think the scene was referring to leading questions that push the victim into a corner after first dismissing some extreme choices. Can be done here. We could look at the last poll we had:

Toxic Elite vs n00bs... going forward, how should they relate to each other?

1) All out war

2) Attempting to understand and be respectful of each other's position

3) As neutrally as a neutral option in a forum poll

Obviously tongue in cheek, but option 3 is meaningless and option 1 is a "when did you stop beating your wife? " variant, leaving option 2 as the only sensible choice unless you're trying to be edgy. 

Consider this set of alternative choices:

1)Just ignore everyone who has an opinion different from yours. Be passive aggressive to a fault, always polite. 
2) pursue a solution based on arguing and finding a middle ground.
3) neutral as usual.

I think that's what the yes Minister scene was talking about. 

Sarahschmara

Ohboy said:

TheDragonHermit said:

blacklotus said:

But according to "Yes, Minister", polls can always be manipulated to give the desired results.

Yeah, it is true. But I think in Yes, Minister they were referring to methods of data manipulation that can throw different results depending on the mathmatical model used. This is something I could have pointed out but didn't seem relevant.

I think the scene was referring to leading questions that push the victim into a corner after first dismissing some extreme choices. Can be done here. We could look at the last poll we had:

Toxic Elite vs n00bs... going forward, how should they relate to each other?

1) All out war

2) Attempting to understand and be respectful of each other's position

3) As neutrally as a neutral option in a forum poll

Obviously tongue in cheek, but option 3 is meaningless and option 1 is a "when did you stop beating your wife? " variant, leaving option 2 as the only sensible choice unless you're trying to be edgy. 

Consider this set of alternative choices:

1)Just ignore everyone who has an opinion different from yours. Be passive aggressive to a fault, always polite. 
2) pursue a solution based on arguing and finding a middle ground.
3) neutral as usual.

I think that's what the yes Minister scene was talking about. 

Yikes! That’s a cynical view (although not incorrect). 

shteev

Ohboy said:

We could look at the last poll we had:

Toxic Elite vs n00bs... going forward, how should they relate to each other?

1) All out war

2) Attempting to understand and be respectful of each other's position

3) As neutrally as a neutral option in a forum poll

Obviously tongue in cheek, but option 3 is meaningless and option 1 is a "when did you stop beating your wife? " variant, leaving option 2 as the only sensible choice.

I'll be honest, whoever started that poll is a satirical genius.

Ohboy said:

Consider this set of alternative choices:

1)Just ignore everyone who has an opinion different from yours. Be passive aggressive to a fault, always polite. 
2) pursue a solution based on arguing and finding a middle ground.
3) neutral as usual.

I think that's what the yes Minister scene was talking about. 

Ugh, there's no satire here at all! I prefer the first poll. There's still bias in these new options, but people are likely to engage with that poll thinking it's a real one, rather than chuckling knowingly at the point that the original author was quite obviously trying to get across.

Kinesia

Unfortunately some people can't detect sarcasm. But I sell sarcasm detection kits on my ebay store if you'd like a link?

shteev

Hey, where's my new poll gone? Did we all actually agree to ban sarcasm while I was in bed?

Ohboy

"yes" "no" "maybe"

I don't know.