Can we trust survey data?

 

Back in the day, we could learn many things from telephone surveys.

 

But then computers and cell phones were born and people started dropping their land lines.  Not surprisingly those that still have land lines are different than those who do not.  Think less educated, less wealthy and older.

 

So clearly land line only surveys are not going to be projectable.

 

Instead research companies have begun to combine cell phone and computer data with the information received from land lines.  Weighting the responses has proved to be tricky.

 

Perhaps more troubling are the results from a recent study by Pew Research to determine the validity of combined responses.  Pew found that answers from phones versus computers varied by anywhere from 0 to 18 percentage points.  That's a big difference.  And companies are likely to make decisions based on any skew greater than 10%.  Possibly wrong decisions.

 

Interestingly the disparities had to do with intensity - so they aren't contradictory.  That's a relief.

 

Apparently phone respondents were more likely to give extreme responses.  They are also more likely to favor the last choice they hear, while online respondents are more likely to favor the first choice.

 

Discrepancies were especially large when respondents were asked to access their quality of family and social life.  Telephone respondents were more likely to be satisfied than online respondents.  They were also more likely to say gay, lesbian, Black and Hispanics face a lot of discrimination.

 

Meanwhile, online respondents were more likely to rate political figures negatively.

 

Researchers noted that it could be possible that telephone respondents were more inclined to give socially responsible answers. (McGinty, 2021)

 

So where does that leave us?

 

Can we use research gathered exclusively online?  Or should people look for combined data?  Should we verify research before we use it?  How would we do that?  Is the the best option for people to do their own research?

 

Have you participated in a phone survey or live research?  Did you have a desire to please the interviewer?  Have you noticed any pattern to your answers when you participate in online research?

 

 

McGinty, J. (2021, April 30)  What Happens When Opinion Polls Move Online?  wsj.com.  Retrieved January 24, 2022, from  https://www.wsj.com/articles/what-happens-when-opinion-polls-move-online-11619775001

 

To reinvent the office, bring back lunch.

 

Back in the 80's in addition to half-day Fridays, we also had more flexible lunch breaks.

 

The basic purpose of a two-hour lunch was to allow time for people to actually have business lunches and network. 

 

Research has shown that negotiations are more successful when participants take the time to get to know each other a bit first.  So it isn't just about a free lunch.  It's also about increasing productivity.  (Cialdini, 2018)

 

Of course, rarely was I wined and dined.  Although I did go out to local diners with co-workers on occasion.

 

Instead, I used the extra time to either run errands or work out.  This enabled me to maintain work/life balance even while working past 8 pm most evenings.

 

I've read a lot lately about the need to improve work/life balance, but I haven't heard anyone discussing the idea of bring back lunch.

 

Perhaps they should.

 

 

Cialdini, R. (2018, May)  The Six Principles of Successful Workplace Negotiation.  influenceatwork.com.  Retrieved January 18, 2022, from,

https://www.influenceatwork.com/wp-content/uploads/2018/05/Workplace-Negotiation-article.pdf

 

 

Maybe WSJ should offer a Kindness Challenge.

 

The Wall Street Journal recently informed me that to help me reach my New Year's goals they are offering three 6-week challenges.  There is an "Investing Challenge," a "Money Challenge," and a "Fitness Challenge."  Should I chose to engage in a challenge, a daily email will be sent to my inbox to guide my efforts.

 

It appears they have neglected to offer a "Kindness Challenge."

 

Perhaps they are unaware that research has proven that money does not buy happiness. 

 

But giving to others does.

 

According to a 2015 research study, in 120 out of 136 countries there is a positive relationship between giving and happiness.  And yes, the United States is one of those countries.

 

Giving to others satisfies the need for social connection.  If people have control over who they give to and how much they give, they will feel a personal sense of accomplishment as well.  (Dunn, Aknin, & Norton, 2015)

 

Even the perpetually greedy should understand that.

 

If not, there's always Henry James - "Three things in human life are important: the first is to be kind; the second is to be kind; and the third is to be kind."

 

 

Dunn, E., Aknin, L., and Norton, M. (2015, September 5)  Prosocial Spending and Happiness: Using Money to Benefit Others Pays Off.  harvard.edu.  Retrieved January 11,2022, from https://dash.harvard.edu/bitstream/handle/1/11189976/dunn,%20aknin,%20norton_prosocial_cdips.pdf?s