Appendix D - Methodologies

Methodologies

Barna conducted four online surveys in July and August 2015 for The Porn Phenomenon study, with a total sample of 2,771 participants. These quantitative studies were preceded by qualitative research in the form of an open-ended online survey with 32 adults and 20 pastors on the topics of pornography and sex addiction. This qualitative research served to inform the development of subsequent survey tools and to provide context for interpreting the findings in the final data.

The researchers felt that an online methodology was essential to ensure confidentiality / anonymity and candid responses, which would not be possible in a phone poll. Our team was still surprised, in the qualitative research, by the candidness of the respondents. Many related personal stories of their own or a family member’s struggle, revealing the emotional factors surrounding pornography use.

The quantitative surveys consisted of parallel questions about perceptions of pornography, exposure, use and attitudes towards use. At the beginning of each survey, participants were warned of the sensitive nature of the questions and asked to confirm their interest in continuing. And again at the beginning of the section about pornography use, respondents were asked if they wished to continue due to the sensitive nature of the topic. Only 3 percent of respondents dropped out of the survey at this point. The total dropout rate for the entire survey was less than 40 percent (who initially started the survey, but discontinued at some point for a variety of possible reasons).

In a survey among U.S. teens and young adults, 813 participants between the ages of 13 and 24 were recruited and surveyed through a national consumer panel. The panel is representative by age, gender, region and socioeconomic grade, and no other screening criteria were applied. This survey included an extra module on “porn 2.0”: the use of digital devices and social media for pornography consumption. Ninety-eight percent of teens and young adults continued the survey after the second sensitive topic warning. The sample error on this survey is plus or minus 3.4 percentage points at the 95-percent confidence level.

In a general U.S. population survey, 1,188 adults 25 years and older were separately recruited and surveyed through a national consumer panel. The panel is representative by age, gender, region and socioeconomic grade, and no other screening criteria were applied. This survey included an extra module on perceptions of pornography and the Church (for self-identified Christians who attend church regularly). These questions were parallel to those asked of pastors. Ninety-six percent of adults continued the survey after the second sensitive topic warning. The sample error on this survey is plus or minus 2.8 percentage points at the 95-percent confidence level.

In a survey of U.S. Protestant church leaders, 432 senior pastors and 338 youth pastors were recruited and surveyed through publically available Protestant church listings. These respondents were given a survey parallel to the main adult study, with an extra module for youth pastors of questions about “porn 2.0.”

Senior pastor data was weighted to be nationally representative of churches by denomination, church size and region according to church characteristics from the most recent National Congregation Study by the Association of Statisticians of American Religious Bodies. Qualifiers for inclusion in the study were only that participant’s role (not necessarily title) is that of senior pastor. Nearly all are in paid full-time roles (93%), 5 percent are part-time and paid, and 2 percent are unpaid volunteers.

Youth pastor data was weighted on denomination and region according to church characteristics from the most recent National Congregation Study by the Association of Statisticians of American Religious Bodies. Qualifiers for inclusion in the study were only that participant’s role (not necessarily title) is that of youth pastor or leader. The majority is in paid full-time roles (71%), 19 percent are part-time and paid, and 10 percent are unpaid volunteers. An average of 95, and a median of 60, teens attend these pastors’ junior and high school youth activities in a typical week.

The sample error for the senior pastor survey is plus or minus 4.7 percentage points at the 95-percent confidence level. The sample error for the youth pastor survey is plus or minus 5.2 percentage points at the 95-percent confidence level.