问卷调查质量研究：应答代表性评估

社会杂志

问卷调查质量研究：应答代表性评估

作者1：任莉颖,北京大学中国社会科学调查中心；作者2：邱泽奇,北京大学社会学系；作者3：丁华,北京大学中国社会科学调查中心；作者4：严洁,北京大学政府管理学院

出版日期:2014-01-20 发布日期:2014-01-20
通讯作者: 任莉颖,北京大学中国社会科学调查中心 E-mail:isssrenly@pku.edu.cn
基金资助:
本研究受国家自然科学基金资助项目“并行数据和调查数据质量管理”（71171004）资助。

Research on Survey Quality: Evaluation of the Representativeness of Survey Responses

Author 1：REN Liying，Institute of Social Science Survey，Peking University； Author 2： QIU Zeqi， Department of Sociology， Peking University； Author 3：DING Hua，Institute of Social Science Survey，Peking University； Author 4：YAN Jie，School of Government，Peking University

Online:2014-01-20 Published:2014-01-20
Contact: REN Liying，Institute of Social Science Survey，Peking University）Email：isssrenly@pku.edu.cn E-mail:isssrenly@pku.edu.cn
Supported by:
This research was supported by the project “Paradata and the Quality Management of Survey Data”(71171004)，which was sponsored by National Natural Science Foundation of China.

摘要/Abstract

摘要： 随着问卷调查中无应答现象的增多，应答样本代表性问题成为问卷调查研究者的关注焦点。由于自身局限性，应答率无法提供有效的调查质量信息，建构新的应答代表性指标因此就成为研究重点。在综合比较相关研究成果的基础上，本文认为，R指标对于评估并提升问卷调查质量有较好的应用前景，并探讨了R指标的概念界定、计算方法、指标构成和注意事项，同时运用这一指标对“中国家庭动态跟踪调查”2010年初访数据的应答代表性进行了评估。

关键词: 社会调查 , 调查质量 , 应答代表性 , R指标

Abstract: As nonresponses in surveys have increasingly become more common in recent years, the representativeness of survey responses has called attention from survey researchers. Response rate is commonly used as an indicator of survey quality. However, theoretically and empirically there is not necessarily a direct link between response rates and nonresponse biases. So how to get alternative indicators of response representativeness has become a focus in research.After reviewing multiple measures of assessing response representativeness, we consider that Rindicator is the most promising compared with others. Regarding its construction, Rindicator is guided by sound theories, based on rich sampleframe data and paradata, and can be obtained by relatively simple algorithm. Regarding its application, Rindicator can be used for comparing different surveys with the same target population, different waves of a panel survey, or times of measurement in different stages of the same survey.This article introduces the definition of the concept of Rindicator, its computation, composition and limitations. Rindicator was applied to the evaluation of the representativeness of the survey responses in the China Family Panel Studies (CFPS), 2010. We divided the whole fieldwork process into three stages and computed the Rindicator, Maximal Absolute Bias, and partial Rindicators for each stage. The analysis of these indicators led to a discovery that the samples were over or underrepresented in the areas with variations in community attributes, economic development, population density, nonagricultural population ratio, and support from community commissions. Moreover, the seriousness of these problems changed as the survey went on.

Key words: social survey , survey quality , response representativeness , Rindicator

任莉颖, 邱泽奇, 丁华, 严洁. 问卷调查质量研究：应答代表性评估[J]. 社会杂志.

REN Liying, QIU Zeqi, DING Hua, YAN Jie.
Research on Survey Quality: Evaluation of the Representativeness of Survey Responses[J]. Chinese Journal of Sociology.

参考文献

American Association for Public Opinion Research. 2011. Standard Definitions： Final Dispositions of Case Codes and Outcome Rates for Surveys（7th Edtion）, http://www.aapor.org/Standard_Definitions2.htm#. UsojAmzxvIV.

Babbie，Earl. 2007. The Practice of Social Research（11th Edtion）. Belmont，CA：Wadsworth.

de Leeuw， Edith and Wim de Heer.2002. “Trends in Household Survey Nonresponse：A Longitudinal and International Comparison.”In Survey Nonresponse，edtied by Robert M. Groves，Don A. Dillman，John L. Eltinge，and Roderick J. A. Little.New York：Wiley：41-54.

Groves，Robert M. 2006.“Nonresponse Rates and Nonresponse Bias in Household Surveys.”Public Opinion Quarterly 70(5)：646-675.

Groves，Robert M. and Emilia Peytcheva.2008.“The Impact of Nonresponse Rates on Nonresponse Bias： A MetaAnalysis.”Public Opinion Quarterly 72(2)：167-189.

Groves，Robert M.，Michael Brick，Mick Couper，William D. Kalsbeek，Brian HarrisKojetin，Frauke Kreuter， BethEllen Pennell，Trivellore E. Raghunathan，Barry Schouten，Tom W. Smith，Roger Tourangeau，Ashley Bowers，Matthew Jans，Courtney Kennedy，Rachel Levenstein，Kristen Olson，Emilia Peytcheva，Sonja Ziniel， and James Wagner. 2008. “Issues Facing the Field： Alternative Practical Measures of Representativeness of Survey Respondent Pools.” Survey Practice 1(3)：14-22.

Groves，Robert M.， Nicole Kirgis，Emilia Peytcheva，James Wagner，William G. Axinn，and William D. Mosher. 2008.“Responsive Design for Household Surveys： Illustration of Management Interventions Based on Survey Paradata.” NCRM Research Methods Festival, St Catherine’s College, Oxford, UK.

Groves，Robert M. and Steve Heeringa. 2006.“Responsive Design for Household Surveys： Tools for Actively Controlling Survey Errors and Costs.” Journal of the Royal Statistical Society: Series A（Statistics in Society） 169 (3)：439-457.

Heerwegh，Dirk，Koen Abts，and Geert Loosveldt. 2007.“Minimizing Survey Refusal and Noncontact Rates： Do Our Efforts Pay Off?”Survey Research Methods 1(1)：3-10.

Keeter，Scott，Carolyn Miller，Andrew Kohut，Robert M. Groves，and Stanley Presser. 2000.“Consequences of Reducing Nonresponse in a National Telephone Survey.” Public Opinion Quarterly 64（2）：125-148.

Kreuter，Frauke，Kristen Olson，James Wagner，Ting Yan，Trena M. EzzatiRice，Carolina CasasCordero， Michael Lemay，Andy Peytchev，Robert M. Groves，and Trivellore E. Raghunathan. 2010.“Using Proxy Measures and Other Correlates of Survey Outcomes to Adjust for Nonresponse： Examples from Multiple Surveys.” Journal of the Royal Statistical Society：Series A (Statistics in Society) 173(2)：389-407.

Kruskal，William and Frederick Mosteller. 1979a.“Representative Sampling I：NonScientific Literature.” International Statistical Review 47（1）：13-24.

Kruskal，William and Frederick Mosteller.1979b.“Representative Sampling II：Scientific Literature Excluding Statistics.”International Statistical Review 47（2）：111-123.

Kruskal，William and Frederick Mosteller.1979c.“Representative Sampling III：Current Statistical Literature.” International Statistical Review 47（3）：245-265.

Olson，Kristen. 2006.“Survey Participation，Nonresponse Bias，Measurement Error Bias and Total Bias.” Public Opinion Quarterly 70(5)：737-58.

Schouten，Barry，Fannie Cobben，and Jelke G. Bethlehem. 2009.“Indicators for the Representativeness of Survey Response.”Survey Methodology 35(1)：101-113.

Singleton，Royce and Bruce Straits.2005. Approaches to Social Research （4th Edtion）.New York：Oxford University Press.

Wagner，James. 2010.“The Fraction of Missing Information as a Tool for Monitoring the Quality of Survey Data.” Public Opinion Quarterly 74(2)：223-243.

Wagner，James. 2012.“A Comparison of Alternative Indicators for the Risk of Nonresponse Bias.”Public Opinion Quarterly 76(3)：555-575.
责任编辑：张军

[1]	张春泥, 卢云峰. 如何在社会调查中更好地测量中国人的宗教信仰？[J]. 社会杂志, 2018, 38(5): 126-157.
[2]	谢宇，胡婧炜，张春泥. 中国家庭追踪调查：理念与实践[J]. 社会杂志, 2014, 34(2): 1-32.
[3]	洪大用. 环境关心的测量：NEP量表在中国的应用评估[J]. 社会杂志, 2006, 26(5): 71-92.