Wednesday 23rd November 2022, 17:00–17:15 (Australia/Melbourne), Zoom Breakout Room 3
This paper presents the first findings from a small Australian probability-based online panel, a pilot we designed to support a larger panel we plan for 2023. Trialling a dual-frame sampling strategy, while also conducting two recruitment experiments, we examine initial response outcomes and subsequent attrition for various samples and treatment groups. Using data from the first two waves, we test the representativeness of the entire sample, and all relevant subsamples, against benchmarks from the Australian census and several other Australian surveys. We use the usual demographics—age, gender, education—but also measures such as employment status, well-being or health. In wave two, we test different longitudinal incentives, focussing on the impact of loss aversion and present bias on retention. With more waves planed, we will trial several questionnaire designs and run additional experiments.
A probability sample of about 600 adults was recruited from the Australian electoral roll (through listed addresses) and from the population of Australian mobile owners (through RDD). Respondents were enrolled in the panel after completing the first wave questionnaire. Panel members were asked to complete an online questionnaire in each wave, with no other response modes offered (push-to-web only). Initial contacts occurred through letters, postcards, and SMS text messages; subsequent contacts occurred through email.
We conducted two recruitment experiments to refine our strategy for the larger panel we are planning. That new panel, funded and owned by a major Australian university, will allow academic researchers to contribute questions for free or on a cost-recovery basis. The first experiment tested the saliency of university sponsorship, while also stressing the non-commercial aspect of the panel. The second experiment tested the impact of emphasising the longitudinal nature of the survey, stressing that members are expected to participate multiple times during the lifetime of the panel.
Markus Hahn is a research fellow at the ANU Centre for Social Research and Methods. His research interests include survey methodology, the analysis of economic inequality and various aspects of labour economics. Prior to joining the ANU, Markus worked as an economist and survey statistician for the Household, Income and Labour Dynamics in Australia (HILDA) Survey.