Background: Achieving acceptable response rates from health care providers via postal questionnaires is an ongoing challenge. The use of monetary incentives is one of the most effective strategies for increasing response rates. However, the effect and cost of such an incentive on retail pharmacists’ response rates has not been well studied.
Methods: A sample of 700 pharmacies was selected at random from the electronic Yellow Pages in NSW Australia and mailed a brief survey regarding pharmacotherapies and advice for smoking cessation. Half of the sample was randomly allocated to receive an offer of an US$14 gift voucher.
Results: The response rates were 65.9% for the voucher group and 53.5% for the no-voucher group. The odds of response from the voucher group was 1.68 (95%CI = 1.23, 2.30) times greater than for the no-voucher group. The cost per additional respondent was US$67.95. The incentive also reduced follow up costs by 10%.
Conclusions: A moderately sized monetary incentive is able to achieve a significant increase in response rates for retail pharmacists, thereby reducing potential bias in the sample.
- postal survey
- response rates
Statistics from Altmetric.com
Postal surveys are a well used tool for collecting data for a range of health related settings.1–3 Achieving acceptable response rates is crucial to minimising bias4 and remains a challenge, particularly for studies of health care providers.3,5 A number of strategies have been trialled to maximise response rates, with one of the most effective strategies being the use of a monetary incentive.6 While monetary incentives can increase the odds of response by a factor of 2.02, the effect is dependent on factors such as the amount of the incentive.6–8
The potential importance of population type has been acknowledged, yet most of the research into the effect of monetary incentives for health care providers has focused on medical practitioners.6 Other important community based health care providers such as retail or community pharmacists have received little attention, despite this group’s potential to modify population health risk behaviours because of their contact with large numbers of people. This group of health care providers practise in a highly commercialised environment with frequent contact from pharmaceutical companies that can offer substantial incentives for participation in studies. Given these factors and the proliferation of the use of incentives in all forms of marketing, it is important to continue to study the effects of small to medium incentives on response rates, particularly for little studied groups such as pharmacists.
This study aimed to explore the impact of a US$14 incentive on response rates for pharmacists in NSW, Australia.
A sample of 700 pharmacies was selected at random from the electronic Yellow Pages for NSW, Australia. Pharmacies were eligible to participate if they had sold any nicotine replacement therapy (NRT) or bupropion in the previous month. Eligibility was self assessed by the pharmacist completing a screening item on the front of the survey. The accuracy of recall was expected to decrease over time, therefore a period of one month was selected as the maximum time since contact with a customer that would provide acceptable recall. The pharmacist in charge in each selected pharmacy was mailed a primer postcard followed by the questionnaire within the following two weeks. Non-responders received one print reminder four weeks after receipt of the questionnaire. Telephone reminders were provided a further two to six weeks later.
Half of the sample was randomly allocated using random number generation to receive an offer of a AU$20 (US$14) gift voucher (voucher group) as partial reimbursement for the costs incurred in completing the questionnaire. The vouchers could be redeemed at any one of a number of large supermarkets and department stores throughout Australia. For the voucher group, both the questionnaire and the accompanying letter stated that the voucher would be mailed to the participant once the completed questionnaire had been received. The authors were aware of participant’s group allocation but had no direct contact with the participants during the mail out or follow up process.
The study was approved by the University of Newcastle Human Research Ethics Committee with the proviso that after data collection was completed, all participants be advised that only half of the sample had been offered the voucher and be given the opportunity to withdraw their data.
The questionnaire took about 10 minutes to complete and was six pages in length with items well spaced and in large font. The 28 items included items relating to the provision of advice to NRT and Zyban purchasers, attitudes toward supporting smoking cessation in the pharmacy environment, and training received regarding NRT and smoking cessation. The content of the data collected from the pharmacists is reported elsewhere.
Of the 700 pharmacies selected in the sample, 35 were found to be ineligible (returned survey showed no NRT or Zyban sold in past month, pharmacy closed, wrong address, duplicate, or no pharmacist at the pharmacy). Of the remaining 665 pharmacies, 397 returned a completed questionnaire (response rate = 59.7%).
For the voucher group, 220 of the 334 eligible pharmacists returned a completed questionnaire, giving a response rate of 65.9%. For the no-voucher group, 177 of the 331 eligible pharmacists returned a questionnaire, giving a response rate of 53.5%. The difference between these two proportions was significant (χ2 = 10.6, df = 1, p<0.005 OR = 1.68, 95%CI = 1.23, 2.30). Of the 220 voucher group pharmacists who returned a questionnaire, 21 (9.5%) indicated they did not want to receive the voucher.
After the mailing of a letter disclosing that the study involved two groups, only one of which received a voucher, 11 participants withdrew from each group. This gave final response rates of 62.6% for the voucher group and 50.2% for the no-voucher group. The difference between these two proportions was significant (χ2 = 10.4, df = 1, p<0.005; OR = 1.66, 95%CI = 1.22, 2.26). Figure 1 shows the effect of the first mail out, print reminder, and telephone reminder on response rates.
The cost per additional respondent of the vouchers was calculated as follows:
Therefore, the cost per additional respondent was US $75.12. If the number of pharmacists (n = 21) who did not want to be sent the voucher is deducted from the numerator, the cost per additional respondent is US$67.95. If the cost of mailing the voucher to those who complete the survey was included in the calculations, the cost per additional respondent would be slightly higher. The use of the voucher also decreased follow up costs by about 10% at each follow up point, based on the additional printing, mailing, and telephone costs that would have been incurred had the voucher group response rates been the same as the no voucher group response rates.
DISCUSSION AND CONCLUSION
The use of a moderate monetary incentive produced a significant increase in the number of pharmacists who completed a health related questionnaire. An increase in response rates from 54% to 66% is both statistically significant and probably reduces the potential for bias in the sample. The increased odds of a response, at 1.68 is slightly lower than the 2.02 found by Edwards’ et al systematic review.6 Given that previous research has found higher response rates are likely to be achieved by a non-conditional incentive, rather than the conditional incentive used in this study, double the odds of a response as found by Edwards et al6 may be achievable with this population. When considered in terms of the cost of US$67.95 per additional respondent, smaller incentives are worth exploring with this population. The generalisability of the finding outside the Australian context must be considered. However, given that the finding is not dissimilar to other studies of incentives6 the result may be generalisable.
What this paper adds
What is already known on this subject?
A number of studies have shown that health care providers such as medical doctors are more likely to respond to health surveys if a monetary incentive is provided. Little is known about the influence of incentives on response rates for other important health care provider groups such as retail or community pharmacists.
What does this study add?
This study shows that a significant increase in pharmacists’ response rates to a postal survey can be achieved using a modest monetary incentive, and that this incentive acts independently from using reminders that also increase response rates.
The use of incentives to increase response rates imposes an additional cost on research funds, yet seems to significantly increase response rates, even for health care providers in a highly commercialised environment. Therefore, researchers even on limited funds need to consider the potential benefits of incentives as a matter of course.
It should be noted that the study included the use of a primer postcard and reminders, each of which has a significant effect on response rates. A factorial design that would have isolated the effect of the incentive, was not possible in this trial given the level of funding available. However, figure 1 shows that the impact of the incentive was to increase the response to the initial mail out. The two reminders seemed to have a similar impact on both study groups, independent from the effect of the voucher.
Clearly, a useful increase in the response rates of retail pharmacists is achievable with a moderately sized monetary incentive, although the incremental cost may be considered high.
The work of Richard Turner and Deanna Wolfgang on this project is acknowledged.
Funding: this paper was prepared by the Centre for Health Research and Psycho-oncology (CHeRP). The project was funded by the University of Newcastle Research Grants Committee, the Cancer Council NSW, and the Hunter Medical Research Institute. The views expressed are not necessarily those of the Cancer Council NSW.
Competing interests: none declared.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.