In order to better ensure the quality of the data we collect for you, we implement on every project a set of monitoring and verification processes that we refer to collectively as our Quality Control (QC) system.
Followings is a summary of the general QC measures we take for common types of data collection activities. These general measures may be adjusted to better match specific project situations or client requests.
For any data collection campaign, a trained staff member who is not involved in other aspects of the project is appointed as the project’s QC manager. This person is responsible for supervising QC procedures.
Ensure Understanding — Before starting any fieldwork, the project manager organizes a meeting whose purpose is to ensure that all supervisors, interviewers, reviewers and the QC manager fully understand the client’s research goals and the questionnaire content. Interviewers are briefed thoroughly on the aim of each project step, questionnaires, and instructions.
Trial Run – before carrying out an actual survey, our team runs a trial survey on real subjects in order to uncover any potential issues that were not anticipated in the research design stage.
Monitoring Ratio – for every 3 to 5 interviewers we assign one supervisor.
Backup Collection – as a precautionary measure, BOMI generally attempts to gather 3%-5% more completed questionnaires than required.
Street Intercept Surveys
In general, we require respondents to provide their name,phone number and possibly other personal information as a means of encouraging thoughtful responses and for the purpose of post-interview verification.
At the first interviewing date, interviewers are debriefed by their supervisor, who discusses in detail all the challenging points of the questionnaire.
During the intercepts, fieldworkers are monitored by quality control supervisors.
Immediately after a questionnaire is completed, the interviewer is required to check that all questions have been fully answered, and if not, they ask the respondent to complete the form. If respondent fails to, or is unwilling to answer all questions satisfactorily, their questionnaire is discarded.
All completed questionnaires are reviewed within three days of the interview, and respondents will be contacted if any of their responses require clarification.
Separately, 30% of respondents are telephoned to verify identity and confirm that they completed the questionnaire on the given date.
Computer-Aided-Telephone-Interviews (CATI)
All interviews are recorded.
30% of recordings are reviewed to ensure interviewers followed script and audio matches extracted data. Any problems discovered are followed up on with further investigation and appropriate measures.
Interviewer Recruitment
BOMI recruits its interviewers with the greatest care. We seek individuals who are professionally competent and who show potential for long-term cooperation. Interviewers accumulate experience by working regularly on BOMI’s projects. They start with simple questionnaires and are assigned progressively more complex projects as they demonstrate increasing skill and knowledge.
WeChat Surveys
Several measures are taken in order to prevent fraud and multiple registrations:
a) Mobile phone numbers are verified by SMS.
b) Several automated system checks are implemented, including mobile phone number format check, duplicate mobile phone number detection, and duplicate WeChat account detection.
Before being invited to participate in any survey, respondents are required to take an internal introductory survey that allows us the opportunity to verify respondent data.
Basic demographic information is continuously checked against recorded data through surveys and regular profile updates for consistency.
Respondents are asked to update their profile every 6 or 12 months depending on category.
