Probing for sensitivity in translated survey questions: Differences in respondent feedback across cognitive probe types
Keywords:Translation, pre-testing, sensitive questions, cognitive interviewing
One of the core components of the TRAPD (Translation, Review, Adjudication, Pretesting and Documentation) team approach to translation in survey research is pretesting. Cognitive interviewing is increasingly being used for pretesting survey questionnaires adapted to different populations. Exploring the issue of question sensitivity is particularly relevant when adapting a questionnaire to a population different than the one for which it was designed. However, little guidance exists on the use of cognitive interviewing, and specifically, the types of verbal probes, to elicit respondent feedback on question sensitivity. In preparation for the Saudi National Mental Health Survey, cognitive interviewing was carried out to pretest the Arabic version of the World Mental Health survey instrument (CIDI 3.0). Different types of cognitive probes: proactive direct, proactive indirect and general probes were randomly assigned to survey questions to investigate differences in the feedback elicited by each type of probe. Findings suggest that different types of cognitive probes that are designed to explore perceived sensitivity of the survey questions elicit different amounts and types of feedback. An indirect cognitive probe identified a topic to be sensitive in more instances than a direct probe or a general probe. A general probe, on the other hand, elicited more non-codable feedback especially when paired with a survey question that asks about a more abstract concept such as the respondent’s feelings.
LicenseAuthors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).