interrater reliability in qualitative research

Allows the researcher to include themes that have been derived from data collection tools and those that are generated from the data analysis process.again can be derived from data collection questions), and themes are typically conceptualized as domain summaries. Some, if not all, themes are determined ahead of full analysis (e.g.Is viewed as being partially qualitative as consensus and calculation of accuracy/reliability is undertaken.This process of coding is also known as consensus coding.Accurate or reliable coding is calculated using Cohen’s kappa this indicates the level of agreement between the coders.Ideally, the codebook is applied to the data by more than one coder, each working independently for some, the ideal coder has no prior experience with or knowledge of the topic of concern and comes to the coding process naive.

The researcher categorizes the data into (pre-determined) themes.

Coding is guided by a codebook/coding frame, which contains a list of codes/themes – each has a label/name, a definition, information on how to identify the code/theme, a description of any exclusions or qualifications to identifying the code/theme, and data examples.

The identification of codes/themes is commonly based on agreement between multiple coders.

The process of coding aims to prioritize “reliable” data coding – in other words identification of “accurate” codes/themes within data.

These drive the coding process and are the output of the coding process.

questions in a semi-structured interview with participants.

In these approaches themes are often conceptualized as domain summaries which have often been derived from data collection questions e.g.

These three titles emphasize the key distinctive element of each approach.

TA can be considered as being one of three broad “types” (schools).

A list of key reference sources is also provided. The first blog provided an i ntroduction to Thematic analysis (TA) and discussion of what a theme is, this blog provides a description of the three schools of TA and some study design recommendations, and the final blog provides an outline of the six phases of reflexive TA.

Interrater reliability in qualitative research