Move Analysis: Interrater Reliability And Intercoder Agreement

844 Words2 Pages

calculated. The level of inter-coder agreement is reported and established, and the results of the move identification are presented (Crookes, 1986).
2.4.3) Interrater Reliability/ Intercoder Agreement
One of the studies of move analysis was conducted to validate a move model for research article introduction sections by use of a group of raters or coders. Crookes (1986) undertook a study to validate Swales’ (1990) move model for empirical research article introductions by establishing the model’s level of interrater reliability/intercoder agreement. He asserted that for a system or a model that claims to be generated and established by the identification and recording of the characteristics of a group of texts of the same genre (moves and …show more content…

Crookes (1986) pointed out that it may be due to one or a combination of the following reasons. First, the framework or move model used in the study may not adequately account for all the functions and purposes of all the texts in a corpus. Second, the coders may not be sufficiently trained. Third, some texts in the corpus may not fit or conform to the framework. Fourth, the descriptions of move and step and/or definitions within the framework may not be explicitly inadequate. Fifth, boundaries of moves and steps in the corpus cannot be consistently and unanimously identified and agreed. Sixth, lexicogrammatical signals used in the move and step identification may be misleading and/or unclear.
After identification of the aforementioned explanations for a low level of inter-coder agreement in his study of research article introductions in ESP, Crookes (1986), then, revised the move and step framework he used. Key changes that were made included additions to move definitions, modifications of the degree of generality of move 1, and the omission of the previous model’s restrictions on the co-occurrence and sequence of moves 1, 2, 3 and 4. New raters were trained and new introductions were coded. A new and sufficiently high level of inter-coder agreement was

Open Document