Abstract
Background: The current Curriculum and Assessment Policy Statement (CAPS) for teaching languages and literacies in South African schools includes visual literacy components in all grades and thus teachers need to be visually literate, to be critical viewers of the visual, and to know how to teach visual and critical visual literacy.
Objectives: The aim of this research was to investigate the possibilities of designing multiple-choice items that attempt to assess student teachers’ visual and critical visual literacy content and pedagogic knowledge.
Method: In this reflective case study we present, discuss, and reflect on examples of multiple-choice items designed for the assessment of components of the Primary Teacher Education Project (PrimTEd). Our reflections are informed by literature in the fields of visual literacy and critical visual literacy education.
Results: Sourcing socio-culturally inclusive, multimodal texts and creating appropriate classroom teaching scenarios on which to base questions that comply with the criterion of test fairness is challenging to achieve in any test format. It is particularly difficult to achieve when constrained by a multiple-choice format.
Conclusion: Multiple-choice items can be used to assess some aspects of student teachers’ visual and critical visual literacy, such as discourse-specific terminology, explanations of terminology, and choices of classroom teaching strategies. However, alternative question forms or tasks have greater affordances for assessing other aspects of student teachers’ ability to read still and moving images and multimodal texts with understanding and criticality, and to teach learners how to do so.
Contribution: The article contributes to the field of visual and critical visual literacy assessment in initial teacher education through an investigation of the affordances and limitations of the multiple-choice format commonly used in large-scale assessments.
Keywords: reflective case study; assessing visual and critical visual literacy; multiple-choice questions; student teachers; PrimTEd Assessment project.
Introduction
In 2016, as a contribution to the Integrated Strategic Planning Framework for Teacher Education and Development in South Africa 2011–2025, the Department of Higher Education and Training (DHET) tasked teams of teacher educators across South African universities with the development of Initial Teacher Education (ITE) standards for Mathematics and English (‘Home’ Language and ‘Additional’ Language). The aim of these knowledge and practice standards is to provide teacher educators with guidelines for curriculum design and enactment in ITE programmes for primary school teachers. Given the importance of understanding what student teachers know when they begin their Bachelor of Education (BEd) degree, and of assessing what they know and can enact in the classroom when they graduate, one strand of the Primary Teacher Education Project (PrimTEd) focuses on assessment. The authors were part of the team tasked with designing items for an English test to be used across universities. Given the large-scale nature of test administration and marking, we were requested to design items in multiple choice format. In this article, we reflect on our experiences of designing items in this format for the assessment of student teachers’ knowledge of visual and critical visual literacy.
The PrimTEd Knowledge and Practice Standards for primary teacher education graduates: language and literacy (PrimTEd Literacy Working Group 2020–2021) recognise that teachers should be both visually and critically visually literate. For example, under the general heading Teacher standards: Practice is the specific outcome statement that graduating teachers should be able to ‘[i]mplement multimodal forms of instruction and evaluate instructional practice in each of the key components of reading and writing’ (Specific outcome 3). Two of the ‘components’ listed are ‘visual literacy’ (3.1) and ‘critical engagement with texts’ (3.1). Under the general heading Teacher standards: Knowledge is the specific outcome statement that graduating teachers should:
Demonstrate knowledge of phase appropriate features of page or screen-based visual texts, of how the relationship of verbal and visual features of texts affects meaning and of strategies to teach learners to become firstly, visually literate and subsequently, critically visually literate. (Aitchison et al. 2020–2021:17)
The assessment criteria accompanying this knowledge statement are as follows:
- Features of page or screen-based visual texts (e.g. layout, colour, image choice) can be explained.
- The effects of the relationship between words and images and colours of various kinds on meaning can be explained.
- Strategies for teaching learners how to read and view visual texts or texts that combine words and images can be described. (Assessment criteria 17.1 to 17.3)
With reference to visual literacy, the PrimTEd Standards for teaching English as First Additional Language (EFAL) as a subject and for using EFAL ‘as the general medium of instruction’ include:
Ability to use a range of instructional strategies and methods including recycling and repetition of key vocabulary and language structure and using multimodal texts – to assist learners to make the transition from learning in a home language to learning in English is demonstrated. (Assessment criterion 5.4 [Aitchison et al. 2020–2021:30])
Teachers are also expected to demonstrate ability to ‘source, design and manage appropriate EFAL resources’ (Assessment criterion 6.1 [authors’ own emphasis]).
After providing a brief rationale for including visual and critical visual literacy in school and ITE curricula, we describe and discuss some of the challenges we have faced in our attempts to design multiple-choice items for inclusion in the PrimTEd English tests. In place of a discussion section, beneath each example of test items, we have written a brief commentary to which we refer in the final part of the article.
To provide context for our presentation of test items and reflections on these, we briefly review literature in the fields of visual and critical visual literacy and assessment.
Literature review
Visual literacy has been described as an ‘organic concept’ (Harrison n.d.) that requires ongoing redefinition as the design and production of the visual changes. We find useful for teaching and learning, at all levels, the definition offered below:
Visual literacy is a set of abilities that enables an individual to effectively find, interpret, evaluate, use and create images and visual media. Visual literacy skills equip a learner to understand and analyse the contextual, cultural, ethical, aesthetic, intellectual and technical components involved in the production and use of visual materials. A visually literate individual is both a critical consumer of visual media and a competent contributor to a body of shared knowledge and culture. (Association of College and Research Libraries [ACRL] 2011:2)
In 2022, ACRL updated its document on visual literacy to include ‘four emerging themes’ in visual literacy (ACRL 2022:2):
- Learners participate in a changing visual information landscape.
- Learners perceive visuals as communicating information.
- Learners practice [sic] visual discernment and criticality.
- Learners pursue social justice through visual practice.
In incorporating both visual and critical visual literacy, this definition, together with the themes subsequently identified, is in the tradition of early critical literacy scholars such as Freire (1972a, 1972b). In the early 1970s, Freire showed how ‘the process of learning how to read both the word and the world critically’ (Janks 2010:13) enabled adult literacy learners to become critically conscious actors in society. Critical reading of images, and of the relationship between words and images, is an important part of reading both the word and the world. As noted by Chung (2013:4, in Adil 2022:1), critical visual literacy ‘goes beyond mere analysis and understanding of visual objects’ (although this is an important starting point), as it involves asking critical questions about these objects – for example, about their choice and placement in a text on a page or screen. In outlining three steps for ‘thinking about looking’, Ferreira and Newfield (2014:85) ask the following:
- What or who? The visual content: Who or what is in the image? What do you see? What don’t you see? Who is shown? Who isn’t shown?
- How? Representation: How are people, places or things represented? Shots? Angles? Lighting? Colour? Eye contact? etc.
- Where? Context: How is the image used? In what context – textual, social, political? What is the text’s purpose or genre?
These questions appear in Doing Critical Literacy: Texts and Activities for Students and Teachers, a publication designed to guide learners and teachers in becoming critically visually literate readers and designers of texts for both page and screen. As Janks (2014:1) writes in her introduction to this workbook, ‘the ability to do critical literacy gives us potent ways of reading, seeing and acting in the world.’
In an earlier publication, Janks (2010) makes an important distinction between a literacy teacher and a critical literacy teacher:
I think it is possible to think of a literacy teacher as someone who works with others to make meaning with or from texts. A critical literacy teacher is, in addition interested in what all kinds of texts (written, visual and oral) do to readers, viewers and listeners and whose interests are served by what these texts do. They also help students to rewrite themselves and their local situations by helping them to pose problems and to act, often in small ways, to make the world a fairer place. (p. 19)
For Newfield (2011:81) what distinguishes critical visual literacy from visual literacy is the emphasis of the latter on ‘the positioned and positioning nature of visual texts, on the socio-political consequences of semiotic choice in visual texts, and on reading against rather than with the visual text’.
In our view, learners need teachers who include both visual literacy and critical visual literacy in their classroom work and thus student teachers need to become visually and critically visually literate. Kedra and Zakeviciute (2019:1)describe students entering tertiary education in recent times as being ‘technologically savvy but often visually illiterate. They do not know how to interpret and evaluate images and how to use them for effective communication’. While visual and critical visual literacy have always been important, they have become more so in an age in which ‘new possibilities for representation’ are ‘afforded by the new media of production and dissemination’ (Kress & Van Leeuwen 2006:32). Also, as suggested by one of the reviewers of this article, given the importance of responding to learners’ multiple intelligences (Gardner 1983), a focus on the visual may be enabling for learners whose spatial-visual intelligence is ‘stronger’ than their verbal-linguistic intelligence.
In surveying the views of media literacy scholars and teachers in 35 countries, on the challenges of assessing media literacy, Schilder, Lockee and Saxon (2016:43) found that the most frequently mentioned challenge was ‘lack of teacher preparedness and teacher training to assess media literacy outcomes’. This finding is similar to those of South African classroom-based researchers. For example, Moodley (2015) found that teachers in her study lacked the pedagogic content knowledge to guide learners in engaging with visual texts. Mnyanda and Mbelani (2018) express concern that the teachers they observed were not able to capitalise on learners’ digital literacy knowledge and skills and thus, by implication, were unable to guide learners in thinking critically about what they were viewing and what they were designing.
For the PrimTEd languages and literacies test, preparing items that aim to assess student teachers’ ability to meet the assessment standards specified for visual and critical visual literacy, and which also conform to the requirements of ‘test integrity’ (Weideman 2011) has proved to be a considerable challenge. We argue that it is a challenge that is exacerbated, by the assessment team’s decision, for reasons outlined below, to design and use multiple choice questions (MCQs) in the test.
Assessing student teachers’ knowledge of visual and critical visual literacy
While there is an increasing use of multimodal pedagogies in education at all levels (eds. Archer & Newfield 2014; Bowen 2017; Callow 2018; Wei 2022), there has been limited research on the assessment of visual literacy competencies in education in general (Moodley 2015; Schilder et al. 2016) and in higher education in particular (Bowen 2017; Kedra 2018; Yeh 2010). We have not been able to locate any research based on the choice and use of MCQs in assessors’ attempts to do so.
We acknowledge that many advocates of a multimodal, multiliteracies approach to teaching and learning have long been critical of standardised testing in general, and of the lack of opportunities to demonstrate nuanced understandings or creative responses that are an inevitable consequence of the use of MCQs (e.g. Kalantzis, Cope & Harvey 2003; Newfield et al. 2003; Reed 2014; Schilder et al. 2016).
However, in contexts in which assessment of the languages and literacies content and pedagogic content knowledge of large numbers of student teachers throughout South Africa is the goal – as in the PrimTEd Assessment Project – it can be argued that standardised testing and the use of well-designed MCQs is a practical and useful option, given the following widely recognised affordances of this question type (University College Dublin, Teaching and Learning Resources, n.d.):
- Responses are easily marked (often by computer), objective and reliable.
- MCQs may measure different cognitive levels of testees.
- Responses offer opportunities for feed forward (assessment for learning) and feedback.
- MCQs facilitate the development of question banks so that items can be rotated across numerous iterations of a test.
As described in Roberts and Mort (2023), the team of item designers engaged in preparing MCQs for the PrimTEd language and literacies test was advised by Moloi (2021) who demonstrated how to consider items from five perspectives: (1) accuracy; (2) fairness; (3) validity; (4) reliability; and (5) accessibility. While recognising the importance, for the design of MCQs, of providing both one unambiguously correct answer and three plausible distractors or foils to support accuracy, validity, and reliability of multiple-choice items, in this article we focus on the challenges associated with designing items to assess aspects of visual literacy knowledge pertaining to fairness and accessibility.
Roberts and Mort’s (2023) description of the agreement reached by the team on how to promote fairness when designing MCQs is quoted in full because it indicates important features that test designers need to address in each item, some of these being particularly difficult to achieve when aspects of visual literacy knowledge are being assessed (Roberts & Mort 2023):
With reference to fairness, the team decided that this aspect would be promoted if items were well written and culturally accessible to students from diverse backgrounds. For example, in the case of the former criterion, each aspect of the item (from the instruction to the stem, the stimulus and the distractors) had to be unambiguous, well written, and purposeful. The distractors had to be plausible answers rather than obviously incorrect. The appearance of the key (correct answer) and distractors had to be visually similar, so as not to make the correct answer too apparent. There could be no repetition in the distractors, so that the test candidates’ time would not be wasted with unnecessary reading. With reference to the latter criterion, that of cultural accessibility, the content of prompts – either written texts and/or images – needed to be accessible to students from widely varying socio-cultural backgrounds, and to express southern African diction and experience. (pp. 42–43)
As Roberts and Mort (2023:43) explain, accessibility is likely to be enhanced if item designers carefully consider ‘the context and the type of world view and experience reflected in the stimuli or prompts for test items’.
Research methods and design
Research design
In writing about case study research in educational settings, Bassey (1999) identifies several types: theory building, theory testing, storytelling, picture drawing, and evaluative. This reflective case study, in which test item design is the case, includes elements of the storytelling and picture drawing types and is to some extent also evaluative, given that reflection is at its heart. It should be noted that, from its inception, the PrimTEd Assessment project has combined research and development, with lecturers across South African universities participating in face-to-face and online workshops and in email exchanges. In this article, we reflect on a selection of the items designed by one or both of us as members of a larger English test item team in which the number of participants varied across workshops. Team members designed items individually or in pairs, shared them with the team for comment and, if necessary, adjusted them in response to comments made. Subsequently, all items were reviewed by members of the PrimTEd Assessment project for conformity to the requirements of quality MCQs and for their ‘match’ to one of the knowledge and practice standards or sub-standards. All the items discussed in this article were designed to be used in the pilot phase of PrimTEd, but were excluded from the administered pilot test.
We chose the items presented and discussed to illustrate the concerns we have about the affordances of MCQs for assessing teachers’ knowledge of visual and critical visual literacy and of how to teach learners to be visually and critically visually literate. We agree with Attia and Edge (2017) and Arnold et al. (2022) that there is a need to move away from (Atti & Edge 2017):
[R]esearch methods as objectified procedures to be learnt by researchers’ and towards ‘the development of researchers who craft procedures integral to the environments in which they operate – environments of which they are also a functioning constituent. (p. 33)
However, we brfiefly outline three aspects of a conventional research methods description.
Research participants
The authors as test item designers, together with other members of PrimTEd test item development team, are the participants.
Data collection and analysis
The test items included in the article are the data and were selected firstly, because they were designed by the authors; and secondly, because they illustrate the challenges we experienced in our attempts to use multiple choice items to assess elements of student teachers’ content and pedagogic content knowledge of visual and critical visual literacy. Our reflections on the items, in terms of their conformity to the requirements of high-quality MCQs and in terms of their affordances and limitations for assessing elements of visual and critical visual literacy, constitute our analysis.
Image selections and use
Images selected for test items need to be generative for the assessment of student teachers’ visual and critical visual literacy content and pedagogic content knowledge. Our search for culturally accessible multimodal materials appropriate for use in primary schools was made more challenging by the need for these to be either open access, or materials for which permission to use for non-commercial purposes is easily obtained.
There are also technical challenges associated with using images. Numerous examples of cartoons or cartoon strips or advertisements could not be copied and pasted into Jumptrak, the digital assessment platform being used for testing in PrimTEd. Redrawing these images would be too time consuming and expensive to be viable.
In selecting examples of visual texts, item designers need to consider the likely background knowledge of both the testees and the learners whom they are preparing to teach. Many student teachers’ visual literacy experiences in secondary school classrooms are likely to have been constrained by the washback effect of the National Senior Certificate examination papers in which, for many years, cartoon strips and advertisements have been dominant (Moodley 2015). However, while cartoons and advertisements have a role to play in visual and critical visual literacy education in the later years of primary school, young learners need to learn how to ‘think about looking’ (Ferreira & Newfield 2014) at the images in the stories and information texts they encounter in the classroom.
Thus, student teachers who will work in primary schools need content and pedagogic content knowledge that will enable them to facilitate such thinking.
In the next section we present and reflect on a selection of items designed to assess elements of student teachers’ content and pedagogic content knowledge of visual and critical visual literacy.
Ethical considerations
Ethical clearance to conduct this study was obtained from the University of South Africa College of Education Ethics Review Committee. The ethical clearance number is 2023/05/10/90502744/36/AM. Permission to use the illustrations on which the designed test items are based was obtained by PrimTEd co-ordinators. Test items selected for this article were excluded from those used in the tests administered to students.
Findings and discussion
Items designed for assessing student teachers’ content and pedagogic knowledge of visual and critical literacy
The open access materials included in the storybooks and teacher resources developed for the African Storybook Initiative1 have proved excellent for devising questions pertaining to visual literacy, but the difficulty of formulating such questions in multiple-choice format remains, as we illustrate in the example below.
The example comes from a South African Institute for Distance Education (Saide)1 resource designed for teacher professional development work in Uganda. The story used in the resource is originally from Mozambique but was versioned into one of the languages used in Uganda. Neither the Ugandan language nor the Mozambiquan origin of the story is centrally important to the items devised about the illustration for the PrimTEd test, although we acknowledge the value of using a story from Africa in an African language.
The South African Institute for Distance Education presents an illustration (see Figure 1) by Hélder de Paz Alexandre titled Why Frog is so ugly (Mozambican folktale 2014) as a resource for teachers to utilise for conversing with children. They advise teachers to look at the picture, then think about questions to ask children, and finally make some suggestions to teachers. The next section offers more insight into this Saide resource
Talking about pictures
Look at the pictures in the Mozambican folktale, Why Frog is so ugly.
- What questions could you ask about this picture from the storybook?
- What conversations could you have with children about this picture?
We had the following ideas for questions:
- The frog has a speech bubble (or a thought bubble) in the picture. What language is the frog speaking (or thinking in)? What is it saying or thinking?
- Do frogs really use language? How do we know?
- What colour is the frog in the picture? Are frogs this colour in life?
- Does this frog have a tail? Do frogs usually have a tail?
- How many legs does the frog have?
In the Saide resource, each of the bulleted questions designed to be asked by teachers could be used to promote lively discussion in a primary school classroom and to address aspects of visual literacy. For the PrimTEd test, we attempted to use the illustration and the accompanying questions to design MCQs to assess aspects of student teachers’ visual literacy knowledge together with their understanding of the importance of working with learners’ linguistic repertoires (McKinney 2017).
Box 1 presents the first example of four visual literacy MCQs followed by a brief commentary.
| BOX 1: Visual literacy multiple choice questions with brief commentary. |
Similar MCQs could be designed to assess student teachers’ knowledge of the metalanguage of visual literacy or critical visual literacy as in the examples presented in Box 2.
| BOX 2: Multiple choice questions to assess student teachers’ knowledge of metalanguage of visual or critical literacy. |
For Question 4 in Box 2, in recognition of the limited teaching of visual literacy that some first-year student teachers are likely to have experienced (see Mbelani & Murray 2009), we decided to provide support. In our view, this is an example of an MCQ in which all the distractors are visually similar and plausible with the cognitive level appropriate for entering BEd students, although we hope that graduating teachers would find it easy to identify the correct answer.
While each of the MCQ items above attempts to assess an aspect of student teachers’ visual literacy, none of them attempts to assess knowledge of critical visual literacy. In our view designing MCQs to assess the latter is even more of a challenge. Ferreira and Newfield’s ‘What or Who? How? Where?’ questions provide a framework for critical visual literacy questions that could be asked about the frog illustration:
- What language does the frog speak? Why has this language been used? What other languages could the illustrator have chosen? (The question translates into English as What can I do?)
- What does the illustrator want you to notice about this frog?
- If you drew a frog, would it look like the one on the storybook page? Why or why not?
Teachers could ask primary school learners each of these questions to assist them to think about an illustrator’s choices and the likely influence of these choices on readers of this page from a story. Very similar questions could also be asked of student teachers. However, designing MCQs based on this illustration to assess aspects of student teachers’ critical visual literacy knowledge is a much greater challenge. The MCQ item in Box 3 was designed as an attempt to assess whether student teachers understand that a designer’s choices of image and layout on a page attempt to position viewers or readers to respond in particular ways.
| BOX 3: Multiple choice question to determine whether student teachers comprehend that a designer’s image and layout choices on a page are intended to position viewers or readers to respond in specific ways. |
In addition to using the African Storybook Teachers’ Resource to design visual literacy test items, this resource was used to design several items for assessing student teachers’ understanding of the importance of valuing learners’ home languages, and of drawing on their full linguistic repertoires in the classroom. Question 6 is one example of such an MCQ item (see Box 4).
| BOX 4: Multiple choice question to assess student teachers’ understanding of the importance of valuing learners’ home languages, and of drawing on their full linguistic repertoires in the classroom. |
As noted by Callow (2018:5), ‘picture books continue to be cornerstone resources in primary classrooms, enduring in their appeal, but at the same time evolving, with authors and illustrators exploring new forms and concepts’. Given that images and their positioning on the page or screen are central to the meanings available in fiction and non-fiction books for primary school learners, the PrimTEd item writers have attempted to design MCQs to assess student teachers’ visual literacy knowledge and practices in relation to picture books. Question 7 exemplifies such an item (Box 5). Drawn from the American children’s story Charlotte’s web, which features prominently on South African educational websites alongside classroom resources, the item uses a scene from the 2006 edition.
| BOX 5: Multiple choice questions to assess student teachers’ visual literacy knowledge and practices in relation to picture books. |
Due to copyright constraints, the book cover is not reproduced here, although it is widely available online. The image depicts Wilbur the pig, with Charlotte the spider perched on a web atop his snout, set against a farm sunset backdrop.
Conclusion
Reflections on work in progress
To conclude this article, we reflect briefly on what we have learned thus far from our experiences of designing MCQs for the assessment of visual and critical visual literacy content and pedagogic content knowledge.
Firstly, we suggest that MCQs can be designed successfully to assess student teachers’ subject or content knowledge of the metalanguage of both visual and critical visual literacy because correct and incorrect options can be offered as single words or short phrases. Knowledge of this metalanguage should enable teachers to comprehend and discuss articles and books that focus on visual literacy and critical visual literacy and to use what they have learned in planning lessons. In teaching visual and critical visual literacy in primary schools, teachers also need to know how to ‘version’ this metalanguage to make it comprehensible to primary school learners so that these learners can extend the ways in which they ‘read’ and discuss images and layout on a page or screen.
This is an aspect of pedagogic content knowledge for which we have not yet attempted to design MCQs, although it should be feasible to do so as ‘simpler’ words, phrases, or examples could be offered as options in MCQ format.
Secondly, we have found it challenging to design MCQs that do not position testees to take up the item designers’ position on an image – a position that may not be equally fair to all of them. As some of those interviewed for Schilder et al.’s (2016:43) study noted, ‘[i]t is difficult to take your own philosophical views out of assessment’.
We suggest that it is particularly difficult to do so when offering multiple options, only one of which is ‘correct’, given that an obvious question to ask is, ‘Correct according to whom?’ In our view, ability to read and respond critically to a visual text is more appropriately assessed through questions that enable a range of responses and rationales for these responses on the part of the test taker.
Thirdly, as indicated in Question 5 (Box 3), we suggest that it is slightly easier to design MCQ items to assess student teachers’ knowledge of how to teach critical visual literacy than to assess their critical visual awareness because a range of plausible teaching strategy options or teacher questions can be offered.
Fourthly, while we think it is feasible to design MCQs to assess some aspects of knowledge of pedagogic practices associated with teaching visual literacy, the items are likely to be quite wordy, and thus time-consuming for testees to read, because of the descriptions needed in both the stem and the four options.
While MCQs may be the best option available for large-scale, computer-marked national assessments, perhaps it should be accepted that these are not well suited to assessing all aspects of student teachers’ subject and pedagogic knowledge of visual and critical visual literacy. We suggest that teacher educators teach ITE students how to use a range of more open-ended and multimodal strategies to assess learners’ developing visual literacy and critical visual literacy. In addition to theorising visual literacy and critical visual literacy, the work of scholars such as Janks (2010), Janks et al. (2014), and Ferreira and Newfield (2014) referred to above, together with others such as Vasquez (2014) and Vasquez, Janks and Comber (2019), provides examples of how to engage primary and secondary school learners in activities that can be assessed both formatively and summatively. When teacher educators use such open-ended and multimodal strategies in assessing their students’ content and pedagogic knowledge of visual and critical visual literacy, and provide feedback to their students, they are modelling how graduate teachers could use open-ended, multimodal assessment tools in their classrooms.
Acknowledgements
We express our sincere gratitude to the PrimTEd project leaders for their invaluable support throughout the development of this manuscript and for granting permission to utilise the PrimTed dataset in this article.
Competing interests
The authors declare that they have no financial or personal relationships that may have inappropriately influenced them in writing this article.
CRediT authorship contribution
Duduzile P. Zwane: Conceptualisation, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Validation, Visualisation, Writing – original draft, Writing – review & editing. Yvonne Reed: Conceptualisation, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualisation, Writing – original draft, Writing – review & editing. Both authors reviewed the article, contributed to the discussion of results, approved the final version for submission and publication, and take responsibility for the integrity of its findings.
Funding information
This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.
Data availability
The authors confirm that the data supporting this study and its findings are available within the article and its listed references.
Disclaimer
The views and opinions expressed in this article are those of the authors and are the product of professional research. They do not necessarily reflect the official policy or position of any affiliated institution, funder, agency, or that of the publisher. The authors are responsible for this article’s results, findings, and content.
References
Aitchison, J., Dixon, K., Pretorius, E., Reed, Y. & Verbeek, C., 2020–2021, Standards for South African language and literacy graduate teachers, Prim TEd Project, Department of Higher Education and Training, Pretoria.
Arnold, R., Ireland, J., Mahato, P. & Van Teijlingen, E., 2022, ‘Writing and publishing a reflective paper: Three case studies’, Welhams Academic Journal 1(1), 4–11.
Association of College and Research Libraries, 2011, ACRL visual literacy competence standards for higher education, viewed 22 April 2025, from https://ala.org/acrl/standards/visualliteracy.
Association of College and Research Libraries, 2022, Framework for visual literacy in higher education, viewed n.d., from https://ala.org/acrl/standards/visualliteracy.
Attia, M. & Edge, J., 2017, ‘Be(com)ing a reflexive researcher: A developmental approach to research methodology’, Open Review of Educational Research 4(1), 33–45. https://doi.org/10.1080/23265507.2017.1300068
Bassey, M., 1999, Case study research in educational settings, Open University Press, Milton Keynes.
Bowen, T., 2017, ‘Assessing visual literacy: A case study of developing a rubric for identifying and applying criteria to undergraduate student learning’, Teaching in Higher Education 22(6), 705–719. https://doi.org/10.1080/13562517.2017.1289507
Callow, J., 2018, ‘Classroom assessment and picture books – Strategies for assessing how students interpret multimodal texts’, The Australian Journal of Language and Literacy 41(1), 5–20. https://doi.org/10.1007/BF03652002
Dixon, K., 2005, ‘Language and the designing of texts’, English Teaching: Practice and Critique 4(3), 97–110.
Ferreira, A. & Newfield, D., 2014, ‘Critical visual literacy’, in H. Janks, K. Dixon, A. Ferreira, S. Granville & D. Newfield (eds.), Doing critical literacy, Routledge, New York, NY.
Freire, P., 1972a, Cultural action for freedom, Penguin, Harmondsworth.
Freire, P., 1972b, Pedagogy of the oppressed, Penguin, Harmondsworth.
Gardner, H., 1983, Frames of mind, Basic Books, New York, NY.
Harrison, K., n.d., ‘What is visual literacy?’, Visual Literacy Today, viewed 22 April 2025, from https://visualliteracytoday.org/what-is-visual-literacy/.
Janks, H., 2010, Literacy and power, Routledge, New York, NY.
Janks, H., 2014, ‘Introduction’, in H. Janks, with K. Dixon, A. Ferreira, S. Granville & D. Newfield (eds.), Doing critical literacy, Routledge, New York, NY.
Kalantzis, M., Cope, B. & Harvey, A., 2003, ‘Assessing multiliteracies and the new basics’, Assessment in Education 10(1), 15–26. https://doi.org/10.1080/09695940301692
Kedra, J., 2018, ‘What does it mean to be visually literate? Examination of visual literacy definitions in a context of higher education’, Journal of Visual Literacy 27(2), 67–84. https://doi.org/10.1080/1051144X.2018.1492234
Kedra, J. & Zakeviciute, R., 2019, ‘Visual literacy practices in higher education: What, why and how?’, Journal of Visual Literacy 38, 1–7. https://doi.org/10.1080/1051144X.2019.1580438
Kress, G. & Van Leeuwen, T., 2006, Reading images, 2nd edn., Routledge, New York, NY.
McKinney, C., 2017, Language and power in post-colonial schooling, Routledge, New York, NY.
Mbelani, M. & Murray, S., 2009, ‘Seeing is natural, but viewing is not: Teaching visual literacy in a rural classroom’, Education as Change 13(1), 59–71. https://doi.org/10.1080/16823200902933586
Mnyanda, L. & Mbelani, M., 2018, ‘Are we teaching critical digital literacy? Grade 9 learners’ practices of digital communication’, Reading & Writing 9(1), a188. https://doi.org/10.4102/rw.v9i1.188
Moloi, Q., 2021, How to write MCQ, Internal training, Prim TEd, 10 October 2021. Unpublished workshop materials.
Moodley, V., 2015, ‘Visual literacy in high-stakes testing: Implications of washback for language teachers’, Literacy Information and Computer Education Journal 6(4), 2054–2062. https://doi.org/10.20533/licej.2040.2589.2015.0274
Mozambican folktale, 2014, Why Frog is so ugly (Colour-in), Mozambican Writers, African Storybook, Johannesburg, South Africa, viewed 22 April 2025, from https://www.bookfusion.com/books/204251-why-frog-is-so-ugly.
Newfield, D., 2011, ‘From visual literacy to critical visual literacy: An analysis of educational materials’, English Teaching: Practice and Critique 10(1), 81–94.
Newfield, D., Andrew, D., Stein, P. & Maungedzo, R., 2003, ‘No rubric can describe the magic’, Assessment in Education 10(1), 61–81. https://doi.org/10.1080/09695940301695
Prim T-Ed Literacy Working Group, 2020–2021, Knowledge and practice standards for primary teacher education graduates: Language and literacy, DHET, Pretoria, viewed 22 April 2025, from https://www.jet.org.za.
Reed, Y., 2014, ‘Designing assessment of multimodal representations of themes from pleasure reading’, in A. Archer & D. Newfield (eds.), Multimodal approaches to research and pedagogy, pp. 207–228, Routledge, New York, NY.
Roberts, N. & Mort, T., 2023, ‘Designing an English language and literacies knowledge and skills test for initial teacher education students in South Africa’, Journal of Education 90, 32–48. https://doi.org/10.17159/2520-9868/i90a02
Schilder, E., Lockee, B. & Saxon, D., 2016, ‘The challenges of assessing media literacy education’, Journal of Media Literacy Education 8(1), 32–48. https://doi.org/10.23860/jmle-8-1-3
University College Dublin, n.d., Teaching and learning resources, viewed n.d., from https://www.ucd.ie/teaching/resources/
Vasquez, V., 2014, Negotiating critical literacies with young children, 2nd edn., Routledge, New York, NY.
Vasquez, V., Janks, H. & Comber, B., 2019, ‘Critical literacy as a way of being and doing’, Language Arts 96(5), 300–311. https://doi.org/10.58680/la201930093
Wei, L., 2022, ‘Translanguaging, multimodality, southern theory and pedagogical possibilities’, Pedagogies 17(4), 408–412. https://doi.org/10.1080/1554480X.2022.2143090
Weideman, A., 2011, ‘Academic literacy test: Design, development, piloting and refinement’, Journal for Language Teaching 45(2), 100–112. https://doi.org/10.4314/jlt.v45i2.6
Yeh, H.-T., 2010, ‘Towards evidence of visual literacy: Assessing pre-service teachers’ perceptions of instructional visuals’, Journal of Visual Literacy 29(2), 183–197. https://doi.org/10.1080/23796529.2010.11674680
Footnote
1. See www.saide.org.za.
|