Abstract
Keywords
Introduction
Visual data generated by participants in a study can assist researchers to obtain deeper or more vivid understanding of the social meanings in the material produced. These data may be acquired, for instance, when participants draw or paint or produce photographs or when they create forms from clay in response to researchers’ questions or directions. Despite the abundant use of such material in social sciences studies, the processes followed to analyse it are not always easy to apply, lack a guided analysis or are inadequate for the range of participant-constructed data. We present an analytical tool that offers a consistent procedure, applicable across subject disciplines and for different research purposes, to guide the systematic, transparent, and replicable analysis of participant-generated visual data. The knowledge obtained by using this tool could then be used with knowledge gathered from a separate, independent, but similarly rigorous analysis of textual data collected in the study. The article sets out first to present existing methods to analyse participant-created visual data indicating the need for an analytical tool for use by researchers with varying analytical skills, across subject disciplines, and with a clear procedural application. Second, it describes the development and presentation of the analytical tool (CIDA), adopting an empiricist and pragmatist approach, using design-based research. Three, the article applies CIDA to data obtained from the Mmogo-method, a visual data-collection method. The article concludes with a discussion, limitations, and ethical considerations. Next, we present a brief overview of existing visual data analysis methods and theoretical frameworks.
Methods to Analyse Participant-Created Visual Data
Analytical approaches to visual data created by participants could be guided by a specific theoretical framework, participants’ involvement, to generalise results, and test hypotheses, or to identify representational meanings.
Drawing on a theoretical framework to analyse participant-created visual data is illustrated by Liebenberg (2009) who used grounded theory’s sequential coding phases. Other examples of theory-driven analytical approaches include discourse analysis, a feminist approach, a psycho-analytic approach, or a semiotic approach (see Capous-Desyllas & Morgaine, 2018; Liebenberg, 2009; Theron et al., 2011; Van Leeuwen & Jewitt, 2001). Application of a selected theoretical framework or approach to the analysis of visual data obtained from participants’ creations often limits the analysis to the boundaries of the selected framework.
Participants’ involvement in visual data analysis vary. In some instances, participants are actively involved in the analysis through a “dialogical process around the image” (p. 60) (Liebenberg et al., 2012) or through collaborative writing (Mitchell et al., 2011). The analysis of such created-image data also relies mostly on the analysis of the language or transcribed textual data verified by participants in a process of member checking: participants get the opportunity to correct misinterpretations that may result from the researcher’s analysis or to provide additional information (see Koelsch, 2013), thereby contributing to the trustworthiness of the findings (Lincoln & Guba, 1985). The problem, however, as Morse (2015) argues, is that member checking is often impractical; it can also be difficult for participants, who may struggle to recognise their own material once it has undergone analysis at higher levels of abstraction. Analytical approaches to visual data without relying on participants’ accounts or interpretations of the material they have created is, however, limited.
Existing procedures using visual data as a separate unit of analysis are usually applied to generalise results and test hypotheses (Bell, 2013), or to identify representational meanings (Jewitt & Oyama, 2013; Van Leeuwen & Jewitt, 2001). They are often orientated towards the analysis of art, culture, and literature, but with little practical relevance to conducting a systematic analysis of the visual data as a separate unit of analysis from an atheoretical broad perspective, with no participant involvement. To this end, our search for an analytical tool was guided by the following questions: What analytical tool could be used by inexperienced as well as experienced researchers, and without requiring extended knowledge of, for instance, arts, psychoanalysis, or semiotics? How can this analytical tool be applied by researchers individually or in a team? What procedure is needed to lead researchers step-by-step from identification and description to interpretations and conclusions; contain the logic of incremental understanding of the representation; and be accountable for the groundedness of (competitive) interpretations and conclusions?
Development of the Tool
We adopted an empiricist and pragmatist approach, drawing on design-based research principles as proposed by Koskinen et al. (2011). The analytical tool was developed in the context of mutually informing processes of applying VDA theory and iterative user-centred feedback (see also Michel, 2007).
Design-Based Research
This tool has been constructed using design-based research which draws on the epistemological aim to create artefacts, products, tools (analytical), services, interventions, and systems that respond as well as possible, to the needs of the intended end users (Gregor & Hevner, 2013). Design research is an iterative process and, for our purpose, three phases have been applied (see Hevner, 2007; McKenney & Reeves, 2019; Plomp & Nieveen, 2013; Van den Akker et al., 2006). Phase 1 consists of four steps. In Phase 2 cyclical processes are applied to develop the tool through feedback and continuous revisions; and Phase 3 deals with the assessment and dissemination of the tool. A visual representation of the process is presented in Figure 1. Visual representation of the process of developing CIDA.
Phase 1: Develop Initial Tool
We applied four steps in this phase to analyse users’ needs and context, and literature search and assessment.
Step 1. Analyse the Needs of the Intended Users
We required an analytical tool inclusive of several approaches that focused on image-based data as a separate unit of analysis; that is systematic (follows a set procedure) and easy to use; that relies on the observations of an individual researcher or a team of (co)-researchers; and that is transparent (open to scrutiny and verification). We identified the requirements for the tool and defined them as being: - adaptable to varied approaches, focusing on image-based data, systematic, and easy to use; - reliant on the observations of an individual researcher or a team; and - transparent.
Step 2. Analyse the Context
We needed an analytical tool for: - application to an academic and research context; - use by inexperienced as well as experienced researchers; and - not requiring extended knowledge of, for instance, arts, psychoanalysis, or semiotics.
Step 3. Consult literature
Development of the analytical tool began with a literature search using the following concepts: visual methodologies, arts-based research, visual research, arts-informed research, visual arts methodology, image-based (data) analysis, and visual meaning-making.
Step 4. Assess literature
In design research, an extensive and systematic account of sources is uncommon because the approach is mainly heuristic. To this end, we selected literature covering a compendium or broad overview of different VDA approaches, and that offered practical instructions to guide a detailed analysis, would be generally useful and extend the boundaries of a specific tradition (e.g. psychoanalysis, arts, literature, ethnography). We applied the following selection criteria in identifying the literature to develop the tool: exclude theoretical elaborations; include literature relevant to the intended use (e.g. video analysis insufficiently relevant; aesthetic analyses of art partially relevant; literature on photographic elicitation rejected); include components applicable to an interdisciplinary setting; and, from an empiricist and pragmatist approach, include literature with components that would contribute to the development of a practical analytical tool for VDA.
The identified sources were mostly theoretically orientated manuals with very little practical instruction for performing VDA. We scrutinised the literature for VDA of participants’ experienced social meanings in the natural context in which they occur, which we called social framework use. This framework excludes visual data obtained for therapeutic or documentary purposes or for aesthetic assessments. In other words: the image and its analysis are not intended to cure a participant or present a fluent visual story. Participants’ assessment of the inherit beauty of the image is also irrelevant. For this reason, two guidelines informed the selection of components for the analytical tool: - First, theory and methodology of VDA to delineate the boundaries of the analytical tool (see Banks, 2001; Bohnsack, 2008; DiBartolomeo et al., 2015; Drew & Guillemin, 2014; Grady, 2008; Emmison & Smith, 2007; Knowles & Cole, 2008; Liebenberg et al., 2012; Lynn & Lea, 2005; Mason, 2005; Theron et al., 2011). - Second, components that are useful and practically orientated (see Margolis & Pauwels, 2011; Mitchell, 2008, Rose, 2016, Schnettler & Raab, 2008, and Van Leeuwen & Jewitt, 2001) for a comprehensive discussion).
We used the findings from Phase 1 to develop a first draft of the analytical tool.
Phase 2: Improving the Tool
The development of the tool entailed cyclical processes (see Koskinen et al., 2011). The analytical tool was first presented to experienced researchers in VDA to obtain feedback from several collegial discussions. The tool was applied 12 times in two countries (South Africa and The Netherlands) with postgraduate social sciences students—four groups in South Africa and eight groups in the Netherlands. Groups varied in size from six to 15 students. Student groups provided user feedback as part of their academic curriculum to practise data analysis; the discovery of new knowledge through research forms part of the mandate in a tertiary education setting. We provided the various groups with different examples of participant-constructed data but applied the same analytical procedure. We removed all identifiable information from the data examples and requested the student groups to treat the information shared in the groups as confidential. Ethical permission to use feedback from the (anonymous) users to improve the tool-in-progress was not obtained because the focus was on developing the tool for the purpose of analysing visual data. Groups discussed the applicability of the analytical tool critically and suggested revisions. Subsequently, we revised every phase of the analytical tool three times to ensure that it enabled a focused, guided analysis. Finally, we evaluated the tool against the requirements set out in Phase 1 and we named it: Created-Image Data Analysis (CIDA).
Phase 3: Assessment and Dissemination
Created-Image Data Analysis (CIDA) Analytical Tool.
The CIDA tool consists of five phases, each with an analytical focus and operational questions (see Table 3). Phase 1 covers the basic information; Phase 2 examines the elements and organisation of the visual representation; Phase 3 analyses its logic or cohesion; Phase 4 interprets meaning; and Phase 5 concludes with an evaluation. In applying CIDA, we suggest the following procedure. - Not all the CIDA elements may be relevant for every image-based dataset, because of the general and inclusive nature of the analytical tool. Every entry should be completed step-by-step, systematically, and meticulously. If an entry is irrelevant, indicate this as ‘Not applicable in this case’. - Carefully, closely, and repeatedly observe the image-based data. - Analyse one image or one case at a time. In multiple cases, apply CIDA multiple times. The number of repetitions depends on the level of saturation. The analysis is completed when it is possible to provide a satisfactory and theoretically sound answer to the research question (Timmerman et al., 2019).
Example of Mmogo-Method Participant-Created Visual Data
Exploration of meanings in social phenomena and often hard to address topics (e.g. relational experiences, loneliness), particularly in contexts of diversity such as South Africa, required a novel approach to collecting data. The Mmogo- 1 method®2 was developed as a data-collection tool to obtain thick, detailed and layered visual, textual and observational data (see Roos, 2016a). It is a relationally and context-sensitive focus group method (see Barbour, 2014; Chilisa, 2020), focusing on creating an optimal interpersonal space for data collection that enables research participation irrespective of participants’ or researchers’ background (socio-economic or socio-cultural) and by its composition and application provides a transformative context. Since its development in 2002, the method has been applied in more than 30 different research topics (social science, environmental science, community psychology, youth studies, socio-gerontology), thereby demonstrating its applicability across subject disciplines and contexts (Dlamini & Tesfamichael, 2021; Liebenberg & Theron, 2015; Malpert et al., 2017; Romm, 2018; Theron, 2016).
The Mmogo-method: Participant-Created Visual Data
Visual data from the Mmogo-method are obtained from participants’ visual representations and descriptions. We applied due diligence in obtaining informed consent from participants before data collection and in order to be able to use the data for future purposes, in this instance to develop an analytical tool.
In applying the method, eight to 10 volunteers seat themselves in a circle. For optimal interaction, norms are introduced, such as transparency and predictability, and, by way of introduction, participants are informed what will be expected of them; how the group will be involved, and that consequently confidentiality can be ensured only partially. They are assured of unconditional acceptance, which means that participants or their visual constructions will not be judged in any way. Following the introduction, participants―for example, in this instance, young men―are provided with materials (malleable clay, beads of different sizes and colours, and dried grass stalks) to construct representations, as invited by the researcher:
The visual data obtained from the Mmogo-method provide detail about the social meanings of participants that formed as they related and interacted with the social and material world, drawing on Blumer (1969). Analysis of the visual data obtained from the Mmogo-method is based on the assumption that nothing in the shape, selection of the colour of the beads, or the structure of the configuration of the visual representation is meaningless, accidental or random.
Example of the Mmogo-Method in Applying CIDA
In applying the tool, we selected participant-generated visual data that we had obtained using the Mmogo data-collection method. Visual data were obtained from Setswana-speaking younger people about their experiences of their relationships with older persons in a rural village Khuma, South Africa. Research on intergenerational relational experiences with Setswana-speaking people in rural South Africa had been conducted mostly with segregated generational groups, using interviews, focus group discussions or the Mmogo-method. Findings indicated ineffective relational interactions between related and unrelated older and younger Setswana-speaking people in rural South Africa. Older persons perceived younger people as stubborn, disobedient, and disrespectful, while younger people experienced older people as rigid, demanding, and sometimes abusive (Chigeza et al., 2021). Intergenerational interactions around mobile phone and generational expectations of giving and receiving care confirmed unsatisfactory generational experiences and perceptions (Roos & Robertson, 2019; Roos, et al., 2017). Yet it was unclear what actually occurred to activate social power and explain what deeper social structures were involved in the relational dynamics between older persons and younger people, particularly in a traditional, rural community.
It was therefore decided to invite unrelated older and younger Setswana-speaking people from the same rural community to participate in the same research context. Older and younger people participated as two separate groups in the intergenerational group reflecting technique (IGRT) (Roos, 2011; White, 2000) in combination with the Mmogo-method. In applying the IGRT, one generational group first assumed an active listening position while the other generational group described their experiences in relation to the listening group. For this purpose, the younger people were invited first, to express their experiences visually in relation to unrelated older persons through the Mmogo-method. On completion of this initial stage, the older persons switched positions with the younger people and reflected on what the younger people had said, while the latter assumed an active listening position relative to the older persons.
Visual Representation With Verbatim Explanation of a Young Man’s Experiences in Relation to Older Persons a .
aVisual representation and verbatim explanation reprinted by permission from Springer. The Mmogo-method and the intergenerational group reflecting technique to explore intergenerational interactions and textual data analysis (Roos, 2016b, pp. 93–94) and Theorizing from the Mmogo-method: Self-Interactional Group Theory (SIGT) to explain relational interactions (Roos, 2016c, p. 160).
Guiding Questions to Conduct a Systematic Visual Data Analysis

Visual representation by a younger Setswana-speaking man.
Discussion and Concluding Remarks
The need for an analytical tool that is atheoretical, accessible, user-friendly, practical, and designed for low-threshold analysis of image-created data informed the development of CIDA.
The application of CIDA, as demonstrated here, yielded different interpretations and micro-understandings of one case study. It serves as another approach to obtaining social meanings. In the example presented in this article, CIDA revealed the underlying generative mechanisms of intergenerational dynamics in a rural South African community. From the perspective of the younger person who created the image, older individuals act as the guardians of socio-cultural boundaries; they control intergenerational exchanges, and, when they perceive a symbolic threat, such as younger people who challenge socio-cultural practices (norms), the older individuals revert to threatening or restrictive behaviour. In combination with the textual data (see Roos, 2016b and Roos, 2016c for a comprehensive discussion of the findings obtained from the analysis of textual data), we think that interpretation #1 offered in Phase 4 is more completely grounded in our analysis, and better includes the contradictory perspectives of the representation, thus offering richer meaning. The request to construct visual data is about younger people in relation to older individuals and not from the perspective of older persons. Perspective #2 fits less well because this interpretation sets out from older persons as subject. On a formal level, the two interpretations have a core in common: for some reason (good and understandable or bad and obsolete) there are boundaries; they are contested and they are kept. There is no free exchange of domains (inside–outside) and it is an older man who controls this exchange with some force. The application of CIDA therefore confirms the textual data but from a different perspective.
The final integration of the independent visual and textual analyses produces an (ideographic) micro-understanding of each dataset. Integrating the micro-understandings at a higher level of interpretation thus produces transferable knowledge; new information applicable to similar contexts or research participant groups (See Lincoln & Guba, 1985; Miles & Huberman, 1994.
The universality of CIDA as an analytical tool was demonstrated by its applicability for analysis of visual data created by participants from a rural South African community by inexperienced and experienced researchers across diverse socio-cultural backgrounds. This was possible because the analytical tool offered a conceptually sound and empirically grounded understanding (or explanation) of the image-based material as it relates to the research question. To this end, CIDA provides social science researchers, students, and evaluation boards with clear markers for conducting image-based data analysis that is not speculative but rigorous. The application of CIDA should clearly comply with widely acknowledged ethical research practices, including but not limited to protecting the identity of the producers of the visual data, and in the use or dissemination of knowledge obtained by the analysis.
Limitations of the CIDA analytical tool include that it is not framed for application in a participatory and interventional change model but is intended, rather, to serve the practical purpose of interrogating data in order to provide the basis for interpreting them from an atheoretical perspective to provide plausible explanations of social phenomena. However, by involving the producers of the image-based data in the analysis, social change can be created from an action research perspective (see Capous-Desyllas & Morgaine, 2018). Another limitation is that the tool has not been applied to static visual data, such as crockery or furniture or clothes, or to image-based data that depend on motion, such as videos, picture shows, movies or in-vivo presentations.
In the application of this analytical tool, we demonstrated that it provides a grounded, rigorous and transparent methodological procedure for analysing participant-created image-data. We are confident that the analytical tool is able to: - be applied effectively to participant-generated visual data; - be used easily by individual researchers or by a team of researchers; - draw on several approaches during the process of analysis and therefore yields multiple perspectives and different conclusions about participants’ social meanings; - be used for analysing image-based data as a separate unit of analysis, resulting in a collection of micro-understandings related to the social meanings that develop in relation to a complex social reality; - provide a systematic procedure for analysing data irrespective of context or subject discipline; and - offer an opportunity to scrutinise and verify the analysis, thereby contributing to trustworthiness.
