top of page

DOI: https://doi.org/10.33008/IJCMR.2019.04 | Issue 1 | March 2019

Author: Matthew Freeman, Bath Spa University

Abstract

Both the biggest challenge and the biggest opportunity for understanding transmediality – itself the use of multiple media technologies to tell stories and communicate information – is the sheer breadth of its interpretation. Though primarily still seen as a commercial practice, this article explores the application of transmedia practices to the communication of history across multiple media platforms, questioning what this approach means to understandings of transmediality. More specifically, the article furthers discussions of the contribution that transmedia storytelling can make to educational practices, identifying new strategies for how transmedia storytelling is now being used to capture and narrativize historical memories, as media-based educational resources. To do so, the article focuses on the Colombian armed conflict and the Desarmados project, which I use to theorise how transmediality can work as historiography, allowing for not only a new way of experiencing and remembering history, but as that which can reshape history for the better, reconciling the past and the present.

Introduction

It may be a cliché, but it is often said that travelling broadens the mind – that immersing yourself in different cultures around the globe can open your eyes to the true potentials and possibilities of the world. Cliché or not, it is absolutely true. Toward the end of 2015, I was invited to teach on the Masters in Transmedia Communication programme at EAFIT

University in Medellín, Colombia, itself the first postgraduate degree devoted to transmediality in Latin America. Here, transmediality is not – or rather should not be – a commercial practice associated with fictional storytelling, franchise world-building, cross-promotion, branding, and so on. Instead, it is a political communication technique that is seen as key to developing social change in local communities; in this context, transmediality is about reconstructing memories and building educational bridges between past and future. As one of the postgraduate students at EAFIT University asserts, ‘I strongly believe that transmedia in Colombia can contribute to creating processes of memory, recognition and solidarity for the victims of the Colombian armed conflict. I think that using transmedia with local communities can be the clue to starting real processes of reconciliation in the country.’ When understanding transmediality, in other words, travelling really does broaden the mind.


Across the globe, people now engage with media content across multiple platforms, following stories, characters, worlds, brands and other information across a spectrum of media channels. And yet perhaps the biggest challenge and the biggest opportunity for understanding this ‘transmedia’ phenomenon right now is the sheer breadth of its interpretation. In the contemporary era of media convergence where the sharing of media across multiple platforms is increasingly accessible, transmediality has emerged as a global strategy for targeting fragmentary audiences and spreading content across a spectrum of media channels. Still, practices of transmediality are still most closely associated with what Birkinbine, Gómez and Wasko (2017: 15) refer to as the global media giants – those being ‘the huge media conglomerates such as Disney and Time-Warner, [which] take advantage of globalization to expand abroad and diversify’. Outside of the conglomerates, though, transmedia storytelling – the practice of telling stories across multiple media platforms, often in creative, digitised and participatory ways (Jenkins, 2003; 2006) – has evolved in far more experimental spaces in recent years. While transmediality is still a common strategy in Hollywood’s contemporary blockbuster fiction factory, so often tied up with corporate notions of brand-building, ‘cash nexuses’ (Lemke, 2004), ‘multiple revenue streams’ (Starlight Runner Entertainment, 2011) and the use of intellectual property as a brand-orientated ‘marketing assault’ (Alpert and Jacobs, 2004), smaller national communities and often far less commercial cultures around the world are now beginning to make very different, nationally specific uses of transmediality, applying the practices of the transmedia phenomenon to the needs of a nation or re-thinking the application of this phenomenon by reapplying it to non-fictional, political, or heritage projects (Freeman and Proctor, 2018). Such a shift feeds into wider global transformations towards the ‘unofficial’ appropriation of digital media platforms for socio-political purposes; Jenkins, Shresthova, Gamber-Thompson, Klinger-Vilenchik and Zimmerman (2016: 7), for instance, have explored the challenges now faced by the current youth generation seeking to acquire ‘the skills necessary for political participation at an age where there is less than complete access to the rights of citizenship.’


This article deals with one such example of political participation, focusing on the socio-political context of Colombia and its armed conflict. I explore the application of transmediality to the practice of communicating an aspect of Colombian history and its socio-political fallout across multiple media – questioning what this means to our understandings of transmedia storytelling. More specifically, in the most basic sense this article furthers discussions about the contribution that transmedia storytelling can make to educational practices. But beyond mere education, something that scholars including Jenkins (2009), Scolari (2016) and Teixeira Tárcia (2018) have each considered previously, this article identifies strategies for how transmedia storytelling has been used to narrativize memories and histories, as well as psychological and physical consequences of conflict, as media-based educational resources in schools. To do so, I focus on the Desarmados project (on which I served as a consultant for its later developments) as an indicative case study. Not about the history of transmedia storytelling, then, but instead a theorisation of how transmedia storytelling can be used to deal with history – that is, to narrativize history across media in ways that affords educational and socio-political benefits. And in doing so, I consider how this application of transmediality raises broader questions about exactly what transmedia practices are for, reflecting on the role of such practices in building cultural memory, fostering reconciliation, and creating new ways of experiencing and remembering history.


Conceptualising the Practice of Transmedia Historiography


It is now understood that ‘transmedia’ is not a noun, but rather an adjective in search of a noun. ‘Transmedia, by itself, simply describes some kind of structured relationship between different media platforms and practices’ (Jenkins, 2016). Thus scholars have turned their attention to ‘transmedia storytelling’ (Jenkins, 2003; 2006), ‘transmedia engagement’ (Evans, 2015), ‘transmedia branding’ (Tenderich and Williams, 2015) and so on. But what of transmedia historiography? How can we understand the use of ‘multiple media technologies to present information … through a range of textual forms’ (Evans, 2011: 1) as that which communicates the stories of history, embracing the multifaceted politics of those histories along the way? Research has delved into the relationship between the cultural form of transmediality and politics already, albeit in relation to ‘politicized [entertainment] properties like The Hunger Games, Game of Thrones, The Walking Dead, and Christopher Nolan’s Batman films’ (Hassler-Forest, 2018: 304). For as Hassler-Forest (2018: 297) stresses:


Transmediality is more than just a textual practice, in which a single narrative – or, more appropriately, storyworld – is strategically disseminated across multiple media (see Jenkins 2006). It is also a dialogic form that is constantly being reconfigured by competing forms of audience appropriation, technological transformations, and changing industrial practices.

By ‘transmedia historiography’, then, I mean the coordinated use of digital platforms and non-digital materials – integrated dialogically in ways that encourage audience appropriation – to transform how people make sense of a historical moment, encouraging more active ways of learning about the complex, multi-perspectival components that make up a given history, such as its politics, cultures, memories, and so on (see Freeman, 2019). Still, before analysing the workings of Desarmados – a project that will be fully outlined shortly but for now can be summarily described as an internationally funded initiative that aims to reconstruct the cultural memory of the Colombian armed conflict using video letters and other media artefacts – I will begin this article by outlining some of the key theoretical pillars needed to conceptualise transmediality as a historiographical education practice. This means delving into some existing scholarly understandings of transmediality, education, and historiography.


Today’s digital transmedial environment, itself ‘the migration of our media and our attention from one screen to many’ (Holt and Sanson, 2014: 1), has the potential to tell stories in new and dynamic ways across multiple media (Jenkins, 2006; Scolari, 2009; Freeman, 2016a). However, Hay and Couldry argues that understandings of transmediality are all too often based on Western-centric and commercial media sectors such as film and television: ‘International differences are obscured by the generality of the term “convergence culture”, and it can be helpful to consider convergence “cultures” in the plural’ (2011: 476). Pearson, too, notes that ‘researchers have focused primarily on the United States and occasionally the United Kingdom’ (2014: vi), thus leading to a rather macro-level interpretation of the workings of transmediality. By contrast, better understanding the practices of telling stories across media means acknowledging the innate multiplicity of transmediality’s potential. And this means establishing a cultural specificity approach to both the study and the practice of transmediality, conceiving of it as essentially a recognisable approach to creating and communicating stories whilst also taking into account the politics, peoples, ideologies, social values, cultural trends, histories, leisure and heritage of individual peoples and their own communities. Taking a cultural specificity approach to transmediality means mapping the many faces of transmediality in different countries. For as I argued previously, ‘past builders of fictional story worlds employed many different strategies that showcase just how many possibilities there are for telling tales across multiple media’ (Freeman, 2016a: 189-190).

So what are the possibilities for transmedia practices once applied as an educational strategy? One of the newer meanings for transmediality lies in its application to education, with educators and different governments around the world seeking to bring the digitised, creative and participatory engagement associated with the former to the teaching and learning practices of the latter (Fleming, 2013). Current debates in this area of digital literacy studies center around the integrated and diverse uses of digital technologies in educational contexts, for example how today’s youth generation are learning new things via uses of digital media (Scolari et al, 2018). Specifically, ‘transmedia education’ represents a move away from traditional learning and towards interactivity across multiple platforms and learning zones. The interactive power of a transmedial approach to education was recognised by the United States Department of Education in 2011. Jenkins (2009) challenged teachers to involve students and to encourage them to utilise what they see, hear, and read in a far more interconnected way, both in and outside of the school classroom. In such a system, students are urged to seek out additional content, explore different pieces of information in various contexts, interact easily with other readers, and evaluate ideas across formats. Later I will analyse how such a transmedial approach to education has been adopted to shape how school children have made sense of the Colombian armed conflict, but for now it is important to consider the conceptual relationship between transmediality, education, and historiography.

How, in other words, can a transmedial approach to communicating history create new ways of not just experiencing that history, but also reshape how it is remembered, acted on, and even transformed for the better? What is the value of thinking about transmediality as a historiographical practice? Conceptually, the art of transmedia storytelling has a great deal in common with the multi-perspectival narratives of a historiographical practice. In a fictional example of the former, for instance, the story may well switch from one character’s point of view to another’s, as the audience moves from one medium to another. See, for example, Wide Sargasso Sea, a novel written by Jean Rhys in 1966. Wide Sargasso Sea is a prequel to Charlotte Brontë’s famous 1847 novel Jane Eyre. Rhys’ novel followed the life of Antoinette Cosway, the first wife of Mr. Rochester in the Brontë novel, who was a secondary character in Jane Eyre that was turned into the hero of her own story. By switching between the perspectives of different characters across additional stories, the larger story of Jane Eyre was thus extended. As Jenkins (2009) puts it, this kind of transmedia storytelling is precisely about subjectivity – that is, ‘exploring the central narrative through new eyes, such as secondary characters or third parties. This diversity of perspective often leads fans to more greatly consider who is speaking and who they are speaking for.’ And much like a transmedia story, history, quite similarly, is never a single-perspective narrative; it cannot be easily synthesized into one single chronicle. Rather, the tales of history are entirely made up of a ‘collection of historians exchanging different, often conflicting analyses … students of history would be better served descending into the bog of conflict and learning the many “histories” that compose any given subject’ (Conway, 2015). In effect, both the consuming of transmedia stories and the learning of history operates on the basis that people will gain a richer and fuller understanding of that given story/historical event if they consume as much material relating to it as possible, across any number of platforms: ‘To fully experience any fictional storyworld, consumers must assume the role of hunters and gatherers, chasing down bits of the story across media channels … to come away with a richer experience’ (Jenkins, 2006: 21). Similarly, historiography is about rejecting the idea of a single, standardized perspective and instead embracing the idea that hunting down as many perspectives on history as possible will provide the fullest understanding. As such, applying the practice of transmediality to the learning of history makes sense, but more than this, it can also allow for a multi-perspectival way of communicating and sharing history that leads to reconciliation and solidarity for all parties involved, as I will now explore in relation to Colombian culture.


Colombian Culture and the Desarmados Project


Colombia has a population of 48 million, a landmass of 1.139.000 km2, with 5 million internally displaced people, 480,000 refugees, two left-wing guerrilla groups/armies and more than six new right-wing paramilitary groups/armies called BACRIMS (see Gómez and Velásquez, 2018). Colombia also has the most unequal distribution of wealth across the continent, with 30% of its population living in poverty, and it is experiencing one of the longest armed conflicts in the world, lasting almost 50 years (Fisas 2009; UNDP, 2010).


As part of its ongoing peace process, on May 25, 2015, the Colombian government issued decree 1038, under which it established the aspiration that all educational institutions, spanning pre-school to higher education, would promote the objective that young people and teachers alike have a newfound space for learning, discussion and reflection on non-violence, the culture of peace and sustainable development in the country of Colombia. In the Colombia Country Strategic Plan document (2017-2021), education is one of the Government Priorities, ‘targeting schoolchildren … [and] participation in education activities’, while also ‘prioritiz[ing] the areas most affected by the conflict.’ The need to understand the emergence and history of violence in Colombia has led researchers to consider the origins and multiple causes of the armed conflict, the main factors that have contributed to the persistence of the violence, and the impacts it has had on the population. As such, a number of Latin-American academics (see García-Durán, 2014; Gomez and Velásquez, 2018) highlight the need to adopt a multi-perspectival approach to education in order to understand the multifaceted nature of the Colombian armed conflict. Transmedia storytelling is one such multi-perspectival approach, establishing itself as the ideal communicative form for the complexity of the country’s political state. For some Colombian universities – such as EAFIT University in Medellín – transmedia storytelling is as a way of dealing with the complexities of the conflict precisely because of its multi-perspectival nature, as different media communicate different perspectives of the conflict: ‘The multiplicity of socio-political factors shaping the Colombian armed conflict highlights the need to adopt a complex and multidimensional approach in order to understand the nature, and future solution, of this conflict’ (Gomez and Velásquez, 2018: 178). As we shall see, transmedia in Colombia can contribute to creating processes of memory, recognition and solidarity for the Colombian armed conflict victims.

Indeed, out of this context comes Desarmados, an internationally funded initiative supported by the Colombian Ministry of Culture, EAFIT University, and Bath Spa University. The Desarmados project aims to reconstruct the cultural memory of the Colombian armed conflict using video letters and other digital/non-digital artefacts and was proposed as a pedagogical tool for the Colombian Chair of Peace. Its purpose is to involve young people with the country’s history and to give them a platform to ask questions to ex-guerrilla and paramilitary fighters as well as civilian victims. It harnesses the potentials of transmediality by allowing the young people of Colombia to meet the various voices of the armed conflict, like indigenous people, Afro-descendants, soldiers, teachers, ex-guerillas, paramilitaries, and so on. As will be demonstrated shortly, these groups can each tell their own experiences through multiple media platforms, in turn allowing students to better understand the origin and impact of the violence. Specifically, Desarmados aims to: harness and appropriate (commercial) practices of transmedia storytelling as tools for documenting the citizens of Medellín and for narrativizing their memories of the Colombian armed conflict; reconstruct the cultural memory of this armed conflict; and develop workshops with a total of ten secondary schools in Medellín to help engage children in the transmedia project and to test new transmedia education materials as tools for social enterprise between survivors and civil society. Desarmados was the result of the thesis of three students enrolled on the MA in Transmedia Communication at EAFIT University. The University subsequently presented the project to the Ministry of Culture, in the category ‘Co-production of Content for a Culture of Peace’, and won. After the delivery of the prize, the main website was built, which includes numerous interactive videos about the history of the armed conflict and over a dozen audio-visual video letters. Other transmedia materials deriving from the project comprise a journalistic resource, social media channels (Facebook and Instagram), a student-led workbook, and an app, which at the time of writing is in the final stages of development. The project was nominated in Colombia for the Kids’ Choice Awards 2017 in the ‘Favourite Website’ category and was presented at the international Build Peace conference in 2017.


Research for the project was based on the simple process of speaking to as many people as possible who had been impacted by – or themselves impacted – the conflict in one way or another, be them victims, politicians, ex-guerillas, and so on. These voices are the stories that were joined up across media, as project leader Juan Sebastián Zuluaga explains:

 

It is a platform that aims to generate an exchange of correspondences and, in addition,
become a pedagogical tool of the Chair for Peace. It offers an interactive map, with a timeline, showing animated videos that explain the relevant events of the armed conflict. The country of Colombia cannot simply turn the page after sixty years of conflict. If we forget the victims it is to victimize them a second time. Those who left, those who died and those who suffered during the conflict have to be in force in the memory of their society, otherwise it risks victimizing them all over again. So a project like this is not to revive wounds but is to remember that we have forever tarnished the human being.

Indeed, Desarmados was not intended as a piece of propaganda; rather, in its hope to not revive old wounds, the project sought to create a far more hopeful sense of reflection. That is to say, by allowing people to see and witness others, be them other victims or whoever else, the joining up of their voices across and between multiple media platforms sought to join up these different political and emotional perspectives into something that inspired solidarity, reconciliation, and reflection. Digging into the past so as to remedy the future, if you will.


The original methodological contribution of Desarmados as a practice discovery thus lies in its mix of qualitative research methods, multiplatform media production practices and pedagogic insight to comprehend how a coordinated use of narrative, audio-visual and textual content can be used to teach socio-political and historical aspects of an armed conflict. But more than this, Desarmados’s use of transmedia education strategies and materials showcase a link between multiplatform education practices and the development of peace-building. Allow me to now demonstrate these ideas in action via the project’s own media platforms. In the ensuing sections, first I will explain the function of each platform in historiographical terms before analysing how its technological affordances led to rich forms of understanding the Colombian armed conflict while inspiring positive acts of reconciliation and solidarity.

Website – remembering the past


Initiating the Desarmados project is its website (www.desarmados.org), its ‘mothership’, as Jenkins (2009) puts it – meaning the primary media platform that anchors the rest of the transmedia story and which all other platforms build upon. Thematically, the strategic function of the website is to remember the past, to provide a participatory means of learning about the origins of the violence and how the past has shaped the present. The website is divided into six sections: ‘History of the Conflict’, ‘Protagonists’, ‘Map of the Protagonists’, ‘Leave Your Study’, ‘Blog’, and ‘Pedagogic Material’. This final section will be discussed shortly, but for now I will focus on the first three of these sections, which all link together.

The ‘Map of the Protagonists’ page shows a basic map of Colombia, including its key cities. In the past, ‘[p]rinted maps were a popular way of holding transmedia stories together and contributing new narrative information to a story world’ (Freeman, 2016a: 81), such as the maps produced by author J.R.R. Tolkien for Middle Earth. But maps, especially digitised maps, today afford much educational value, too. For example, along the bottom of the Desarmados web page are specific dates – ranging from 1965 to the present day. Users are able to navigate through the various years and across different Colombian cities; when they do so, they can watch short educational videos that reveal something about the origins or the impact of the Colombian armed conflict in that particular city and/or year. These videos are mainly of individuals, teaching users something about place and history via subjective memories and experiences. Put simply, the map epitomises the educational strategy of the entire project – that is, that history is ‘not a collection of facts deemed to be “official” by scholars on high’ (Conway, 2015), but is only ever a grassroots set of individual memories, all in dialogue with each other and built up by all corners of a society. The map signals the central idea to users – i.e. students – that the history of Colombia belongs to the individual.

And the emphasis on the individual establishes a narrative for the history of Colombia that is then extended transmedially across additional parts of the website. Previously I argued that ‘it is now time to theorise transmedia storytelling not as a phenomenon that relates … to crossing media, but instead as a single experience of drillable multi-media consumption’ (Freeman, 2016a: 200). The Desarmados website is one such single experience of drillable multi-media consumption, with users encouraged to click through to the ‘Protagonists’ part of the website. Here, six videoletters, each documenting individual reflections on the personal impact of the Colombian armed conflict, are available to watch and listen to. Each of the videoletters come from very different people, be them ex-parliamentarians or victims who have been displaced from their homes. Discussing the strength of transmedia storytelling, Hancox argues that ‘its multifaceted use of multiple platforms affords arguably the best possible mode of storytelling – a mode that is capable of enhancing characterization, emotional and experiential engagement’ (2018: 166). Enhancing the characterisation of the Desarmados protagonists stems from the ability to upload your own ‘responses’ to each of the aforementioned videoletters, such as further videoletters, diaries, written letters or photos.

As such, users have a firsthand account of the testimonies of the people who have been silenced and forgotten by the conflict, of those who feel excluded and defeated. By allowing users to respond to and post their own memories in dialogue with those of others, a narrativised thread of correspondence is thereby created – a collective memory, if you will, based on a chain of personal memories, each providing feedback, discussion, questions and answers. It acts as a network of historical stories that are complemented by the data of the aforementioned map, together creating a history of place, of the events that were lived, and of individual motives or consequences of violence. This feature allows children and young people who see any of the stories to learn not only about the intimate experience of the event, but also about the context in which it occurred. More than this, the transmedial nature of the videoletters, i.e. with the individual and previously disparate voices of the conflict suddenly coming into contact with each other for the first time, as one videoletter responds directly to the last, works to create a conversation that actually affords a sense of reconciliation. Those who experienced personal loss, for example, sometimes expressed forgiveness in their videoletter having seen and heard from particular ex-parliamentary figures, who themselves expressed a sense of regret over the causes and consequences of the violence in their community; youth and ex-combatants began a correspondence exercise to get to know each other, recognising each other for the first time and learning of their common ground in terms of how they imagine the future of Colombia. Such is the ‘reflexive and self-organizing potential of transmediality on the level of culture, [as] each additional version of a text or its fragment influences the ways in which we understand and remember the source text itself’ (Ibrus and Ojamaa, 2018: 90). Put simply, the transmediality of the videoletters led to empathy on both sides, as well as a retelling of the history of the Colombian armed conflict based not on one perspective, but on the exchange of memories between different individuals.


Pedagogically, therefore, and unlike the average history book that does not allow for the exchange of views or stories, the Disarmed website makes participants out of students, participants out of individuals, and a collective narrative out of personal memories – all of which is underpinned by the transmedial exchange of correspondences (via videos, photos, letters, interviews, etc.). Looking forward, then, users are building new stories in dialogue with the past, shaping a more hopeful image for Colombia’s future based on reconciliation.

And this ability to create new stories, shaped via an exchange of correspondence, has implications for how we understand the value of telling a story across multiple media. It may be common knowledge to think of transmediality as a single narrative that is strategically disseminated across multiple platforms (Jenkins, 2006), but the Desarmados videoletters exemplify transmedia storytelling as a form of cross-generational postmemory. The concept of ‘postmemory’ describes the relationship that the ‘generation after’ bears to the personal, collective and cultural trauma of those who came before to experiences they seemingly ‘remember’ only by means of the stories, images and behaviors among which they grew up. But, as Hirsch (2012) elaborates, ‘these experiences were transmitted to them so deeply and affectively as to seem to constitute memories in their own right. Postmemory’s connection to the past is thus actually mediated not by recall but by imaginative investment, projection, and creation.’ In other words, postmemory describes the way that one generation remembers the past, and specifically the idea that the way in which they remember the past is quite often not though recall but through mediated images only. In terms of Desarmados and its process of narrativising history transmedially, what is important to note is that the very transmediality of the project website, i.e. its joining up of people and platforms, works almost to counter this issue of postmemory insofar as it puts different generations into contact with one another via multiple media sources, which themselves come into contact digitally. In effect, transmedia storytelling hereby allows one generation to speak to and learn from another – not directly, perhaps, but via watching and engaging with the larger narrativisation of everyone’s history.


Workbook – imagining the future


The Desarmados website may initiate the project, looking backwards to the past, but a more structured sense of engagement in real life was needed in order to accomplish the project’s ambitions. With ‘the real roots of transmedia storytelling [being] in education’ (Fleming, 2013), a workbook was subsequently designed for use in classrooms by secondary school students, guiding the process of learning about the Colombian armed conflict (see Fig. 1). In Colombia, it is common to find textbooks that offer concepts about peace and human rights in the context of the country’s conflict, and for a series of pedagogic activities to be developed in the classroom. However, in these textbooks there is often little interactivity between the students, teachers, and the protagonists of the armed conflict. Accordingly, the project team sought to explore which culturally-responsive transmedia storytelling practices can be used to teach the Colombian armed conflict to school children, delivering teaching guidelines and producing a set of materials to be used in the transmedial teaching practices of secondary schools in Medellín. Anchoring the educational resources in the classroom is thus its student workbook. Thematically, the strategic function of the student workbook is to imagine the future, or more specifically, to creatively imagine a better future for Colombia. The logic, quite simply, is that positive emotion trumps negative emotion; in the search for reconciliation, for catharsis, the project team wanted the transmedial act of crossing from one media platform to another to allow for a positive emotional reaction based on reflection.


Matthew Freeman
FIGURE 1

So, having witnessed the range of videoletters available at www.desarmados.org, the pedagogic journey of Desarmados continues via the workbook activities that are led by teachers in the classroom. As with the earlier analysed videoletters, students are required to reflect on the memories of others; the ‘protagonists’ of the website become characters whose lives are extended into the classroom setting, much like the character of Antoinette Cosway being extended from Jane Eyre to Wide Sargasso Sea. The subjective personalisation of this approach was designed to engage students more emotionally and to allow them to understand the meaning of the armed conflict and the violence that has been perpetuated on individual lives. The first question posed to students is: How do you imagine the people who have been part of the war? As Rojas points out, the history books have tended to represent these figures as barbarians, uncivilized, rebels, victimizers or victims: ‘In traditional historiography, the faces of the war have been divided between good and bad, ignoring their particularities and the contexts in which they have grown up’ (Rojas, 2001: 22). The pedagogic experience of Desarmados seeks to overthrow those kinds of prejudices, rejecting the notion of a single, standardized chronicle of the history of Colombia and its people in favour of an exchange of different, often conflicting memories, with students themselves descending into the proverbial bog of conflict and learning the many histories of this particular conflict. More than learning multiple, personalised histories, classroom exercises are designed to help the transformation of Colombia, a country mired in decades of violence, hatred and pain.


For example, classroom challenges, conducted in reaction to the website content, include letter writing, drawing, and memory tree games (see Fig. 2 & 3). Having witnessed a reflection on the loss of freedom, students might be asked, ‘What does freedom mean to you?, and to draw a more progressive idea of freedom in Colombia. As with the subjectivity of all forms of transmedia storytelling, these classroom challenges allow students to explore the central narrative of the conflict through new eyes, leading them to more greatly consider the question of who is speaking and who they are speaking for: ‘Solidarity and respect are reflected in my letter to Diana, one of the protagonists of Disarmed. In every mail we realize how young Colombians trust that peace is the way!!’ (Age 8). ‘The young people of the country admire [Diana] and trust that through teaching such as hers we can understand the virtues of peace’ (Age 10). As project leader Zuluaga explains further of these challenges:


This innovation generates spaces of interaction between the protagonists of the armed conflict in the country and society, at the same time that it seeks to sensitize young people in terms of understanding the causes and consequences of war and to encourage them to think together about the changes that are required to rebuild the country. All this in order to face a past in conflict and assume a process of peace and reconciliation that allows changes in the perceptions, attitudes and behaviors in our society to forge a shared and peaceful future.

Matthew Freeman
FIGURE 2

Matthew Freeman
FIGURE 3

Social Media – documenting the future


Utilising transmedia storytelling to draw profound attention to the perceptions, attitudes and behaviours in Colombian society require that the world of the story goes beyond the digital. In the case of Desarmados, its users are required to interact with the locales of the real world, which is where social media comes into play. Thematically, and most basically, the strategic function of the social media platforms – again, Facebook and Instagram – is to document the future, commemorating it in the real world. The project’s use of social media channels is really about extending the experience of the project outside of the classrooms and into daily life. Having gained a knowledge of the past (website) and imagined a vision for a better tomorrow (workbook), social media becomes a means to document this vision, joining up additional perspectives, reflections and memories across multiple media. Examples include students using social media to document their visions as graffiti drawing on walls, or posting further responses to the videoletters, etc., building the multi-perspectival histories further.

Of course, one of Jenkins’ original seven core principles of transmedia storytelling was ‘performance’, which concerns ‘the ability of transmedia extensions to lead to fan produced performances that can become part of the transmedia narrative itself’ (2009). But the type of performance being enacted by the Desarmados social media users is less to do with notions of fandom and more about capturing a sense of historic place. Joshua Meyrowitz commented that a lot of Westerners have lost touch with their sense of place because the ‘traditionally interlocking components of “place”’ (1999: 100) had been broken up by digital media since their location did not hinder them from always being ‘in touch and tuned-in’ or, as most would now say, connected to or ‘always-on’ their portable media (McStay, 2010: 3) – an idea that arguably also applies to any social media user. However, at a time when the innate connectivity and shareability of social media is also making certain strands of transmedia stories ironically fleeting, it is the role of locative media and physical real-world projects such as the aforementioned graffiti drawing to keep audiences politically engaged.

One such example of a locative, politically engaged extension of the Desarmados project is the use of its social media accounts to encourage users to consider the relationship between what they have learnt about conflict and its impact on their own community. ‘Enter www.desarmados.org,’ one Facebook post reads, ‘and you can share facts of the conflict that happened in your community so that together we can create a map of memory reconstruction so that these events will never happen again. Now it’s your turn!’ One message, for example – again written on a wall for all to see and captured via a photograph on Facebook – pleaded with the citizens of Medellín to remember the violence that took place in a specific street but, in response, to ‘recover humanity, solidarity and start a new era of peace in our streets.’


By inscribing parts of the transmedia story of the origins and impact of the Colombian armed conflict outside of screen-based media forms (and the classroom space) and onto the physical walls of real locations across Medellín, those inscriptions essentially become characters in the unfolding story. While I have implied throughout this article that the transmedia practice represented by Desarmados has little to do with the commercial whims of the likes of Disney and Time-Warner and their brand-based transmedia entertainments, it is certainly possible to draw a direct comparison between the social media strategy utilised by Desarmados and the practice of location-based promotion that has taken hold in the advertising industry. Scholars have discussed the ephemeral nature of new media promotion, from YouTube content and websites to interstitials and memes (Grainge, 2011; Pesce and Noto, 2016). With the rise of mobile technology, a promotional campaign now has the ability to both reach out to audiences and to guide them to specific locations as part of a broader, spatially linked experience. Broadly describing an internet-based scheme employing a scavenger hunt metaphor, these promotional practices may span multiple territories, and involve multiple users. The development of these locative forms of promotion have seen promotion as a whole become an explicit journey, with audiences invited to participate in one identifiable event in advance of engagement with another event. Consider the way that in 2014 Starbucks made use of locative mobile media technology to track consumers’ device IDs and locations, using that information to deliver personalised text messages with offers of 50% discounts on their favourite drinks at the most local Starbucks.

Occupying much more of a social-activist arena than this overtly promotional area, the Desarmados social media channels are nonetheless devised with a number of the same motives in mind. Just as with location-based promotion, the aforementioned Facebook examples sought to create a multimedia experience that transcended the screen and the classroom; there is also a similar degree of interactivity that is based on users generating content for projects by inputting their own meanings into how the images are experienced. There is even a comparable emphasis on equating experience to place, attaching location-based images to community spaces that are public and shared, with the communal nature of these images and spaces linked to the messages of reconciliation, solidarity, and change.

All of which is to say that the same promotional leanings that are inherent to social media platforms and which afford myriad ways to ‘communicate and share’ (Gauntlett, 2011) are at work in the pedagogical, historiographical, and socio-political uses of those platforms. The locative, real-world physicality of the aforementioned Facebook posts, each enabling and promoting ‘sharing, collaboration and content creation’ (McStay, 2010: 37-38), is what is most significant about the contribution made to the meaning of the Desarmados narrative – that is, that everyone has an important voice in the recreation of the history of Colombia.


Moreover, making use of the inherent promotional/democratic affordances of social media to establish the socio-political ambitions of the project also raises important questions about the recreation of cultural memory via these particular platforms. The earlier analysed videoletters may have exemplified transmedia storytelling as cross-generational postmemory, but the use of social media to document new stories about Colombia’s future in real-world locations points to what Michael Rothberg (2009) describes as ‘multidirectional memory’, which encourages us to think of the public sphere as a malleable discursive space in which groups do not simply articulate established positions but actually come into being thorough their dialogical interactions with others. Writing in reference to the collective memory of the Holocaust, Rothberg provides ‘a framework that draws attention to the inevitable dialogical exchange between memory traditions and keeps open the possibility of a more just future of memory’ (2009: 21). For Rothberg, it becomes useful to rethink the means by which collective memories are made, especially in political historical contexts defined by conflict and tragedy, as ‘moments [that] coexist in which historical memory serves as a medium for the creation of new communal and political identities’ (2009: 12). Rothberg may be referring to the image of the Holocaust across culture, but his ideas are equally useful for making sense of the kinds of transmedial interventions represented by Desarmados and its social media platforms. In this case, and by understanding the value of social media in a project like this one as that which fosters forms of multidirectional memory, it becomes apparent that ‘both the subjects and spaces of the public are open to continual reconstruction’ (Rothberg, 2009: 5). Users are not merely promoting solidarity; they are rewriting the entire story of solidarity.

Conclusion


This article has explored how one project’s combined use of digital platforms (narrativizing the origins, consequences, politics, places and peoples of the Colombian armed conflict across websites, social media, video letters, etc.) and physical artefacts (drawings, games, workbooks, etc.) allows for not only a new way of experiencing and remembering history, but has demonstrated how the practice of narrativising history across digital and physical artefacts can reshape that history, creating new knowledge and ways of reconciling the past and present. Indeed, Desarmados is a transmedia project that encourages Colombian people not to escape their pasts, but rather to think differently about their pasts by traversing ‘across and between the borders where multiple media platforms coalesce’ (Freeman and Gambarato, 2018: 11). It asks those people to see their history differently, and it is the practice of transmedia storytelling – with its power to immerse people in interactive platforms and shared, connected experiences – that is fundamental to achieving those important social ambitions. Fundamentally, the use of transmedia practices in Desarmados – themselves representative of what I have argued to be a practice of transmedia historiography – is really about making sense of a violent past that for many people still does not make sense; such practices enable the narrativisation of what is un-narrativisable from a single perspective by making use of multiple perspectives and the activism that emerges from surrounding media.


Where, then, does that leave my broader attempts to theorise transmedia storytelling as that which narrativises history across media in ways that specifically affords educational, socio-political and historiographical benefits? Firstly, rather than separating ‘commercial’ practices of transmediality, i.e. based on the use of additional platforms as ‘cash nexuses’ (Lemke, 2004) that in turn create multiple revenue streams and ‘marketing assaults’ (Alpert and Jacobs, 2004) from so-called ‘democratic’ forms of transmediality, like transmedia journalism (see Gambarato and Alzamora, 2018), Desarmados reinforces the need to embrace the multiplicities and pluralities of transmediality as a multi-perspectival and cross-disciplinary practice, one that is capable of addressing specific and very different objectives. Transmediality now means very different things, in different parts of the globe, to different sets of industries, cultures, practices, arts, and disciplines (Freeman and Proctor, 2018).


Yet despite the multiplicity and plurality of its applications around the world, two ideas best characterise the kinds of transmediality exemplified and afforded by Desarmados, both of which push forward our general understanding of what transmedia practices are really for. The first idea concerns the importance of conceptualising transmediality as a series of practices for building and capturing memory. Colin B. Harvey (2014) has argued previously that memory is a key component of all transmedia storytelling, fictional or otherwise, insofar as audiences are required to remember the specifics of a story from medium to medium. But beyond this individualised definition of memory based on remembering plots or characters during the act of migrating across media, one might wish to discuss transmedia practices as the capturing of a more collective cultural memory: Desarmados is a transmedia project that is designed to preserve the memory of a population, rooted in memories of its collective past. Be it via postmemory or multidirectional memory, a project like Desarmados demonstrates the idea that joining up what were previously desperate individual memories across multiple media platforms allows people to make greater sense of those individual memories – the multi-perspectival interconnectedness of transmediality here affords dialogue and context.


The second idea concerns the social-activist notion that transmediality – far more than being a strategic practice of extending narratives across platforms – is something that actually helps people. As Camilo Tamayo Gomez, one of the Desarmados researchers, argues:

The development of transmedia narratives is a clear example of how constructions of memory, recognition and solidarity are a healing process for victims in contexts of armed conflict. Thus, the development of transmedia products to construct memory narratives is based on expressive activism as an instrument to exercise political and social actions in the public spheres of this Colombian city (Gomez and Velásquez, 2018: 154).

Understanding how transmediality can deal with the traumas of a history in a positive way, then, means acknowledging the ways that ‘transmediality can enable not just the spreading of messages across media, but equally the creation of a social fence around those messages, inviting participation and building a stronger community’ (Freeman, 2016b: 95). Crucially, while none of these ideas are necessarily specific to Colombia – and while the thematic ingredients of different historical contexts will always change the nature of how that history is narrativised transmedially – one can nevertheless claim that these factors of conceiving of transmediality as 1) a practice for rebuilding cultural memories, and 2) a healing process to exercise political and social actions, do encapsulate an altogether culturally specific model for the function of transmediality in Colombia. Which, by contrast, raises related questions to do with the broader potentials of recreating and narrativising everyday life via digital media technologies, as well as how the integration of old and new media forms can shape how we navigate everyday life, and indeed how the transmedial narrativisation of histories across media can help people to deal with the traumas of those histories in a profound way.


Looking forward, the potential exists for researchers to now consider how Colombian notions of transmedia storytelling, i.e. as that which contributes to memory and solidarity, can be adapted or localized to achieve similarly profound social functions in other countries or cultures. How else and for what historiographic benefits might transmedia practices be applied elsewhere? The very act of narrating history across media, as has been demonstrated via Desarmados, works to realise something altogether new in terms of how we experience that history, remember it, act on it, reshape it for the better. I believe it was George Santayana who famously said that ‘those who cannot remember the past are condemned to repeat it.’ With transmedia practices applied at their creative best, there should be no need to forget.

Acknowledgements

Many of the ideas in this article emerged from a number of funded initiatives. These include the Transmedia Earth Conference, held at EAFIT University in 2017 and for which I co-organised and received Newton Funds (£2,000), and the Desarmados app, itself funded by a Santander Pioneer Award in 2017 (£5,000). I would personally like to thank both Paola Morales Escobar and Camilo Tamayo Gomez for their generous support in Colombia.

References

  • Alpert, D and Jacobs, R (2004) Videogames and Licensing in the Hollywood Film Market. Paper presented at the Korea Games Conferences, Korea, 16 October.

  • Birkinbine, B, Gomez, R and Wasko J (eds.) (2017) Global Media Giants. New York and London: Routledge.

  • Colombia Country Strategic Plan (2017-2021) World Food Programme. Available at: http://www1.wfp.org/operations/co01-colombia-country-strategic-plan-2017-2021 (accessed 12 December 2018).

  • Conway, M (2015) The Problem with History Classes. In: The Atlantic. Available at: www.theatlantic.com/education/archive/2015/03/the-problemwith-history-classes/387823/ (accessed July 2, 2018).

  • Evans, E. (2011) Transmedia Television: Audiences, New Media, and Daily Life. New York and London: Routledge.

  • Fisas, V (2009) Yearbook on Peace Processes. In: Geografías de la guerra, el poder y la resistencia. Oriente y Urabá antioqueños 1990–2008, edited by García de la Torre, Clara and Clara Aramburo. Barcelona: Icaria Editors.

  • Fleming, L (2013) Expanding Learning Opportunities with Transmedia Practices: Inanimate Alice as an Exemplar. Journal of Media Literacy Education 5 (2): 370–377.

  • Freeman, M (2016a) Historicising Transmedia Storytelling: Early Twentieth-Century Transmedia Story Worlds. New York and London: Routledge.

  • Freeman, M (2016b) Small Change – Big Difference: Tracking the Transmediality of Red Nose Day. VIEW: Journal of European Television History and Culture 5(10): 87-96.

  • Freeman, M and Proctor, W (eds.). (2018) Global Convergence Cultures: Transmedia Earth. New York and London: Routledge.

  • Freeman M (2019) The World of The Walking Dead. New York and London: Routledge.

  • Gambarato, R and Alzamora, G. (eds.) (2018) Exploring Transmedia Journalism in the Digital Age. Hershey, PA: IGI Global.

  • García-Durán, M (2014) Colombia: Challenges and Dilemmas in the Search for Peace. Accord 14: 1-23.

  • Gauntlett, D (2011) Making Is Connecting: The Social Meaning of Creativity, from DIY and Knitting to YouTube and Web 2.0. Cambridge: Polity Press.

  • Gómez, C T and Velásquez, O M (2018) Transmedia Projects in Contexts of Armed Conflict and Political Change. In: Global Convergence Cultures: Transmedia Earth, edited by Matthew Freeman and William Proctor, 140-156. New York and London: Routledge.

  • Grainge, P (ed.) (2011) Ephemeral Media: Transitory Screen Culture from Television to YouTube. Basingstoke: Palgrave Macmillan.

  • Hancox, D (2018) Transmedia Writing: Storyworlds and Participation at the Intersection of Practice and Theory. In: The Routledge Companion to Transmedia Studies, edited by Matthew Freeman and Renira Rampazzo Gambarato, 165-172. New York and London: Routledge.

  • Harvey, C B (2015) Fantastic Transmedia: Narrative, Play and Memory Across Science Fiction and Fantasy Storyworlds. Basingstoke: Palgrave Macmillan.

  • Hassler-Forest, D (2018) Transmedia Politics: Star Wars and the Ideological Battlegrounds of Popular Franchises. In: The Routledge Companion to Transmedia Studies, edited by Matthew Freeman and Renira Rampazzo Gambarato, 297-305. New York and London: Routledge.

  • Hay, J and Couldry, N (2011) Rethinking Convergence/Culture: An Introduction. Cultural Studies 25(4): 473–486.

  • Hirsch, M (2012) The Generation of Postmemory: Writing and Visual Culture After the Holocaust. New York: Columbia University Press.

  • Holt, J and Sanson, K (2014) Connected Viewing: Selling, Streaming, and Sharing Media in the Digital Era. New York and London: Routledge.

  • Ibrus, I and Ojamaa, M (2018) Estonia: Transmedial Disruptions and Converging Conceptualizations in a Small Country. In: Global Convergence Cultures: Transmedia Earth, edited by Matthew Freeman and William Proctor, 83-98. New York and London: Routledge.

  • Jenkins, H (2003) Transmedia Storytelling: Moving Characters from Books to Films to Videogames Can Make Them Stronger and More Compelling. In: Technology Review. Available at: www.technologyreview.com/ biotech/ 13052 (accessed 12 January 2018).

  • Jenkins, H (2006) Convergence Culture: Where Old and New Media Collide. New York: New York University Press.

  • Jenkins, H (2009) Transmedia Education: The 7 Principles Revisited. In: Confessions of an Aca-Fan: The Weblog of Henry Jenkins. Available at: http://henryjenkins.org/blog/2010/06/transmedia_education_the_7_pri.html (accessed 12 December 2018).

  • Jenkins, H (2016) Transmedia What? In: Immerse. Available at: https://immerse.news/transmedia-what-15edf6b61daa (accessed 13 January 2018).

  • Jenkins, H, Shresthova, S, Gamber-Thompson, L, Klinger-Vilenchik, N and Zimmerman, A. M. (2016) By Any Media Necessary: The New Youth Activism. New York: New York University Press.

  • Lemke, J (2004) Critical Analysis Across Media: Games, Franchises, and the New Cultural Order. Paper presented at the First International Conference on Critical Discourse Analysis, Valencia, University of Valencia, May 12-14.

  • McStay, A (2010) Digital Advertising. Basingstoke: Palgrave Macmillan.

  • Meyrowitz, J (1999) No Sense of Place: The Impact of Electronic Media on Social Behavior. In: The Media Reader: Continuity and Transformation, edited by Hugh Mackay and Tim O’Sullivan, 99-120. London: SAGE Publications.

  • Pearson, R (2014) Foreword. In: Transmedia Archaeology: Storytelling in the Borderlines of Science Fiction, Comics and Pulp Magazines, by Carlos A. Scolari, Paolo Bertetti and Matthew Freeman, vi-ix. Basingstoke: Palgrave Pivot.

  • Pesce, S and Noto, P (eds.) (2016) The Politics of Ephemeral Digital Media: Permanence and Obsolescence in Paratexts. New York and London: Routledge.

  • Rojas, C (2001) Violencia y Sociedad: la búsqueda de la identidad en la Colombia del siglo XIX. Editorial Norma.

  • Rothberg, M (2009) Multidirectional Memory: Remembering the Holocaust in the Age of Decolonization. Stanford: CA: Stanford University Press.

  • Scolari, C A (2009) Transmedia Storytelling: Implicit Consumers, Narrative Worlds, and Branding in Contemporary Media Production. International Journal of Communication 3: http://ijoc.org/index.php/ijoc.

  • Scolari, C A (2016) Transmedia Literacy: Informal Learning Strategies and Media Skills in the New Ecology of Communication. Telos 103: 13-23.

  • Scolari, C A, Amici, S, Ardèvol, E, Barreneche, C, Davies, H, Horst, H, Koskimaa, R, Pereira, S, Tirocchi, S, Winocur, R and Taddeo, G (2018) ‘Round table: Transmedia Literacy Research Project.’ Paper presented at the Transmedia Literacy International Conference: Teenagers, Transmedia Skills and Informal Learning Strategies in the New Media Ecology, Barcelona, Spain, 23 March.

  • Teixeira Tárcia, L P (2018) Transmedia Education: Changing the Learning Landscape. In: The Routledge Companion to Transmedia Studies, edited by Matthew Freeman and Renira Rampazzo Gambarato, 314-322. New York and London: Routledge.

  • Tenderich, B and Williams, J (2015) Transmedia Branding: Engage Your Audience. Los Angeles, CA: USC Annenberg Press.

  • UNDP – United Nations Development Programme. National Human Development Report for Colombia. Bogotá: El Malpensante editors, 2010.

 

Authorial Ontology and Communicative Intentionality in (an) Observational Documentary Film


DOI: https://doi.org/10.33008/IJCMR.2019.05 | Issue 1 | March 2019

Author: Dafydd Sills-Jones, Auckland University of Technology


Y Dosbarth Melyn [The Yellow Classroom] (2018)


Abstract

The aim of Y Dosbarth Melyn [The Yellow Classroom] in research terms was to explore in what ways the observational mode of documentary filmmaking might relate to the selfhood of the author. In particular, the work asks: how does the observational documentary mode enable an author to communicate aspects of their own ontological position? Screened at Wales International Film Festival, Camarthen Bay Film Festival, Wairoa Film Festival, and the Cardiff International Film Festival, Y Dosbarth Melyn [The Yellow Classroom] underlines the contingent and shifting nature of the connection between text and audience in the filmmaker’s mind. In particular, the work shows that observational documentary techniques can be used in a more fluid way than has been previously recognised and admitted by many of the field’s Direct Cinema practitioners.


Research Statement

The aim of Y Dosbarth Melyn [The Yellow Classroom] in research terms was to explore in what ways the observational mode of documentary filmmaking might relate to the selfhood of the author. In particular, the work asks: how does the observational documentary mode enable an author to communicate aspects of their own ontological position? Of course, no documentary film or media is a transparent window on to the world, and no authorial view ever has full agency. Instead, a documentary film’s ‘claim to the real’ (see Winston, 2008) and its ‘communicative intentionality’ (see Scannell, 2007: 174-176) are related and mediated through the notion of authorial ‘voice’ (Plantinga, 2005; Nichols, 2017).

Documentary’s claim on the real, that is, its basic ability as a form or genre to speak to historical reality with a heightened level of referentiality, is dependent on an established textual configuration that ‘counts’ as documentary, in the eyes of a community of makers and viewers (Nichols, 2007: 13-14). This in turn sets up an agreement between author(s) and viewer(s), as to how such a text works and what is to be communicated through a certain form. The author(s) execution of this through form is then the communicative intention of the text. Voice is then a further concept, used here in the sense of a wholistic aesthetic approach by which the form is used to execute a communicative intention. However, this voice has a close relationship to the ontological position of the author(s) and its execution may well be partly (or sometimes mostly) a question of instinct, affect and embedded tacit knowledge on the part of the author(s).

The question remains, then, to what extent is the texts’ communicative intentionality determined by the form, and to what extent can an author challenge that form, without destroying its implicit communicative ‘contract’. Here the difference/relation between communicative intentionality and communicability is key. Without communicative intentionality (or the ‘knowingly public’ element of a text), a text’s communicability is adversely affected and with it the efficacy of the author’s ‘voice’.

My earlier films eschewed the ‘realist documentary apparatus’ (i.e. interview, observation, narration) in favour of formalist and musical techniques. This was in order to respond to criticism of the realist apparatus (see Winston, 2008; Bruzzi, 2006), and to test the coherence and communicability of other techniques. For Y Dosbarth Melyn [The Yellow Classroom], I returned to the realist apparatus of documentary – or, more specifically, to one main element of it, observation – in order to see how that formal apparatus inflected my authorial voice. Would the techniques of Direct Cinema – itself describing the recording of events in which the subject and audience become unaware of the camera’s presence, characterised by the likes of the ‘observational mode’ and a fly-on-the-wall-aesthetic, as theorised by Leacock, Pennbaker, Drew and Wiseman – work to present an ‘open’ depiction of the ‘real’ with room for various interpretations? Or would the drawbacks of this Direct Cinema style – i.e. its need for inherent drama, or its ‘prison house of objectivity’, as Winston (2008: 44) names it – cause the author to make allowances, adjustments and changes to the observational mode? What, then, would be the effect of such changes to the relationship between form and communicability?


Y Dosbarth Melyn [The Yellow Classroom] had three ostensible thematic strands:

  • the cultural divide between Welsh and non-Welsh speakers in a Welsh community [1];

  • the emergence of selfhood in the context of the socializing and ideological apparatus of a school system’s use of space [2];

  • and the role of ‘nature relatedness’ in a school’s strategies of socio-educational conditioning [3].

There is not enough room in this statement to discuss how all three of these strands were affected by the merging of an observational filmmaking approach and my a priori ontological position, so I shall discuss the issue where the inflection was clearest and most significant: the issue of Welsh language acquisition. I myself am a native Welsh speaker, brought up by two Welsh-speaking parents. My own children are brought up in a mixed English-Welsh language home. Therefore, my ontological position on this issue involves internal tensions around bilingualism and national identity, tensions between language advocacy and a respect for individual choice, between a belief in the importance of collective identity (i.e. Welsh nationhood) and the specificity of the individual experience (i.e. the experience of a Welsh non-Welsh speaking child in a Welsh speaking school). This position affected my decisions and my authorial intention, and therefore the balance between form and communicability in the following examples.


Firstly, in the first ‘maths’ scene (01.16-03.29), I kept one camera position in order not to disrupt the lesson in progress. However, as is usual with Direct Cinema, I did shoot a variety of angles and focal lengths in order to ‘cover’ the cuts one would have to make to create a seamless scene. I gave in to the temptation to narrativize away from the pro filmic and to re-order and to create secondary meanings not immediately in evidence, using the surface of reality to create metaphors for discussing what lay beneath, thus invoking the contentious Direct Cinema notion of ‘being there’.

As I had expected, and sought to avoid in earlier films, this sense of ‘being there’ was only achievable through the quasi-dramatic practice of time compression and casting into proto-typical character roles. Given the drawbacks of this approach – Winston (2008), for example, asks what is left of reality after such a treatment – my motivation for this was clear on this occasion. I wanted to reflect the centrality of the teacher in the dynamics of the room, and in particular the centrality of this specific teacher’s method within the overall process of language acquisition, and even further distanced the importance of this kind of teaching for the success of balancing national and individual aspirations.

If the maths scene represented non-interventionist observation (at least when recording), and its attendant problems in dealing with coherence, at other times I did intervene, breaking the ‘rules’ of observationalism (04.31-06.05). In order to reflect the effort and sincerity with which the children approached their use of Welsh, almost always a language alien to their homes, I took on board what Nichols calls a more ‘participatory’ role, engaging some children in conversation. It was a question of the nature of the political meaning of the profilmic; had I not spoken, would the children have conversed in Welsh or English? If in English, would that have appeared to carry the meaning that the classroom was Welsh, and the playground English, a common criticism of Welsh language schools in English speaking areas? My intervention again came from a personally-held belief that the middle ground needed to be expressed between those who oppose Welsh language education, and those who espouse mono-lingual Welsh education for fear of losing the language. And in the middle of that battleground are the children’s lived experience. My response was to enable the children to show that they could speak Welsh in the playground, whether they would have done otherwise or not.

These two examples exemplify a number of things. Firstly, the observational mode of the realist documentary, however removed, requires an affective commitment by the author. Secondly, this affective commitment carries with it an imprint of the self which in turn carries a trace of the ideology at large within the habitus of the individual. I could not escape my ontological position, especially in the heat of observational and technological ‘action’. These first two points may not be new, but are confirmed in this example.

Thirdly, whilst I did rely on my own ontological positioning at times within the filming, the close adherence to an established realist documentary mode such as observation can help to loosen the grip of the author’s individual ontological position, allowing moments within the film to remain ‘open’ and available for interpretation in a way another mode might not. An example here might be the final scene when children recite The Lord’s Prayer before they leave the school (12.18-13.05). This is framed at eye level, to preserve an empathy and solidarity with the children. The shot is long, without a cut or imposition of nondiegetic (or quasi-diegetic) sound. The resultant meaning is open; what kind of social fabric are the children being stitched into? Do they resist this? Knowing what the audience might know about how their own experiences at this age that have or have not stayed with them, the question hangs as to the efficacy of such a school.

In conclusion, the relationships between the form (or, in other words, the cultural contract between maker and viewer), the author’s communicative intention (or their sincere attempt to speak through a text), and the author voice (emanating from their ontological position), are held in balance by observational techniques. On the other hand, in this example, at least, this balance is more possible when the author is able to break the rules, and adapt the form.

In terms of dissemination, Y Dosbarth Melyn [The Yellow Classroom] has been screened at Wales International Film Festival, Camarthen Bay Film Festival, Wairoa Film Festival (New Zealand), and the Cardiff International Film Festival, where it was a merit finalist in the category ‘Promotion of Welsh Language and Culture’. It has also been presented as a research project at Aberystwyth University (Wales), and Auckland University of Technology (New Zealand).


The main significance of this project is that it underlines the contingent and shifting nature of the connection between text and audience in the filmmaker’s mind. The realist apparatus has often been used as a guarantee of screen truth, usually through the socially and legally authorising function of institutions such as broadcasters. This example shows that observational techniques can be used in a more fluid way than recognised and admitted by many Direct Cinema practitioners. Indeed, the project suggests that observation cannot act alone as a technique/approach, and always requires the author’s active, subjective and affective engagement. This in turn suggests that the ‘agreement’ between audience and text in the case of observational documentary material is far more complex and contingent than is often presented.

While it is hard to accurately gauge the influence of a short film of this kind (with the whole notion of audience effect and influence being a complex discussion for which there is no room in this publishing format), it is hoped that this film has had an influence in three separate areas. First, that the community immediately surrounding the school can come together around the text, with both teachers and parents being able to see the school’s methods, in terms of language, space and relational socialisation. Second, that this audience, and a wider audience, may realise that there is a ‘middle way’ between polar positions adopted towards Welsh language education in predominantly English-speaking communities Wales [4]. And third, that the academic/professional milieu that encounters the film and its verbal presentation in a journal format thinks again about the ways in which observation and authorial subjectivity comingle and complicate the notion of evidence and screen language, hopefully moving discussions forward towards an ever more nuanced understanding of how, where and when reality exists and can be represented on screen.


This research was conducted at Aberystwyth University, and supported by the TFTS Department, in association with the TFTS Screen Practice Research cluster (@screenaber).


References

  • Bourdieu, P (1990) Structures, Habitus, Practices. In: The Logic of Practice, edited by Pierre Bourdieu, 52-65. Cambridge: Polity Press.

  • Bruzzi, S (2006) New Documentary: A Critical Introduction. London and New York: Routledge.

  • Broberg, A, Kyttä, M and Fagerholm, N (2013) Child-friendly Urban Structures: Bullerby Revisited. Journal of Environmental Psychology 35: 110-120.

  • Nichols, B (2017) Introduction to Documentary. Bloomington: Indiana University Press.

  • Plantinga, C (2005) What A Documentary Is, After All. The Journal of Aesthetics and Art Criticism 63(2): 105-117.

  • Scannell, P (2007) Media and Communication. London: Sage.

  • Williams, G A (1985) When was Wales?: A History of the Welsh. London: Penguin.

  • Winston, B (2008) Claiming the Real: The Griersonian Documentary and its Legitimations. London: British Film Institute.

  • Zelenski, J M and Nisbet, E K (2014) Happiness and Feeling Connected: The Distinct Role of Nature Relatedness. Environment and Behavior 46(1): 3-23.


Notes


[1] Drawing on Gwyn Alf Williams’ historiographical notion of a ‘shadowline’, cutting from North East to South West Wales, re-emerging in many ways over time in Wales’ history (Williams, 1985).

[2] Drawing on Broberg, Kyttä and Fagerholm’s notion of ‘Bullerby’, and the effect of differently configured spaces on child development (Broberg, Kyttä and Fagerholm, 2013).


[3] Drawing on Zelenski & Nisbet’s understanding of the effect of nature relatedness to cultural connectedness (Zelenki & Nisbet, 2014).


[4] The recent rhetoric-based campaign by Kate Hopkins in the British press, is the most recent and extreme example of how this issue is often used by hard-right commentators to spread fear and hatred amongst non-Welsh speaking parents of Welsh-educated children.

 

Updated: Mar 25, 2019


DOI: https://doi.org/10.33008/IJCMR.2019.06 | Issue 1 | March 2019

Author: Owen Lloyd, Royal Welsh College of Music and Drama


Abstract

In 2016, I started a collaborative project with Architects and Crystallographers from Cardiff University to explore creative opportunities within crystallographic data-sets and modelling algorithms. This composition research developed and extended their Leverhulme-funded research which had already commenced. Outputs include music, generative compositions, composition tools, audio-visual work and an installation in Berlin.

Research Statement

This ‘route-map’ discusses the processes behind a group of compositions, Incomm1 through to Incomm10, and two generative works, Berlin Incommensurate and Incommensurate Visualisations, that arose from distinct phases in a body of composition research. This research extends a larger, Leverhulme-funded research project bringing together architects and crystallographers to investigate the creative possibilities available within crystallographic data and modelling algorithms. Architecture and crystallography sit at opposite extremes of scale within applied research. Crystallography explores the relationships between crystalline materials and their structures and geometries at the atomic scale. Architects Sergio Pineda and Mallika Arora, and crystallographers Kenneth D. M. Harris, Benson M. Kariuki and P. Andrew Williams, from Cardiff University, have come together to explore how properties within these molecular geometries can translate when scaled up to the dimensions of spatial or material design. In order to facilitate this, an application has been coded that allows creative practitioners to access crystallographic data within CAD software (Pineda et al, 2016).


Further to this design research, this statement sets out a body of composition research investigating how crystallographic modelling algorithms can be used to make sound and music. Rather than exploring the symmetrical geometries of the architect’s research, I based this project on a model for describing the asymmetrical dimensional relationships within crystalline materials that replicate with non-repeating structures. To investigate these incommensurate structures, I made an application which sonifies them through the creation of scales, time intervals and synthesis processes as well as using them to control a host of other musical parameters. This application forms the primary toolset for the research and its development and modulation, as well as works that I came up with throughout the process, are described below.


Data Sonification


Functionally, my focus is on sonification as creative practice, and this research in no way claims to elucidate the data output in any practically scientific way. Data sonification has its roots in scientific practice but is now well established within the arts. Practitioners working with sound and music have long explored the structural and timbral potential within extra-musical data sets: John Cage’s Reunion (1968) drew on the structures inherent within a game of chess to make its music, and his Atlas Eclipticalis (1961-62) superimposed a star map onto music staves to generate its events. The term sonification provides a useful lens through which to view a number of works that existed before it was established. Works such as Music on a Long Thin Wire (1977), and the two Cage pieces mentioned above, can all be usefully discussed in terms of their sonifications. Music on a Long Thin Wire, for example, offers sound material directly linked to phenomena outside of music, and examining it as sonification brings about a causal mode of listening seemingly at odds with the abstract nature of its sound world. Within the scope of this paper, however, sonification is used in its relatively traditional sense, with a numerical dataset being rendered as sound.

Incommensurate Structures in Crystallography


Williams has been my main point of contact with the crystallographers, and his patience with my stumbling understanding of crystallography, allied to his considerable coding skills, have been instrumental to my ability to conduct my portion of the research. Williams describes incommensurate structures in crystallography as follows:


Conventional crystalline materials are those in which the component atoms/molecules are arranged with long range translational order in three dimensions: the entire material is constructed from a well-defined structural unit that replicates in three-dimensional space. They have three translational periodicities. For some materials, on the other hand, the arrangement of the component atoms in three-dimensional space can be described only by invoking four or more translational periodicities. Such materials are described as “incommensurate”. Although existing in three-dimensional physical space, the material is now no longer periodic in three dimensions but is periodic in four or higher dimensions. As such its appearance is not that of a conventional, ordered crystalline material. The three-dimensional structure of the incommensurate material represents a three-dimensional slice through a higher dimensional superspace.

He then describes the model upon which the compositions are based:


The idea of an incommensurate material can be represented by creating a series of sine waves, arranged in a periodic fashion in two dimensions with the start point of each sine wave offset along a diagonal. This represents a two-dimensional structure. Drawing a line through the set of sine waves creates a one-dimensional slice through the two-dimensional structure. The points of intersection of the line and the sine wave will be incommensurate and the values of the distance between them will never be found to repeat exactly (Fig.1).

This model was suggested and outlined by Harris and then coded by Williams. It was written in Python and then runs within an application, coded by myself, in Max.



Owen Lloyd
FIGURE 1

The Data


The fundamental mathematical process behind the research exists as a program written in Python and nested within Max using the py/pyext Max externals [1]. These run a Python script within Max, outputting the results to the patch for further use. The form that these results take are, initially, 100 floating point values that describe the distances from zero of the points of intersection in the model described above, scaled between 0 and 1. The list of values is processed in different ways and then stored in coll objects for later use.


The first process performs a logarithmic function on the data, and then multiplies them all by 20000. This creates a spread of values that sits within a useful range when accounting for the logarithmic relationship between octaves and creates the scale by changing the range of the values from 0 to 1 to a range between 0 and 20000 hertz. This does generate frequencies outside the range of most human hearing, but it avoids the arbitrary imposition of a ceiling, or floor, of hertz values, enabling an individual’s hearing to dictate the range: the frequencies are available for those who can experience them.

Scales


The first musical structures explored through the data were scales. This was done by creating a simple mixer that realised the scales generated through the Python function in the form of one hundred sine wave oscillators that could have their volumes modulated by sliders. A modulatable lag was added to the array of sliders which allowed fading in and out of sustained tones. In this way the early stages of the research could focus on the frequencies available in each scale, and how they interacted with each other. In addition, a visualisation of the frequency spread was also coded, giving a very quick indication of the structure of the scale and quickly leading to an interesting realisation concerning the spread of values. What emerged was that, depending on the variables input into the code, the output was stepped to a greater or lesser extent. This led to interesting scale structures where very tight clusters of frequencies were punctuated by large steps (Fig.2). The acoustic implications of this were that a scale could be found where a dominant characteristic was its modulation of beat frequencies.



Owen Lloyd
FIGURE 2

Synthesis Methods


A number of synthesis processes are used in the application, based, in the main, on two wavetable oscillators. In order to create these a larger dataset is needed in order to avoid an oscillator with a sample length so short that it produces simply the sound of its own aliasing. An oscillator of 512 samples is created by adjusting the original Python script to allow for a larger output. This is then used to create a modulated sine wave oscillator, the result of the values having a sine function performed on them. A second oscillator is made by scaling the intervals between the intersections – rather than the accumulating values of the scale – to a set of values between -1 and 1 to create a wavetable based very purely on the data set. These oscillators are then used to make an FM oscillator that refers to the scale to determine the frequencies available for the carrier and modulator waves. An FM index value between 0 and 1 is determined by the raw output from the Python script. Additive synthesis is also present. 10 data points from the Python algorithm, taken at index intervals of 10 – the value at index 0, index 9, index 19 etc. – and scaled between 1 and 10, are used to create a set of ratios to multiply a fundamental frequency by. This results in an additive oscillator with 10 partials whose frequencies are determined by the data, and are representative of the overall shape of the scale.


Sequencing


The next step in the research phase was to code a series of sequencers. These take the form of four discrete sequencers with multislider interfaces. There are two multisliders for time values and a corresponding pair for pitch values. The time sequencers are scalable to a range within a controllable maximum duration providing an opportunity to explore micro timings within the dataset, as well as longer form musical structures. To shape the notes, amplitude envelopes use the dataset to determine attack and decay values. All sequencers are also independently scalable in terms of their number of events, and the duration sequencers also have a note off function to create rests of a length determined by the data.


Each of these pairs of sequencers focus on different modes of synthesis from the processes described above. One pair uses the FM oscillator and the other offers a choice between the modulated sine wave, the wave created from the intervals, and the additive oscillator. These, in turn, are then sent through a low pass filter with cutoff frequencies, again determined by the scale.


Incommensurate Compositions


With these tools in place, the project moved on to a period of compositional research using the application (Fig.3). Initially this compositional phase fed into the development of the application, with features added to the toolset as gaps in functionality were identified and opportunities explored. As the toolset became more established and a final format decided upon, the composition phase became more aesthetically driven as sets of values were input to the Python code and the results investigated more fully in terms of pitch and time structures, and timbre. These Incommensurate Compositions came about through a process of improvisation with the application. Outputs from these improvisations were recorded and combined in editing software resulting in a series of works that bear both the imprint of the data and my own compositional voice. There were times when I wondered if the works would ever be free of the very high frequencies that populate them and I toyed with the idea of massaging the data to shift them down. But as I worked further it became clear that these frequencies were characteristic of particular scales, and that other scales were available to me that had spreads of much lower frequencies added to plateaued clusters of higher tones. Timbrally the works tend towards metallic tones, this is certainly a function of the FM and additive synthesis models that drive much of the sound, but the wavetable oscillators used within these processes seem to add harmonics which reinforce this aesthetic. Here are a selection of works from this phase of the research:




Owen Lloyd
FIGURE 3

Berlin Incommensurate


In January 2018, Berlin Incommensurate was exhibited in the gallery at Acud Macht Neu in Berlin as part of Transmediale Vorspiel 2018 (Fig.4). During the development of the work, questions around the tricky relationship between time-based artwork – with implicit start and end points combined with a sequence of events – and a gallery space – without an expectation of timed entry and exit points – led to the decision to make a generative, installed composition. This allowed the structures within the data to operate over a much longer timescale, with time values that had dictated gesture at the scale of fractions of a second expanding to govern the overall structure of a far longer composition.



FIGURE 4


The project started with a streamlining process aimed at optimising a new version of the Max application for live, generative composition and performance. The composition environment that contains the nested Python algorithm is not agile when changes to the parameters of the python model are made; there can be appreciable lag as new values are calculated. To mitigate this twenty scales from the code were selected and stored in text files to be accessed far more rapidly by the coll object in Max. Another change limited the app to one sequencer, a decision taken in-part for aesthetic reasons as the two sequencers often run asynchronously, resulting in chaotic material needing aesthetic management in the moment. This is not a problem with a human in control but is far more challenging to manage algorithmically. Finally the synthesis engine was simplified, with the sustained pitch mixer using just pure sine waves and the sequenced material using only the FM synthesis algorithm. To balance this simplification, a layer of granular synthesis was added, with its controlling parameters governed by values from the data set. This granular engine was set to recycle the last minute of the output of the rest of the synthesis engine, allowing sound that had passed to linger, and material that had been generated in one scale to be transformed by settings from another.


This streamlined set of processes is put to work within a compositional environment dictated by the creation and controlled decay of ordered, sequenced structures, combined with the accumulation, and sudden silencing, of sustained tones and their associated beat frequencies. These two cycles unfold asynchronously, providing a central spine for Berlin Incommensurate. To bring about the decaying sequences a reset event is triggered. This sets parameters in the time and pitch sequencers to a single value from the data. These sequencers then play notes made in the FM synthesis engine with new modulation, index and envelope parameters derived from the data. As the composition unfolds, according to time values derived from the dataset, a modulation event is triggered. This picks a single time event and a single pitch event in each sequencer and changes them to new values from the data. As this process unfolds at a faster rate than the reset cycle, the sequence can degrade over time from its orderly beginning to a more clumsy, staggering structure. Then the next reset event is triggered and the cycle begins anew, different every time. Sitting behind these discrete note events is a ground of sustained sine waves with its own reset and modulation cycles. Here the reset event creates relative silence, as all one hundred frequencies are cut off at once. The shorter modulation cycle adds a random frequency from the data, at a random volume from the data. This builds up over time to a thick, often beating, texture that, aesthetically, is closely aligned with additive synthesis.


Allied to these cycles are other parameter changes, the most forceful of which is a shift to another of the twenty scales available. This affects everything, from pitches to time values, from spectral content to synthesis parameters, making it a very strongly voiced variable in the work. In order to promote variety and longer term change the scales available range widely. Some instances have a relatively smooth distribution where others have an unevenly stepped range of values. A few scales cluster together at very low values, making their sections faster moving and their pitch characteristics more focussed on beat frequencies (Fig.5). Other parameters that changed with either the reset or modulation events were reverb, granulation and equalisation settings. Here you can find a thirty minute, unedited slice from the application’s output:





Owen Lloyd
FIGURE 5

Incommensurate Visualisations


Since the installation in Berlin the application is being developed in different directions in attempts to link the model with other disciplines and sound environments. The first iteration uses the model to create visual material, both in accompaniment to the generative work, and as a standalone route to visual outcomes. A module has been added to the generative work that produces a sequence of coloured lines in red, green and blue which scan across the screen fading to white as they reach the time position of the next reset event. Red lines appear horizontally and vertically when modulation events occur. This provides simple visual feedback about the imminent structure of the work, and also grants access to the way in which it is made up of discrete, overlapping, processes with shifting phase relationships (Fig.6). Here is a section of video to demonstrate this visual feedback:




Owen Lloyd
FIGURE 6

In a further separate development, away from any thought for sound, I made a version of the application to simply visualise the twenty scales from the generative work. This started as a simple patch that distributes vertical lines across a screen, giving them x coordinates according to some of the scales. Screenshots of these were then taken and layered together in image editing software (Fig.7). This process has since been taken further and is ongoing. At present the software assigns colours to the lines and layers them across the screen. Over time they build up, mixing colours and forming patterns based on the data (Fig.8).

Owen Lloyd
FIGURE 7

Owen Lloyd
FIGURE 8

A Link to a Modular Environment


The most recent development in this research has been to create a procedural link between the dataset and an analog synthesis environment in the form of a eurorack modular synthesiser (Fig.9). Here, the application generates control voltage and gate signals that can be routed to the outputs of an eight output, DC coupled, audio interface. In this case the application is set up for an Expert Sleepers ES-8 audio interface module but the patch is customisable and could be set up for any interface. This application is one of the foci of my general composition practice now, giving me the dramatic changes that the scale changes afford, allied to material generated outside of the dataset. Here is an example of this integrated approach to the work:





Owen Lloyd
FIGURE 9

Reflection


This research furnishes us with a suite of software environments for sonic and visual practice that place a crystallographic theory at their heart. Of most use to practitioners other than myself are the two composition applications. One of these is an environment allowing exploration of all available scales from an algorithm based on a model for describing incommensurate crystalline structures. The second takes a selection of these scales and makes them available for the generation of control data that interfaces with a modular synthesiser through a DC coupled audio interface. Both of these applications provide procedural connections between creative practice and science, inviting data from science to both define and further colour sound and composition. Importantly both are open ended. With a knowledge of Max, both programs could be re-configured to suit different projects. In fact, a further aim is to write an application that is much more open, outputting scaleable values, as lists or over time, in order to make them accessible in forms that don’t imply any particular outcome.


Reflecting more broadly I find that working in detail with this dataset uncovers clear differences between these incommensurate structures and noise based random structures. This is particularly interesting for my composition process as it changes the structures within my, often indeterminate, work in fundamental ways. The results still sit within indeterminate norms but now have a stepped underlying structure that provides more order than when using noise as a basis. This leads to the clustering of data events described above, which, when used to determine musical properties, results in idiosyncratic time and pitch outcomes. Switching between these structures in real time within a composition makes for compelling punctuation based not on dynamics or a single key change, tools that I might reach for outside this environment, but on the reconfiguration of every musical process at play.

Looking forward within my own work, these data structures are still generating new ideas and materials. I am developing a more powerful and modulateable version of the additive synthesis engine as its own application, again capable of linking to modular synthesis environment. I am in talks with film-makers, designers, visual artists and choreographers in order to plug the data into new processes within interdisciplinary situations. The link to architecture is also still ongoing and I hope to be able to combine these data structures with geometries developed by Pineda through the project, but on a far larger scale, in order to realise agile built environments with an embedded incommensurate music.


References

  • Hermann, T, Hunt, A and Neuhoff, J G (2011) The Sonification Handbook. Berlin, Logos.

  • Pineda, S et al (2016) The Grammar of Crystallographic Expression. Presented at: Acadia 2016, Ann Arbor, Michigan, USA, 27-29 October.


Notes


[1] These can be found at: https://grrrr.org/research/software/py/.

 

An interdisciplinary, peer-reviewed and open access academic journal devoted to pushing forward the approaches to and possibilities for publishing creative media-based research. 

IJCMR_Footer_Black.png
bottom of page