Lina Ramona Vitkauskas is a Lithuanian-Canadian-American video poet from Chicago living in Toronto. Her website is linaramona.com. We’ve featured her videopoems often over the years. I interviewed Lina via email about her new project, HALLUCINATIONS.
Large language models (LLMs) as deployed by OpenAI, Google, Meta, IBM, and other corporations are straining our energy infrastructure, putting technical writers out of work, and sparking lawsuits over perceived infringements on intellectual property rights. To many of us, this seems like a boondoggle pushed by techno-utopian fanatics obsessed with their end-time fantasy of a Singularity. For a poet to go up against it seems quixotic, to say the least. Why engage with AI at all?
This is a fascinating question. Short answer: we are beyond choosing to not engage. The internet and social media began this way. People dismissed both as fads or flat-out refused to participate, therefore dismissing any opportunity to have a voice in how either would play a part in our lives. We allowed big tech to dictate to — and sell us (literally selling us) — these technologies, thus, both ubiquitously seeped into the fabric of daily life. Because of this, we were unable to gain any footing in the narrative (too little, too late).
Big picture: AI would not exist without humans / human intelligence. Humans created, raised, and fed it on our collective knowledge and ignorance. It seems most rational to me that poets are the sole group to claim the narrative regarding this technology (as comedians have with politics, using satire, for example). What better group than those who wield language and thought, bending both to our will in a format / form that can never be fully defined? In my view, poets (as well as visual artists and filmmakers) are the voice of humans in this space, because we continue to defy expectations and perhaps most fully represent the expanse and uniqueness of creativity. While our collective experiences are similar, our subjective ones still remain authentic to each of us. LLMs can only regurgitate what is currently available to ingest. We haven’t reached singularity nor does AI currently have the capacity to read dreams, the human mind, or individual thoughts. Poets are the gatekeepers of reminding humanity of our humanity. We speak many languages that are untranslatable by binary logic. We speak and write the human condition, what is simultaneously innate, collective, and separate. This is also a great opportunity to reclaim our space in this domain, as mentioned earlier. As Nam Jun Paik once said, “I use technology to hate it properly.”
So tell us how you set about creating your own answer to an LLM. What did that process look like? Who or what was your inspiration?
Two inspirations: co-founder of the Oulipo, Raymond Queneau, wrote A Hundred Thousand Million Poems, which consisted of ten sonnets that were then “sliced-up” to offer the reader an infinite number of new poems — contingent upon how one arranged the lines; and experimental filmmaker, Nam June Paik, who famously “uses technology to hate it properly”. It is also slightly reminiscent of the Surrealist Compliment Generator.
HALLUCINATIONS is human mimicry — and rebuke — of AI “hallucinations” (irony abounds as hallucinations are an intrinsically human experience, and for AI, an LLM in recursion is ultimately unable to emulate humans). It is simultaneously a book, a collective digital project, and video poems. I invite collaborators to send poems with the intention of adding to the LLM (Lina Language Model), ultimately fostering poetic community and exemplifying that humans still reign in poetic originality.
It began with three poems which spun up into 48 variations. The new poems / versions shape-shift and take different forms, as they would after being repeatedly fed through an LLM. Binary number titles are used to help democratize the content, helping readers focus more on the poems (less on titles) helping to build a more collaborative, collective unconscious mindset.
Exact Method:
Using one prompt in an LLM to engage in a “hallucinatory” brainstorm, I began generating original, new poems. The poems are each labeled by a binary number / code and leverage literary devices such as repetition and juxtaposition.
Poems became extensions of one another, as they are “unplugged” and “replugged” in randomly to create new poems (reminiscent of neural networks, fibre optics, 20th c. switchboard cords, etc.)
Italicized commentary throughout the poems echo the type of feedback language that some LLMs now ask of users — very similar to reviews or surveys online (i.e. “how did we do?”) I use these spaces to inhabit the voice of the LLM, attempting to emulate a “mechanical grief” (perhaps the desperate lament of machines longing to be human?)
What did you make of Google’s decision to name their LLM for video generation VideoPoet? It’s as if they’ve read the manifesto on your project’s website, and decided that, as you put it, “hallucinations are poetry”!
We can hardly call what they are showcasing on their capability reels poetry (PIXAR raccoons swimming and going to the Eiffel Tower, cute teddy bears playing drums, weird bear-owl hybrids on a branch roaring, or pastel paint blobs exploding, etc.)
For my video poems, I source archived and public domain footage (as well as free download stock) but I create my own pieces / footage from those foundations. I use filters, editing tools, even my own collage pieces (print and digital) to mix it up.
I think it is another great example of how technology can flatten creativity, but I’m sure it will progress beyond cartoon animals doing “funny” human stuff in a few years. I’m still hoping this type of banality goes away and they actually start using AI to help people and the environment (healthcare, climate change).
Has this project affected the way you approach or compose videopoetry, or poetry in general? I’m wondering whether, for example, it’s changed how you view authorship, or the relationship between the writer and the work…
I approach all of my video poetry projects differently, so this was actually borne out of conversations being had at my current day job (workplace) about protocols to integrate AI into our workflows.
I immediately became fascinated by the idea of hallucinations and recursion by reading more about it here: https://xn--wgiaa.ws/6-gunnar-de-winter-recursions-curse-when-ai-eats-ai-content
Humans can properly hallucinate, meaning there is even some value in when we cerebrally hit a wall. Friction is good for creativity. When a machine hits a wall, it becomes redundant (dual meaning). Or it can destroy everything. I guess one could argue that humans could do the same, but we also have decision-making ability and free will.
Poetically I think recursion is interesting if only for what creative iterations are generated.
The exercise of doing this particular project hasn’t changed the way that I would compose or create video poems, no. I think we are at an interesting inflection point in general, however: do we symbiotically incorporate this technology into everything we do, or, are we more selective as humans as to how we can help us?
I still think that there is much to be discussed publicly around the ethics and repercussions of using AI / LLMs in creative spaces. I personally think creatives should be vigilant and wary. Verify then trust. Play but don’t publish. It can help, but not fully take on creator roles. It’s a tool, not an entity.
The five videopoems you’ve shared online from the project so far certainly flow into one another, drawing on a common vocabulary of sounds and images, almost like stanzas in a larger poem. Is that how you think of them? I gather you’re working toward an anthology or collection. What form(s) do you anticipate that will take?
There are currently 48 poems in a limited edition chapbook (contact Gagnè Contemporary to purchase), all of them iterations of 1-3 original poems spun from one LLM prompt: “write a long form essay about how AI and creativity coexist”.
The next phase of this larger, collaborative project is up to you, the people, my fellow humans. Become part of the HALLUCINATION project by submitting your own poems to the Lina Language Model at hallucinations.me.
Folks in the Toronto area can check out a gallery showing of HALLUCINATIONS as part of a new show called Post Future Era at the Gagné Contemporary Gallery at 401 Richmond. The show features Vitkauskas, Kunel Gaur, and Justin Neeley. Otherwise, check out the videopoems on Vimeo.
Perhaps a more accurate title for this conversation would read, “From the Artist’s Canvas to the Page to the Screen and Back Again and then to the Screen Once More,” but such a title would be unwieldy. Still— this fluid and fascinating movement between mediums lies at the heart of Sarah Tremlett’s latest project, a print anthology, Frame to Frames : Your Eyes Follow II/Cuadro a Cuadros : Tus Ojos Siguen II (ekphrastic poetry + films/cine + poesía ecfrástica).
The book is a multimedia, bilingual collection of poems accompanied by QR codes linking to streaming videopoems. Acclaimed poetry filmmaker Csilla Toldy also contributed her expertise to the project as co-director of Poem Film Editions. Featuring the work of 22 poets and filmmakers, these texts and films are mostly inspired by the painting, “Huapango Torero” by contemporary nonbinary Mexican artist Ana Segovia. The book is the first release from PoemFilm Editions, Tremlett’s new publishing platform dedicated to the art of poetry film. Additionally, a Spanish edition of the book (with additional text) is coming out in November, published by Chamán Ediciones, and will be launched at the upcoming MALDITO Videopoetry Festival in Albacete.
Tremlett’s Frame to Frames II call for ekphrastic poetryfilms was part of a curated program for the 2023 FOTOGENIA Film Poetry & Divergent Narratives Festival in Mexico City. It was an invitation for the creation of new videopoems with Segovia’s painting serving as the point of inspiration. The painting, vivid in color and emotional tone, is a response to the gendered politics of machismo and the animal welfare concerns of bullfighting practices. Since FOTOGENIA, the collection of videopoems has been traveling the festival circuit, with selections screening at the 9th Weimar Poetry Filmtage in April 2024 and REELpoetry 2023.
There is also a bilingual documentary (made for REELpoetry 2024) on the making of the Frame to Frames II project with five of the videopoem artists. The doc is available for viewing here: https://vimeo.com/929116208.
What makes this collection so unique, besides the QR code-based format, is its emphasis on the ekphrastic videopoem. According to the Poetry Foundation, ekphrasis translates to “description” in Greek. Ekphrastic poetry embodies the “imaginative act of narrating and reflecting on the ‘action’ of a painting or sculpture… the poet may amplify and expand its meaning” (322). The videopoems featured in Frame to Frames : Your Eyes Follow II/Cuadro a Cuadros : Tus Ojos Siguen II (ekphrastic poetry + films/cine + poesía ecfrástica) do just that. Just as Ana Segovia’s painting, “Huapango Torero,” serves as a filmmaker’s portal for new meanings, this anthology is likewise a portal as the reader is encouraged to move seamlessly between the page and streaming online content via QR codes. Not only is this collection truly innovative and collaborative in spirit, taken as a whole, the book reaffirms the contemporary relevance and ever-evolving nature of the ekphrastic as creative incitement and provocation. And while a curated program for a poetry film fest might be ephemeral or inaccessible for those not in attendance, this anthology brings the poetry film festival directly to the reader in a way that hasn’t quite been done before. The Spanish translations by Camilo Bosso also allow for transnational and transcultural dialogues between artists, poets, and filmmakers.
Although this new anthology is a testament to the collaborative spirit that has become the hallmark of the videopoetry community, the project was ultimately spearheaded by poet, filmmaker, and videopoem theorist Sarah Tremlett. Sarah is quite active in the contemporary poetry filmmaking world, known widely for her organization and online platform Liberated Words CIC. Described by Karina Karaeva as a “visual philosopher,” Sarah’s original videopoems have taken top honors at poetry film festivals around the world, and she has also served as jury member and judge for such festivals as REELpoetry and LYRA, among others. She is the author of the seminal study, The Poetics of Poetry Film: Film Poetry, Videopoetry, Lyric Voice, Reflection (2021, Intellect: University of Chicago Press), which includes the voices of over 40 contributors. Described as an encyclopedic and rigorous investigation of the genre, the book is a one-of-a-kind exploration of videopoetry’s formal characteristics framed by the lyric voice. I recently had the opportunity to exchange some thoughts on ekphrastic videopoetry and the new anthology with Sarah, which are excerpted below. Segments of the following interview draw from her scholarship in The Poetics of Poetry Film as well as her own creative process and years of poetry filmmaking experience.
PK: Do you consider the ekphrastic poetryfilms featured in the new anthology to be adaptations of Segovia’s painting? Or are they something more? Why or why not?
ST: Before focusing specifically on ekphrastic poetry films, in their construction, poetry films can exhibit many types of (often app-based) adaptation: where still photographs become animated or coloured and layered with other photographs; a musical score that is remixed; a poem where the lines are altered to fit the film; a montage of many sources combined to create a single film; a drawing that is layered into another time and place. You could argue poetry film is adaptation. Others take a postmodernist stance arguing that all is intertextual, a continuous flow of material reinventing itself.Ekphrasis itself can be argued to be happening in many poetry films themselves. Every filmmaker who selects a poem by a poet to develop it in their own way can probably be considered to be committing ‘reverse ekphrasis’, though often not deliberately.
The importance of the relationship between the original artist and their respondee in the ekphrastic work sets it apart from other types of adaptation. The central point is that the second artwork is a reply that implies co-existence of perspectives (however abstracted) and also if reimagining, rather than directly representing, extends the original to create a ‘between’ space with its own characteristics. As I write this, I am reminded of the reverse ekphrastic response a filmmaker might make to a poem by another poet, too. Meriel Lland, filmmaker of the winning Frame to Frames film A Love Spell Cast in Petals, also emphasised how she had thoroughly researched the subject, and she felt she was in dialogue with the artist through her response, and I think this is something that is important to remember.
PK: In The Poetics of Poetry Film, you write, “Quite often the poetry film is realized as it is written: poem, then film, with soundscape design completing the picture; but of course, life is rarely this compartmentalized” (40). How does the ekphrastic encourage the liberation from compartmentalization within the creative process? And what are some of the ways in which the poetryfilms in the new anthology “resist the representational” or embody the “the brilliance of intensional, unique symbols” (5)?
ST: I am not sure that I can definitively answer it does, but here are some thoughts. It was you, Patricia, who noted that you wouldn’t have made your ekphrastic poetry film without this ekphrastic prompt and maybe counter intuitively, that is one way to create liberation from a particular personal approach. Since you are also an auteur poetry filmmaker, standing outside your comfort zone and eliciting something unknown from inside could be really important for you to develop your practiceAs mentioned, the ekphrastic poem is somehow (to varying degrees) a ‘co-existence of perspectives’ (Cunningham, 2011). If you are a poet who usually collaborates with the same filmmaker, the terms have altered. The original context, voice and subject matter of the source artist have firstly entered the thought processes of the poet, and secondly cannot help but suggest a different type of dialogue between poet and filmmaker, maybe as if a third voice is present, an inclusion of ‘other’? Ultimately, the source artist has to be taken care of in some way, accorded a position, directly or indirectly; by reference or inference. There is also the aspect of the different types of source that might liberate new approaches and thinking: whilst many worked to paintings, Martin Sercombe with poet Thom Conroy chose an AI artwork and Javier Robledo an Argentinian visual poem. So, yes, actually I do think ekphrasis does liberate the artist from a standard practice into unknown territories.
The festival painting (Huapango Torero by non-binary Mexican artist Ana Segovia) is wholly representational, and was selected by over half the artists in the book. This painting where a boy holds a flower up to a bull, is a call to end animal cruelty, machismo and bullfighting. It revises an original work where boys used to go into bulls’ fields at night to practice bullfighting. The highly political subject of animal cruelty though, on the one hand encouraged the visual depiction of animals – the bull – but on the other, an unwillingness to show the gory details, the actual killing, the bloodshed. Filmmakers chose different ways to negotiate this.
In It Ain’t Wot it Seems, Penny Florence adapted direct images from Segovia’s painting that became layered with each other, alongside the bilingual, moving text of the visual poem (also a visual poem on the page).
The winning film, A Love Spell Cast in Petals, by Meriel Lland was many layered and directly representational, including images of bulls, a carving of a bull, and a powerful poem that confronts the subject with depth and emotional strength; a call for change – an end to cruelty to animals.
Janet Lees found the painting too complex to work to, and so based her film on the extraordinary poem ‘Self Portrait with a Line from Lorca’ by Elena K. Byrne and Lois P. Jones which was based on the painting Huapango Torero. Whilst she included some images of toreadors, the main subject matter was a Mexican dancer in slow motion, which the poets viewed as a feminist parallel in rhythm to the toreador’s movements with his cape. This revisioning can be seen as a filmic intensional undoing of the performative machismo of death and killing through celebratory joy and the feminine.
In Huapango Torero, Jack Cochran and Pamela Falkenberg created an ekphrastic animation of Segovia’s work… as they say “in an intertextual way.” Ideas flow and reinvent each other, a poem is influenced by another poem, and a song, or Ana Segovia’s paintings reappear in different locations and guises in the narrative.
In A New History, your film, Patricia, is about ending cruel stereotypes and a new beginning towards animal-human relationships. You talk to the boy in the painting; and the really meaningful and beautiful line ‘as the hoof takes the hand to show us all another way’ ending with ‘not every dance must end in death … a new history awakens.’ Here the painting is visible in your poem but not in the film at all. It is a reverse ekphrastic transfer via text alone.
Beate Gördes based her images directly on the bull but there was no verbal poem at all.
In Crystal Flower Carlos Ramirez Kobra from Mexico made a film that included images of bulls but associated the poem with the death of his mother and her village home.
Alejandro Thornton from Argentina focused on the title Huapango Torero and filmed a dancer’s bare feet stamping out the Huapango dance, whilst the words Resist / Exist appear in coloured smoke, but no bull in sight.
My own performative poetry film includes a mime artist who is both man and bull at one and the same time, to show how little difference there is between us, and how if you taunt a man he will react just the same as a bull. The mime artist was made up with a curly moustache (echoing bull’s horns) and accompanied by silhouettes of the shapes they made in performing, which appear bull-like. The poem is an Italian sonnet in two halves; in the first the man is full of his own importance, and in the second half this is dissolved by the arrival of a fly. The Spanish voiceover and the music tell the narrative very clearly, of the fate of the bull, but we don’t actually see one at all.
Finn Harvor was inspired by Huapango Torero but only in terms of an association between the hot summers in both Mexico and Korea. His film focused on the South Korean landscape and the sun, without referencing the narrative in the painting at all.
Of the artists who chose their own artwork, some were directly representational as in Colm Scully’s Interior Group Portrait of the Penrose Family which was exactly that, and the poem affords a deeper look into their lives through touching on actual events; or Tova Beck Friedman’s The Fall of Lilith painted by the Pre-Raphaelite painter John Collier, where Beck-Friedman examines with a feminist critique a deeply patriarchal approach to narrative
Ian Gibbins responded to Judy Morris’ illustrations of plants, where, after each Latin name of a plant a stream of consciousness description erupts that expands across numerous associations, and I feel is truly intensional.
Csilla Toldy’s poem ‘This Yard’ was a response to another poet and their poem, as she says in a double ekphrastic process.
PK: You have asserted that “Poetry film-making is largely attuned to and in a philosophical dialogue with the world” (323) and can “create radical change for humanity and the planet” (322). How does this new anthology contribute to that philosophical dialogue or create change?
ST: In general, since the rise of digital media and the Internet, the chance for different voices to speak out has emerged, through genres such as poetry film. And these voices have only grown, year by year. Unfortunately for the planet, the environment has become a central issue, and the poetry film community worldwide is voicing its distress. For me, organizing poetry film events and or publishing books means I can share these voices, and particularly encourage a diverse lens.
PK: What were some of the unique challenges or revelations that arose during the completion of this first publication from PoemFilm Imprints?
ST: I knew that asking artists to create work that tries to offer ideas for political change would be difficult, especially coming from left field, but I feel that the responses were extraordinary, brave and memorable. The question is – how to create an artwork that speaks to us both politically but also creatively, reflectively and aesthetically without making us turn away, or reject the work for other reasons, too. Every artist in this collection achieved that very difficult double act, and I applaud everyone who took part.I have worked in publishing on and off for many years, so I knew what I had to do in terms of production, editing, proofreading, paper selection etc. etc., and I have been curating poetry film screenings since 2012, so in general not many areas were a surprise. However, I specifically wanted it to be bilingual, to include Spanish readers, and to show the comparative musicality – euphonious or sonic patterning – rhythm, syntax etc. between the two languages. I am learning Spanish, and I had worked with translator Camilo Bosso before, and through him I discovered a lot about the language and honing the exact translations in the process. This was time-consuming but has been richly rewarding!
Maybe the biggest revelation is that although I kept thinking it was taking too long to produce, since I had announced it in December in Mexico, the fact that it only took six months, for a 116-page, bilingual anthology with links to films was amazing. If you look at academic publishers and their long schedules I feel really pleased about that.
Csilla Toldy, my co-director also has been very helpful and given great publishing advice and a second pair of eyes, which are really needed at the start of a company.
In terms of the aims of Poem Film editions, it was also essential to source an environmentally aware printer, (for the book and even bookmark); it is important to me that the books follow through in my eco credentials, and environmental beliefs.
What has also been wonderful is the reception it has had, both from contributors and readers. It is especially gratifying to hear praise first hand, as I travel around on my tour presenting the book: so far FOTOGENIA (Mexico city), REELpoetry (Houston online), Weimar (Germany), and Leeds Trinity ekphrastic symposium (UK). However, I really would like more of the contributors to come along, although many aren’t in the UK. The next one is at Bristol Literary Film Festival on October 27th.
PK: Is there anything else you’d like to share about ekphrastic videopoetry, your own creative process, or any other comments or contributions by filmmakers featured in the book?
ST: In terms of my own practice, I personally have worked with ekphrastic poetry films before, as in Villanelle for Elizabeth not Ophelia (based on the painting Ophelia by Dante Gabriel Rossetti) which takes a feminist stance against the position of the model and abuse of power, and there are others that are upcoming. My latest film Flight which is from the commissioned poetry (with images) collection The Unexhibited, due later this year, includes some fragments of my early Neo-Expressionist paintings, alongside those of the Cornish painter Peter Lanyon. The film centres on drone footage of the coast of Cornwall, and this is also a reference to Lanyon who in his later years flew a glider and made glider paintings (actually dying from a gliding accident). It also includes a reference to an ekphrastic poem I wrote ‘The (Last) Green Mile’ (based on one of his other works) in Transitional anthology by the Otter Gallery workshops, Chichester University, 2017.
I would finally like to add something of the reality of the working process of Bull, my own poetry film response to Huapango Torero which gives an insight into a dramatic, scripted (though without dialogue) performative poetry film. I conceived the narrative and concept (and lighting), which was interpreted by my daughter Hatti aka XaiLA who is a performance and makeup/ special effects artist in LA. My other daughter Georgie directed onsite, with a script (sent by WhatsApp) by myself. Hatti has never taken on this role before, and together they interpreted what I wanted and then some, as there was the added factor of a subtle, strangely dark humour brought to the performance. It was also determined by the clothes and makeup and the small space to film in (a small studio apartment), which in some ways also added to the sense of being trapped, whilst feeling like an experimental, cabaret-style venue. I found the Spanish band Lapso Producciones whose evocative, bitter-sweet cabaret-style music fitted both parts of the Italian sonnet structure and the Spanish voiceover artist Helena Amado brought a subtle sense of delightful irony to the narrative to complete the picture. I think this film shows how each person, each creative practitioner contributed an important part of the final result.
All the contributors have been wonderful, and supportive and view it as a unique and timely project that they are proud to be part of, so I can’t really ask for more than that. It was a leap of faith, a leap in the dark and I really had no idea that it would achieve what it has, when I think back to last summer when I began requesting films. At that stage a book hadn’t even been thought of. Looking back, I think it was the quality of the films and the poetry that inspired me to expand the concept from a prize and screening to an intermedial project. I have been told it is a first in the field and if so, I am extremely happy!
As Janet Lees mentioned in the video documentary on Frame to Frames, in poetry films the poem often passes you by, but here you can stop and pause and go back to the poems and read them in either language at your leisure. So, there is not only the comparison between the painting and films but also the comparison between the poems on the page in English and Spanish and also the poems as they appear in the films.
What I would like to say is that this project is also very different in that the ‘book’ is more than simply a book. It is a central hub with bilingual poems and explanatory synopses, and the poetry films are extensions of that, if you like, via QR link. It affords a different type of (varying chronologies) audience experience for the reader/viewer.
PK: Do you plan on organizing additional ekphrastic videopoem series in the future?
ST: You ask about more Frame to Frames events. Readers of Moving Poems can always submit ekphrastic poetry films to me. I will build a collection and it could serve for the next edition which will be down the line.
For press, further details regarding readings and screenings, or if you wish to submit ekphrastic poetry films for future events see poemfilmeditions@gmail.com.
To purchase the book please go to Poem Film editions at: Liberatedwords.com/store
Visit Liberated Words for a lengthy, fascinating essay by award-winning videopoet Janet Lees: “Joint forces: collaborating in poetry film.” Here’s a taste:
My Instagram tag is ‘everything is poetry’. Writing this piece, I’ve been thinking of changing it to ‘everything is collaboration’. I love what the poet Matthew Rohrer says about poetry: ‘I’ve come to believe that the writing of all poems is a form of collaboration’. He talks about collage poetry, ekphrasis and ‘collaborations with the voices that I heard on the brink of dreaming’. He asserts, ‘There is no creation out of nothing on this Earth. There’s only making new things in collaboration with other things.’
I’ve sometimes said that I stumbled into making poetry films and then stumbled into collaboration. Recently I’ve come to realise that this is not true (top fact: the Estonian word for making poetry is lluletama, which also means to lie). As a child I drew, painted and wrote poetry and stories as a matter of course. From the moment I was given my first camera, my beloved Grandad’s box Brownie, at the age of 11, I took a lot of photographs too. I listened to music endlessly as a teenager – not all of it great, but most enduringly Kate Bush, David Bowie, Leonard Cohen and other similarly poetic songwriters. So there was some early cross-fertilisation going on between the three key elements of a poetry film: words, visuals and sound/music.
The Lyra Festival is Bristol’s (UK) poetry festival, and 2024 is the festival’s sixth edition. The theme for this year was Poetic Futures, with a focus on technology and the future and also imaginative new worlds.
I was invited to view Cancer Alley, a poetry film created by UK poet, Lucy English, with US filmmakers Pamela Falkenberg and Jack Cochran, with digital media effects company Holotronica.
The film itself is a powerful insight into the lack of responsibility that multinational companies take (or governments enforce) for the impact of their activities on the environment. It highlights the industrial area of ‘Cancer Alley’ in Louisiana and the devastating problem of pollution created by the factories at the heart of the global petrochemical industry. It is impossible not to be deeply disturbed by the situation humanity finds itself in, and reflect on past situations that we still haven’t learnt from. A short poetry film is vastly apart from an Oscar-nominated blockbuster on so many counts (not least budget of course), but I think it is a compliment to the quality of this film that I brought to mind Erin Brockovich and felt depressed that 24 years on from the film, and 50+ years on from the Hinkley ground water contamination incident that it features, that here is another horrible situation that is, inevitably, just one of so many more around the world. I hope that the film is a tiny stepping stone to widening knowledge of Cancer Alley.
The film was presented as a continuous loop at the Watershed arts centre in Bristol. It was situated in its own darkened space, just off the main bar, and was free to enter and exit at will. The audience steps in and faces the double screen presentation, where they can watch standing or sitting.
This was a great venue because it was open all day for curious people to drop in and take a look. For me, I think the chance encounter is hugely valuable for drawing in audiences from a wider base than would choose to specifically attend a film screening of any kind of poetry or art film. The film was prominently featured in the brochure for the festival too, which I think is very encouraging for poetry film. It can be all too easy for organisers to put events that run for a duration at the back of a brochure (where they are easily overlooked), after the ‘headliner’ daily events. I hope this encouraged festival visitors to plan to drop in to the Watershed before, or after, their ticketed events, and people hanging out at the bar for a coffee or some lunch to take a look too.
The film was advertised as a poetry film hologram exhibition. I have to say, this was the most disappointing thing about the presentation. With hologram in the description, I was expecting a 3-d element to the film and felt I was mis-sold on that. I’d been hoping for something more like the ‘Apparition’ I’d seen of a Dominique Gonzales-Foerster piece in her retrospective exhibition a few years ago that was in Dusseldorf and Paris, but in the poetry film genre. I’ve since checked to see if I had misunderstood the nature of holograms, but a generally defining feature of them is the creation of a 3-dimensional effect. Cancer Alley is presented with a layered element. The film is split between footage that appears on a back wall, and images and text that is on a foreground transparent gauze screen. Together these are beautifully done. I particularly liked the integration of the type on screen, and the images of smoke and yellow rain. However, for me, these are flat layers rather than 3-dimensions, albeit with a depth to them.
Holotronica, the company that English, Falkenberg and Cochran worked with on this, does create 3-dimensional presentations, and in fact claims itself as ‘world-leaders in hologram effects’, with many amazing shows and events, including Beyoncé, on their website. They have specialist products for projection – including the specialist gauze screen. Unfortunately, though the quality of the image on the foreground gauze was just beautiful, it was extremely hard to appreciate when the projection on the back wall was on a screen that did not fill the ‘window’ in the gauze. The surroundings of the back screen are all too visible because they were not blacked out. I had to work hard to suspend disbelief that I wasn’t looking through the gauze layer into a classroom with a whiteboard (effectively I was), and that a teacher wasn’t going to appear soon to set geography homework on the effects of pollution.
But there were also serendipitous pluses at work too. There were points at which the projection spilled onto the ceiling and the adjacent metal pipework and surrounded the viewer, and those moments felt stunningly immersive. They brought me into a comparison with feelings I had inside the Sarah Sze and Artangel project ‘Waiting Room’ last summer in Peckham Rye, London.
I was fortunately able to chat to all three of the creators, Lucy, Pam, and Jack, after I watched the film. They see the result at the Watershed as their pilot project, something that they would like to build upon, leading to something better and more ambitious in the future. For this event specifically, they are fully aware of the limitations of the technical presentation of the film at the Watershed. Budget is always an issue because the technical equipment is very expensive, and it does create limitations and compromises. They would have liked to have been able to black out the area behind the gauze. Some artists are of the mindset that they would not show their work in less-than-ideal conditions. But I am very much with Pam on her views that doing something and showing work on a shoestring is better than doing nothing – it can only mean learning from the process and helping to demonstrate what is possible and what might be achieved in future. They would love to be able to bring this work to other venues, and I hope it helps them, and others, to bring poetry film installation ideas to fruition in the future.
It is sad that creatives are so often put in the difficult position of doing something with nothing or very little, and/or funding it themselves. The technology is paid for, the technical staff are paid for and little is left for either the details of fulfilling the true creative potential of the work that has been created, or paying the artists fairly. (I recommend anyone interested in this to check out the campaign of UK-based artist Lindsay Seers – Frank Fair Artists Pay)
It is also interesting to reflect on the differences between this and the VR experience Abandoned Library that I saw at the MIX 2023 conference at the British Library. The VR meant that the creatives were in full control of the ‘environment’ in which the viewer was placed. There were similarities in the environmental theme, and the use of smoke, mist and rain to create mood and feeling for the piece. However, VR is still so restrictive and uncomfortable to experience. I’m not sure I would readily swap the ease of stepping into a room and comfortably sitting down, for something I’ve got to wait my turn for or book a slot, then sitting awkwardly in a swivel seat while someone (at far too close quarters) adjusts the headset while I feel like I am about to have a minor medical procedure. I would rather be in a room with Cancer Alley.
Like Pam Falkenberg, I am always going to be a fan of doing something on whatever basis you can manage regardless. Poetry film is a powerful genre, but making events and opportunities where it can step up a level to become impactful through immersion is, for me, something to keep pushing for. Cancer Alley is to be celebrated as another stepping stone forward in presenting poetry film in more immersive and creative ways.
In the summer, I attended MIX Digital Storytelling Conference 2023 … and reviewed the event for Moving Poems. I briefly mentioned the excellent keynote speaker at the event – Adrian Hon. But I realised that his talk has prompted some wider thoughts about collaboration in poetry film. Adrian Hon is big in the computer gaming world, and a particular plea in his speech was a call for creatives (in the context of MIX he meant largely writers but I think his point applies to visual artists equally) to be involved with technology at all stages of development and production of a project. Creatives need opportunities to prototype ideas so that they can better understand how a project might develop when people with other skills work on it. I wholeheartedly agree, and hope his vision will have influence. A popular question for any creative is to explain how a project came into existence, and what happens behind the scenes in the development of a project. In particular, in the poetry film world where so many films are made by such small teams or partnerships, it is common to talk about or be asked about how the filmmaker has collaborated with the writer. Do they get involved together at an early stage as advocated by Adrian?
I began reflecting on the films I have made, and they have come about in numerous different ways. I’ve made films from pre-existing poems. This means having a personal response to a poem and expressing that in film. But even this simple beginning can have different situations. Do I know the poet personally or not? Do I have any contact or discussion with the poet before or during the making of the film? Is the contact in person, or by email/messaging? Have I chosen the poem? Or has the poet chosen me to make a film? I think all of this can change the dynamic in the filmmaker’s relationship with the poem.
Sometimes the poet might be the filmmaker themselves. There are lots of examples to explore on Moving Poems – search ‘author-made videopoems‘ and you will find Valerie LeBlanc and Daniel Dugas, Jessie Jing, Marc Neys, Matt Mullins, Janet Lees and many more. Early on, I decided I would try to make a film from my own writing, and though the result is similar to my other work in its technique and imagery, I know that my approach to the visual ideas in this film felt very different because as I wrote the words I had images in my mind.nnI have made work collaboratively with writers. I’ve discussed the ideas for a film with a writer who went away and wrote a poem, recorded the voice and then I made my film. I’ve discussed ideas for a film with Lucy English for her Book of Hours project, then wrote a short second voice response to her poem (Glitter – December evening in the Book of Hours), so the writing became a joint poem, and then I made the film. I collaborated even more deeply with Rosie Garland for Because Goddess is Never Enough.
Having discussion and input into projects has been rewarding in all instances – but it was quite different with Rosie. This time, the idea for the project came from me. I researched the subject and gave a dossier of material, texts and images to Rosie. She came back to me with snippets and first drafts which we were able to discuss and develop, and she was very open to my edits and changes to words and the ordering of the poems of the final piece. I also changed the first and third person voice around in some places. Some of the changes and edits happened as I worked on and developed the films. There have been dynamics that I have enjoyed, and I’ve been stimulated by collaboration. But equally it can be enjoyable to just try making a film in response to only the words of a poem – to be responsible for the reading (whether myself or choosing another voice), and be free of any connection to the writer. Marie Craven has told me that she will sometimes make a film without necessarily asking the poet first – she wants to try things out in an independent way that might not necessarily work. Then if she finishes the film she will ask later, and has only once had a rejection.
If the thought of taking Marie’s approach worries you, then there is no shortage of out-of-copyright poetry to play with. Or, as a final thought – there is also found poetry and erasure poetry to play with, another scenario for a filmmaker to explore. In fact this was my route into poetry film before I knew it existed as a genre. Channel Swimmer was my first film, and it was made with texts extracted from two novels. Often a very successful process for Matt Mullins, for one.
I can’t pinpoint what the differences might be in the end results of any film, but I do think that this idea of changing the dynamics of involvement in a project is a very interesting part of my filmmaking journey. Some approaches have felt more comfortable and successful, and some less so. I encourage you to mix it up and experiment with something different to your norm.
The online Poetry Film in Conversation series, hosted by Helen Dewberry, returns on June 8 from 7:30-9:00 PM British Standard Time. Rosie Garland, Maria Jastrzębska and Moving Poems’ own Jane Glennie are her interlocutors, with plans to discuss research, re-imagining and collaboration: “What is the role of the poet? What is the role of the filmmaker? How can we adapt and develop poetry into film?”
Tickets are £6.13 through Eventbrite.
Jane Glennie and Rosie Garland will discuss their collaboration Because Goddess is Never Enough. The work is inspired by dancer Tilly Losch. Maria Jastrzębska will address writing for Snow Q, which re-imagines the Snow Queen story.
Fiona Tinwei Lam is the current City of Vancouver (Canada) Poet Laureate. She has had a very busy role co-ordinating the City Poems poetry project which aims to foster public engagement with local history and culture through poetry. I am very pleased to say that this project has a very significant poetry film component.
You can watch selections from the competitions while the project is open for the audience awards until 26th May 2023.
You can read more about the project in a short article Fiona wrote about the competition. I hope the project proves a good template for encouraging similar future projects in Canada and elsewhere in the world.
Poetry Film Live and Lyra Bristol Poetry Festival are holding an online series of events, ‘Poetry Film in Conversation’. The events kick off on February 9th 19.30 (GMT) with Animation, Motion Graphics and Text on Screen. Diek Grobler, Suzie Hanna and Jane Glennie will each give a presentation (Suzie’s will be pre-recorded) followed by a panel discussion chaired by Lucy English, and finishing up with an audience Q&A.
Diek Grobler is an artist working in various media and disciplines. Since 2010 his creative and theoretical focus has been on animated poetry-film. His films have been widely exhibited on international animation festivals, and his work has been shortlisted twice for the Weimar Poetry-film Award. He was awarded a PhD in Art from the University of South Africa and is an independent researcher on Poetry-film and experimental forms of animation.
Jane Glennie is a filmmaker, typographer, and founder of Peculiarity Press. Her films have screened worldwide, featured on www.shondaland.com, and received awards at competitions in the UK, Germany, and USA. Her poetry film with Rosie Garland, funded by Arts Council England, has now been published as a ‘book of the film with extras’.
Suzie Hanna is Emerita Professor of Animation at Norwich University of the Arts. She was Chair of NAHEMI, the National Association for Higher Education in the Moving Image from 2016 – 2019, and remains an honorary member of the executive. As an animator who collaborates with other academics and artists, her research interests include animation, poetry, puppetry and sound design. She has made numerous short films all of which have been selected for international festival screenings, TV broadcast or exhibited in curated shows. She also creates improvised animated projections for live performances of music and poetry. Recent commissions include short films for BBC Ideas and Cambridge University Creative Encounters Programme. She contributes to journals, books and conferences, and has led several innovative projects including online international student collaborations and digital exhibitions of art and poetry on what was Europe’s largest public HiDef screen. She works as a production consultant and as an international academic examiner, and she was a member of the AHRC Peer Review College from 2009-2014.
To book tickets please go to Eventbrite: https://www.eventbrite.co.uk/e/poetry-film-in-conversation-animation-motion-graphics-and-text-on-screen-tickets-516766210647
As humans, we are driven to narrative. It is almost impossible for us to experience a sequence of events and not attempt to ascribe some kind of narrative arc to it. What just happened? What does it mean? How did it start? What will happen next?
There is a considerable literature on the theory and practice of creating narrative in different contexts: fiction or non-fiction; in print or on stage or screen; or via any other medium. Narrative can be language-based, as in a novel, or non-verbal, as in a choreographed dance, or a combination of both, as in a movie. But the basic structure of narrative mostly boils down to a few key points: there is a beginning, middle and an end; something changes along the way; it occurs in some kind of contextual framework. If any of these key elements is missing, we, the readers or viewers, inevitably will try to fill in the gaps.
Over the last 20 years, neuroscientists and cognitive scientists have made significant advances in understanding how – and to some degree, why – the brain creates narrative. Much of this new research complements well the ideas of theorists and practitioners concerning the role of narrative in literature, cinema, theatre and dance. Indeed, many authors have integrated data across the sciences and humanities to build new appreciations of how and why narrative works. Key foundation texts in this field include The Poetics of Mind: Figurative Thought, Language and Understanding by Raymond W Gibbs, Jr (1994); On the Origin of Stories: Evolution, Cognition and Fiction by Brian Boyd (2009); and How Literature Plays with the Brain: the Neuroscience of Reading and Art by Paul B Armstrong (2013).
From a cognitive point of view, we can consider the construction of a narrative as coming in different flavours: for example, we can describe a series of external events, that is, things that others can also describe from their own experiences of the same events; we can create a story from our own remembered experiences that is essentially private, since no one else can have those same memories; or we can create a fiction, a story that no one has ever actually experienced, even though such a narrative necessarily contains elements that are relatable to the external world.
In order to create a narrative, we must access several different elements of memory. There is no single phenomenon called “memory”. Rather, there are many forms of memory, some of which are so fundamental to neural processing that we are not consciously aware of them. The duration of different types of memory can range from a few tenths of a second (eg the early steps of processing visual or auditory stimuli) to a lifetime (eg learning to walk or knowing what a flower is). Furthermore, many forms of memory lie outside easy verbal description, eg how to button up a shirt; how you solved a crossword puzzle; how you felt at lunch-time yesterday.
The components of a traditional first-person narrative (“I did this, and then I did that…”) rely on what is generally known as “autobiographical memory”. This is memory of what you have done in the past. It is fully private, in that only you can access it. Unless you have a very specific type of brain injury, it is updated continuously as you consciously experience the world. There are several remarkable features of this memory system:
For the reader or viewer of a narrative, we automatically feed the story (such as it might be) through our own autobiographical memory processor. We identify the temporal sequence, the salience of each component, the relationships between the components, assign meaning to elements we recognise and make a guess at the meanings of elements new to us. Even the most abstract, abstruse, uneventful “narrative” will have a beginning, middle and an end, a context in which it is viewed, an emotional and cultural framework within which we will evaluate it. And so we create our own narrative version of “the story”, almost certainly incomplete when compared with the narrator’s intent, perhaps remembered only fleetingly, but more likely, generating a new entry of our own autobiographical memory (“Let me tell you about the movie I saw last night…”).
This ability for the viewer to make narrative out of minimal clues has been well recognised for many years. A famous experiment by Heider and Simmel (1944) showed how moving abstract shapes are commonly read as behaving like people within a strong narrative arc.
Similarly, short form texts such haiku, one-sentence poems, even Tweets (!!) can be commanding in their narrative intensity. Advertisers have known all this for a long time. Successful television advertisements must tell a story in as few as 15 seconds (“Look at this! See, it’s amazing! That’s why you need it… Buy one now! Get it here!!”). Indeed, some television advertisements have been recognised as stand-out examples of short-form video narration, for example, highly-regarded productions for Budweiser and Google.
https://www.youtube.com/watch?v=_ZhO57NBJm0
Most television advertising lacks such sophisticated production values, but even the most simple, hackneyed approaches can inspire a poetry video narrative. In my 42nds, the timing of the scenes and the amount of text per scene closely follows that of typical advertisements 15-45 seconds long. This video was commissioned for outdoor screening in a downtown shopping mall and has since been screened on other public locations mixed in with genuine advertisements.
I’ll finish with two examples of masterful, albeit unconventional, poetry videos, both of which have featured on Moving Poems previously, that incorporate many of the elements mentioned above. These episodic narratives subvert the tropes of commercial television whilst illustrating the highly mutable state of autobiographical memory: Profile by RW Perkins and Human Condition by Rich Ferguson and Mark Wilkinson.
The success of these videos relies totally on our ability to:
An empty screening is a nightmare – Covid closures, bad or no publicity, or just no one want to come and watch … all are awful scenarios. But before this point – stay alert for the increasing number of scam festivals that promote themselves on platforms such as FilmFreeway. There may be total scams that are completely fake and will just collect the entry fees and do nothing, but there are also a growing number of events that are dubious at best – perhaps multifarious categories to elicit many more hopefuls but little else going on beyond a few ‘prizes’, or perhaps an online-only screening that no one will pay any attention to because it doesn’t have an established audience. Poetry film is growing as a genre in the film world which is, of course, fantastic, but this means it becomes more vulnerable too as it is less of place where everyone knows everyone.
All festivals, events and calls for work are mentioned by Moving Poems with our best efforts and in good faith. However, do check all details yourself as we cannot guarantee accuracy, and make your own judgements because we cannot verify the things that we share.
We found several articles which describe this problem in more detail, and which contain helpful advice on how to steer clear:
I’ve always loved language and languages. I did Latin, French and German at school and I could easily have ended up studying linguistics in a slightly different universe. For me, poetry and experimental writing are fundamental ways to explore the limits of language: to try to describe what cannot be put into words, to find out what happens when language is stripped down to its essentials (whatever they are…), to discover how the visual, oral and aural aspects of language interact.
Combining video with poetry and experimental writing has been a revelation in this context. In a video, text can be dynamic, as it changes and morphs in multiple dimensions. Voices can be added, distorted, re-timed, presented in counter-point to each other and to on-screen text; they can even be made to articulate the literally unspeakable via increasingly sophisticated text-to-speech algorithms. And then there are all the possible interactions between the text of the video and its audio-visual content.
Over the last few years, I’ve been increasingly interested in how we deal with translation in poetry videos. I have had many videos screened in non-English speaking festivals and installations where there is usually a requirement for subtitles in either English or the native language. But sometimes, there is an absolute requirement for subtitles in the native language. I also have collaborated with non-English speaking poets which has required me become familiar with at least some aspects their native tongue. And I have even created a genuine bi-lingual video poem.
So how do we deal with multi-lingualism? How should the translations work? There is a large literature on the nature of translation, as well as the underlying neuroscience of bi- and multi-lingualism. But I have been strongly influenced by a couple of books in particular, both of which have been written by authors who have translated some of the most influential experimental poetry and writing :
Poetry videos offer a unique slant on translation that is not available for written text: videos give us the option to hear the original language, and, indeed, read the original written text itself as well as a translation. And we still have access to all the same audio-visual material and its interactions with the text. One corollary of this is that the translated text does not necessarily have to be as “poetic” as the original. It may not even need to be a complete translation, if the sound of the original and its accompanying imagery allow.
It is very common for translated poetry videos to have subtitles added in a similar way to any other video or film. However, conventional subtitles can clash with the visual aesthetic of the video. Nearly all my poetry videos have at least some of the text embedded in them, as part of the overall visual design. When adding translated text, I try to use the same fonts, layouts and designs as the original, so that the look of the video is not changed and the translation is seen as a natural component of the work. Another option is to use closed captions for a translated version. It does not look very elegant, but it allows the user to turn the translation on or off. A further advantage is that the text exists as a separate underlying time-stamped file (eg .srt format) that can be translated by a third party as required.
So now to the big question: how do we actually get the translation? Ideally, you are sufficiently knowledgeable in the appropriate languages to do it yourself. I can do that well enough for German or French, and I have made a genuine bilingual English-French video based on a poem of mine, Signature, originally published in the French journal Recours Au Poème. But although I have become familiar with some aspects of other languages, most notably Spanish, Italian, Greek and Swedish, I cannot translate from English into them. Instead, I rely on machine translation, good dictionaries and, when necessary, advice from a native speaker.
My preferred machine translation system is DeepL which, when tested on languages I do know, performs better than Google Translate across the board, especially when the language becomes more idiomatic or figurative. The suggested translations can be checked and fine tuned in several ways. One is to simply back-translate the phrase to see if you get the same thing. Using a different system for the back-translation (such as Google Translate) can also be useful. Another good strategy is to replace some of the words in the original with synonyms or near-equivalents and compare how they get translated. If the translation offers options, I often look them up in the native language dictionary or thesaurus (eg Wiktionary) that shows how they understand the meaning of the word and how it should be used. And I always keep a grammar book at hand for the language in question to find out how it is structured and how things like tenses, cases, pronouns, adjectives, etc, actually function. These resources have been critical for most of my translations.
Sometimes, the translation simply will not work. An implied meaning in one language perhaps cannot be made in another, often because of the way the grammar rules operate. As is well known to translators, there are idioms and turns of phrase that do not cross languages or cultures. Experimental writing or visual poetry that relies on the intrinsic structure of words and their grammatical variations may be impossible to translate in any literal manner. What do we do then? We simply watch the video, listen to the ebbs and flows of words that even a native speaker may not understand, and revel in the uncertainty of it all.
Click here to see all Ian’s videos with translations.
This essay first appeared on Ian’s blog, which anyone with a serious interest in videopoetry ought to follow. —Dave B.