A robot with character

Interview with researcher Jorrit Thijn

Creative writers should play a much greater role in the development of robots, says Jorrit Thijn, PhD researcher at HKU and the Vrije Universiteit Amsterdam in the project Robotstories | Expanding Narratives. “My view of human beings is that identity emerges through the interactions you have with other people and with your environment. That’s the principle that I try to apply in the model for the robot.”
In his PhD project Robots with Character, Jorrit works together with Sander Goetzee, a fellow PhD researcher affiliated with Vrije Universiteit Amsterdam, to explore how interactions between the elderly who have dementia and robots might become more meaningful by creating the suggestion of an inner world within the robot: a robot identity. This robot identity is shaped through both texts written by creative writers and content generated by AI via so-called Large Language Models. A newly designed authoring tool and identity manager must ultimately express the robot’s inner world in the interaction with its elderly conversation partner with dementia.

Cutting up the stuffed toys

Jorrit studied at HKU Theatre’s writing programme between 2004 and 2010. The seed of his wish to breathe life into something that is lifeless, was planted there, during the making of a theatre performance featuring a scene in which children destroy two soft toys. The scene was based on the Greek tragedy Medea, in which the title character kills her children. “When the scissors cut into the stuffed toys, the audience reacted incredibly shocked. That moment has always stayed with me.”

'To my surprise, some people refused to give back the little block'

Growing fond of a metal block

His fascination eventually led him to HKU’s master’s programme Crossover Creativity, where Jorrit researched the animation of non-living entities. One of his experiments involved asking participants to carry around a small metal block for ten days. They were instructed to keep it warm and maintain a logbook during the process. “To my surprise, some people refused to give back the little block after those ten days, because they had grown fond of it.”

Robots as story tellers

Going from stuffed toys to metal blocks to robots, was a process that took several years, but working with robots had long been a heartfelt wish for Jorrit. In 2016, he came across the Nijmegen-based literary organisation Wintertuin. “Their writers had started a project with Mike Ligthart, then a PhD candidate at Delft University of Technology, aimed at turning robots into storytellers for children. Exactly what I wanted to do as well!”

Step towards PhD trajectory

From 2016 onwards, several shorter-term research projects were launched under the umbrella of Robotstories. Initially, these collaborations involved Vrije Universiteit Amsterdam and Wintertuin (the former TU Delft researcher had switched to another institution), and later HKU and ArtEZ joined as well. The collaboration proved so successful that Jorrit himself embarked on a doctoral trajectory last year. He now works in a tandem construction with fellow doctoral researcher Sander Goetzee from VU Amsterdam, under the banner of the latest follow-up project: Robotstories | Expanding Narratives.

'We give the robot a history – a backstory'

A bit grumpy

““Until a few years ago, such a tool would have been highly scripted, structured on a so-called branching narrative,” Jorrit explains. “You begin with a storyline, and if person A says one thing, the robot responds in a particular way. If person B says something else, the robot gives a different response. It is a system of branching pathways, and each one had to be written out manually."

“However, now that the Large Language Models have become so huge, this is no longer necessary. We can structure the architecture differently by using this form of generative AI. For example, we can decide that our robot is a little grumpy in the morning and speaks in shorter sentences. Or make it more cheerful in the afternoon and more inclined to respond enthusiastically. We give the robot a background story. That story first needs to be translated into a model. That is what I will be working on. Sander will investigate how to connect this to our identity manager. The central research question is: how can you design more meaningful interactions between humans and robots?”

Lecturing researcher Hanan Faour, tenured at ArtEZ, does a short recital during the start of 'Robotstories | Expanding Narratives' in a care home in Utrecht.

Collaborating with creative writers

Creating such a backstory calls for a different way of writing stories for robots and AI. This is where creative writers come in. “Creative writers are exceptionally talented at imagining meaningful stories and connections,” Jorrit says. “They are able to create characters with highly complex identities from scratch. That expertise is urgently needed in the development of social robots.”

To further explore this field, Hanan Faour, lecturing researcher at ArtEZ, is involved in the project. Hanan collaborates with three creative writers: Tine Tabak, alumnus of HKU’s Writing for Performance programme; Wietse Leenders, alumnus of ArtEZ Creative Writing; and writer Steff Geelen, from Wintertuin. Hanan will also work with students from ArtEZ’s Creative Writing programme.

A new Pepper


Another key participant is, of course, the robot itself. “In earlier editions of Robotstories, we first worked with NAO robot and now with Pepper: a one-metre-tall robot that looks very sweet. But Pepper is going to retire. The company that manufactures it is discontinuing production and can no longer supply spare parts. So we need to find a new robot. “And that is where my theatre background is relevant. Because the robot needs to have a certain presence, or at least an appearance that makes it possible for people to project a personality onto it.”
Jorrit Thijn talks with Pepper robot Memo and residents at the start of 'Robotstories | Expanding Narratives' in a care home in Utrecht.

What does the beach feel like?

The first time the Pepper robot met seniors with dementia and healthcare workers in a residential care home, the encounter was organised as a tea party. “We clearly explained: this is a robot, not a human. And the robot cannot do that much yet. We need to help it a little. For example, can you tell the robot what the beach feels like? Or what a forest smells like? That led to some very interesting conversations, as well as new stories from the seniors. Conversations they otherwise wouldn’t have had with their care professionals, spouses or children. Stories that might otherwise never have surfaced. In that sense, the robot is not just a tool for the elderly patients themselves, but also for the people around them. It would be wonderful to discover that such a robot is not a replacement for the work of care professionals, but rather a valuable addition to it.”

Stage experiment

Before the new robot is introduced to the elderly with dementia, Jorrit first plans to conduct a stage experiment in autumn 2025 using a robot modelled according to the architecture developed up to that point. The experiment will take place in a theatre setting with a general audience. “There, we will examine which elements of the interaction with the audience might be transferable to the care home environment, and how that new setting, in turn, affects the meaning the robot brings to the interaction.”

‘What does it mean when a robot, as a character, becomes part of our lives?’


Minor Artistic Artificial Intelligence

At some point, HKU students will also become involved in Robotstories | Expanding Narratives, Jorrit explains. “We are currently developing a Minor in Artistic Artificial Intelligence, which is set to launch in September 2025. I’m really looking forward to that. I would love to explore the robot’s identity together with students from different disciplines. For example: what does the robot’s home look like? That could be explored with Design students. And from there on, together with students from Theatre Design, we could create a world for the robot. It is important to think about what it means when a robot, as a character, becomes part of our lives. For me, that is the truly distinctive artistic contribution that HKU is making within this research.”