Rehabilitation centres across the world are using computer games to help patients dealing with the impact of serious illness or injury.
Ruby Flanagan, a nurse from the Wirral, lost her leg at the age of 24 after being hit by a car in August 2021. She is now receiving therapies based on computer games as part of her rehabilitation, which she hopes will mean she will one day be able to lift her young son off the floor.
Ruby suffered her injury while shopping with her five-month-old son, Leon. Although she managed to throw her son out of harm’s way, Ruby was not so lucky. Her right leg had to be amputated, her left leg needed extensive reconstruction and her pelvis was shattered by the impact of the crash.
“The first few weeks in hospital are a blur,” Ruby told BBC Click. “I don’t remember waking up. I don’t remember who told me I had my leg amputated. In my head, I thought I’ll learn how to walk again. I’ll get a fake leg, a prosthetic leg, and that will be that. “I didn’t realise how hard it was actually going to be.”
Now at a specialist rehabilitation clinic, called Steps, in Sheffield, Ruby is receiving a variety of conventional treatments, including hydrotherapy and physiotherapy, as well as regular MindPod sessions. MindPod allows Ruby and other patients with similar conditions to control an animated dolphin to help their bodies regain strength, balance and co-ordination.
“When I first came to Steps, I never imagined intense rehab to be games,” she laughs. She says the ambient lighting and calming nature of MindPod’s environment is helping her move her body instinctively, without thinking about it.“
[MindPod is] helping balance, co-ordination and core stability,” she says. “It reflects on things like if I were in the kitchen, reaching for things up in the cupboards or down below.” Ruby is making excellent progress thanks to her hard work and the support of staff at the clinic.
“A lot of feedback that we’ve had from clients is they feel they’ve worked within the MindPod but they also feel relaxed when they come out of there, which is really important,” explains Steps head of therapies Lucy Moore.
The immersive video-game-inspired therapy has been developed by Dr Omar Ahmad and Dr John Krakauer, of the Kata studio at Johns Hopkins University, in the US. It uses motion-sensors and cameras to track patients’ movements as they direct a playful dolphin called Bandit across a screen.
But Dr Ahmad, who invented Bandit, says it’s not an animation in the traditional sense. “All the movement in the game is generated in real time,” he explains. The patient ultimately “becomes the dolphin by mastering its motor-dynamics and expressing movement within the animal’s space”.
His colleague, Dr Krakauer, who is a professor of neurology and neuroscience, describes the novel approach as a “digital therapeutic”, meaning a doctor could effectively prescribe software “as [a] pill”. “It creates a feedback loop of learning and enables exploration in the way a child learns to move their arms in early infancy,” he says.