The Alzheimer’s Intelligence Project shows how smarter AI can empower humans and give communities a voice on future innovations
SEATTLE–( BUSINESS WIRE )–Today at Lenovo Tech World, Lenovo™ in collaboration with Innovations in Dementia, unveiled Alzheimer’s Intelligence, photorealistic 3D avatars with custom AI based on the lived experiences of people with dementia and Alzheimer’s. This proof-of-concept project gives people and families undergoing a dementia diagnosis 24-hour access to a conversational avatar that offers curated advice that prioritizes accuracy, privacy, and compassion.
This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20241015879964/en/
‘Liv’ an Alzheimer’s intelligence avatar used by Ahmad Krayem, one of the focus group participants involved in the Lenovo project. (Photo: Business Wire)
Globally, there are about 55 million people living with dementia, and that number is expected to reach 139 million by 2050, said Dr. David Llewellyn, Professor of Clinical Epidemiology and Digital Health. “AI advances in Lenovo’s ‘Alzheimer’s Intelligence’ initiative demonstrate how the technology has the potential to enhance human interactions, offering valuable tools to support individuals living with dementia, both now and in the future.”
In this first application, Lenovo is pioneering the use of AI enabled by its comprehensive portfolio of technology solutions, from individuals to enterprises. This combined technology aggregates the first-hand experiences and advice of hundreds of people living with dementia and Alzheimer’s into responsive, photoreal 3D avatars capable of natural, unscripted conversation. With this proof of concept, someone diagnosed with dementia is just one click away from real-time conversational resources and assistance.
With today’s increasingly advanced advances in AI, we must leverage this technology intentionally and responsibly for communities that may be overlooked by innovative technologies, said Doug Fisher, Chief Security and AI Officer at Lenovo. This is part of our commitment to deliver Smarter AI for All” by developing and deploying technologies that can empower people at every scale.
The avatar was created from a combination of images of 10 people suffering from dementia and Alzheimer’s. From the initial pose of each image, generative AI estimates the face for several thousand expressions and other angles inspired by the subject. These were then aggregated into a single data set, which was combined with the filmed faces of the players to create the image of “Liv”, the AI avatar.
A large language model (LLM) data set containing Liv’s deliverable advice was created using data coming directly from the experiences of people with dementia, including entries from the Innovations in Dementia Dementia Diary project and in-depth panel interviews. Each time a user asks a question (via Speech-to-text), LLM queries the dataset to provide a text-based answer to the user’s question, expressed using a language “persona” created for Liv, and based on a knowledge base built for Liv. The replies were then voiced using a vocal synth created for the project. “Sentiment analysis” is used to analyze the underlying feelings of replies, which are reflected in the AI’s facial expressions when speaking. Lastly, real-time 4k visual AI is used to make the speech produced by the vocal synth appear to be spoken in real-time.
Alzheimer’s intelligence will allow people newly diagnosed with dementia to ask questions that only someone who has lived with the disease can answer, including understanding daily challenges, discussing the disease with family, and exploring new hobbies. Most importantly, the entire experience is designed to be accessible, requiring minimal technology expertise and prioritizing natural, intimate interactions.
The avatar is currently being trialled by dementia sufferers in a controlled environment with the aim of making it more available to the public in the future. The creation of the project and early interactions have been captured in the films linked below.
The Alzheimer’s Intelligence Project offers a new way to easily access valuable data-sourced insights based on real people living with dementia and Alzheimer’s. While the information varies widely, the development team was careful to apply clear boundaries to the AI and ensure that no medical advice was provided by the avatar. This includes working with Dr. Llewellyn and Innovations in Dementia, who both provide advice and consultation on avatar creation and testing.
The AI was trained and tested for this specific use case, and the project was designed and realized with Lenovo devices, services, software, servers and cloud solutions. This is the first time Lenovo’s AI-enabled solutions have come together to develop this kind of avatar. Devices and solutions include:
- Lenovo technology partner Kaleida, which led the development of the avatar and underlying AI, leveraged Lenovo’s AI professional services to support processes and security.
- ThinkStation P7server, ThinkPad T14s Gen 6, and ThinkPad X1 Carbon Gen 12 AIPC laptops, as well as Lenovo Legion and ThinkVision monitors and accessories.
When people are first diagnosed with dementia, they may feel confused, with many questions about what is happening. This AI does not replace human contact but what it does is offer a knowledgeable and compassionate source of reassurance and advice based directly on the experience and wisdom of other dementia sufferers. said Steve Milton, Director of Innovation at Dementia. It’s great to see technology leaders like Lenovo prioritizing the innovative use of AI in a way that not only recognizes the expertise of people with dementia, but also leverages it in unique ways to support others when they need it most.
Innovations in Dementia states that around 20% of people who come to the clinic are under 65 and may live for years with the condition. This NGO promotes a positive but realistic view of dementia: although it is life-changing, it does not have to be life-ending.
We recognize the importance of giving everyone a voice in innovation, comments Lenovo’s Doug Fisher. With major advances in AI and smarter technology, now is the time to explore and trial creative new ways to use technology like AI wisely and responsibly, for the greater good. Ultimately, this is about re-imagining a future where technology is for “and by” everyone, giving everyone a say in what they want from the most transformative technology of our generation.
Gail Gregory and Ahmad Krayem, focus group participant comments¦
- It is very important to involve real people in the creation of the avatar. Because people with dementia are the experts. We are the ones who live with it. You can’t just take something from a textbook because it’s not real. It must be real. And the more realistic it is, the more relevant it is. I think this would be a very useful tool, especially for people who live independently because they don’t have anyone to ask, Gail Gregory.
- I want to help others who have recently been diagnosed with dementia and reassure them that this is not something to be afraid of. A doctor can tell you what medications to take. But only dementia sufferers can tell you what they’re really experiencing, Ahmad Krayem.
Watch the Alzheimer’s Intelligence video Here
The participants in this film include:
Gail Gregory: Diagnosed with Alzheimer’s at age 55, Gail also breaks down common stereotypes about someone living with dementia. He could address serious topics with humor, and was forthright in his opinions and struggles.
Ahmad Krayem: Ahmad was only diagnosed with this disease in his early 60s after his wife, who was a pharmacist, insisted that he undergo an examination. Ahmad finds quitting his job a big challenge and has gone through a journey of rejection and acceptance. He spoke passionately about helping others who have been through this.
Alzheimer’s Intelligence is a proof-of-concept tool and is not available to the public, however anyone wishing to hear a diagnosis from someone with Alzheimer’s or dementia can contact Innovations in Dementia (UK) or the Alzheimer’s Association (US).
Example of interaction with avatar:
Q: I always forget to take my pills. How can I remember it?
A: It’s very common to forget things like taking medication. Maybe establishing a routine could help, such as taking the pill after meals or at the same time every day. You can also try setting an alarm or reminder on your phone. There are also pill organizers that can be useful. Do you think any of these options are suitable for you?
Q: How do I talk about my diagnosis with friends and family?
A: Talking about your diagnosis with friends and family can be a daunting task, but it can also help provide support and understanding. Start by sharing how you’re feeling today and maybe a little about what you’ve learned about your condition. Encourage them to ask any questions, as this may help them understand what you are experiencing. It’s also okay to be honest about any fears or concerns you have. Do you think it might be useful?
About Lenovo
Lenovo is a global technology powerhouse with revenues of US$57 billion, ranked #248 on the Fortune Global 500, and serves millions of customers every day in 180 markets. Focused on a bold vision to deliver Smarter Technology for All, Lenovo has built its success as the world’s largest PC company with a comprehensive portfolio of AI-enabled, AI-enabled and AI-optimized devices (PCs, workstations, smartphones, tablets), infrastructure (servers, storage, edge, high performance computing, and software-defined infrastructure), software, solutions, and services. Lenovo’s continued investment in world-changing innovation is building a fairer, more trustworthy and smarter future for everyone, everywhere. Lenovo is listed on the Hong Kong stock exchange under Lenovo Group (OTC:) Limited (HKSE: 992) (ADR: LNVGY). To find out more, visit https://www.lenovo.com and read the latest news via our StoryHub.
LENOVO, THINKSTATION, THINKPAD, and THINKVISION are trademarks of Lenovo. All other trademarks are the property of their respective owners. ©2024, Lenovo Group Limited. ©2024 Motorola (NYSE:) Mobility LLC. All rights reserved.
View source version on businesswire.com: https://www.businesswire.com/news/home/20241015879964/en/
Stuart Gill, sgill@lenovo.com
Source: Lenovo
