Why deepfakes of dead loved ones are big business in China
AI-generated avatars of deceased 'builds on China's long cultural history of communicating with the dead'
"Last year was tough for everyone," said a Chinese AI boss as he addressed a recent annual general meeting, and 2023 had indeed been tough for him. He died.
A growing number of people in China are buying AI-generated avatars of loved ones to help process their grief, raising a number of ethical and legal questions.
What is it?
SenseTime founder Tang Xiao'ou announced the service from beyond the grave as a digital clone, which had been trained by the company's engineers using a large language model machine learning programme trained on video and audio clips of Tang.
Subscribe to The Week
Escape your echo chamber. Get the facts behind the news, plus analysis from multiple perspectives.
Sign up for The Week's Free Newsletters
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
From our morning news briefing to a weekly Good News Newsletter, get the best of The Week delivered directly to your inbox.
A "new way of remembering, and reviving" beloved relatives is "being born", said The Guardian. For only 20 yuan (£2.20) Chinese people can "create a moving digital avatar of their loved one".
The technology "isn't perfect", said MIT Technology Review, because "avatars can still be stiff and robotic", but it's "maturing, and more tools are becoming available through more companies".
When the avatar "looks increasingly lifelike" and "gives fewer out-of-character answers", it's "easier for users to treat it as their deceased family member".
The Taiwanese singer Bao Xiaobai used AI to "revive" his 22-year-old daughter, who died in 2022. Shine reported that he spent more than a year experimenting with the technology before creating a video of his daughter singing happy birthday to her mother. He reflected that AI is "a tool for expressing yearning, a way to express missing someone".
It's already big business. The market for "digital humans" was worth 12 billion yuan (£1.3 billion) in 2022 and is expected to quadruple by 2025. This has led to some moral quandaries.
Social media users deployed old footage of the singer Qiao Renliang, who died by suicide in 2016, to create new content starring him. In one video, the AI clone of Qiao says: "Actually, I never really left."
But Qiao's parents said the video was created without the family's consent and lawyers say such content should be banned if it causes "mental pain" to the relatives of the deceased.
Others have questioned whether "interacting with AI replicas of the dead" is "a healthy way to process grief", said MIT Technology Review. "It's not entirely clear what the legal and ethical implications of this technology may be."
There are also question marks over one company that offers deepfaked video calls, usually to an elderly family member who may not know that the relative has died and whose family has "arranged the conversation as a ruse". It's "pretty common" for Chinese families to tell "necessary" lies to avoid overwhelming seniors, as portrayed in a movie "The Farewell".
Cultural traditions
The market is "particularly strong in China", said MIT Technology Review, with "at least half a dozen companies" now offering these technologies and thousands of people already paying for them.
This is because the business "builds on China's long cultural history of communicating with the dead". In Chinese homes, it's usual to put up a portrait of a deceased relative for a few years after their death.
Avatars of lost loved ones are "not much different from a traditional portrait, except that it's interactive", said Zhang Zewei, founder of a Shanghai-based company Super Brain.
During the annual Qingming festival in April, "Chinese people sweep the tombs of their ancestors, burn joss sticks and fake paper money, and tell them what has happened in the past year".
This festival "provides a particular opportunity for this kind of technology", said The Guardian, and China's "digital natives are likely to experiment with digital afterlives faster than living policymakers can regulate them".
Create an account with the same email registered to your subscription to unlock access.
Sign up for Today's Best Articles in your inbox
A free daily email with the biggest news stories of the day – and the best features from TheWeek.com
Chas Newkey-Burden has been part of The Week Digital team for more than a decade and a journalist for 25 years, starting out on the irreverent football weekly 90 Minutes, before moving to lifestyle magazines Loaded and Attitude. He was a columnist for The Big Issue and landed a world exclusive with David Beckham that became the weekly magazine’s bestselling issue. He now writes regularly for The Guardian, The Telegraph, The Independent, Metro, FourFourTwo and the i new site. He is also the author of a number of non-fiction books.
-
Ukraine's stolen children
Under the Radar Officially 20,000 children have been detained since Russia's invasion in 2022, but the true number is likely to be far higher
By Harriet Marsden, The Week UK Published
-
'Ignore the polls. They're stupid.'
Instant Opinion Opinion, comment and editorials of the day
By Harold Maass, The Week US Published
-
The Finest Summer Flavours
By Sponsored Content Published
-
The AI 'concierge' that will decide who you date
In The Spotlight If the bots click, real life may follow – or that's the idea, says Bumble
By Chas Newkey-Burden, The Week UK Published
-
Indie film's 'very brief' use of AI sparks backlash and calls for boycotts
Talking Points Did the creators of a new horror movie make a deal with the artificial intelligence devil?
By Rafi Schwartz, The Week US Published
-
Video games to play in the winter, from 'Alone in the Dark' to 'The Last of Us Part II Remastered'
The Week Recommends Bundle up with some video game bundles
By Brendan Morrow Published
-
Shein: the biggest Wall Street float of 2024?
Speed Read Clothing industry disruptor is about to test its acceptability on the US stock market
By The Week UK Published
-
From 'thunks' to mixed reality, the future of books is interactive
The Explainer What is in store for literature in an increasingly digital world?
By Theara Coleman, The Week US Published
-
Bad Bunny joins in criticism of AI music
Speed Read Concern growing in music industry over generative learning, unauthorised impersonations and copyright issues
By Harriet Marsden, The Week UK Published
-
The week's good news: Oct. 19, 2023
Good News It wasn't all bad!
By Catherine Garcia, The Week US Published
-
The week's good news: Sept. 28, 2023
It wasn't all bad!
By Catherine Garcia Published