Disney+ releases its first AR-enabled short film, ‘Remembering,’ starring Brie Larson | TechCrunch
Media & Entertainment

Disney+ releases its first AR-enabled short film, ‘Remembering,’ starring Brie Larson

Comment

Image Credits: Disney+

Today is Disney+ Day, and, as part of its perks, the company is offering Disney+ subscribers a new AR experience in conjunction with the short film “Remembering,” starring and produced by “Captain Marvel” Brie Larson and directed and written by filmmaker Elijah Allan-Blitz. The eight-minute-long movie features a companion augmented reality app that allows users to scan their TV with an iOS device to watch an extension of the movie on the small screen.

In “Remembering,” Larson plays a writer who forgets an idea she had when her phone rings and interrupts her thoughts. The writer’s inner child — played by the young actress Dusty Peak — helps her recover her lost idea, which is represented as a flying and talking cluster of light, also voiced by Larson. The inner child lives in “The World of Imagination,” a fantastical wonderland full of rainbows, shooting stars and dolphin-shaped clouds.

The movie aims to spark a discussion about why it is essential to remember your younger self and all the creativity you once had. In doing so, it explores concepts like the origin of ideas and why adults can sometimes be reluctant to use their imaginations.

In years past, Disney has created a number of AR experiences, but this is the first AR app that connects directly to content on the Disney+ platform, the company told TechCrunch. It’s an experiment in seeing if AR can serve to enhance movie storytelling even when viewers are watching in their living rooms.

The “Remembering” AR component itself is designed to bring “The World of Imagination” alive to viewers by having them engage with the film using their smartphones.

Image Credits: Disney+

To engage with the AR experience, Disney+ viewers will scan a QR code on their TV screen that allows them to download the “Remembering: The AR Experience” app, designed by technology studio Magnopus and Walt Disney StudioLab, on their iPhones or iPads. Users can also visit disney.com/remembering or search the App Store to find the new app.

Viewers are meant to keep the app open while they watch the film. The AR app listens to audio cues by leveraging Apple’s ShazamKit technology. When it recognizes a key piece of audio around three minutes in, the device will chime, alerting users to hold up their phone and point it at their TV. A 10-second countdown then begins ahead of the AR experience.

When users point their iPhone or iPad at the TV, they’ll see a waterfall flowing down to the floor as well as dolphins, butterflies, trees, foliage, glowing flowers and other wondrous digital elements.

The movie continues to play during the experience. You can watch on the TV screen or on your iPhone or iPad, as Dusty’s character describes “The World of Imagination.” In the scene, a shooting star flies across the screen and dolphin-shaped clouds move in the sky and dive into “The River of Life.”

We tested the app out for ourselves and noticed no issues. However, the AR experience only lasted a minute or less, and you can’t interact with the digital elements. You can choose to restart and replay it as much as you like, though.

Image Credits: Disney+

The AR app is only available on iOS devices. There are currently no confirmed plans for the app to become available on Android devices. Viewers aren’t required to download the app to watch the film and can choose to have a passive viewing experience instead.

A former kindergarten teacher, filmmaker Elijah Allan-Blitz, wanted to explore the idea of what imagination looks like from a child’s perspective. He worked on the project for two years, taking inspiration from Peak’s ideas about imagination to craft the story, then enhancing it using AR. The movie itself was then filmed on a volumetric stage at NantStudios. With live on-set projection mapping, the team produced the light and movement for the personified “idea.”

This allowed Brie and Dusty to act while also seeing “incredible landscapes all around them instead of having to pretend,” the filmmaker explained.

“[‘Remembering’] is the first of its kind … We feel like this is part of the future of how humanity will interact with entertainment,” Allan-Blitz said. “The AR experience moves away from a typical passive experience of streaming and allows viewers to engage with it in a deeper way. That makes it something that you’re going to remember on a deeper level than just something you watch. It’s actually something you did,” he added.

The filmmaker noted that while “Remembering” is for everyone to watch, it’s really meant to be a “Trojan horse” designed to encourage adults to get in touch with their younger selves.

“It’s taking what makes art so wonderful and makes me feel like my job is worth anything, which is to speak the unspeakable, to show the unknowable, and to say that you cannot just view it from the outside, but you can participate in it,” Larson said. “You’re welcome. You’re invited to join. And that invitation in itself is just the beginning of what I hope will be many more conversations going down this pathway of how we can deepen storytelling so that we can ultimately be more connected.”

Image Credits: Disney+

“Remembering” is the latest project from The Great Unknown Productions, Larson and Allan-Blitz’s film and television company that aims to use technology to advance stories. The company earlier produced a virtual reality series called “The Messy Truth,” which won an Emmy in 2020 for Outstanding Original Interactive Program.

While the duo didn’t say there is another AR experience under their belts, they’re definitely thinking about it.

Disney+ declined to say whether it would introduce more AR-enabled features in the future.

“Time will tell,” the streamer told us.

The streamer is not the first to adopt AR, though rivals have only seen the technology as a means of marketing their projects not enhancing them directly.

HBO Max recently promoted its “Game of Thrones” prequel series “House of the Dragon” with an app called DracARys that let users raise a virtual dragon. The streamer also partnered with Snap to create a fire-breathing dragon in Snapchat Lenses. Apple TV+, meanwhile, launched an AR app called For All Mankind: Time Capsule, which gave fans the ability to interact with virtual objects from the show, such as photographs, a mixtape, letters and more. And Netflix gave Emmy voters a virtual AR experience with digital Easter eggs from Netflix original series including “Ozark,” “The Crown” and “Stranger Things.”

Snap, HBO Max partner to launch AR experiences for ‘House of the Dragon’ premiere

The new “Remembering” AR app arrives at a time when Disney is further experimenting with regard to its streaming efforts. Recently, Disney+ dabbled in livestreaming, announced a cheaper ad-supported tier and has begun exploring an Amazon Prime-like subscription that ties streaming to commerce.

The short film “Remembering” is available to watch on Disney+ on all devices, including Apple TVs, Roku devices, Amazon Fire devices and more.

Updated 9/8/22 at 3:15 p.m. ET with removal of statement that Disney plans to make the app available on Android devices in the future. 

More TechCrunch

Trawa simplifies energy purchasing and management for SMEs by leveraging an AI-powered platform and downstream data from customers. 

Berlin-based trawa raises €10M to use AI to make buying renewable energy easier for SMEs

Lydia is splitting itself into two apps — Lydia for P2P payments and Sumeria for those looking for a mobile-first bank account.

Lydia, the French payments app with 8 million users, launches mobile banking app Sumeria

Cargo ships docking at a commercial port incur costs called “disbursements” and “port call expenses.” This might be port dues, towage, and pilotage fees. It’s a complex patchwork and all…

Shipping logistics startup Harbor Lab raises $16M Series A led by Atomico

AWS has confirmed its European “sovereign cloud” will go live by the end of 2025, enabling greater data residency for the region.

AWS confirms will launch European ‘sovereign cloud’ in Germany by 2025, plans €7.8B investment over 15 years

Go Digit, an Indian insurance startup, has raised $141 million from investors including Goldman Sachs, ADIA, and Morgan Stanley as part of its IPO.

Indian insurance startup Go Digit raises $141M from anchor investors ahead of IPO

Peakbridge intends to invest in between 16 and 20 companies, investing around $10 million in each company. It has made eight investments so far.

Food VC Peakbridge has new $187M fund to transform future of food, like lab-made cocoa

For over six decades, the nonprofit has been active in the financial services sector.

Accion’s new $152.5M fund will back financial institutions serving small businesses globally

Meta’s newest social network, Threads, is starting its own fact-checking program after piggybacking on Instagram and Facebook’s network for a few months.

Threads finally starts its own fact-checking program

Looking Glass makes trippy-looking mixed-reality screens that make things look 3D without the need of special glasses. Today, it launches a pair of new displays, including a 16-inch mode that…

Looking Glass launches new 3D displays

Replacing Sutskever is Jakub Pachocki, OpenAI’s director of research.

Ilya Sutskever, OpenAI co-founder and longtime chief scientist, departs

Intuitive Machines made history when it became the first private company to land a spacecraft on the moon, so it makes sense to adapt that tech for Mars.

Intuitive Machines wants to help NASA return samples from Mars

As Google revamps itself for the AI era, offering AI overviews within its search results, the company is introducing a new way to filter for just text-based links. With the…

Google adds ‘Web’ search filter for showing old-school text links as AI rolls out

Blue Origin’s New Shepard rocket will take a crew to suborbital space for the first time in nearly two years later this month, the company announced on Tuesday.  The NS-25…

Blue Origin to resume crewed New Shepard launches on May 19

This will enable developers to use the on-device model to power their own AI features.

Google is building its Gemini Nano AI model into Chrome on the desktop

It ran 110 minutes, but Google managed to reference AI a whopping 121 times during Google I/O 2024 (by its own count). CEO Sundar Pichai referenced the figure to wrap…

Google mentioned ‘AI’ 120+ times during its I/O keynote

Firebase Genkit is an open source framework that enables developers to quickly build AI into new and existing applications.

Google launches Firebase Genkit, a new open source framework for building AI-powered apps

In the coming months, Google says it will open up the Gemini Nano model to more developers.

Patreon and Grammarly are already experimenting with Gemini Nano, says Google

As part of the update, Reddit also launched a dedicated AMA tab within the web post composer.

Reddit introduces new tools for ‘Ask Me Anything,’ its Q&A feature

Here are quick hits of the biggest news from the keynote as they are announced.

Google I/O 2024: Here’s everything Google just announced

LearnLM is already powering features across Google products, including in YouTube, Google’s Gemini apps, Google Search and Google Classroom.

LearnLM is Google’s new family of AI models for education

The official launch comes almost a year after YouTube began experimenting with AI-generated quizzes on its mobile app. 

Google is bringing AI-generated quizzes to academic videos on YouTube

Around 550 employees across autonomous vehicle company Motional have been laid off, according to information taken from WARN notice filings and sources at the company.  Earlier this week, TechCrunch reported…

Motional cut about 550 employees, around 40%, in recent restructuring, sources say

The keynote kicks off at 10 a.m. PT on Tuesday and will offer glimpses into the latest versions of Android, Wear OS and Android TV.

Google I/O 2024: Watch all of the AI, Android reveals

Google Play has a new discovery feature for apps, new ways to acquire users, updates to Play Points, and other enhancements to developer-facing tools.

Google Play preps a new full-screen app discovery feature and adds more developer tools

Soon, Android users will be able to drag and drop AI-generated images directly into their Gmail, Google Messages and other apps.

Gemini on Android becomes more capable and works with Gmail, Messages, YouTube and more

Veo can capture different visual and cinematic styles, including shots of landscapes and timelapses, and make edits and adjustments to already-generated footage.

Google Veo, a serious swing at AI-generated video, debuts at Google I/O 2024

In addition to the body of the emails themselves, the feature will also be able to analyze attachments, like PDFs.

Gemini comes to Gmail to summarize, draft emails, and more

The summaries are created based on Gemini’s analysis of insights from Google Maps’ community of more than 300 million contributors.

Google is bringing Gemini capabilities to Google Maps Platform

Google says that over 100,000 developers already tried the service.

Project IDX, Google’s next-gen IDE, is now in open beta

The system effectively listens for “conversation patterns commonly associated with scams” in-real time. 

Google will use Gemini to detect scams during calls