Avatar Chat with Savannah Niles Leading Social & Avatars at Magic Leap + More!

OMG what a fun opportunity!! I got to have a chat with Savannah Niles, an MIT Media Lab alumni who has been leading Magic Leap’s efforts to create Social and Avatar experiences. We talked inside her own thing!!

She is very brilliant, I got to catch her after her talk at LeapCon, a blog about that time and wider thoughts is linked below. This next chat we got deeper on what she has worked on, how the Magic Leap team approached designing avatars and then went deep on some areas she wanted to hear from me about: environmental AI

Talking with Savannah as an avatar was a beautiful and surreal experience. It really felt like we were sharing space together, because we were! We stood up, shifted weight, moved around and even high fived and ended with a fist bump! She is in Florida and I’m in California and we hung out in shared space together for over 40 minutes and could have kept going.

Social on Magic Leap has already changed everything for me. Video calling is a weird outlier as far as Im concerned: the experience of being avatars is that much better. I don’t want to sit and stare at a screen I want to inhabit the same space as a friend, and that’s what Social on Magic Leap lets us do.

This conversation inspired an upcoming blog about embodied AI and Environmental AI that will feature clips of our conversation to help explain the ideas.

Here is the full conversation all the way through cut up as segments so you can browse. I’d recommend just letting it play through, we were on fire!! ;)

Let it play through, choose videos or scroll below as I’ve also pulled out some segments with context so scroll down if you desire!

We were just talking so the fact that it went into such nice conceptual bins is a testament to how intelligent Savannah is and how engaging the Avatar experience really is on Magic Leap. Just keep in mind that the ‘camera’ for this is tied directly to my head so things might get a little shaky as I nod in agreement or do other natural things ;)

Exploring how the Avatars were designed for Magic Leap Social and finding the “Millenial” art style!

Asking after how shared context will be handled in Magic Leap Social was too on the nose for her to discuss currently, so let’s just wait and see what they are cooking up ;)

We talked about XR as a spacesuit (had never heard that metaphor and now the ML marketing materials make a lot more sense!) and also how mixed reality might be a kind of antidote to the fracturing of reality that can come when everyone has their own virtual playgrounds.

Savannah was curious to hear more about what I had been thinking since our first quick chat and so I downloaded some of my thoughts. Stay till the end of this clip when she walks across the shared space to write down notes, that was a holy grail moment for me in terms of UX because it drove home that we were both spatially present. and inspired the next set of discussion below.

I was very interested to find that Savannah has visited DynamicLand, and we had a fun discussion around using paper in XR.

I have researched stylus based drawing input and am excited to bring more gestural free-hand interpretation into the MagicVerse.

 

I got to see real Mike Seymour be Virtual Mike Seymour to interview the venerable Ken Perlin as an avatar discussing with a photorealistic avatar MeetMike at Siggraph 2017, very good insights from Perlin on what an Avatar’s job is in communication and how it can best achieve those goals given constraints. I think the Magic Leap team succeeded along his line of thinking with their avatar system.

Yet Magic Leap is trying ‘Digital Human’ fidelity level avatars as well. See Magic Leap’s work on MICA, in addition to the Avatar design and work going on in Social, it is beyond fascinating watching Mike Seymour’s recent talk “What Happens When Technology Has a Human Face?”

As an end little note, this video below was a reflection after a quick chat with Savannah after her design panel talk at LeapCon 2018 where I was working out some ideas and seeing her feedback. How the avatar intelligence will understand how to be it self is an ongoing research area that enables all this, her a short little musing about how to conceptualize that in technical terms:

See you around the MagicVerse everyone.

Selfies: Your Face In Networked Space

Between us sits the grand mediator. We are increasingly talking with one another, maintaining and initiating friendships, even relationships through the grand mediator that is the Internet. As we continue to utilize the grand mediator in an ever more pervasive manner, we are inevitably bringing more of the subtleties of human interaction into cyber space. Internet-mediated conversations are filling up with expressivity and emotionality conveyed by the most ancient and powerful emoticon of all: our faces.

Now we can talk with anyone instantly, but conveying ourselves accurately without our best tool is difficult if not impossible. So much of conversation is sub textual layers conveyed by our original emoticons. Yet a video call is often not a possibility, or would indeed be a nuisance, and fully realized expressive 3D avatars do not yet exist. We need a way to bring more nuances to digital engagement within limited bandwidth constraints and without causing a drag on time demanded per engagement. So we have set about fixing the problem through a misunderstood trend: selfies.

I'll admit, I was skeptical of selfies at first, but then I realized their connecting power.

I'll admit, I was skeptical of selfies at first, but then I realized their connecting power.

I think people who bemoan the trend are missing what selfies are being used for at their core. Beyond the surface layer of vanity they function as instantly created avatar surrogates allowing us to more meaningfully insert ourselves into the cyber world. More than mere pictures; combined with the Internet, they’re a way to send yourself somewhere else, and in turn receive someone else.

Selfies are just a means to an end, a momentary digitization of yourself and your context that you add to the data pool and exchange with others. Selfies in the networked world are about fixing the communications gap by filling in an emotional and expressive component. No static avatar image or emoticon can truly convey what your individual face can express, so instead you digitize yourself to show others.

We see the selfie as a tool most notably with apps like Snapchat that are indicative of the broader trend often called the ‘Alive Web.’ Snapchat can be like hanging out with a friend anywhere on Earth, all the time. “Look over there at that thing!” they send in visual form, and you say, “wow what a cool thing, here’s my expression which is unique and maybe funny too,” and send them your avatar. This can apply not just to platonic friends, but also initiations of potential relationships. When meeting a special someone in the physical world, many people spend a great deal of time beforehand prepping their faces and practicing the interaction itself. Now they also spend time preparing to ensure optimal digitization.

Usage of selfies enables a richer form of the kind of quick bite interaction that thrives in the networked world. They fill a specific niche in the growing gradient of interaction modalities and further enable our capacity to interface in ever-more precise ways.

Selfies are just a response to a missing capability, a tool to further facilitate networked social interaction.  As our existence is increasingly enveloped in and mediated by the network, we are finding clever ways to bring the nuance of our humanity with us. Yet our conceptions of relationships and even the nature of the self will invariably adapt as we journey ever deeper into networked existence.

For those concerned that something is being lost in the transition to a networked existence I would ask that you consider what is being gained. Never before has humanity been this interconnected. We have always longed for connection and now it is ubiquitous. Current technology has its set of sacrifices, but we are filling in the gaps. As we utilize the grand mediator in an ever more pervasive manner, we will continue to bring our humanity with us.

Our network connections will grow in strength and nuance until some day soon we will cross a threshold. Soon our networked presence will be as nuanced as our physical. Soon we will have the ability to send a meaningful majority of our individual perception and our individual self anywhere on Earth at any moment. Mark Zuckerberg and Facebook know this, they spent $2 billion on the Virtual Reality headset company Oculus to ensure their place in this future.

The grand mediator’s role is becoming so pervasive that its visible status of mediator is ebbing away. It is becoming thoroughly transparent in practice. Through better technology and clever usage the Internet will transcend beyond something we connect to in order to connect with each other, and become just us connecting with each other.

Selfies represent a stepping-stone along our grand path, a new tool for our humanity to express itself through the grand mediator. Better tools are coming, they always are.

- JH