Magic Leap Play, LEAPcon friends, and the future of XR as Language & Healthcare

meaningmapping-2d.png
 

Magic Leap.

The augmented reality glasses that were talking like they had it, the real deal, the holy smokes, the bonafide extended enhanced amazing powerful joyous reality altering machinery of the finest computation on your face!

Did they deliver with Magic Leap One?

You can count, right?

We’re on version one of version one version of new reality. So yes indeed does it have bugs and foibles. The FOV is just big enough to start getting a taste for proper synthesis of graphics and view. Yet it’s still a floating rectangle of perception. A big rectangle, yet edged nevertheless.

For the voices getting upset that this tech is not good enough, I’ll just say that it’s good enough for everyone using it. Magic Leap One is an overall rad device with lots of computing power, solid inputs and some excellent touches that make it a really wonderful development platform. So good you could even live with it! Magic Leap’s whole team did a stellar job here, thank you!

We’re undergoing a big shift in a tech capability space that was just 7 years ago a gimmicky and searching approach to make goofy experiences of changing the world! Not the whole world of course, just the world of the computer sensor. We had lots of dreams and visions, but mostly showed each other with powerpoint and hopeful hand gestures. Times were dark yet hopeful.

First time using Ml1 at Steve Lukas’ house

First time using Ml1 at Steve Lukas’ house

Fast forward to now. Magic Leap is a Cambrian Explosion moment for the new ways of computing, now called XR. Magic Leap and Hololens are enough to catalyze the new ways of computing among us who research, create and build. And there are other models from ODG and the tech modules are shuffling around searching for form as new conglomerate companies.

It’s been funny watching the term “XR” come into use as it seemed to emerge spontaneously to signify a merging, or crossing, of all concepts related to computer mediation as applied to human perception.

The Magic Leap One is a very slick device and also a very alpha device. The displays have limited field of view, there are some fun differences between the color balance of each eye’s display and even between their focal planes. It washes out totally outside.

None of that changes the fact: Magic Leap One WORKS! It works well. Well enough to where we are seeing great things fast from an extremely excited community.

I have been dreaming of the launch of a generally useful, robust look-through spatial computer headset. I did not and still do not care what ‘brand’ it is, as long as the dang thing lets me do my visions and stories!

So when Magic Leap was announced I started befriending Twitter people who had an ML1 or were getting one. Anyone in the XR space doing fun and meaningful things. And it’s been so fun watching the people, techniques and demos emerge out of the woodwork around the next phase of getting XR from gimmick to holy shit.

 
 
Don a VR helmet and meet John Hanacek on registration day @ LEAPCon #LEAPCon #MagicLeap

At LEAPcon 1 I met amazing people. The Magic Leap talks were inspiring, then AT&T got up on stage and I laughed loud enough that I bet you heard me if you were in that tiny presentation room. If you’ve read my blog at all, or know me, you know that I can often see the very real dark side of any given wonderful thing. Convenience often has a dark side. So I’m watching this space and tech closely, yet also am finding reasons for optimism. Specifically I’m meeting reasons for optimism.

The people give me the hope, especially my newest tribe #LeapNation which emerged on Twitter right after I met Steve Lukas of AcrossXR now Magic Leap who started the group chat. The “Magic Leap” has been very literal for me, suddenly collaborating and discussing with over 50 different talented developers pushing the boundaries and laughing the whole way.

Was great to see a real-life Lumin Runtime app from Sven Mesecke and his team at Rebel Camp in Oregon @dachsghund

Basically every app you can get from other developers on Magic Leap currently is a fully ‘immersive’ experience that does not utilize the UI/UX framework and OS layer that Magic Leap has with Lumin Runtime. Rebel Camp has a real app in that OS environment and it was great to see, even as a proof of concept. This is big and I’m very glad that Rebel Camp is getting the expertise to make Lumin OS apps because these are amazing test-beds to collaborate with Magic Leap on adding intelligence into the operating system while developers get that ‘for free’. If Android can evolve into a XR operating system, I’m all for helping. Hats off to Rebel Camp for diving into the Lumin rabbit hole and emerging with a rabbit.

Sven told me that jhana.space had proceeded me a little bit with him having found it in the forums as I asked the same questions he assured me weren’t crazy: how the hell do I get models with textures into ML1 reliably?!

Developing for Helio browser is very fun, and I’m excited to see what official WebXR support looks like as it comes to the headset in 2019.

I have a special interest in the medical and therapeutic applications of XR, and it was my great pleasure to talk with two surgeons, Rafael Grossman and Alex Johnson at John’s Hopkins.

I sketched out with them a prototype idea that will keep brewing as many forms of knowing around energies, health and ‘trauma’ continue intersecting: contact-less surgery using vibrations and intention tracking channeled through the hands.

They are largely not satisfied with the current surgical robots, and so a vision of direct hands-on manipulation of tissues with a fidelity down to microns without the need for held tools excited them to say the least!

 

Brian (@ImmersionXR) from Immersion Neurotechnologies showed me his demo after us having talked over Twitter for weeks before. His work to get EEG into Magic Leap is amazing and path-leading.

At the Medical talks at LEAPcon I was very impressed by the quality of research and solutions people have been developing.

After the talk I learned from a Leaper that the Magic Leap One is getting heart-beat data and just using it for noise cancelling. She seemed coy as the Cheshire cat as to whether we’d get access to that data any time soon, so make sure to add your voice to the “we need heart beat please!” chorus haha

My interest in medical is currently channeling through as holohealing.com seeking to unite a knowledge and toolbase, with a special interest in human bioenergy visualization and work.

Important note about the reflectivity of Magic Leap One for first responders & therapists:

During training as a California State Beach Lifeguard we were told specifically not to wear reflective sunglasses on the job. If the victim sees their wound in the reflection of your lenses they can go into shock, which just made your job as first responder almost impossibly difficult. Most of lifeguarding first aid is to keep people out of shock. In my years as a guard I experienced the immense health benefit of ‘tactical lying’ to victims about the state of their condition. If someone can’t move their arms and legs, they don’t need you to freak out and tell them that. If someone has a massive gash on their head and they ask “how bad is it?” you can tell them it’s fine and they'll be fine. But that won’t work if they see their blood in your reflective lenses! So for all emerging medical prototypes with ML1 just remember that you have reflective lenses on, so be careful how you insert the ML1 into healthcare situations!

I’m finding humor, curiosity and heart are the keys to making this new medium emerge as something useful. Don’t take it too seriously, yet take it seriously enough to get passionate.

First time I used the Magic Leap was with Steve Lukas (@slukas) showing me his freshly received headset then I received mine on 9/9/18. Every day with it has been a horizon-widening experience. The form factor of ‘holographic headset’ is just singing with my imagination, and then comes all the learning of how to translate ideas to code!

This is a hugely exciting time to get in and shape the medium of ARVRXR whatever, you’re shaping R reality so stay open and find where everything intersects. My research goal is to use Magic Leap and other similar headsets to bring together many different knowledge threads in new ways of visualizing. We are to have a medium for thinking the unthinkable, as Bret Victor (worrydream.com) says.

We seem further along in some areas than I thought we would be and on pace for others.

Overall the thing that draws me in most about Magic Leap and this look through style of Mixed Reality is that I enjoy high quality physical environments and things. I want to expand and merge new aspects into a consensus reality more so than exist in many walled off realities. The best part about reality prime that we share by default is that no one owns the light that bounces off a painting or the sound that leaves my vocal chords as we speak and breathe.

The XR future that I care about is characterized by balance and by a revival of sacred aspects, such as plants being amazing beyond our tech, and real paintings made of atoms being wicked cool. It’s so fun to develop for a new holographic medium while sitting in my partner Kyra V Brandt’s oil painting artwork. A feeling of elevating and grounding of the computer medium in being something humane, and fundamentally artistic over specific. Emergent over prescribed. Gestural and free is how we can be with computers helping our minds and hearts to sing our most authentic forms and dance our most authentic songs.

Easter egg:
Check out Universe Creator by Les Bird if you have a Magic Leap One and stay tuned for more from this community!


Look for the red beanie easter egg in the videos below ;) #LeapNation

 

Video

johnhanacek.net semantic meaning mapping XR magic leap hololens
 
Now we are entering a time of holographic spatial computation. A magical computer is still computational, a computational magic is still magical. Through our intentions channeled via tools we find ourselves building the world anew each day. Choose wisely and play deeply. Optimism and pessimism are each self fulfilling prophesies.

The Deep Potentials of XR

Everything that follows here are resources for understanding the magnitude of the shift that the human experience can undergo through our passionate utilization of technology for ‘story being’.

I’ve gotten to meet Ken Perlin, who has been an inspiration to my ambition for what the ‘computer’ as a medium really ought to behave like.

Ken Perlin (Academy Award Winner & Computer Science Professor, New York University (NYU)) discusses his research on the future language of AR. Perlin demonstrates his research by drawing figures (through HTML5 and JavaScript), and explaining how these drawings are used as a language.
Talk by Helen Papagiannis, Augmented Reality ArtistSpeaker at NEXT Berlin 2012
People are alive -- they behave and respond. Creations within the computer can also live, behave, and respond... if they are allowed to. The message of this talk is that computer-based art tools should embrace both forms of life -- artists behaving through real-time performance, and art behaving through real-time simulation.

Stories:

Water

The excellent Ramez Naam rushes ahead to a world where XR is in our very minds to explore the remapping of this conservative old world onto radically new possibilities in Water. This is a wake-up call to all of us working on this that behavior and choices are more fundamental then technology; we are responsible for a ‘good’ world.

from jhanacek.net:

The merger of VR and AR into a functional whole seems more likely to occur than when I wrote these stories in 2015 of a world where VR as used for school and AR happened in the background. It was easier for me to ground VR in stories back then. Now I feel I can ground XR and even make demos. I am working on new visions where the world itself is the school. You are encouraged to view the world as school regardless of the technology, we just seek to augment the learning potential in any given moment with best alignment.

Blogs:

Art by Kyra V Brandt Long before the Wayfair app came out, I decided to see if the ML1 gallery app could handle a little room planning. It was tough to get the pictures placed exactly where I wanted them. Some intelligence with the mesh would go a long way here as I kept losing the picture behind the wall occlusion!

From Magic Leap developer samples, built in Unity. Really fun use of the controller as a remote controller for little 'vehicles' this is a surprisingly addictive little experience that you get to open up in unity or unreal and learn how it is put together! https://www.johnhanacek.net/
meaningmappingmeshsidewJH.png

Winds of Imagination, Waves of Change

A philosophical and metaphorical musing on looking to the horizon of the future.

This universe is full of waves. Even particles are waves at their deeper more meaningful quantum level. So it is with change. 

Think about standing in an ocean. There are small waves you can make, ripples that radiate from you effecting limited space, but still impacting the whole system even if just slightly. Then there are the grand waves, the ones that come from out beyond the horizon. These grand waves are fueled by wind. In the world of humans it is much the same, although now metaphorical. Humanity generates a powerful wind of imagination and desire. The waves of change are fueled by our combined imagination, under no one's sole control, yet effecting all. 

Now that we humans are networked together directly this wind is growing in strength, and the waves it is making are growing larger than ever before. These cannot be controlled, but they can be noticed. 

The oceans taught me this. If you wish to catch a wave, first you must see it coming. You may not know how high it will be, or exactly where it will break until it is just in front of you; but if you have been watching the wave arrive it will not surprise you. You will be ready, and if you place yourself in front of it just so, you will ride it. 

Yet you must be vigilant. If you do not notice the wave until it is upon you, it will crash over your head. If you rush too far out to meet a wave it will pass by and break behind you leaving you stranded far from shore. If you catch a wave too late, only just as it is cresting, you will fall off its crest and smash into the trough below. You may try to duck under the waves as they come, preferring to let them pass you by but this is a losing battle; your breath will tire eventually and the waves are relentless. Change, like an ocean wave, can be immensely destructively powerful. But if you pay attention, you can ride the change.

This is how I look at the horizon of the future. I do not look to the future to predict specifics, I look to identify the bumps on the surface of possibility, the tell-tale signs that a wave of change is available to happen. 

WAVE-horizonJH.jpg

This is the work of foresight, of analyzing trends: to see the wave of change before it breaks, to follow its latent potential all the way until it finally rears up and reshapes the world, and to share that knowledge with others so that we may all ride together. Change comes inexorably, it is a constant of the universe. Waves pulverize shells to sand and mold lumpen stones into spheres. Life constantly evolves. Stars are born live and die. The galaxies spin and collide and coalesce. All matter and energy is seeking all that is allowed in the universe, spinning out in an elegant dance of radiant permutation. Whatever is possible has a chance of happening. 

The system of humans on earth is not some amusement park wave generator, we cannot simply “turn off” the waves of change we make. The change we bring is fueled by that endless growing wind of imagination and desire, of questions asked and answers sought. We are a part of the system that is the universe and so are enveloped in its constant of change. We are the universe expressing possibilities, we are a mechanism by which it changes itself, changes ourselves. We are a seething, roaring ocean.

In this moment, there are monumental waves on civilization’s horizon, ones grander than we have ever seen before. Waves of change fueled by winds of recombinant networked imagination, the strongest winds society has ever generated. The crests will keep getting higher, to ride the waves will become ever more perilous. From fire to nuclear weapons the potential to fall off the crest has been growing with the height of the fall. Synthetic biology, programmable matter, quantum computing, these are waves so immense that they are only now finding land, only now starting to rise up and show us their true height. Even the grand waves of traditional computing and digital networking are still rearing up, still not fully washed over the world. Yet already we see what they have brought. Some people have ridden them well, many more have been left behind.

We cannot fight change; to fight change is to fight nature. But we can ride it. We can harness change so that it may be useful, so that it may propel us forward. If we teach each other how to, we can all ride together; and if we catch the waves of change just right, it can even be fun.

- JH