News on Augmented Reality, Virtual Reality, Mixed Reality, UX/UI Designer, Internet of Things, Artificial intelligence, Quantum Computing, continually updated from thousands of sources around the net
Qualche giorno fa l’ufficio brevetti e marchi degli Stati Uniti ha pubblicato una domanda di brevetto di Apple che si riferisce a una funzionalità progettata principalmente per “AR glasses” ed “Headset” che eviterà il cosidetto “burn-in” del display.
(Image credit: Martin Hajek/iDropNews)
Il burn-in è quell’effetto che, a seguito della visualizzazione prolungata nella stessa posizione nello schermo di un’immagine, comporta un deterioramento del fosforo dello schermo ( Il display è perfettamente funzionante al verificarsi di questo problema) con formazione di una cosiddetta “immagine fantasma“, un’immagine sbiadita che, indipendentemente da ciò che si visualizza sul display, rimane in sovrimpressione.
Operazione di visualizzazione basata sull’attività oculare
La domanda di brevetto di Apple riguarda un sistema di monitoraggio oculare progettato per rilevare “saccadi oculari” e battiti di ciglia e quindi apportare le modifiche necessarie alle visualizzazioni degli occhi in tempo reale senza che l’utente sappia che ciò sta accadendo in background.
Le saccadi oculari sono un rapido movimento oculare che porta una regione inizialmente periferica al centro del campo visivo (nella fovea). Gli esseri umani eseguono diversi movimenti oculari saccadici al secondo per utilizzare questa parte della retina ad alta risoluzione per guardare l’oggetto di interesse.
Durante saccadi e battiti di ciglia, la sensibilità visiva dell’utente viene temporaneamente soppressa. I circuiti di controllo dell’headset possono sfruttare la soppressione momentanea della sensibilità visiva dell’utente per apportare modifiche al funzionamento del display come ridurre il consumo di energia, apportare modifiche dell’immagine potenzialmente invadenti, evitare o ridurre gli effetti di burn-in, riducendo così il consumo di energia e migliorare le prestazioni del dispositivo.
Sopra l’immagine mostra un diagramma con un sistema di monitoraggio oculare può raccogliere Iinformazioni sull’occhio di un utente. Il sistema può includere componenti riguardanti il tracciamento dello sguardo, sensori di immagine, fotorilevatori e dispositivi di rilevamento della luce, altre componenti per il monitoraggio dei movimenti oculari.
Come con la maggior parte dei brevetti, osserva che l’invenzione non è limitata ai soli occhiali ma potrebbe anche essere utilizzata in sistemi futuri come display heads-up Mac, tv e altro ancora.
Mirko Compagno
AR/VR/MR Architect & UX/UI Designer
Innovation Manager MISE: Sistemi di visualizzazione AR/VR
We’ve got almost a full year until the next installment of Ghostbusters arrives, but in the meantime, it turns out that Sony is about to launch an augmented reality experience that will let fans use immersive computing to combat the franchise’s whimsical apparitions.
Starting this Saturday, fans who can make it to Tokyo, Japan will be able to play “Ghostbusters Rookie Training” using head-mounted AR devices.
The location-based experience will use a prototype AR headset from Sony, as well as assorted accessories, to give users the power to explore a real-world setting populated by virtual ghosts and demons.
But instead of putting users in a classic single-player situation, the users will all have to work together to accomplish a series of Ghostbuster-related tasks, all while communicating with each other throughout the AR location-based gaming space.
(1) Players in Tokyo demonstrating the AR game, (2) A replica of the Ghostbuster Proton pack, (3) Scene from the promotional video.Images via Ginza Sony Park
And in case there’s any doubt about the depth of the experience, would-be players should be warned that each program is about an hour-long, so only truly devoted Ghostbusters fans should even think of giving this a try.
But that hour-long commitment might be worth it even for non-fans since there’s apparently an appearance by the infamous evil Stay Puft Marshmallow Man.
Sony hasn’t posted much information about how the prototype AR headset works, but based on the video demonstrations the headset appears to use high-end waveguides, which “might” put the headset in the same general class as devices like the HoloLens and the Magic Leap One.
Along with the headset, there are other Ghostbuster-specific props included in the experience that may or may not be interactive controllers of some sort.
Aside from the Ghostbusters experience, Sony is apparently using the prototype on a couple of other experiences. One experience puts users in an interactive museum of ’60s memorabilia, and the other experience appears to be a concept for an outdoor interactive art project.
Several scenes in the other concept videos indicate that the headset may also include advanced hand tracking, along with attached earbuds and a large back-mounted module that looks like it might house a battery and some of the device’s computing components.
La multinazionale americana della consulenza (in collaboraz. con G20 Young Entrepreneurs Alliance) ha analizzato l’impatto economico e sociale dell’Extended Reality. Emerge che aumenterà il valore dei lavoratori e la loro produttività. In media, il 21% dell’orario di lavoro potrebbe potenzialmente essere incrementato dall’uso di Xr, raggiungendo oltre il 30% nell’ambito dei servizi sanitari e sociali, nella produzione e nell’edilizia.
L’Extended Reality, cioè la tecnologia che comprende la realtà virtuale (vr) e quella aumentata (ar), ha un potenziale straordinario sia in termini di benefici economici che sociali: offre opportunità di business ed esperienze rivoluzionarie ai consumatori, ma implica anche in una certa misura la presenza di rischi, sia per la società nel suo complesso che per il singolo individuo.
È quanto emerge dal report “Waking Up to a New Reality: Building a Responsible Future for Immersive Technologies”, pubblicato da Accenture in collaborazione con G20 Young Entrepreneurs’ Alliance, una rete globale di circa 500.000 giovani imprenditori e delle organizzazioni (in linea di massima di tipo confindustriale, ad esempio i giovani della Confindustria italiana) a sostegno, che analizza le modalità in cui l’Extended Reality stia già contribuendo attivamente alla creazione di valore in molteplici settori, non limitandosi più a caratterizzare mercati come il gaming el’intrattenimento. Questa innovativa tecnologia si sta configurando non solo come elemento di rilievo nella costruzione dell’esperienza del cliente, ma anche come mezzo utile per aumentare la produttività della forza lavoro e fornire formazione.
L’Extended Reality permette una connessione più intuitiva, in grado di collegare i nostri sensi naturali con il mondo che ci circonda e le aziende, start-up in primis, stanno sperimentando metodologie sempre più all’avanguardia per esaltare queste esperienze coinvolgenti che sollecitano tatto, gusto e olfatto. Un ulteriore elemento su cui si basa l’unicità di questa tecnologia è il modo in cui i nostri pensieri vengono utilizzati: svolgono, infatti, un ruolo fondamentale nel controllo del mondo fisico, attraverso la traduzione delle onde cerebrali in segnali digitali.
Numerose aziende stanno già sperimentando i benefici prodotti da questa nuova realtà digitale, attestando miglioramenti nella produttività e nella formazione dei dipendenti in molteplici settori. Si prevede ad esempio che la spesa per quest’ultima, condotta utilizzando vr/ar, incrementerà del 46% (cagr) tra il 2018 e il 2023, raggiungendo gli 8 miliardi di dollari. Anche i mutamenti sociali sono evidenti: lo Xr, ad esempio, può contribuire all’educazione di bambini e ragazzi, accompagnandoli in luoghi che non hanno mai visto, fornendo terapie per persone con disabilità fisiche o psicologiche e aiutando gli operatori sanitari ad apprendere nuove competenze. Accenture, ad esempio, ha sviluppato un’esperienza vr pluripremiata per gli operatori sanitari impegnati nel settore del benessere infantile.
L’indagine mostra inoltre che l’Extended Reality aumenterà il valore dei lavoratori oltre che la loro produttività mediante il rapporto di collaborazione instaurato tra uomo-macchina. In media, il 21% dell’orario di lavoro potrebbe potenzialmente essere incrementato dall’uso di Xr, raggiungendo oltre il 30% nell’ambito dei servizi sanitari e sociali, nella produzione e nell’edilizia.
Previsioni di spesa in tecnologie ar e vr. Fonte Accenture
La crescente consapevolezza rispetto alle potenzialità dell’Extended Reality è dimostrata dal fatto che gli investimenti aziendali in questa tecnologia stanno superando la spesa effettuata dai consumatori. Secondo una stima di Idc, arriverà a valere tre volte tanto entro il 2023, raggiungendo i 121 miliardi di dollari. Al contempo l’indagine condotta da Accenture mostra che il numero di domande di brevetto per ar e vr è quasi quintuplicato tra il 2014 e il 2016, superando le 6.000 richieste, mentre nello stesso periodo i finanziamenti per le start-up sono cresciuti del 237%.
Nonostante le opportunità rappresentate da questa innovazione, lo studio rileva che la forza e l’eccezionalità delle esperienze rese possibili dalle tecnologie di Xr possono tuttavia portare dei rischi. Ad esempio l’utilizzo improprio dei dati personali, poichélo Xr potrebbe esporre i sentimenti, i comportamenti e le informazioni sensibili del singolo ai giudizi, al furto e alla manipolazione, in misura esponenzialmente maggiore rispetto a quella esercitata dai social media che tutti noi conosciamo; ma anche la cyber security, dal momento che non solo gli avatar potrebbero essere utilizzati per creare nuove forme di criminalità legata all’identità, ma alcuni compiti di importanza cruciale, come la chirurgia, che diventano dipendenti da tecnologie immersive, potrebbero essere a rischio di estorsione. Inoltre, quando si vive un’esperienza virtuale come quella proposta dall’Extended Reality, diventa più difficile distinguere la realtà dalla finzione, rendendo più semplice influenzare profondamente comportamenti, opinioni e decisioni. Infine, preoccupa il comportamento antisociale dei cosiddetti troll, ovvero identità artificiose, che potrebbero passare dall’intimidire con le parole, come accade attualmente sui social media, all’intimidire fisicamente le persone in un mondo virtuale tramite gli avatar.
Il numero di brevetti per le tecnologie ar e vr è in crescita. Fonte Accenture
Secondo Accenture, le strategie prioritarie che le imprese devono mettere in atto per poter trarre vantaggio da questa innovativa tecnologia senza amplificarne i rischi includono, in primis, l’adozione di una cultura della responsabilità sin dalle prime fasi di progettazione di servizi e prodotti che utilizzano lo Xr, per essere in grado di tenere il passo con l’andamento rapido dell’innovazione; definire un ecosistema di partner con cui lavorare, come neuroscienziati, esperti di salute mentale, sociologi e teorici del comportamento. E infine, destinare gli investimenti Xr al miglioramento della produttività, della formazione e della creatività dei lavoratori.
Lo studio non trascura nemmeno la necessità da parte dei decisori pubblici di inserire questo tema nella propria agenda, suggerendo alcune iniziative che possono essere messe in atto sin da ora, come garantire un accesso inclusivo e a prezzi accessibili a questa tecnologia ampliando nuove e potenti infrastrutture (come le reti 5G) al fine di rendere le esperienze di Xr disponibili e a prezzi adeguati, in particolare per la fornitura di servizi sanitari, educativi e sociali. Inoltre sarebbe opportuno incentivare innovatori e attività imprenditoriali a livello locale, consentendo alle piccole imprese non solo di utilizzare gli strumenti e le esperienze offerte dall’Extended Reality, ma anche di partecipare al loro sviluppo, garantendo soluzioni rilevanti. O, ancora, stimolare la ricerca e la discussione, riunendo esperti di settori e discipline diverse per costruire la comprensione e i principi necessari che consentano all’innovazione in materia di csr di prosperare nel rispetto di adeguate misure di salvaguardia.
La tecnologia Xr aiuta la produttività. Fonte Accenture
Per cogliere nella loro interezza i vantaggi offerti dalle nuove tecnologie, senza tralasciare il benessere dell’individuo e della società, è necessario, quindi, essere precursori e innovatori, non permettendo alle continue evoluzioni che interessano il nostro mondo di sopraffarci, ma elaborando sistemi sempre più all’avanguardia che ci consentano di sviluppare al meglio le nostre capacità e il nostro futuro.
Teaming up with the New Museum and six leading visual artists.
1 of 6
APPLE
2 of 6
APPLE
3 of 6
APPLE
4 of 6
APPLE
5 of 6
APPLE
6 of 6
Participants include Chicago-based artist Nick Cave, Swedish animator Nathalie Djurberg and composer Hans Berg, multimedia artist Cao Fei, as well as conceptual artist Carsten Höller. A bulk of the AR artworks “live as a visual layer on the cityscape and are experienced via a walk with an iPhone in six major cities,” as described by Apple in an official announcement.
Accompanying the public art project is a new program called [AR]T Lab: AR Experiences with digital artist and teacher Sarah Rothberg who is offering free lessons on augmented reality software to beginners in all Apple Stores worldwide. “In this Lab, attendees get hands-on with whimsical objects and sounds created by Rothberg to learn how to code their own AR experiences using Swift Playgrounds,” said Apple.
AR in the healthcare market is witnessing a big boost with a high expected CAGR of 33.36% and market value expected to rise from US$621.727 million in 2018 to US$3,497.315 million in 2024
Augmented Reality (AR) and Virtual Reality (VR) technologies are gaining significant traction among healthcare experts owing to their numerous applications that range from assessment of surgical preparation to minimally invasive surgery and rehabilitation. Other applications of augmented reality in healthcare include medical training and pharmacy benefits management. As the population increases, the growing demand for surgical treatment as well as healthcare expenditure among people is boosting the application of augmented reality and virtual reality technologies in the healthcare sector by a significant degree.
Technological advancement in augmented reality and artificial intelligence technologies along with the increasing workload of healthcare professionals and stringent regulatory compliances in laboratory testing are expected to bolster the market forecasts in the upcoming years. Higher adoption of mobile augmented reality technology helps in bridging the gap in the patient-healthcare provider relationship and also helps patients to make better decisions about their health by educating and proving information to them.
After debuting its virtual Pocket Gallery last year with the works of Johannes Vermeer, Google Arts & Culture has released a sequel that brings even more artists into your home via augmented reality.
Available in the Google Arts & Culture app for iOS and Android, “The Art of Color” features 33 famous paintings from around the world organized into wings by color palette, with Pablo Picasso and Vincent Van Gogh among the featured artists.
Like the Vermeer gallery, users can anchor a miniature version of the virtual gallery in their physical environment via ARKit or ARCore.
To access “The Art of Color” feature, first open the app, then click on the camera icon button located at the bottom of the app. The next menu will show you a menu including the Pocket Galley option. Once you click on the Pocket Gallery menu option you’ll be prompted to look find a well-lit surface upon which to place the virtual gallery.
Once that tracking is done, you can then tap on the “Art of Color” icon, located at the bottom of the screen, and download the new feature. When that’s done, just tap the Enter button and you’ll be immersed in a virtual gallery in your real world location. The experience almost becomes a VR experience, except users can still see the real world through the exit doors of the gallery.
Once immersed in the gallery, users can walk around the virtual halls to view works of art more closely or double-tap to transport themselves to various wings of the digital museum. Also, tapping on a painting brings up a card with more information on the piece.
“One of the goals of the Google Arts & Culture team is to find new or unexpected ways to bring people closer to art. From renowned masterpieces to hidden gems, ‘The Art of Color’ brings together artworks like Georgia O’Keeffe’s ‘Red Cannas’ and Amrita Sher-Gil’s ‘Mother India’ or Hokusai’s ‘South Wind, Clear Dawn,'” said Andy Joslin, design lead for Google Arts & Culture, in a blog post.
While Google has begun using augmented reality in many of its existing products, like Google Maps and Google Search, its seems like the Google Arts & Culture team has gone “all in” on AR, so much so that they’ve consolidated all of the AR tools under the Camera tab in the app.
In recent years, the Google Arts & Culture initiative has been best known for its VR experiments, but augmented reality is increasingly front and center for the team, including an Art Projector tool that brings life-sized individual works of art into the user’s personal space.
Outside of its mobile app, the team has also partnered with other organizations to tell their stories in augmented reality. For example, the team assisted CERN in using AR to explore the Big Bang. The Google team also spearheaded the Notable Womenproject, which featured an experience that used AR to digitally insert historically famous women into real currency.
Despite these wide ranging uses, it appears that showing off art in AR through a mobile app is becoming one of Google’s favorite palettes for immersive experimentation. And, until teleportation becomes a thing, it’s the only way to see the world’s most famous works of art in one space.
The Science Behind TIME’s New Apollo 11 Moon Landing Augmented Reality Experience
TIME this week launched TIME Immersive, a new iPhone and Android app that we’ll use to deliver groundbreaking augmented reality and virtual reality experiences. First up: the TIME Moon Landing experience, the world’s most accurate 3D re-creation of the Apollo 11 mission, which took place 50 years ago this month. Users can watch an approximately five-minute AR simulation of the Apollo 11 landing, narrated by TIME’s Jeffrey Kluger and featuring original NASA audio from the mission, then explore the surface of the moon on their own.
What makes the TIME Moon Landing hyper-accurate? At the experience’s core lies incredibly precise data meticulously collected over the last 20 years by John Knoll, the chief creative officer and visual effects supervisor at Industrial Light and Magic, a top Hollywood special effects company founded by George Lucas.
“I’m old enough to remember seeing the Apollo 11 landing live as a kid,” says Knoll, who gave his data to TIME. “That really left a big impression on me. In the years that followed, I was always fascinated with the space program.”
Knoll began collecting Apollo 11 landing data after stumbling upon a transcript of radio calls between the spacecraft and mission control. Those transcripts, he says, underscored the harrowing few minutes just before the “Eagle” lander touched down on the lunar surface, when it was running dangerously low on fuel. That moment, says Knoll, was largely glossed over in the Apollo 11 documentaries of his youth. “In reading the timestamped transcripts, this is white-knuckle time,” he says.
Knoll’s commitment to accuracy came in part from his disappointment with some Hollywood directors who pay lip service to scientific precision but abandon it in favor of what they or the studios believe is better storytelling. “I was very committed to making the re-creation as technically accurate as I could make it, in getting everything right about the motion of the spacecraft, the lighting conditions, the lunar terrain, where individual rocks and craters were,” says Knoll. “And to figure out if there were clever or sneaky ways to extract data from unlikely sources.”
To that end, Knoll relied on a handful of data sources, including NASA telemetry graphs, footage from a descent camera on the lunar module (LEM), and data from the Lunar Reconnaissance Orbiter (LRO), a probe orbiting the moon that was launched in 2009. He made up for shortcomings in the data with advanced computer vision techniques, including one process whereby the altitude of moon surface features can be estimated based on how bright or dark they appear in photographs.
“When you look at a photograph of the moon, and you see all that light and shadow, what you’re seeing is the orientation of the surface relative to the sun,” says Knoll. “If a surface is brighter, it’s because it’s inclined more towards the illuminance, and if it’s darker, it’s because it’s inclined more away. If you start on one end of an image, and if a surface is lighter than the average then it’s inclined up, so you accumulate the altitude, and if it’s darker, it’s declined, and so you decrement the altitude. By doing that, you can integrate an approximation of the terrain.”
Knoll hopes that the experience helps people better understand and take pride in the complexity of the Apollo project.
“I’m a big champion of science education, and people really understanding what we achieved,” says Knoll. “Those Apollo missions were great and amazing, and especially in these very divisive times, everyone regardless of their political affiliation can look back with some pride and look back at the accomplishment.”
The TIME Moon Landing experience was co-produced by TIME, John Knoll, the Smithsonian’s National Air and Space Museum and Smithsonian’s Digitization Program Office, Trigger, RYOT, and the Yahoo News XR Program. It is available within the TIME Immersive app, which you can download for iPhone in Apple’s App Store, or for Android in the Google Play Store. Look out for more TIME Immersive projects in the near future.
Bimba ha un tumore al cuore: salvata a Milano con il primo intervento con gli ologrammi.
I medici durante l’operazione hanno usato una copia perfetta del cuore della bimba.
L’intervento
La caduta durante una tranquilla giornata in campagna. La corsa all’ospedale più vicino, in Albania, e il tragico referto dei dottori: una grossa massa tumorale, 5 centimetri per 3, proprio accanto al cuore. Quindi la decisione dei genitori di venire in Italia per dare una possibilità alla loro piccola. Una possibilità che è diventata realtà a Milano.
Miracolo dei medici del Policlinico di San Donato, che sono riusciti a rimuovere un tumore dal cuore di una bimba di sei anni – la piccola Melissa – grazie al primo intervento messo a segno in Italia con l’utilizzo della realtà aumentata.
Si trattava, spiegano dall’ospedale meneghino, di un “tumore al cuore che si manifesta improvvisamente, una diagnosi terribile per una patologia rara definita inoperabile. L’intervento era molto rischioso, la possibilità di intaccare e danneggiare i tessuti circostanti al tumore era alta e la letteratura scientifica – proseguono dalla clinica – è stata di poco aiuto, poiché i casi descritti sono rarissimi”.
A Milano l’operazione con la realtà aumentata
Eppure al Policlinico l’équipe guidata dal dottor Alessio Giamberti – responsabile di cardiochirurgia delle patologia congenite – ha trovato il modo di salvare la vita a Melissa. L’intuizione vincente di Giamberti e del dottor Massimo Chessa è stata quella di ricostruire il cuore compromesso di Melissa mediante ologramma, “tecnologia molto performante e plasmabile”.
Gli ingegneri biomedici del Politecnico di Milano – Francesco Sturla, Filippo Piatti, Omar Antonio Pappalardo e Giovanni Rossini – hanno creato una copia perfetta del cuore della bimba permettendo così, ricostruiscono dall’ospedale, “di simulare l’intervento, prima in laboratorio e poi in sala operatoria”.
L’intervento per la rimozione del tumore è perfettamente riuscito, così come il secondo intervento per il posizionamento di un defibrillatore.
“L’ologramma salvavita”
“L’ologramma ci ha consentito di visualizzare meglio la conformazione della massa e di decidere quale fosse la miglior via d’accesso e la modalità di intervento. In questo caso la tecnologia è stata davvero cruciale, direi salvavita, perché ci ha dato la certezza di poter enucleare il tumore, fortunatamente benigno, senza provocare danni”, ha spiegato il dottor Giamberti.
“L’ologramma è attualmente la tecnologia migliore al supporto del chirurgo. La rimozione era assolutamente necessaria – ha concluso il medico – poiché la massa crescendo avrebbe potuto ostruire il flusso sanguigno dando origine ad aritmie, talvolta mortali”.
Melissa, grazie al suo ologramma “speciale” e ai suoi angeli custodi col camice, adesso dovrà “soltanto” sottoporsi a controlli periodici, ma potrà avere una vita normale e tornare nella sua casa a festeggiare il suo settimo compleanno.
These days, new and evolving technology has introduced the world to 3 very fascinating realities, Virtual Reality or VR, Augmented Reality or AR, and Mixed Reality or MR. in this article, you will see what makes them different from each other and how they are contributing in different areas of work. Let’s have a brief look at what is VR, AR, and MR
● VR — With VR app development, it engages users in a completely artificial digital setting.
● AR — It covers virtual objects on the real-world setting.
● MR — It covers and keeps the virtual objects anchored to the real world.
Virtual Reality or VR
Virtual Reality (VR) is also called a computer-simulated reality which delivers an immersive experience. In this, computer technologies are used with the real headsets to create an imaginary world with the lifelike sounds, imageries and other feelings that are the imitation of a real environment. An accurate VR app development setting will immerse all the five senses in the human body including taste, smell, sight, sound, and touch, but in reality, it is not always possible. Nowadays, it can be said that VR has established itself in some very practical areas, especially after the years of popularity in the gaming industry. VR uses two types of main headsets:
1. PC-connected
These headsets are connected to a computer or gaming console that provides with top-quality visual experience. They can also be used with special controllers and users can interact with the virtual world.
2. Standalone
These headsets are not needed to be connected to a computer or a gaming console. Most of the standalone headsets use a smartphone screen for interacting with virtual reality. They are quite affordable and easy to use
Augmented Reality or AR
Augmented Reality (AR) is live and direct or indirect viewing of a real-world environment where its elements are amplified or augmented using audio, video, graphics, or GPS data. It gives you a lot more freedom than what you get in the real world. Smartphones and tablets are two of the most widespread means of AR as of now. Two types of main devices are:
1. Portable devices
AR is perhaps the most reachable and handy reality technology, as people can get access to it using portable devices like smartphones and tablets in order to use applications based on augmented reality. AR apps simply use a smartphone camera in order to seize the real world. Then the virtual items are overlaid, and users can easily see them on their portable device.
2. AR glasses and headsets
Another way to enjoy augmented reality is by using smart glasses or AR headsets. As compared to VR headsets, these AR glasses and headsets don’t engage the users into a completely virtual environment. Instead, they just add virtual objects in the real world.
Mixed Reality or MR
Mixed Reality is also called as hybrid reality. It is the merger of real and virtual environments in order to create new environments and visuals. In that new environment, both physical and digital entities exist together, interacting in real time. It means a new imagery is placed inside a real space in such a manner that the new imagery can interact to a degree, with the real world as you know it. The distinguishing factor of MR is that the artificial content and the real or physical world content can interact with one another in real time.
There can also be a different form of mixed reality. In this new form of mixed reality, users watch and interact with a fully virtual environment which is overlapped on the real world surrounding the users. If you are finding it a bit confusing, look at it from a different perspective. Just imagine that you are fully engaged and interacting into a completely virtual environment. However, you are still walking around in your room at your place. What do you think will happen if you trip over an object lying on the floor? To prevent any such incidence, your headset must be able to keep track of the real world while you are immersed in the virtual world and adjust the virtual setting accordingly. This type of MR is a lot closer to VR as compared to AR.
There are different types of devices that can be used for mixed reality:
1. Holographic devices
These headsets comprise transparent glasses through which you will be able to keep track of your surroundings easily and avoid any kinds of unfortunate incidents while using MR. in this; Virtual experiences are generated using holograms.
2. Immersive devices
These headsets comprise of non-translucent spectacles that totally block out the real world just like VR headsets. They use cameras for tracking the real world.
Conclusion
It can be difficult to point out one choice from all three realities. While VR is being used for years in the gaming industry, AR and MR are also not far behind. However, while AR just overlays the virtual objects on the real environment, in MR, the digital parts of the environment are more conscious of what is happening in the real surroundings around you and thus represent a more realistic interaction.
Unlike VR, when you’re talking about augmented reality, describing what an experience is like can be incredibly difficult — primarily because the experiences are even more contextual than relatively static virtual worlds that don’t involve real-world settings.
In AR, everything is about how “you” see things interacting with your real environment. Such is the case with what I’m calling the most important demonstration of Magic Leap technology to date in the form of an AI assistant called Mica.
Together, the team described a world in which a Magic Leap user will be able to interact with intelligent assistants in the form of fully realized augmented reality humans that can recognize your position in a room, as well as items in that room. Having mapped the area and your position within it, the AI assistant will then interact with you to help you do any number of things.
For example, as detailed in the presentation, the AI assistant might scan the Magic Leap One wearer’s eyes to detect his mood and then suggest an appropriate song to play through the home’s music system. Similarly, the AI assistant my access the Magic Leap One user’s preferences to adjust things such a the level of light in a room at a certain time of day.
We’re already becoming accustomed to such interactions on the audio plane via digital assistants like Amazon’s Alexa, Google Home, and, to a lesser extent, Apple’s Siri. But what Magic Leap is describing is putting an even more robust and responsive version of such a digital assistant in the form of a human that inhabits the same space as you, thus taking the assistant metaphor to its highest level. It sounds and looks a bit like science fiction, but it’s not.
What Magic Leap is describing is so close to reality, the company now feels comfortable enough to offer demonstrations of a rudimentary version of the dynamic at work with the Magic Leap One in conjunction with its intelligent assistant Mica.
The result is a stunning experience that takes AR into brand new and exciting territory.
I met Mica for the first time earlier this week. And if you get a chance to meet her, she will fundamentally change how your view the Magic Leap One and augmented reality in general.
When Magic Leap’s team brought me into an empty room hidden deep in the bowels of an LA event center, I didn’t know what to expect. The space was designed to look like a normal room, complete with a table, two chairs, and other furniture situated around the table. Nothing looked particularly futuristic or tech-enabled, so I wasn’t expecting much. Wow, was I wrong.
Upon donning the Magic Leap One, I’m greeted by a virtual woman (Mica) sitting at the very real wooden table. Then, Mica, with an inviting smile, gestures for me to join her and sit in the chair opposite her. I oblige, and then a very weird interaction begins — she starts smiling at me, seemingly looking for a reaction.
I’ll admit, I deliberately avoided smiling (though it was really hard, Mica seems so nice) and kept a poker face in an attempt to see if I could somehow throw the experience off by not doing the expected, that is, returning the smile.
Undaunted, Mica continued to look into my eyes and go through a series of “emotions” that, surprisingly, made me feel a bit guilty about being so stoic.
It’s at this point that I should mention that she doesn’t speak yet, so all of our interactions were conducted in silence, and instead of using words, she communicated using gestures, eye moments, and various body language. At first, I thought this might be a limitation, but retrospect, I think this served to make the experience even more impactful.
That would have been enough to mildly impress me, but what came next was the kicker. She then pointed to a real wooden picture frame on the table, gesturing for me to hang it on a pin on the wall next to us. I did as asked, and… it was the eurekamoment. This was a virtual human sitting at a real world table and she just got me to change something in the real world based on her direction.
But then it got better. Once I’d hung the empty frame, Mica got up (she’s about five feet six inches tall) and began writing a message inside the frame, which in context looked about as real as if an actual person had begun writing on the space.
Alas, I don’t remember what the message was (honestly, I was too blown away by what was happening), but I’m assuming it was somewhat profound, as Mica then looked to me in a way that seemed to ask that I consider the meaning of the message. After a few beats, the life-sized, augmented reality human walked out of the room. But she didn’t just disappear into a wall in a flurry of sparkly AR dust. Instead, she walked behind a real wall in the room leading to a hallway. It was a subtle but powerful touch that increased the realism of the entire interaction.
As I said earlier, it’s incredibly difficult to describe just how profound this experience was, but if and when it’s made available to the public, you’ll be doing yourself a grave disservice if you pass the opportunity up. `
I’ve been trying to think of tool or app that would compel me to wear the Magic Leap One for an entire day. And while I’ve had the device for months now, I haven’t been able to think of anything that would get me to wear it beyond one hour spurts of activity. That’s all changed now. Although battery life and the experience itself aren’t quite ready for such rigorous and extended use, I could easily see coming home and slipping on the Magic Leap One for the rest of the night if it meant having access to such a fully realized AI assistant such as Mica.
After meeting Mica, I have no doubt that this is what the virtual assistant future will look like for most people in the very near future. It’s not assured that it will be Magic Leap that delivers it, but whichever company does, I think it’s safe to say that Magic Leap was first to show us that future in this particular way, and it’s incredible.
This work is licensed under a Creative Commons Attribution 4.0 International License.
Augmented World 