Professor Jeremy Bailenson from Stanford University’s Virtual Human Interaction Lab explains what Virtual Reality is, how it works, and what it can do

I’m still old enough to remember a time when typing a message on a touchscreen keyboard felt very cutting-edge indeed. But I also remember doing that for the first time in a crowded Apple store, with no real intention of buying the first-generation iPhone I was playing with. The experience felt interesting and exciting, but not necessarily useful, and certainly not necessary.

It’s only a matter of time before technologies such as Virtual and Augmented Reality will transform the way we interact with digital content
Share on X

This, many experts argue, is the stage we’re currently at with Virtual Reality: It’s an exciting technology with interesting applications that people are happy to try out – but not yet willing to embrace fully.

Yet just as the tipping point eventually came around when even my grandparents bought their own smartphones – and used them every day – there is a building consensus that it’s only a matter of time before technologies such as Virtual and Augmented Reality will transform the way we interact with digital content in even more fundamental ways than the smartphone has done.

Virtual Reality is an exciting technology with interesting applications that people are happy to try out - but not yet willing to embrace fully
Share on X

For those feeling befuddled by that whole idea, Experience on Demand is certainly a helpful read, and oftentimes an entertaining one as well. Its author – Professor Jeremy Bailenson – is the Director of Stanford University’s Virtual Human Interaction Lab, and one of the world’s greatest authorities on Virtual Reality, yet this doesn’t come across as an academic book.

When writing about technology, it’s often difficult to strike a balance between ensuring that enough of the basics are covered without being patronizing to those already familiar with the subject. The book walks that fine line very well by focusing primarily on the human experience, so that whether or not you know what terms like latency, rendering, tracking or lag mean, you should come away with a better understanding of what Virtual Reality actually does.

As an expert in psychology and mass media, Bailenson has largely remained unalarmed about the extent to which traditional media affect us. Yet he writes that as absorbing as books or videogames or television are, they pale next to Virtual Reality: “VR engulfs us (…) it’s the apotheosis of every media fear and fantasy we’ve ever had,” he writes.

Bailenson's book places VR within a broader social context
Share on X

His book does a good job of pulling back the focus to place VR within a broader social context, explaining how it relates to other technologies – both traditional and emerging – and our existing relationship with the digital world.

Although he cites scientific research throughout, the book is mainly pegged around personal anecdotes and use cases that illustrate what it does to real people, and why it matters to everyone, not just the techy crowd. The picture that emerges is of an astoundingly broad range of applications for Virtual Reality, none of which involve either gaming or pornography.

VR engulfs us. It’s the apotheosis of every media fear and fantasy we’ve ever had
Share on X

There are examples of how VR can be a powerful learning tool
Share on X

Those anecdotes tell the story of how NFL teams have significantly improved the performance of their players by training them in Virtual Reality simulations, and how VR is being used to treat conditions such as chronic phobias and Alzheimer’s. It has helped 9/11 victims overcome posttraumatic stress disorder, and burns patients manage their pain with fewer opioids.

There are examples of how VR can be a powerful learning tool, as Bailenson argues that almost any skill can be improved by virtual instruction (groups learning tai chi moves in virtual reality remembered their moves better and performed them back with 25% greater accuracy than those who had been taught by watching a video, for instance).

We also learn how VR’s unique ability to create empathy by literally “placing you in someone else’s shoes” has been successfully applied to a variety of scenarios, from helping people relate on a personal level to issues such as climate change, to tackling bias and prejudice in diversity training.

Several bizarre experiments describe how experiencing a simulated virtual scenario first-hand can result in instant and lasting changes in behaviour
Share on X

Several – often rather bizarre – experiments in the book describe how experiencing a simulated virtual scenario first-hand can result in instant and lasting changes in behaviour. In one, they explored if walking around as a virtual cow might change participants’ attitude towards consuming red meat, while in another, people visualized their energy consumption during a shower in terms of literally eating lumps of coal, and subsequently went on to use hot water more sparingly. And although more research is needed to verify such results at scale, it is difficult to remain unimpressed by these early indications of VR’s power to create empathetic responses in people – not only in relation to other human beings, but also towards animals and the environment.

One of the surprising arguments that Bailenson puts forward seems to be that by living more of our lives in virtual worlds we can help save the real one. Business travel, for example, could be vastly reduced if we are able to replicate in VR the same levels of interaction and feeling of presence that one gets from face-to-face meetings.

The more time you spend in virtual experiences, the more you come to appreciate the vibrancy of real life
Share on X

“Conspicuous or wasteful consumption in the real world comes with real costs, be it in fossil fuel consumption, the mountains of plastic junk that are piling up in our homes and landfills, or the floating islands of garbage that are growing in our oceans…. When considered this way, deep engagement in social virtual worlds seems less scary than the dystopian scenarios would have us believe, and may have significant social benefits,” he says.

This desire to protect the environment reflects a passionate appreciation of the real world which might seem out of place for someone who has spent the last two decades studying computer-generated environments. Paradoxically, he argues, the more time you spend in virtual experiences, the more you come to appreciate the vibrancy of real life.

Business travel could be vastly reduced if we are able to replicate in VR the same levels of interaction and feeling of presence that one gets from face-to-face meetings
Share on X

Although Bailenson is clearly an enthusiast and advocate for the broader benefits of Virtual Reality, he also addresses its potential dark side, sounding a warning note against the danger of using what he describes as “the most psychologically powerful medium in history” without proper care or consideration.

One of the surprising arguments that Bailenson makes is that by living more of our lives in virtual worlds we could help save the real one
Share on X

Virtual Reality represents the culmination of the way technology is enveloping our lives, and its psychological effects can be profound and long lasting, he cautions. It is therefore important that we learn to use this new medium responsibly, and the best way to do this is to understand exactly what we’re dealing with. As Bailenson is fond of telling journalists, Uranium can equally be used to heat homes or make nuclear bombs. Technologies like VR are neither good nor evil, but how people will choose to apply it remains an open question.

This article was originally published on VRScout

What Virtual Reality Is, How It Works, and What It Can Do #BookPreview via @alicebonasio https://t.co/qzYRe5smBr pic.twitter.com/Vw2sh7D7t8

— VRScout (@VRScout) January 30, 2018

Alice Bonasio is a VR Consultant and Tech Trends’ Editor in Chief. She also regularly writes for Fast Company, Ars Technica, Quartz, Wired and others. Connect with her on LinkedIn and follow @alicebonasio on Twitter.

The post Book Review: Experience on Demand appeared first on Tech Trends.

From body scans to morphing to animated selfies, the future is bright, if a little weird.

In this UploadVR article I talk to 3 companies pushing the boundaries of 3D avatar design and get the perspective from Virtual Reality experts such as Professor Jeremy Bailenson from Stanford University’s Virtual Human Interaction Lab on what we’re looking for in our virtual skins.

Immersion and meaningful social interaction in #VR will only happen when we feel comfortable in our virtual skins
Share on X

VR development is moving at breakneck speed on all fronts, and 2017 is set to see the launch of several long-awaited platforms like Sansar, which are all betting big on Social VR and user-generated content. Most of the focus so far has been on building those worlds and experiences, but if we’re ever to achieve a true sense of presence in these virtual worlds, we need to also be able to create really good avatars. Full immersion and meaningful social interaction can only really happen if we feel comfortable in our virtual skins.

Huge advancements in facial tracking technology have made it a lot easier and cheaper to render realistic facial expressions on an avatar, which might push ahead of cartoony stuff like Facebook showcased earlier this year. Social presence – that sense of really being with another person – is associated with more rewarding communication experiences and higher levels of empathy toward others. It follows, then, that for people to want to engage with each other in virtual environments, we need to foster that sense of social presence, which means getting your avatars right.

We are the Identity-Makers of the New World
Share on X

Research has found that simple things such as holding an avatar’s gaze for longer – only 4 seconds as opposed to 2 – already made people feel more positively toward the other person’s avatar that they were interacting with in the experiment. Professor Jeremy Bailenson, Director of the Virtual Human Interaction Lab at Stanford, also recently conducted a study that showed just how sensitive we are to such subtle variations in facial expressions, and how small changes can have a big impact in the quality of our virtual social interactions. His study included 158 participants and looked at whether enhancing your avatar’s smile during a virtual conversation would affect a user’s perception of the person with which they were interacting.

“Our research has demonstrated for almost two decades that small changes in the appearance and behavior of avatars can affect a social interaction,” explains Bailenson. “In the current study, simply putting a gain factor on smiles–such that a pair of people saw slightly bigger smiles on one another–caused people to speak more positively and feel happier.”

There are a lot of people out there obsessing about creating a way for users to  generate, personalize and “own” their avatars – in the sense that they are able to use them across any platform or device, and for any purpose. Companies such as Itsme, Morph3D and Loom, for example, are bringing technology to market looking to enable users to do just that. And although they’re all approaching the infamous Uncanny Valley from different directions, there’s a general consensus that these avatar-generating tools need to be agnostic. That means using Dolby-like licensing models and open APIs so that users can port their avatars into whatever platform they want, whether that’s Sansar, Steam or Facebook. We talk to those start-ups about how they see the future of avatars shaping up.

Body Scanning: Itsme

“We are the Identity-Makers of the New World,” says Itsme CEO Pete Forde, who wants people to use their technology to create expressive and persistent identities. “What we have done is to create a scalable process that is capable – with careful execution – of being the method by which the world gets turned into avatars.”

His Toronto-based company has been working on their body-scanning tech for the past three years, and claims to have invented a method that is free for the end user and fully automated, allowing the person to see a 3D avatar render within one minute of getting scanned.

They already captured about 8,000 people so far during a five-city tour of Canada with Samsung. Their first product is due to launch in January and will be a personalized avatar keyboard, called Itsmoji, which allows you to use versions of your animated personalized avatars as emojis.

They already captured about 8,000 people so far during a five-city tour of Canada with Samsung
Share on X

Forde believes the realism afforded by this technique – which captures both your body shape and movements – will be key to developing avatars for social platforms:

“Normal people have absolutely zero interest in meeting complete strangers online, and what Facebook figured out early on is that people will not engage unless they are connected with at least 10 real friends within 14 days. Attempting to learn from history, our growth model is based on creating relationships based on tight pockets of friends that actually know each other.”

As people invest more time and project more of their own identity into those avatars, it is important to also ensure there are policies and procedures in place to lock them down in terms of privacy and security: “think FB-style granular permissions,” says Forde.

Itsme is currently closing their seed investment round and preparing SDKs for Unity and Javascript to let developers use avatars directly in their projects and products. They’re also working to create apps that allow you to do all sorts of interesting things with your avatar, such as applying Snapchat-like filters to them, getting a 3D figurine printed, or going to the Shopify store (one of their current partners) to try on some clothes and see how they’d look on you. Future social use cases could also include buying tickets to sold-out sports events and watching them in 360, with your friends sitting next to you in the front row.

“I don’t have a problem with artistic/cartoon avatars per se,” Forde concludes. “There’s a place for them, and if people want to play as a robot or a bunny, knock yourselves out. I don’t see it as an either/or proposition. But if I put you in the dance club and you’re controlling one of these avatars, I want someone to be able to join the party with you and have them essentially play ‘who is the real person’ Turing style. What excites me is that we can now start to experiment with all of this stuff instead of wondering if someday it might be possible.”

Buid-a-Self: Morph3D

When you customize your character, your clothes automatically morph to fit your chosen shape
Share on X

With Morph3D’s Ready Room tool, you can create custom persistent avatars that can be used across any number of VR platforms, and Philip Rosedale’s High Fidelity social VR platform is among its first customers.

It relies on more traditional methods of creating avatars by tapping into its enormous crowdsourced database of assets created over the past 15 years by the members of Daz 3D (a separate company run by the same management team as Morph 3D).

For game and app developers this is a huge time saver as it plugs into the Unity engine and lets players craft their own characters. Currently there are over 400 3D characters available to use in VR applications on their platform. Each of those can also be morphed using sliders, providing an incredibly broad range of customization possibilities on top of that.

Over time it will be interesting to see how Morph 3D can be used in a broader variety of non-gaming applications, and how it applies to AR/MR as well as VR hardware
Share on X

When you customize your character, your clothes automatically morph to fit your chosen shape – be it of a little girl or a bulky man — and the final result can be imported into various social VR applications. Morph3D’s Director of AR/VR Chris Madsen says the objective is to make the process user-friendly and intuitive enough “so my mom can make a character for virtual reality.”

Over time it will be interesting to see how Morph 3D can be used in a broader variety of non-gaming applications, and how it applies to AR/MR as well as VR hardware. They have already started developing an interface which works with HoloLens voice control, for example, where you can modify the size of your character by saying commands such as “small” or “big”.

Loom’s technology turns selfies into personalized 3D avatars
Share on X

Selfie Avatars: Loom.ai

Video embedded above shows how an avatar generated from a single inset image
Share on X

Loom’s technology turns selfies into personalized 3D avatars by applying machine learning to automate human face visualization. It uses public APIs and VFX to create life-like visualizations which can then be animated and used for a range of applications. Video embedded above shows how an avatar generated from a single inset image (in these cases of celebrities such as Will Smith and Angelina Jolie) can look remarkably life-like and expressive.

These are the same types of techniques used in films such as The Avengers to transpose mark Ruffalo’s perceptually salient features onto his version of the Hulk, but using machine learning allowed the company to take what has traditionally been an extremely long, complicated and expensive process into something that’s now available to everyone.

“The magic is in bringing the avatars to life and making an emotional connection,” explains Loom CEO Mahesh Ramasubramanian. “Using facial musculature rigs powered by robust image analysis software, our partners can create personalized 3D animated experiences with the same visual fidelity seen in feature films, all from a single image.”

Loom counts Jeremy Bailenson  – plus Halo creator Alex Seropian  – among its advisors, and has an otherwise impressive pedigree, with a founding team that includes visual effects and animation veterans from LucasFilm and DreamWorks. Ramasubramanian worked on films such as Shrek, while CTO Kiran Bhat was R&D facial lead on The Avengers and Pirates of the Caribbean.

These are the same types of techniques used in films such as The Avengers
Share on X

Loom.ai just announced today that it raised a $1.35M seed round from a range of investors including Y Combinator and Greg Castle from Anorak Ventures, who was a seed investor in Oculus.

“Easily getting your likeness into the digital world has widespread applications,” says Castle. “The impact of experiences is significantly increased when you can visualize yourself in a game, simulation, communication environment or advertisement.”

Bailenson believes this approach will revolutionize how avatars are made, bringing a greater sense of copresence to virtual and augmented reality by giving us avatars that are lifelike and can be both animated and stylizized.

“This is important because social VR is likely to be the home run application in VR,” he explains. “And that all starts with building avatars that look and behave like their owners.”

Article originally published on UploadVR

These 3 companies are working to give us better bodies in VR. via @alicebonasio #VR https://t.co/cWaoofyYEU pic.twitter.com/eL7YoCXw7K

— Upload (@UploadVR) December 13, 2016

For companies looking to get into VR/AR/MR our Virtual Reality Consultancy services offer guidance on how these technologies can enhance and support your brand strategy.

Alice Bonasio is a VR Consultant and Tech Trends’ Editor in Chief. She also regularly writes for Fast Company, Ars Technica, Quartz, Wired and others. Connect with her on LinkedIn and follow @alicebonasio and @techtrends_tech on Twitter.

The post What does the Future of Avatars Look Like? appeared first on Tech Trends.