The problem with hats.

A look at making HMDs fashionable.

70 minutes in heaven with the HTC Vive

Where the HTC Vive taking us?

The Myth of Virtual Reality

Let me give you a few examples of making common technology instantly dissatisfying by renaming it to something that contains lofty promise...

AKIRA in VR. (aka, working with large illustrated novels in VR.)

Spent a little time on working with a large collection of comics / illustrations in VR and this was the results. My primary interest is working with large bodies of materials and quickly being able to find a particular point of interest by visually looking for it in a 3D space.

Marketing VR in the year 2016 - Beyond Imagination

I've been thinking about VR's commercial launch. Not cardboard. Not a developer kit, no. I mean the honest to God, real deal, commercial release.

Ballroom Dancing

You build a beautiful VR ballroom and invite everyone to come. Everyone does, they wander around the ballroom, dance a few waltzes and exclaim that "Why, this is simply splendid! Isn't it dear?"

The Oculus Rift and Swimming Pools.

"I believe that VR won't play nice with our existing entertainment, it is a ravenous platform that will consume and utterly replace huge chunks of our current media and technology."

The hollow face illusion in VR.

VR strongly supports the exact same visual illusions that trick us in the real world. So, it is well worth studying these types of phenomena and seeing where they might be leveraged in VR.

Wednesday 23 September 2015

The problem with hats.

Let me begin by saying that I never give fashion advice.  Why?  Well, no one ever seems to ask me for fashion advice.


I like to think they are just terribly intimidated.*


* I might be wrong.



Here's a VR post about fashion.  Namely the issues with VR headgear and the problem of it not currently win a lot of points with people for style.

I have a couple of working theories on why this might be and possibly how we might come to deal with it.  All very scientific and research based.


Part I - The Baseball Cap Theory


Baseball caps.  They seem to ebb and flow between WILDLY POPULAR and PRETTY POPULAR at any given time.  If you do a quick Google search, using the search term "baseball cap" and pretty much any famous person, you will likely get a hit.  I had a pretty good streak going of finding anyone I looked for up until I tried Stephen Hawking, but he's British so the odds might have not been in my favor.

Go ahead and try it, see if I'm wrong. *  I'll wait here.


* I might be wrong




OK, now.  Let's change gears a bit and take a look at another bit of head gear called a "visor".  You can find these on Google as well.



Almost IDENTICAL to baseball caps in terms of form and certainly function, they are just missing the top part.  What can you see at the top?  A person's hair. *

* Unless they don't have hair, like the angry man on the left.

Now, rerun the same search as you did before subsisting "baseball cap" for "visor" + famous person's name. You'll notice that you have a much harder time finding a match, you'll also find that if you follow the image link for anyone you DO find, it will likely end up being tied to an article that mocks them.




Same celebrities, and as far as I can see basically the same functional baseball cap design only without the top and yet, we see nothing but scorn and ridicule.  It's even so notably bad that the stars get called on it later during late night tv.

"What were you thinking?!?!  HA HA HA!" "I know right?  What was I thinking?  HA HA HA!?!?!"


So..... what's going on?  These are people with great hair, but humans seem to react poorly to a head that is encircled halfway horizontally and yet favorably to a head that is fully covered.

Why?  I have no idea.  Research is required!

Part II - Flowing faces


Let's explore it a bit, shall we?  I'm going it has something to do with how important faces are to us in this world.  We are VERY sensitive to recognizing faces and we REALLY don't like it when something screws with the story a face has to tell.  What kind of story? Well...

Here we have Tom Cruise and the story of his face is something like this for our brain:  Eyes, Nose, Mouth.  Glance at the photo and I'm pretty much going to guarantee the first thing you look at on any face are the eyes and then you'll read the rest top to bottom.

OK, go!:




Pretty simple story right?  Eyes -> Nose -> Mouth.  Beginning -> middle -> end.


Now, our brain is fine with it, if we tell it the beginning and the middle of the story but leave off the end:  eyes, nose........


If fact, it starts to make up things to end the story like "Oh, Tom looks like he's peeking over a wall!"

Our brain also seems to be pretty OKish with this story having a middle and a end as well:  ....., nose, mouth.  In fact, without the eyes, we seem to go right to the mouth and work backwards.  Mouth, eyes.

We really miss eyes though.  Your brain will wander around and keep searching for the beginning of the story.  "Where are the eyes.... Where the hell are the eyes?"  You brain will keep muttering.  "Where ARE they goddamn it??!"







Want to know what our brains really DON'T like?  Having the story interrupted.  Eyes, Mouth.  Our brain just falls over and curls up at how wrong things have suddenly become with the world.








When our brains get irritated by something, the response oddly seems to creep up in the form of "this is silly / funny / weird / odd."


Modern fashion seems to recognize this.  You can cover up your mouth no problem and your brain does not start to giggle or lash out with mockery.



Cover up both eyes and we still seem to have a good grasp of "Everything is OK here"*

* except I can't find the eyes!  Where are the eyes!!?!


It is HARD however to find images of someone covering up their nose and breaking up the story flow of the face.  I had to ride Google all the way to Harajuku, Japan before I found a  consistent resource of images that involved of nose covering fashion.




This essentially is cheating as apparently you can find every God damn look you might possibly think of in Harujiku.



Anyhooooo....


Popular fashion seems to be related in some what to this concept of NOT breaking up a face horizontally.  At least this is what the boys in the lab are telling me.

This....is a problem for us.

There has been this hope that as VR progresses, the technology will get far better and far, far smaller.  The VR HMD (head mounted displays) of the future will be light and much smaller.  No wires, light weight....  So we'd go from THIS:



To something like.... this?



Or this...




Despite the thin size, our brains aren't particularly thrilled with these images.  The face flow is interrupted.

You might think it was hopeless, as did I, until I came across the work of Duster132 (https://duster132.carbonmade.com/).  When you get a chance take a look at some of his stuff, he almost exclusively deals with designs that have no visible eyes, yet all of them still have the appearance of being able to see. 

I think we can pull this off.  It seems to require molded hmds's that are broken up into uneven surfaces and soft materials intertwined with the hard surfaces.  I don't have all the answers but I'm going to recommend the following guidelines:

  • If you cover the eyes, you need to cover the head.
  • The geometry of the HMD can't be a horizontal line, you need to break it up and possibly introduce some kind of vertical drop, possibly a structure that could house stereo mics.
  • Involve hood scarfs of some kind.
  • The surface of the HMD needs to be varied, a flat plane is about the worst design you could come up with.  (which unfortunately is the current design choice for CV1.)




There is hope!  I hope you enjoyed this look at fashion, I might make it a regular thing! * 


* Once every 20 years sounds about right...




Give me a shout at @ID_R_McGregor  on twitter or send me an email at id.r.mcgregor@gmail.com.












Monday 21 September 2015

70 minutes in heaven with Valve's HTC Vive.


You belong to one of two groups.  

Either you received a development kit as a developer and you have unlimited access to a HTC Vive or you need to chase HTC's truck around North America for a shot at a 20 minute demo.

There is currently very little grey area to be found between these two camps.

What DOES exist can be found in private invitations from developers to try out the kits they've been given, something I recently had a chance to do.  I was able to put on HTC's solution and leave it on for a full 90 minutes. *

It made for a hell of an introduction...

* yes, I said 70 minutes in the title, but I was trying to do a "thing" with the title so....


Now.. writing this as I am in late September, I need to be careful not to simply repeat what you've already read many times before.  There have been dozens of great posts at this point describing the HTC Vive experience and I'm quite sure you don't need another one.

Instead, let's fast forward and talk a bit about where some of this "might" be going.

In no particular order....

- - -

Sudden glowing respect for haptics


I have a confession to make.  I've never given haptics much respect.  A controller rumble in my hand never seemed to have much to do with anything I saw on screen, and typically my most commonly felt emotion was annoyance at this crude feedback.

The Vive manage to change all of that in a few short minutes.  A lot of the haptic feedback the controllers seem to give you is in a subtle tap, just a way to let you know that something has touched something else in the world.  I'm now burning with curiosity to know more about how much fine tuning can be done here and what plans might exist for the future.

There's a lot of grumbling about VR and the fact that we can't stop a users from putting their head through a wall and having a look around.

The world isn't solid.  Quite true!  But that might not be the end of the story.

I have a feeling... that through haptics of the kind the Vive has on display... it might be possible to weave together a world that has a subtle resistance to every surface.  If you've ever touched a single strand of spider silk with a finger, you can feel it resist against your touch.  Yes, you can certainly push through it and break it,

 but the thread is most certainly there and you can run your finger along it.  I "think" we can reach a place through haptics where the world actually feels tangible.  The resistance might be very slight but as we come to know it may end up feeling perfectly solid




"Operators", hands and uncanny scale

When running a user through a VR experience, we've traditionally focused on the person wearing the headset, however, inevitably tucked away in a corner, there's a girl or guy running the show in front of a 2D display.  This is the person who cues up the next demo or gently guides the user away from a wall that has crept too close.  Or maybe simply screams profanity at them:

"If you bash my controllers one more f***king time into the wall I swear to GOD I'm going to...." *

* This actually didn't happen during my session, I was exceedingly careful.  It isn't good policy to anger a person while blind and deaf to the world around you.



I should mention that some of the most interesting things happened outside of the traditional demo loop. While I was in the Vive, we had a live Unity3D development session runnin and my host was able to add objects and locations to the scene on the fly.

Without warning I found myself thrown into the middle of a dusty street in a cartoony Western scene with the sun hanging low in the sky.


A few moments later, a revolver appeared in my hand.

All of this was done at the whim of the operator.  If you don't get to wear the headset this turn... maybe you'll be happy to settle for being a God instead.

Anyone remember this bit from bugs bunny?  The one where daffy duck is being toyed with by the bugs bunny the animator?


















Turns out, you can do the exact same thing in VR with an operator running the show, and it makes for complete insanity for both parties.

While waving my shiny new gun around, suddenly the revolver barrel was scaled up to the size of small car and...

....the feeling of power was ridiculous.

There's an unexpected gift that comes from being given hands in a simulation.  You've been given a reference point for scale that you never enjoyed before as a disembodied head.  Put your hand next to a lizard, if the lizard is smaller than you thumb... it is small.  If it is bigger than your hand... it is a big lizard.  If it far, far bigger than your hand... it might be a dinosaur.

Smaller than my hand... small lizard.

Bigger than my hand... big lizard....


Much bigger than my hand... probable dinosaur warning issued....


When your hands are represented in virtual space, you have a new appreciation for how big EVERTHING is due to the relative size.  This is especially true for anything that's within arm's length.  Virtual hands provide a very strong anchor to the world, not just through interaction but by working as tool to gauge size and distance.

So.... most importantly - what this means is.... if someone unexpectedly drops a revolver the size Honda civic in your hand, it's going to make an impression....

Depending on your frame of mind, you might start to cackling madly and try to shoot the sun out of the sky.  This I did.



All the laughing, must have gotten annoying for my operator, as just as quickly, my revolver was shrunk down to the size a pack of matches.  Just a tiny, little thing in the palm of my hand, still crisply rendered with the Vive, feeling absolutely real and about as dangerous as a butterfly.

So, you it appears you can take the same 3D model and convey huge impressions about "power" simply through scale.  Pretty damn neat, amazingly effective.



Later, I was thrown into another scene, an endless void of filled with floating cubes.  I appeared in mid air, floating above the infinite.  As I screeched, cursed and started to reel, the operator scrambled to throw a cube under me to serve as a floor for my feet and sanity.  Later, the box was resized and moved around at will by the operator causing me run around the room, desperate to simply stay on it and not to plunge to my death.

There is a GREAT deal of fun involving traditional 2D display users interacting with VR users that is waiting to be tapped.  Just simple cube manipulation and the prospect of falling is enough to be terribly entertaining for both users.

I am convinced there is absolutely no need to VR to be isolating to the user, after my experience I firmly believe that some of the greatest experiences will come from collaborative and competitive interaction between VR users and traditional 2D displays.  I feel that almost all VR experiences will have SOME kind of 2D interface that allow an audience to peer in on the world and possibly participate.

A sudden fetish for objects


Going back to that Western town and the gun I was given.  It was a simple revolver, the sort of thing you might get as part of a $5 set of weapons from the Unity Asset store.  Nothing terribly special.

And yet... I was captivated...

I could turn it over gently and examine it from all sides.  Since it moved so naturally in my hands, it felt overwhelmingly real.  Pointing it at my face out of curiosity*, I could make out the individual waiting bullets in each chamber.  I could not tell you the number of guns I've used in games over the last 20 years, hundreds, but this was the first time I stopped and actually admired the fine details of what I was holding.  It had a bit of writing on one side carved into the metal and I could hold it close and peer at the words to make them out exactly as you would do in real life.

* ...and this is why I don't own a gun.

I just stood there in the middle of the road, slowly turning the gun over in my hand like a unhinged psychopath or proud gunsmith.

Later on I had a chance to try Valve's Longbow simulation.

As I had found with the revolver, I took great pleasure in simply examining the bow in my hands and getting a feel for this "real" thing.  There's a much more personal connection to objects when you can see them rendered clearly and can manipulate them with precision.

Later still, I was standing in the middle of Job Simulator's kitchen, I picked up a knife and wanting to keep it handy, I actually looked for a way to tuck it into my waistband.  It was a very strong and unexpected need, a thought process that's never entered my head before despite the thousands of items and inventories I've managed over the years in games.

I think things are going to go in some unexpected directions.

Since there is so much connection with the "real" objects in the world, and the controls are so fine, I can easily see a kind of hyper realism coming to market in a big way.  Objects will increasingly have all the detail and modeled complexity of their real world counterparts.  There will be a delight in watching the components of a mechanism interact as one would expect and we will quickly become spoiled as we expect new levels of realism.

Some of this will end of being quite fun.

For example, here's a simple game:

You appear in a room.  Scattered around the floor are the following components:



Find them all and put them together before THEY break in.  You actually have to put the gun together in correctly.  Don't know how this model handgun is assembled?  Guess you have a problem...

You have 5 minutes, good luck....




I think there could be a whole set of games that evolve out building mechanical devices to solve problems and there's an audience out there that are going to take a special kind of pride out of knowing HOW thing work and are put together.  Whole new skill sets are going to be used in VR in the name of fun.

Body and soul


Keep an eye out for full body rendering quite soon, it seems like the next logical and necessary step.  You will look down and your body will be very accurately displayed and feel very "there".  Odds are quite good that this profound experience exists behind closed doors right now and will be a centerpiece of innovation in the year to come.  We've already seen examples, but I'm guessing when it hits, it will be REALLY good.

Once you have a body, you can have gear and decoration.  I expect that we might move away from virtual inventories and you'll be strapping things to your virtual self more and more often.

Valve's Longbow

I am going to get specific about a demo for a sec here, and only because in my own reading about Vive experiences it tends not to get mentioned much but for myself it was a really outstanding moment.

Valve's Longbow demo allows you to wield a bow and arrow and shoot at targets.  Now, I've only shot a real bow for an afternoon against paper targets but..... and this is an odd thing to say... I felt that the simulated experience was better.  Here are a few reasons why:

1.  You don't have to retrieve your goddamn arrows after shooting 3 times.  "Where did that last one go?  Over here?  Under this?  Why am I so bad at this?"

2.  While I enjoy the challenge of target practice quite a bit, a physical bow places demands on certain muscle groups that need to work together and not hopelessly fight each other, this requires training, tone and more time than I can commit.

3.  Real arrows make real holes in real things.  If you are learning or have bad aim this is a problem and a danger.  Valve's demo has balloons that rise up and present themselves as targets.  If I did this in real life, people would likely be punctured and come after me unless I hit them in a vital area.

Let me tell you a bit about this experience and it might tell you a bit about how engrossing this whole thing is..... when I first picked up the bow... I spent about a full minute just playing with the string... drawing it back and "feeling" the tension.  Before this demo, I never gave haptics much attention.... rumble feedback on traditional controllers always felt startling and unnecessary.  This single demo changed all of that for me and now I am fascinated.  As you draw back the string, you get slight haptic feedback that convincingly feels like you are placing tension on the bow.  I just stood there for a long time drawing on the string, back and forth, like some kind of psychopath or enthusiastic bowyer.

I didn't even consider firing an arrow for the longest time, it was simply fascinating to watch the arrow interact with the bow.  Maybe I'm easily amused...

Art and Objects


I got down on my hands and knees in Tiltbrush, chose the smallest size brush and scratched on the floor.

"Rob was here."

I was immensely satisfied with the results.  The writing was very, very small and almost impossible to make out when I stood up.  It was this little message that I wrote in my own hand, scratched into the virtual floor in the corner of my virtual space.  Something just for me, a little detail that you'd miss unless you looked for it.

So, in these very early days, we have a tool that has quickly proving that you can make artistic changes to a 3D space as easily and as intuitively as picking up a sharpie and finding a wall.  It is very exciting to think of virtual online games / environments / communities being hubs not just for "fun" but as places where art is being created and added to the world.



There's some fundamental urge in a lot of us to mark up the world around us and it seems like we are just on the verge of tapping into it in a big way.



It seems to follow that tools will rapidly evolve to the point where the act of crafting something in a simulation is just as common as destruction is now.



Closing


Hand input is compelling to such an extent that I don't think there is much of a future for any platform that does not make this an absolute priority to "get right".  Turns out, humans need to bring our body along in order to be fully present and accept a world as being "real".  Hands are the brain's our envoys to the world both real and virtual.

Give me a shout at @ID_R_McGregor  on twitter or send me an email at id.r.mcgregor@gmail.com.