Virtual reality and head-mounted displays

[2/2012] News: zSight HMD now available on eBay

Fri, 10 Feb 2012 08:00:00 +0000

The zSight HMD is now available on eBay for quick and easy purchase

[2/2012] Blog: When is a Smart Device Really Smart?

VRGuy — Wed, 08 Feb 2012 20:36:00 +0000

(slightly philosophical)

There is a glut of device categories that have 'smart' in them: smartphones, SmartTV, Smart Camera, and of course, our favorite SmartGoggles

What is it that makes a device Smart?

Quite often, it seems that Smart, in the context of devices, is synonymous to connected. A SmartTV is actually an Internet-enabled TV. Smartphones used to be just integrated phones: camera, organizer, mp3 player, phone and then advanced to being connected to a data network. By itself, does that make them smart? I don't think so.

When we speak about humans, smart is another word for intelligence. We don't say that a person is smart because he is well-connected (lots of friends on Facebook?), but because he is exhibiting intelligence.

I don't think the Stocks application on the iPhone is smart because it just retrieves stock price from a database. One could argue that the Siri application on an iPhone 4 is smart because of its natural language processing capability and seeing ability to understand what you mean with your query.

Going back to goggles, I don't think goggles should be called smart just because they are Internet-enabled. It's the extra layer of intelligence and understanding that makes it smart. Goggles that sense that your head is pointing north are just a sensor. Goggles that sense that you are running require additional intelligence. Goggles that display context-sensitive information based on location, time, calendar, proximity, and more are even smarter.

[1/2012] News: Sensics reports record year and announces expansion into larger markets

Mon, 30 Jan 2012 08:00:00 +0000

Firm Now Offers Professional HMDs starting at $9,995

[1/2012] SmartGoggles: Media coverage of SmartGoggles

Thu, 26 Jan 2012 14:10:44 +0000

There was a lot of coverage for the SmartGoggles at CES. Here is a video reviews:

and a full article in Gizmag

Washington Post: top 15 gadgets at CES

CES 2012 Interview: Virtual Reality Gaming with… by NickMcCandless

]]>

[1/2012] SmartGoggles: SmartGoggles with a Smart Phones

Mon, 23 Jan 2012 15:39:37 +0000

One demo that was often overlooked at CES was a demonstration of the Natalia SmartGoggles together with a smart phone. For the purposes of the demo, we used a Motorola Droid Razr that was paired with the SmartGoggles. A 3D gaming application was running on the Droid, and the SmartGoggles were used both as a display mechanism – to show the 3D video – as well as an input device which captured the user’s head movements and sent them to the phone. Thus, while SmartGoggles can certainly run applications on the goggle itself, they can be paired with phones, tablets or PCs to work in tandem. This is particularly useful if you already made a content or application investment in the non-SmartGoggles platform.

An interesting twist in the demo was the game navigation itself. Our content partners developed a very nice interface which used the touch screen of the phone to navigate in space.

We believe this is an early sign of some excellent phone-centered applications.

]]>

[1/2012] Blog: CES and the promise of falling micro-display prices

VRGuy — Mon, 23 Jan 2012 09:34:00 +0000

One of our takeaway from the recent Consumer Electronics Show was that micro-display prices will be dropping nicely in 2012, which is good news for anyone clamoring for high-quality HMDs at lower costs. As I wrote previously, the cost of micro-displays has a big impact on the final cost of HMDs, so a substantial reduction if costs can allow companies to reduce prices on HMDs in the hope of reaching a broader market.

At CES, both on and off the show floor we saw evidence of micro-display prices coming down, both with new companies offering micro-display solutions, existing companies presenting 720p or higher solutions at affordable costs, or very large companies professing their ability to use large-screen technology to create economical micro-displays.

I believe all of these trends would also create downward price pressure on the established micro-display providers like Kopin/4DD and eMagin, unless they want to focus on higher-end military-type solutions.

At the same time, companies like Sensics are going beyond the traditional "an HMD is a microdisplay plus a lens" paradigm to offer smarter goggles and extra features. This combination of reduced component costs and valuable capabilities should make for a fascinating 2012.

[1/2012] SmartGoggles: SmartGoggles FAQ

Fri, 20 Jan 2012 14:16:29 +0000

In recent weeks, we received numerous questions about SmartGoggles. Here is a brief summary.

What are SmartGoggles?

SmartGoggles are a new type of virtual reality goggles. SmartGoggles are to goggles what smart phones are to phones. By adding a CPU, an operating system and the ability to install applications, smart phones became much more than just phones. By adding a touch screen, smart phones made it easy to interact with these new features and applications. SmartGoggles follow the same route. By adding a powerful CPU, initially running Android, SmartGoggles can run numerous applications right on the goggles. By adding the unique ability to monitor hand movements, SmartGoggles add a powerful way to interface with the goggles. At the same time, SmartGoggles are still goggles: they have a 3D display, wide field of view, head tracker and more.

What version of Android are you running?

Natalia, the first SmartGoggles product, runs Android 4.0 “Ice Cream Sandwich” on a 1.2 GHz, dual-cord processor.

When can I buy one?

If you are a corporate or government customer, you can buy SmartGoggles now. If you are a gamer or consumer, you should know that Sensics – the SmartGoggles manufacturer – is working to partner with consumer electronics companies to bring a consumer version of the SmartGoggles to market. We hope to have those later this year.

I would like to develop SmartGoggles products. Where do I start?

If you are a manufacturer and are interested in developing SmartGoggles products or licensing some or all of the SmartGoggles technology, please contact Sensics.

Is Natalia battery operated?

Yes, Natalia can run off rechargeable batteries or off a standard 5V power supply. Depending on the application, the batteries typically hold 1.5 to 2 hours before recharge. There are two batteries inside Natalia and they are hot-swappable, meaning that you can replace one while the other one is used to power the device.

What is your screen resolution?

Natalia, the first SmartGoggle product, has dual 1280×1024 (SXGA) OLED displays. It can also run them in 1280×720 (720p) mode

Can the goggles display 3D?

Absolutely. By including two displays – one for each eye – you get the most natural 3D experience and avoid any crosstalk sometimes associated with 3D TVs.

Are SmartGoggles fully immersive or see-through?

SmartGoggles is a technology and an architecture. Various manufacturers can create different versions of SmartGoggles. The initial product, Natalia, is fully immersive. We expect see-through versions to come to market as well.

Can I use SmartGoggles with my phone or PC?

Yes. You can use SmartGoggles in three different modes:

Standalone – with the application running on the SmartGoggles.
Paired – application runs on a phone or tablet, and the SmartGoggles serve as both a display device as well as a user interface device.
Classic – SmartGoggles connect to a PC and function just like classic goggles.

]]>

[1/2012] Blog: Mindless goggles not going away anytime soon

VRGuy — Fri, 20 Jan 2012 23:51:00 +0000

A reader writes:

"Hi,
You mentioned that goggles of the past were mindless monitors.

I would love mindless goggles provided that they had head tracking and a decent resolution and viewing angle, a bit like those uber expensive sensics ones. :-)

Will you one day release such a product? I am talking flight sim, racing sim, first person shooters. Sony seems to be the only one with something close at the moment but the field of view does not cover the full 180 degrees. If it did, the resultion would need to improve a lot."

Thank you for the input.

I think mindless goggles are not going away anytime soon, just like flip phones are still around (though their primary market these days are young kids and senior adults). Mindless goggles will most likely continue to be cheaper and offer somewhat of a limited experience. A starter kit, before you upgrade to SmartGoggles?

For one thing, SmartGoggles are not fully commercialized quite yet. Based on the wave of enthusiasm and support, I am sure they will be quite soon.

My company is happy to be mentioned in the same sentence as SONY, and we are glad to be impacting the discussion. Imagine how cool it would be if SONY decided to license SmartGoggles technology and make their media viewer a smart goggle - one with full head and hand tracking, wider field of view, higher resolution, untethered, and an Android processor on board. You could immerse yourself in PlayStation games, or even play them in a limitless and omni-directional tracking area. Or, you could connect to a SONY tablet or XPERIA or VITA and add intelligence, immersion and 3D to all the nice features that already exist on these devices.

[1/2012] Blog: One of my favorite CES exhibits

VRGuy — Tue, 17 Jan 2012 09:21:00 +0000

Back from CES, where my company launched the SmartGoggles to substantial press, partner and customer excitement (see the verge, for instance)

One of my favorite exhibits at CES was the Smart Window by Samsung. It is a large transparent window that allows graphical overlays on top of the see-through pane.

Historically, see-through technology has been pretty much limited to heads-up displays and see-through goggles, all of which are fairly small in size. The Smart Window makes see-through panels that are much larger. If you couple this with some ability to modulate the intensity of light coming through the window (e.g. electronic shades), you can truly see the window of the future.

The micro/macro comparison in displays is interesting. For instance, there is a lot of effort on behalf of large companies to create ever-larger high-definition OLED televisions (Samsung and LG both introduced stunning 55" OLED TVs at the show), but all that innovation has not yet made it into micro-displays. Other than SONY, perhaps the really big companies are not yet convinced there is a very large market for OLED micro-displays. Such commitments would help drive down the cost for micro-displays, and make high-performance goggles substantially more affordable.

[1/2012] SmartGoggles: Casual demos at CES 2012

Sun, 15 Jan 2012 03:13:56 +0000

At CES 2012, we had the opportunity to perform quite a few demonstrations of our products to customers, partners and members of the press. As you can see below, they seem quite popular. Here is an example of a Natalia gameplay sequence. Clearly, the player is very engaged and is in the game as opposed to just controlling a character from over the shoulder.

Demonstrations of both existing and new products elicited many smiles, some of which we were allowed to capture:

]]>

[1/2012] New video: At CES 2012, we had the opportunity to perform quite a few demonstrations of our products to customers, partners and members of the press. As you can see, they seem quite popular. Here is an example of a Natalia gameplay sequence. Clearly, the player is very engaged and is in the game as opposed to just controlling a character from over the shoulder.

Sensics — Sat, 14 Jan 2012 06:08:27 +0000

At CES 2012, we had the opportunity to perform quite a few demonstrations of our products to customers, partners and members of the press. As you can see, they seem quite popular. Here is an example of a Natalia gameplay sequence. Clearly, the player is very engaged and is in the game as opposed to just controlling a character from over the shoulder.

[1/2012] SmartGoggles: Multi-modal interfaces and the SmartGoggles

Thu, 12 Jan 2012 14:05:00 +0000

SmartGoggles are virtual reality goggles with a on-board application processor, hand and head position tracking, a built in-microphone and expansion options such as USB. With SmartGoggles, user interface becomes simpler.

For instance, imagine that you are playing a game and you the game asks you to make a simple yes/no decision. With SmartGoggles, you can answer in multiple ways:

Say “Yes”, and have the Android processor on board use voice recognition to understand it.
Nod your head. Since head movements are monitored, a gesture engine on board can understand the movement.
Reach out in space and tap a “yes” area with your hand. Since hand positions are understood by the SmartGoggles, it can tell what you mean.
Use an external device such as a wireless game controller to indicate this selection.

What is the best way to do this? It depends. If your hands are busy, you might want to speak or nod. If you like voice interfaces, just say “yes”

]]>

[1/2012] SmartGoggles: What smart phones teach us about SmartGoggles

Wed, 11 Jan 2012 14:45:38 +0000

Technically speaking, what made smart phones so much more useful than flip phones? Two main things:

An operating system, such as iOS or Android, running on a sufficiently-strong processor, that allows adding applications to the phone, thereby endlessly expanding its based functionality. At the same time, basic phone functions are kept or enhanced
Enhanced user interface – usually a touch screen – that allows the user to conveniently interact with the phone

Given this, it’s no surprise that we adopted the same approach to make SmartGoggles so much more useful than traditional goggles:

An open operating system, Android 4.0 in the first product, that allows access to numerous applications as well as allows executing them locally – on the goggles. At the same time, maintain traditional goggle functions such as 3D viewing, head tracking and the ability to connect to external video sources.
Enhanced user interface – powered by the ability to sense hand motion – thus allowing easier interaction with the goggles

That’s why we believe that some day soon, most goggles will be smart goggles.

]]>

[1/2012] SmartGoggles: New Unity-Powered Gaming Experience for SmartGoggles

Sun, 08 Jan 2012 13:28:43 +0000

I had the opportunity to try an early version the new Unity-powered game delivered by our partner SideKick for the SmartGoggles platform.

Wow!

In the game, you are a big robot (called “HateBot”) that has serious anger management issues and goes on a destruction tour of a city. The game begins with simple Hatebot Hates and Total Annihilation levels in which sheer destruction is the goal. As the game progresses, your goals will become more complex, your enemies will grow stronger and the time limit for each mission will become stricter. You travel over different portions of the city: The financial district, Chinatown and the elegant shopping district will all be pulverized. Shady bankers, traffic wardens, pushy taxi drivers, lawyers and more: Hatebot must destroy a number of them in each level and the clock is ticking. Those pesky choppers and tanks aren’t helping either.

As you’d expect from a SmartGoggles experience, there are no wires. I just put the goggles on the head and the game started – no need for a game console, or PC or video cables that limit mobility. What makes it particularly exciting is that in this game, I am not controlling Hatebot, I am Hatebot. As I move my head, the scene changes, in full 3D of course. As I physically jump around, Hatebot jumps over tall buildings as soon as I leave the ground.

The version I tested uses a game controller (wireless, of course) to control Hatebot’s hands, but the final version in a few weeks will use our built in-hand tracking so that you will really need to swing your hands for Hatebot to take down buildings and helicopters.

You can see some screen captures at our partners page. Below is a video to how this game looks when played in a Kinect, but to see it in 3D, 360 degree mode, you’ll need to try it on SmartGoggles

If this is sign of things to come, fasten your seat belts.

]]>

[1/2012] SmartGoggles: Gearing Up for CES

Fri, 06 Jan 2012 15:05:04 +0000

The Consumer Electronics Show opens next week in Las Vegas and this is the first time we are participating as an exhibitor. We set up a private meeting place to showcase SmartGoggles technology as well as preview Natalia, the first SmartGoggles product. Our primary focus is on showing this to phone, tablet, PC, game console and content companies, and of course for the press. Parties interested in a demo should contact us to see if there are demo slots left.

Hopefully, next CES we will be on the open show floor for everyone to try.

Natalia is coming together nicely. Sure, it would have been great to have CES next month and not this month – more features would be truly ready – but we should have enough for a nice preview even next week.

A couple of units being assembled are shown below.

Feedback thus far has been wonderful. We can’t wait to get more during the show.

]]>

[1/2012] SmartGoggles: Sensics Introduces the Natalia 3D Goggles, Incorporating SmartGoggles™ Technology

Thu, 05 Jan 2012 05:01:36 +0000

Firm Unveils First Intelligent, Interactive 3D Goggles at CES

COLUMBIA, MD (Jan 5th, 2012) –Sensics introduces Natalia™, the first intelligent, immersive, and interactive 3D goggles based on its new SmartGoggles™ technology. Sensics’ Natalia is a fully-immersive 3D goggle that combines the resolution and field of view found in professional head-mounted displays, the unique ability to run powerful applications on board, and real-time, 360-degree tracking of the hands from the user’s perspective.

“The ability to use interactive goggles without wires and without the need for an external computer opens up new opportunities for applications that benefit from limitless tracking area, greater portability, and on-board intelligence,” says Yuval Boger, Sensics Chief Executive Officer. “Imagine being able to use hand movements and gestures to wield a light saber in a game, to select a movie from a media library, or to interact with augmented reality content,” explains Boger. “The possibilities are endless.”

Natalia features a 1.2 GHz, dual-core processor running Android 4.0 on board, strengthened by a powerful graphics and 3D accelerator and 1 GB of memory. Its performance is comparable to top-shelf tablets or smart phones. It includes real-time, limitless-area hand tracking, as well as head tracking providing both angular position and linear acceleration data.

Natalia includes two high-brightness OLED displays supporting both 1280×1024 as well as 720p resolution. It can be operated with either hot-swappable batteries or external DC power. WiFi and Bluetooth allow Natalia to communicate with outside peripherals or other Natalia systems, download content and applications from the Internet, and more. An on-board SD card provides additional expansion options.

Through the libSensics™ applications programmers interface, developers can take advantage of the Natalia capabilities to enhance existing applications or create new ones.

Natalia can be used completely standalone or paired with a PC, game console, tablet, or phone.

Natalia will be offered to consumer electronics and phone manufacturers as a reference design using SmartGoggles “system on a module” technology. It also immediately will be available as a development platform to game developers, and be offered as a commercial product to the professional, academic, and defense markets. SmartGoggles-based products will be available to consumers in late 2012.

Sensics will provide private demonstrations of Natalia at the 2012 International Consumer Electronics Show, being held in Las Vegas January 10-13

For additional information about Sensics and SmartGoggles™ or to schedule a meeting at CES, please visit www.smart-goggles.com and www.sensics.com

]]>

[1/2012] SmartGoggles: Feedback, Features and Prices

Mon, 02 Jan 2012 14:56:10 +0000

The last few days since the SmartGoggles introduction have been gratifying. The level of interest and news coverage validates are belief that the time for smarter, better goggles has come. Just like smart phones changed the way we use phones, we hope that SmartGoggles will change the way we do personal 3D.

Several people have wrote to ask about prices and features of the SmartGoggles, so I think some clarification is in order. There are two separate topics: SmartGoggles technology and SmartGoggles-based products.

SmartGoggles is an underlying architecture and technology. It allows building a new generation of 3D gaming and entertainment platforms. Think about SmartGoggles technology as you would think about a brand new quad-core processor. Yes, the processor has a price, but the processor itself is not enough to run a game – you need to build a system around it. Fortunately, SmartGoggles makes building 3D, immersive systems faster and easier, but SmartGoggles technology by itself can’t run a game.

What Sensics is working on doing is licensing and partnering SmartGoggles technology to a range of consumer electronics companies: phone, tablet, game console and PC makers who want to either build a new 3D platform or extend an existing platform to new display, natural interaction and immersion frontiers. Our hope is that these partners will collaborate with Sensics on building exciting consumer-focused products.

These products can take different shapes and features: a fully-immersive product for the ultimate 3D gaming and entertainment; a see-through model that allows true augmented reality applications; a co-processor for a tablet that extends its power and applications to 3D and natural interaction and more and more.

In order to help partners realize the potential of SmartGoggles, and at the same time “eat our own dog food”, Sensics is developing a complete product based on this technology. This product will be offered as a reference design. It will also immediately become available as a development platform to game developers, and be offered as a commercial product to the professional, academic and defense markets. Initially, this first product will not be offered directly to consumers, as it is not initially made in a consumer-friendly price range.

What features would likely be found in such a first product? I would expect the following key features, divided into three categories: processing, interaction and audiovisual.

Processing

Dual-core 1.2 GHz ARM Processor with 1 GB of on-board memory
Android operating system (hopefully version 4.0 Ice Cream Sandwich)
Embedded 3D and graphics accelerators
External SD card extension
Bluetooth and WiFi connectivity for peripherals and networks
libSensics API that provides full access to on-board capabilities

Interaction

Head tracking: yaw/pitch/roll and X/Y/Z acceleration
First-person hand tracking in a limitless area
120 Hz head tracking updates, 60 Hz hand tracking updates

Audiovisual

Dual SXGA (1280×1024) OLED displays
Support for 720p
Embedded high-performance stereo headset
Embedded microphone

With this first platform, I would imagine a few games and experiences to showcase the capabilities. Expect lots of 3D fun!

Yuval

]]>

[12/2011] Blog: Expect 2012 to be a transformational year for HMDs

VRGuy — Sat, 31 Dec 2011 23:51:00 +0000

2011 was a 'business as usual' year as HMDs go. Sure, there were some new products and product improvements, but nothing earth shattering. At the same time, improvements in displays, motion sensing, augmented reality and processing power are coming together to enable 2012 to be truly transformational.

Sure, some nice progress was made in 2011 in HMDs:

Higher resolution OLEDs became part of a new generation of lighter, brighter HMDs such as the zSight.
Low-latency wireless video is moving into mainstream. I believe it will become a common accessory to HMDs, much like head trackers.
In general, companies like Sensics continued to improve their optics designs, packaging, level of integration and features of professional HMDs.

Having said that, I believe that what's truly going to impact HMDs - the professional models - and VR goggles - the consumer models in 2012 were recent improvements made outside the direct HMD realm:

Lower-cost micro-displays of 'good enough' resolution are becoming available. Once 720P displays are available for ~50$, the economics of goggles change, because displays have historically been a key cost driver for the HMD/goggle cost. What's the difference between a $10K HMD and a $15K HMD? $5K, of course, but otherwise there is no big difference in market penetration. It's hard to see why a $10K price would suddenly cause cause skyrocketing quantities whereas a $15K HMD did not. However, the difference between a $1K goggle and a $6K HMD, or better yet a $500 goggle to a $6K HMD would be huge as the $500 product would suddenly allow an entirely new group of users and entirely new class of goggle applications.
Motion tracking is improving - both inside and outside the HMD. Driven by new generations of cell phones, tablets and game controllers, embedded motion trackers with 6 degrees of freedom (X/Y/Z, yaw/pitch/roll) are becoming good enough and inexpensive enough to make it into practically every product. Not only does this this make them an automatic add-on to products, but their increased quantity in the market opens up new ideas and new development techniques to use them. Outside the HMD, the success of the Wii and the Kinect made it obvious how powerful gesture-based and natural interaction are, and these developments will soon make it into goggles, such as the new SmartGoggles offering.
Just like micro-displays are experiencing their version of Moore's law, embedded CPUs are continuing their march. New phones and tablets these days could have 1.5 GHz dual-core processors with embedded graphics and 3D accelerators. This is a very powerful computing platform. Because they are embedded in phones and tablets, these processors have to be lower-cost, power-efficient and small - all a perfect fit to embedding them into or alongside goggles. At the same time, having an open operating system like Android allows support of new hardware platforms as well as a nearly-endless supply of apps and content to consume.
The improvements in processing power as well as cost and resolution of embedded cameras have given a huge boost to augmented reality applications. Driven by phones and tablets, both the applications and the knowledge gathered while building them will become very useful for goggles.

All taken together, a new generation of goggles will appear. If the typical goggle in 2010 was a lens, a micro-display and a video cable, it will evolve to be much more in 2012/2013. Combine on-board processing, embedded motion tracking for head, hands and others, augmented reality power and lower-cost micro-displays, and the mindless HMD will now morph into something between a fully-fledged independent computing and user interface platform to at least a highly-sophisticated display and virtual reality co-processor for phones, tablets, consoles or PCs.

Sure, there will still be a market for traditional HMDs just like there is still a market for flip phones. Sometimes, users don't need the sophistication of the Smart Phone, or don't want to pay for the data plan or have some ruggedization requirement that can only be satisfied by a flip-phone. Similarly, a special defense packaging, an ultra-low cost or some other requirement will continue to keep traditional HMDs in the market for years. However, I believe true growth will come from the smarter goggles that will take advantage of the above technologies to create a more complete and compelling user experience.

Happy Near Year!

[12/2011] News: Sensics Introduces SmartGoggles™: a New 3d, 360-Degree Gaming and Entertainment Platform

Thu, 22 Dec 2011 08:00:00 +0000

Maryland-based Sensics plans to unveil SmartGoggles™, a new 3D, 360-degree gaming and entertainment platform at the 2012 International Consumer Electronics Show.

[12/2011] Blog: The SmartGoggle

VRGuy — Thu, 22 Dec 2011 21:55:00 +0000

Today, my company introduced the SmartGoggle, the solution for the common virtual reality goggle.
The issue with today's goggles is obvious: they are mindless; just a monitor on your head. Just like a monitor has a video input and will display almost anything you pipe into that video input, a traditional goggle will display that signal in front of your eyes. If you provide two signals, or side-by-side video, it can do so in stereo as well.

But a traditional goggle, like a monitor, requires an external video source. It can be a computer, in which case you can do something interactive. It can be your iPod, so you can use the goggle as a media viewer. Useful, but boring.

While all of this is going on, tablets and smart phones have become increasingly powerful in their computing and graphics capabilities. So, as we were thinking about how to make goggles better, it became obvious that putting some good processing power inside the goggles could do a lot of good. For one thing, you could run applications on the goggles and not have to carry around an external computer with you. The goggles, and these applications, could go with you anywhere, which is cool. These could be connected applications - streaming something from the Web, or these could be local applications such as those using an on-board camera to drive an augmented reality app. Yes, you should still be able to use an external video source to drive your goggle, but now you can also drive it 'from the inside'. This is a bit like the new crop of smart TVs that are becoming very popular. You could connect them to your cable provider or DVD player, but they can also stream a Netflix movie or surf the web using an on-board processor. So far, so good.

The problem of the user interaction still remains. Sure, you can put a head tracker so that the view can change as you rotate your head, but this is typically not enough for true interaction with the application. You can use an external device - a phone, joystick or even a Kinect - as input, but these approaches have limitations: you have to carry them with you; you have to stand in front of a sensor; you are limited in your tracking area; good, but not good enough for goggles.

We then started thinking: what if we put a camera that can track your hands and make that information - both in raw form as well as after gestural analysis - available to the application running on the goggle. That might be cool, because the hands go with you everywhere and because cameras on your head can often see your hands regardless of where you are and which direction you are looking at. Better yet, if we put an array of cameras on the head, we can get depth perception of the hand location as well as get a really wide tracking area. We call this 'first person hand tracking'.

Last, we realized that many goggles are essentially the same on the inside. Sensics, for instance, makes a commercial goggle and then repackages it into a different enclosure for training and simulation applications. Anyone wanting to build a goggle will need to cover several areas: driving displays; head tracking; video processing and more. Given this, it made sense to design a module that essentially encapsulates all these functions and allows goggle developers to focus on the design/styling aspects of the goggles rather than on building everything from scratch time and again.

We've been working on this for a while and are excited with the progress and the initial feedback we are receiving. If you combine these three innovations: on-board Android machine, real-time hand tracking from a first-person perspective, and a 'system on a module' approach for encapsulating most of what's needed to build a goggle, we think you get something. A SmartGoggle.

Remember when the iPhone came out and suddenly people started realizing that it's not just a phone, but much more than that? We think SmartGoggles can be to mindless goggles what smart phones are to flip phones. A major step forward, which we are very excited to take today.

[12/2011] News: Sensics adds linear acceleration sensing to zSight HMDs

Mon, 19 Dec 2011 08:00:00 +0000

X/Y/Z linear acceleration adds another dimension in sensing user activities

[12/2011] New video: 3D visualization Service (www.3DViz.com) was founded in 2002 to serve the private aviation industry. In the term of just a few years, it became the industry standard. Riding on a wave of success, the company added a second simliar industry in the high end niche: yachting. For many years, these two constitued the core of production of our company. As the time went by, so did the ammount of artists and volume of work. With two production facilities, 3dViz currently handles between 80 and 120 projects a year. Virtual reality technology and VR goggles from Sensics combine to bring a new level of realism and immersion to the presentation. This video was recorded at a recent trade show.

Sensics — Tue, 06 Dec 2011 20:04:04 +0000

3D visualization Service (www.3DViz.com) was founded in 2002 to serve the private aviation industry. In the term of just a few years, it became the industry standard. Riding on a wave of success, the company added a second simliar industry in the high end niche: yachting. For many years, these two constitued the core of production of our company. As the time went by, so did the ammount of artists and volume of work. With two production facilities, 3dViz currently handles between 80 and 120 projects a year. Virtual reality technology and VR goggles from Sensics combine to bring a new level of realism and immersion to the presentation. This video was recorded at a recent trade show.

[12/2011] Blog: HMDs are mindless - a monitor on your head

VRGuy — Tue, 06 Dec 2011 22:12:00 +0000

My company makes VR goggles (professionally called: HMDs), so when I say that HMDs are mindless (or stupid or unintelligent or dumb), it is with a somewhat heavy heart.

After all, HMDs are sophisticated devices. To build one, you need to understand optics, electronics, ergonomics, mechanical design and system engineering. You need to balance features with field of view with weight and comfort. HMDs are indeed sophisticated, but nevertheless mindless.

I call HMDs mindless because they are not much more than a fancy monitor on your head. Like a monitor, you need to connect an external video source: a computer, MP4 player, phone or tablet, to provide a signal to be viewed. If the video signal is provided by a cable, it limits your mobility. If it provided via a wireless video link, it cuts the cable but still provides limits on your distance from the video source.

The passive nature of HMDs is not just because it's a 'monitor on your head'. Unless you are content with using the HMD as a media viewer, you will want to interact somehow with the content and with the HMD. In today's products, you might have some push buttons on the HMD and you usually have a head orientation tracker than can let the application know where you are looking. This is a decent start, but most of the user interface experience - selecting menus, interacting with content, moving 3D objects around, still relies on external devices: a joystick, a mouse, a data glove and others. By the way, many wireless video links don't have the ability to send head tracking information back to the video source.

Sure, this is fine for some applications. Military training and simulation applications are sometimes OK with having the soldier being trained carry a computer on his back. Stationary applications (a tank trainer) or those relying on lots of peripheral equipment (such as an academic research project measuring brain activity) can greatly benefit from today's HMDs, but is this enough for widespread use?

The promise of HMDs was to be able to take 3D content anywhere and interact with it in a useful way. Though more complex, it is just like how the iPod allowed us to take our music library with us anywhere and sufficiently interact with it to be useful. I don't think today's HMDs are fulfilling this promise for a broad-enough market.

Something needs to be done about it.

[11/2011] New video: Matt Szymansky VP Products at Mechdyne presenting in Sensics booth at I ITSEC 2011

Sensics — Tue, 29 Nov 2011 08:06:24 +0000

Matt Szymansky VP Products at Mechdyne presenting in Sensics booth at I ITSEC 2011

[11/2011] New video: GenFx flight sim with Sensics at I ITSEC 2011 - demo 2

Sensics — Tue, 29 Nov 2011 07:19:18 +0000

GenFx flight sim with Sensics at I ITSEC 2011 - demo 2

[11/2011] New video: Wireless HMD Sensics, Mechdyne and Unity demo at I ITSEC 2011

Sensics — Tue, 29 Nov 2011 06:59:42 +0000

Wireless HMD Sensics, Mechdyne and Unity demo at I ITSEC 2011

[11/2011] New video: WorldViz CEO Andy Beall presenting at Sensics booth at I ITSEC 2011

Sensics — Tue, 29 Nov 2011 06:14:21 +0000

WorldViz CEO Andy Beall presenting at Sensics booth at I ITSEC 2011

[11/2011] New video: Injected video spotter scope in Sensics booth at I ITSEC 2011

Sensics — Tue, 29 Nov 2011 05:42:50 +0000

Injected video spotter scope in Sensics booth at I ITSEC 2011

[11/2011] New video: iMove 360-degree video on Sensics HMD at I ITSEC 2011

Sensics — Tue, 29 Nov 2011 05:14:35 +0000

iMove 360-degree video on Sensics HMD at I ITSEC 2011

[11/2011] New video: GenFX CEO presenting flight simulator in Sensics booth at I ITSEC 2011

Sensics — Tue, 29 Nov 2011 04:28:14 +0000

GenFX CEO presenting flight simulator in Sensics booth at I ITSEC 2011

[11/2011] Blog: Gentex acquires Intersense

VRGuy — Fri, 25 Nov 2011 20:11:00 +0000

A couple of days ago, Gentex Corporate announced that it had acquired Intersense. Gentex makes various military products including helmets, eye protection devices, aluminized fabric and helmet-mounted displays. Intersense makes various inertial trackers.

I've had the pleasure of working with Intersense over several years, where we partnered on delivering virtual reality solutions for academic and defense markets. To many of our customers, Intersense has always been considered the 'gold standard' of tracking, which is why I find this acquisition disappointing.

The financial details of the acquisition were not published, so perhaps this is a big win for the shareholders of Intersense, but I feel the company will now take an even stronger defense focus and will thus miss the bigger consumer product opportunity.

It is ironic that the Intersense acquisition happened just a week after the Invensense IPO (INVN), which values Invensense at some $800M.

Founded in 1996, Intersense makes professional motion sensing products. Motion sensing is becoming more and more commonplace - just look at the Wii or the iPhone. Surely, Intersense had plenty of expertise in sensors and signal processing to offer a compelling low-cost product that builds off Intersense's professional reputation but offers a compelling price point.

As motion tracking became more common, lower-cost solutions started to appear. For instance, Sensics offers an integrated three degree of freedom (yaw/pitch/roll) head tracker inside the zSight professional HMD. Though the performance of the embedded tracker is not as good an Intersense IC-3, for instance, we found that for many customers it was good enough and saved them the need to pay a couple of thousand dollars for an external tracker. Intersense could have probably easily offered this lower-cost tracker, but they did not. Missed opportunity, I think, both for Intersense and for the market.

Good luck to the excellent team at Intersense, in whatever market you choose to serve!

[11/2011] News: Sensics to present new and improved products at I/ITSEC 2011 modeling, training and simulation conference

Wed, 23 Nov 2011 08:00:00 +0000

Sensics to present new and improved products at I/ITSEC 2011 modeling, training and simulation conference

[11/2011] Blog: Towards socially-acceptable goggles

VRGuy — Fri, 18 Nov 2011 21:13:00 +0000

Holiday season is fast approaching in the US and retailers are starting to offer attractive shopping discounts. A few years ago, my wife asked me to go to a home goods store during holiday season and buy some wine glasses. It was a cold day, and my cell phone was tucked inside my jacket while I was using an earphone in the store to speaking with my wife and decide together on which wine glass set to buy. At that time, mobile earphones were such an uncommon sight that several older ladies approached me - as I had appeared to be speaking to myself - to inquire if everything was OK.

How times have changed. Using a cell phone earpiece or Bluetooth device in a shopping mall - a complete oddity just a few years back - is now completely socially acceptable.

When would it and what would it take to have wearing virtual reality goggles become socially acceptable? Today, when I meet someone at a coffee shop and take out the goggles, people start coming over from adjacent tables to take a look. That's great if you want to sell goggles, but what would need to happen so that you can wear goggles in public unnoticed?

Clearly, the definition of what is 'socially acceptable' changes over time. Purple hair color? Diamond studs for man? Body piercing? Bluetooth headsets? All of these used to be outside the norm and now hardly worth a second look.

What were the motivations of the first people that stepped out of the 'socially acceptably' domain? Using a headset is probably about utility: it is more convenient, perhaps healthier. I don't think too many people used a headset because they felt it was overly aesthetic. On the flip side, there was little actual utility in dying your hair purple. A diamond stud doesn't make you hear better, but some think it makes you look better or draw more attention.

In the case of virtual reality goggles, we'll probably have to go the utility route. If you just want a pair of cool-looking sunglasses, just go to the store and buy cool-looking sunglasses!

What will goggles need to do so that they would be widely worn? If a Bluetooth headset is an audio extension of your phone, what will the visual extension of the phone be? Is it just about reading text messages or looking at driving directions without starting at the phone? What is the killer app? Write back to let me know what you think.

[11/2011] Blog: The Stark HUD 2020 Augmented Reality goggles

VRGuy — Mon, 07 Nov 2011 20:44:00 +0000

A few weeks ago, I wrote about the Stark HUD augmented reality goggles. These are not real AR goggles, but rather a clever promotion for Iron Man 2. Nevertheless, the video is compelling and worth reflecting on what it is so.

1. The goggles are visually attractive and appear to be 'socially acceptable' to wear. Though the definition of socially acceptable is fluid - just a few years ago it seemed odd to walk around with a Bluetooth headset - the closer goggles look like glasses, the better.

2. Information is context sensitive. The idea of context-aware computing has been around for quite some time, and there are patent filings on it dating at least 10 years ago. However, the availability of location-based services, and development in applications that know more and more about the user (Apple's Siri is a great new example), make the goggles useful much more than just being used as a media viewer.

3. The field of view appears wide, and resolution is good enough to read.

4. There is plenty of natural interaction with the device. The video demonstrates interaction using hands and voice commands.

5. No battery or control box. Science fiction, maybe, but still cool.

Will we really need to wait until 2020 to get them?

[11/2011] Blog: Steve Jobs and the HMD

VRGuy — Thu, 03 Nov 2011 12:19:00 +0000

The Web is buzzing about iTV, Apple's HDTV and what it could look like and do. Though Apple has filed some patents related to HMDs, it does not appear that Steve Jobs left us with an HMD design.

What would an HMD designed by Steve Jobs look like? What would it do?

As a business person, I want to build successful companies, and while success can be measured in many financial metrics, one aspect of a successful company would be a company that creates an emotional attachment with its customers.

My little personal story with Apple began many years ago, when I was about 12 years old and living in Boston. I was one of these kids that stood at the corner Radio Shack stores trying to do fun stuff with their TRS-80 computers. The personal computer revolution just started. IBM had not introduced the PC yet, and I wanted a computer of my own. My family lived in an apartment building which, for a 12-year old, was fertile ground do earn money babysitting. Lots of babysitting. Once I decided I wanted an Apple (other candidates were the TRS-80, the CompuColor and perhaps some others that I don't remember), I saved every babysitting penny towards the $1200 goal of getting an Apple II. My parents opened a bank account for me and I would stand in line to deposit $12 here, $30 there, until I reached the magic number and get my Apple II. Its serial number had 4 digits and it was that older model that had a reset key on the keyboard that, while spring loaded, was too easy to press and wipe out everything. I spent hours and hours programming, playing and hacking on that computer. Many years later, my mother donated it to a local school - it was the right thing to do but I miss my old Apple II. I can't say I miss any of the numerous PCs I've went through since.

What was so good about that Apple II? I loved its design. It was open so that you could plug cards inside. It was simple to use and "it just worked" year after year after year. That allowed so many people to write cool software and so on in a vitreous cycle.

What can we learn from Apple about HMDs?

Design matters. Make people want to use or - in the case of HMDs - wear your product
Keep it simple. Plug and play. No drivers to install. No configuration to go through. "It just works".
Open it up so that value could be added outside your company.
Price matters, but you don't have to be the lowest-cost product to succeed
Make it simple to use content that you already own
Humanize the product, if possible.

[10/2011] Blog: Realistic oil&gas plant simulation with an HMD

VRGuy — Sat, 29 Oct 2011 09:57:00 +0000

Our partner VRContext released a video demonstrating walking inside a sophisticated plant using an XBOX 360 controller and a zSight HMD.

What I find particularly appealing about this video is the level of detail. Walking through the plant (while hearing your footsteps, no less!), you say layers and layers of pipes, pumps, floors, etc. This is possible through integration with real engineering databases. Since the plant is already designed, why not use the same databases to ensure safer, lower-cost operation?
I can certainly see why learning about this plant in a comfortable, virtual setting, will prepare the operator for true troubleshooting and maintenance when needed.

[10/2011] News: VRContext and Sensics jointly announce the release of WalkInside running on the zSight HMD

Thu, 27 Oct 2011 08:00:00 +0000

Truly immersive training experience with HMD and Xbox 360 Controller-driven navigation

[10/2011] New video: The Sensics SmartGoggles are a new 3D, 360 degree gaming and entertainment platform. This video introduces the SmartGoggles concept.

Sensics — Thu, 27 Oct 2011 11:57:08 +0000

The Sensics SmartGoggles are a new 3D, 360 degree gaming and entertainment platform. This video introduces the SmartGoggles concept.

[10/2011] News: Sensics expands "Sensics Inside" Licensing Program

Mon, 17 Oct 2011 08:00:00 +0000

Shortens time-to-product for development teams by offering complete optical, electronic or mechanical subsystems

[9/2011] Blog: Cloud watching with an HMD

VRGuy — Tue, 20 Sep 2011 23:16:00 +0000

Below is a comic strip, not an instruction manual, but I guess it is possible to try this at home. Some notes after the comic strip.

Normally, when placing stereoscopic cameras or rendering a virtual image, it is important to try and match the actual distance between the eyes. That's why 3D camera rigs try to minimize the distance between the cameras, which are pretty large:

Having said that, there is no depth perception in such a large distance as looking at the clouds, so substantially increasing the distance between the eyes might create some 3D effect.

[9/2011] Blog: Preview to thoughts about Augmented Reality goggles

VRGuy — Sat, 17 Sep 2011 22:36:00 +0000

One of the followers of this blog asked what I think about augmented reality goggles. Great question, worth discussing in more detail. In short, I don't think today's solutions are there yet, partially because of technical limitations and partially because of the currently-available applications. More on that soon. In the meantime, this video shows what good augmented reality would be like.

[9/2011] Blog: The VR goggle as a media viewer

VRGuy — Thu, 15 Sep 2011 22:32:00 +0000

Several VR goggles (such as the Carl Zeiss Cinemizer) present themselves as media viewers, which translates to a really cool way to watch movies from your iPod.

Is there really a significant market for VR media viewers?

Have you ever gone to a movie theater to watch a movie alone? Sure, when I travel, I sometimes go to restaurants alone, but I don't remember going to a movie alone. Isn't watching a movie alone what VR media players are designed for?

I tried researching how many people go to see movies alone and could not find the answer. There are tons of movie stats from the Motion Picture Association of America, the movies alone is not one of them. Googling this brings up pages titled "Do you ever go to the movies along and feel weird for doing it?"

People watch movies alone at home, but then they can use a TV and don't need a low-resolution set of goggles to do so (Cinemizer had 640x480 pixels, though perhaps has gone up since). Watching movies on a plane is a potential use, but wouldn't an iPad or other tablet be a better experience? Privacy is a plus when using goggles, but would you really spend $500 on a pair of goggles only to use them on a plane to watch movies that you are uncomfortable having your neighbor see?

Sure, I get using an iPod, not to mention that since as of Dec 2010 "only" 297 million units were sold, there is clearly a big market. You can do other things while using an iPod, but you can't do much when watching a movie on a set of VR goggles.

So, I don't get it. Any ideas?

[9/2011] Blog: A 3D look at the Vuzix financial reports

VRGuy — Sat, 10 Sep 2011 23:56:00 +0000

In the spirit of the previous financially-related post, I decided to take a look at the Vuzix (VZX.V) 2nd quarter SEC 10-Q filing and see if there is anything interesting to share from a market direction standpoint.

Some disclaimers: I am not a financial adviser and I don't make stock recommendations. You should buy or sell Vuzix stock based on what you read in this post. It is just my opinion as an individual fairly versed in virtual reality, not a Wall Street person. Also, I don't own Vuzix shares so I don't stand to gain or lose if their share price changes. This analysis is fully based just on the public information contained in the 10-Q.

Having said that, let's take a look at some of the interesting nuggets in the report, in no particular order:

VR Market-focused:

Sales of what the company calls consumer eye wear products are in decline. It sold $1M of consumer products in the first six months of the year compared with $2.2M in the first six months of 2010.
Sales of defense products, such as eyepieces, are on the rise.
The company notes that demand for their consumer eye wear has declined for two reasons. The first is that they pre-announced a higher-performance product which they did not deliver yet, causing customers to slow down their purchasing. The second is that the iPad and other high-resolution tablets are used as media viewers instead of goggles. Personally, I don't fully understand the market need for goggles as video viewers: Resolution on the low-end products is fairly poor (I don't think that Vuzix has an HD product - not even HD720 - in that category); Privacy is not truly needed unless you are viewing certain kinds of media in public places.
The company says it is going to place lower emphasis on consumer products and phase out some of their low-end products. Instead, they will focus on the defense market and upscale products such as their recently announced $5K augmented reality glasses which is priced for academic research (a fun, but not very large market). I can understand the attraction of the defense market. Sales are less sporadic (Vuzix reports a backlog of $3.8M on page 18); margins are higher. But, how large can this defense market really get?
It seems that Vuzix which is/was known for consumer goggles as trying to move uptown in price, whereas professional HMD providers are being encouraged to produce affordable mass-market products. As the saying goes: "The grass may look greener on the other side, but believe me, it's just as hard to cut."

Financially-focused:

Cash is getting tight (page 2). Cash on hand + accounts receivable was approximately $1.8M at the end of Q2, as compared with approx $4M at the end of 2010.
Accounts receivable ($1.2M) is substantially lower than accounts payable ($3.1M)
Customer deposits (these are typically pre-pays or down-payments) are nearly $900K and are higher than cash on hand (approx $700K). Without down payments, the company looks like it would be in a difficult financial situation.
Inventories ($3.8M, page 2) are more than twice the second quarter product sales (about $1.7M, page 11). Since inventory is typically recorded at cost yet product sales reflect actual prices, this is even more startling. Assuming material cost is the primary driver of cost of sales, and looking at Q2 cost of sales ($1M cost on $1.7M product revenue), $3.8M inventory could be enough for more than $6M worth of product sales, which are at least 9 month's worth of sales. It would appear that Vuzix is sitting on really large inventories. Are these obsolete parts? Do they have very long-lead items that require substantial stocking? Were they planning for much higher sales? Page 7 shows the breakdown of the inventory and shows more than $1M of finished goods waiting to be delivered or sold. On page 17, the first item mentioned in discussion on how to improve cash position is "managing our working capital through better optimization of inventory levels."
There are two loans totaling over $400K made to the company by one or two of its officers. Clearly, cash is a bit of a struggle. There is also accrued compensation of over $100K to be paid in the future to officers.
There is an interesting margin discussion on page 14. Apparently, video eyewear is not a truly profitable business. Augmented reality is a bit more, but the best business from a gross profit perspective is engineering services related to the defense side of the business.
The shift away from consumer products is reflected in lower sales and marketing costs, which the company notes are in part due to reduction in catalog advertising costs (Skymall?)

It's great to have a small public company to provide everyone with some market data on virtual reality!

I think Vuzix was tempted to try and create a substantial consumer market for goggles by offering reasonably-priced, nice-looking products. In my opinion, the experience is just not compelling enough both in terms of resolution/field of view and also in terms of content (games/movies) that can take advantage of the goggle capabilities. As such, not enough goggles are being sold and the company is perhaps unable to get the economies of scale it was hoping for as well as to cover its relatively fixed costs for product development and advertising.

Would the company's product fared much better if they were offered by a bigger brand (e.g. Apple), or is there some other missing ingredient needed to break open the consumer market?

[9/2011] Blog: Popcorn carts and the economics of HMDs

VRGuy — Mon, 05 Sep 2011 19:43:00 +0000

The Sensics YouTube channel received a comment noting that for the price of an HMD, "I might as well build a 30' theater room onto my house with stadium seating and a popcorn cart. Please explain how that price is justified, I'd love to hear it.".

So, at the risk of being a bit wonkish, here are some insights on how the price is determined.

First, professional HMDs are currently made in small quantities. Let's try to figure how many:

A company making professional HMDs was recently listed in Inc magazine. Inc. reported their 2010 revenue as $4.8M. If the average price of an HMD they sell is $20K, and even if we assume that they sell nothing but HMDs, this company made 240 HMDs in 2010. Maybe my price assumptions are too high and they made 300 HMDs. Hundreds, not hundreds of thousands.
A small public company that sells consumer-type goggles released their second quarter financials. They sold approximately $720K of consumer goggles in the second quarter. If all of these sales were goggles, and these goggles were sold for an average price of $250, then they sold just under 3,000 units in the quarter. Thousands, not hundreds of thousands.

In contrast, there were approximately 10 million 3D televisions made last year. With quantities, come economies of scale: you can get parts cheaper, you can invest in manufacturing technologies to make cost lower, you can assemble HMDs at low-wage areas and so forth.

Aside from quantities, one needs to consider the cost of the components that go into making an HMD. Have you ever been with a friend at a restaurant only to hear why the components of the $15 salad probably cost $2.34? It's pretty annoying, but I'm going to do this a little bit for HMDs now.

Historically, the key difference between professional HMDs and consumer goggles was the resolution of the display and the width of the field of view. Professional HMDs had higher resolution and wider field of view. Many professional vendors, Sensics included, use 1280x1024 OLED microdisplays from another small public companies. We use these microdisplays because they are high brightness, low power, high contrast and have rich colors. However, they are expensive. On the open market, these displays (and other like them) could cost approximately $2500 each, so approximately $5000 per system. Yes, manufacturers like Sensics do get quantity discounts, but in my opinion the displays drive the cost of the product into a cost that is in line with a professional market. Once prices are in the range of a professional market, vendors perform their own price/quantity optimization. If you priced a hypothetical product at $20,000 apiece, you could sell a certain quantity. If you priced it at $18,000 apiece, you could probably sell slightly larger quantity, but not dramatically larger. On the other hand, you just lost $2000 of profit. Now, if you could price the product at $995 you would sell many, many more, but then you'd be selling it at a significant loss.

Of course, a direct relationship between cost to make and price to sell is not required. Does a basketball shoe suddenly become much so more expensive to make when an 'Air Jordan' sticker is placed on it? Not necessarily. It is just deemed to be worth more. Sensics is profitable, and the Sensics team would like to keep it this way. In fact, though customers clearly appreciate a discount when they can get one, customers are probably also interested in diversity and choice among HMD companies, so it's good to keep more of them around.

What to do? Priority one is to find a lower-cost solution to placing these dynamic images in front of your eyes. This could come from various places:

Find some lower-cost display. Imagine if TI started making displays just like they make DLP components. Imagine if Samsung, or Sharp, or Micron started to sell high-resolution OLEDs to HMD vendors. Then, prices could significantly come down.
Find some alternative display configuration that is not micro-displays.
Place one display in front of both eyes, though this could reduce the refresh rate that each eye sees.
The passage of time. Just like Moore's laws with CPUs, time brings higher resolution displays at a lower price point.

Last, but not least, what you can do with a 30' theater room and a popcorn cart does not fully overlap with what you can do with a professional HMD. Try carrying the room around from place to place. Try training a soldier with the popcorn cart. But, I am on board. Let's hear it for lower-cost displays that will enable making lower-cost HMDs.

[7/2011] Blog: Training using the zSight HMD and the Kinect

VRGuy — Fri, 15 Jul 2011 17:14:00 +0000

An excellent video showing how the Kinect can integrate with the zSight HMD to product a compelling and effective training scenario. Quoting the author of the video, David from 3DVia: "We made the choice to only use kinect to "watch" if the user is doing the correct motion he/she is supposed to be trained at: rotating the valve or walking. Engaging the body in the experience enables the trained person to take appropriate decision, based on a situation that is made as close as possible to the one he/she would face in an real emergency case The HMD also contributes to the presence of the virtual environment, stereo rendering have been disabled in the video."

[7/2011] Blog: 3D and the iPhone

VRGuy — Mon, 04 Jul 2011 11:09:00 +0000

Last year, when Hasbro announced the My3D, a 3D device, I was intrigued: how could a US list price of $35 support the cost of a micro-display, optics, control electronics and a decent enclosure? The answer, of course, is that it doesn't. The device does not have its own display - it houses an iPhone with specialized applications that present 3D images in side-by-side format; it does not have a motion tracker - it uses the iPhone's. It does not have drive electronics - for the same reason.

When the My3D came on the market in April, I immediately went out and got one. After all, buying gadgets is one of the few perks of my job. I downloaded the apps from iTunes, installed them on an iPhone 3GS and put the device to a harsh, un-scientific but brutally accurate evaluation: the teenager test. This is a test where I give a device to a bunch of teenagers and tell them "it's all ready to use; it's free of charge for you; just use it and tell me what you think". As expected, the first five minutes of the test were filled with 'wow - this is cool!' but from the sixth minute till this date, the My3D has never been used again. In contrast, the Motorola Xoom tablet, in spite of surprisingly poor video playback performance, has passed the teenager test with flying colors and is constantly being used.

Before discussing the upside, here are some of the things I don't like about the My3D:

The iPhone 3GS screen, when used in side-by-side mode and magnified through the My3D eyepieces, is nothing to write home about. The resolution is low and the fill ratio of the pixels
When using the My3D, your hands need to hold the device.
User interface is clumsy - holes are provided to insert the thumbs through the My3D enclosure and touch the iPhone screen

But there is an upside. The concept of using the phone (or tablet) to generate the graphics, provide the communication link, app store and perhaps even the motion sensor, is certainly valid. With phone and tablet CPUs becoming ever stronger (the Xoom has a dual-core NVIDIA Tegra) and with goggles supporting side-by-side 3D, you can get pretty good 3D experience without a PC.

[6/2011] News: Sensics adds predictive head tracking to zSight HMDs

Fri, 03 Jun 2011 08:00:00 +0000

Integrated predictive tracking algorithm helps improve user experience

[5/2011] Blog: The HMD and the fMRI machine

VRGuy — Tue, 24 May 2011 21:50:00 +0000

A couple of weeks ago, I returned from the annual meeting of the Vision Sciences Society in Naples, Florida. VSS is an organization of scientists who are interested in the functional aspects of vision. The VSS conference brings together in scientists from a broad range of disciplines including visual psychophysics, neuroscience, computational vision and cognitive psychology.

There is something nice about coming back to a conference year after year in the same location. You already know where to stay, where to eat or not to eat and are free to focus on enjoying the academics, the exhibition and the Florida sun.

Because VSS is primarily focused on academics, the show floor where my company and others exhibited was not often crowded, leaving exhibitors plenty of time to gleam knowledge from the poster sessions as well as chat with other vendors. The VSS show is dominated by eye tracking companies - most of which we've had the pleasure to work with - but HMDs such as the zSight and other (heavier and lower contrast) HMDs were also on display.

The academic crowd is this show is very diverse in their virtual reality experience. It was great meeting existing customers that we've worked with over the years, but just as fun demonstrating the HMD to researchers admitting that they have heard of head mounted displays but never got around to trying one.

A key part of many vision research projects is to generate visual stimuli. HMDs offer a superb vehicle for doing so, for several reasons:

Arrington Research Eye tracker inside a Sensics zSight

The ability to offer stereoscopic stimuli, thus also adding depth perception to studies about motion, color, recognition and more.
A good HMD is often immersive, meaning that it can block external distractions and make sure that the subject is focused on the stimuli inside the HMD.
The ability to integrate eye tracking inside the HMD.
The ability to engage peripheral vision, especially when using an HMD with a panoramic field of view

I had the opportunity to browse the poster session focusing on research involving fMRI. Functional MRI studies put a subject inside an MRI machine and generate certain visual stimuli. The brain function is then measured and analyzed. Some of these projects give scientific confirmation to seemingly obvious results and others open doors to deeper understanding of how people see. For instance, I saw a poster that confirmed that the brain produces different neural responses when presented with pictures of familiar people as opposed to non-familiar people. To me this falls more into the obvious category: if a picture is instantly recognized as familiar, doesn't recognition itself mean that the brain has a different neural response to it?

Some companies on the show such as Cambridge Vision Systems devise clever ways to inject visual stimuli into such a challenging magnetic environment such as an MRI, and even have the ability to do fMRI eye tracking. Really cool stuff. Over the years, we got asked several times of an HMD could be used inside an MRI machine either for research or as distraction to prevent claustrophobia. Unfortunately, our HMDs are not MRI compatible today, though I'm open to ideas on how to make one.

During a typical year, I meet different people that have different uses for HMDs: from training soldiers inside tanks to architecture and industrial design to academic research. The possibilities for using HMDs seem endless, and many people I meet have new and sometimes crazy ideas on what to do (such as the person suggesting HMDs as a way to revive the art of playing an ancient banjo). Regardless, I look forward to returning to VSS next year and learn even more.

[5/2011] Blog: Will Microsoft acquire Lumus Optical?

VRGuy — Sun, 15 May 2011 18:24:00 +0000

There is a rumor going around that Microsoft is negotiating the acquisition of Lumus Optical. Lumus is a startup company that developed a clever see-through eyewear. The company originally targeted both the professional (e.g. defense) market as well as the consumer market, though it reportedly sold off its defense business to focus on the consumer side. The public specifications of its product show a low-resolution (640x480), narrow field of view (27 degrees) display, but one that could be made to resemble a pair of normal glasses.

Publicly, Lumus has been keeping a very low profile. The most recent press release or news article on its Web site, for instance, is dated some two years ago. If it not for their promotion of the upcoming SID show, an outsider could conclude that Lumus is out of business.

Of course, it may very well be that this rumor is untrue or that the acquisition talks will not come through, but it's a good opportunity to analyze where such an acquisition could fit.

One place where a see-through display could fit is with the Microsoft mobile division as part of the Windows phone initiatives. A classic use case of a Bluetooth-equipped see-through display with a phone is showing the caller ID inside the glasses so that the user does not have to pull out or look down at the phone. With phones become more and more sophisticated, dynamic driving directions have also been discussed.

How much would people be willing to pay for such glasses and what would they cost to make? This has been a classic chicken-and-egg problem for goggle manufacturers, where price depends on quantity and quantity depends on price. If Microsoft were to bring this product to market, they could all but guarantee a large enough quantity to make these economical.

Another possible home for a see-through display ix the XBOX group. If motion sensing (e.g. Wii, Kinect) was the last big thing in gaming, 3D, immersion and freedom of motion could be the next. I find this a bit less likely that mobile because gaming often requires immersion and 27 degrees of FOV, at least for the current product, is far from being immersive.

One way or the other, such an acquisition would be a nice shot in the arm for all the goggle vendors trying to find their way to a mainstream market.

If Microsoft ends up acquiring Lumus, you've heard it first here! If they don't, I just might change the title of this post to "Should Microsoft acquire Lumus".

[5/2011] News: Sensics named finalist for Maryland TEDCO innovation awards

Fri, 06 May 2011 08:00:00 +0000

The Maryland Technology Development Corporation (TEDCO) announced today that Sensics has been selected as finalist in the organization’s first ICE Awards, recognizing outstanding businesses and individuals from TEDCO’s diverse portfolio of more than 300 seed and early-stage companies.

[4/2011] Blog: The 11.5M pixel HMD

VRGuy — Mon, 25 Apr 2011 11:11:00 +0000

A few weeks ago, we had the opportunity to ship to a customer one of our high-end HMDs, with a total of 11.7M pixels. Each eye in this HMD has 5.76 million pixels, about 2.7 times as much as an HD1080 signal.
The piSight 166-43 has a horizontal field of view of 164 degrees, which approaches the human visual field.

Building, testing and shipping such a high-end HMD is always a cause for celebration here. We sell lots of 120-degree and 60-degree products every year, but just a handful of the super high-end ones.

This particular piSight has 12 micro-dispalys per eye. The top photo on the right shows the complete HMD. The photo below it shows the eye modules: the left side of the image shows our patented tiled optics in front of the 12 displays, while the right side shows the screen configuration with the array removed.

It takes one or two computers to drive the HMD to its full potential, and we typically recommend driving it with four HD1080P or 1920x1200 signals which feed into our video processing electronics.

The field of view is just spectacular, as well as the level of detail across it. It is simply fun to see how immersive such product is.