Microsoft's HoloLens may soon recognise when you're stressed with decorating - and offer help

Could augmented reality help you do DIY? Microsoft's HoloLens may soon recognise when you're stressed with decorating - and offer help

•     Patent describes a holographic headset with sensors to track stress levels
•     Sensors could include a heart rate monitor and a perspiration tracker
•     When the headset detects rising stress levels it would present help options
•     These options would be tailored based on the task or the wearer's location

By Victoria Woollaston for MailOnline

Published: 11:01 EST, 15 May 2015 | Updated: 11:02 EST, 15 May 2015

Microsoft's HoloLens has, until now, been mainly touted as an entertainment device.
But a new patent reveals the tech giant has much bigger plans for the headset, specifically combatting stress.

The filing describes a holographic headset fitted with sensors that would track a wearer's stress levels and offer personalised help based on the task they are doing.

Microsoft filed the patent in November 2012 and it was awarded this week.

Called 'Augmented reality help', the paper explained that the system would comprise 'a head-mounted display device including a plurality of sensors and a display system for presenting holographic objects.'

HOLOLENS AND STRESS LEVELS 

The filing describes a holographic headset fitted with sensors that would track a wearer's stress levels and offer personalised help.

A range of sensors would track heart rate, increased sweat levels, brinawave activity and blood oxygen to register a 'stress response'. 

Cameras on the headset would then determine what the wearer is looking at before attempting to identify that object and offer relevant help.

An example given in the patent involves building a bookshelf using flat-pack instructions.

If the user becomes frustrated with the furniture, their heart rate increases. The headset recognises the change and scans the wearer's field of view.

After spotting the instructions, and pieces of furniture, a help menu appears to offer support that could include a step-by-step guide or images of the finished product.

The augmented reality help program would be configured to 'receive user biometric parameters from one or more of the sensors, determine the user is experiencing a stress response and present default help content.'

Example sensors are listed as a heart rate monitor, pulse oximeter to measure the oxygen saturation of the wearer's blood, an EEG to monitor brainwave activity and a perspiration sensor to detect sweat levels.

An electrodermal response sensor could also track changes in the skin's electrical resistance.

Elevated levels in each area could suggest the wearer is feeling stressed, frustrated or angry.

Cameras on the headset would then determine what the wearer is looking at before attempting to identify that object and offer relevant help.

An example given in the patent involves building a bookshelf using flat-pack instructions.

If the user becomes frustrated with the furniture, their heart rate increases.
The headset recognises the change and scans the wearer's field of view.

After spotting the instructions, and pieces of furniture, a help menu appears to offer support that could include a step-by-step guide or images of the finished product.
'Numerous situations may arise in which a person may benefit from assistance in a variety of contexts' explained the patent.

'In some examples, assistance may be available via a mobile computing device using a search engine.

'However, depending upon the context, locating and accessing such information in a timely and convenient manner may prove challenging and in some cases impractical.'

HOW HOLOLENS WORKS

The HoloLens uses a visor to project 'holographic' images onto the wearer's field of view.

It can project 3D images into the wearer's field of view - making it appear as if screens, games and even people are in front of them.

It uses sensors to track the wearer's head to ensure the hologram is in the same way.
A projection system then beams the holographic images into the wearer's eye, fooling the brain into thinking they are real.

The headset also has a camera to track the user's hands, allowing them to interact with the holographic images.

 The patent doesn't specifically reference HoloLens, but the gadget is a holographic headset unveiled by Microsoft in January.

It can project 3D images into the wearer's field of view - making it appear as if screens, games and even people are in front of them.

It uses sensors to track the wearer's head to ensure the hologram is in the same way.
A projection system then beams the holographic images into the wearer's eye, fooling the brain into thinking they are real.

The headset also has a camera to track the user's hands, allowing them to interact with the holographic images.

Microsoft has not revealed exactly how the technology works and has not confirmed the stress response sensors will be included on the device.

The headset is still a prototype being developed under the codename Project Baraboo, and Microsoft did not say when the HoloLens would go on sale. 

Microsoft has not revealed exactly how its HoloLens technology works and has not confirmed the stress response sensors will be included on the device. The headset is still a prototype being developed under the codename Project Baraboo and Microsoft did not say when the HoloLens would go on sale

A recent HoloLend demonstration shows a user converting his living room into a giant touchscreen


Comments

Popular posts from this blog

Report: World’s 1st remote brain surgery via 5G network performed in China

Visualizing The Power Of The World's Supercomputers

BMW traps alleged thief by remotely locking him in car