Microsoft's HoloLens may soon recognise when you're stressed with decorating - and offer help
Could augmented reality help you do DIY? Microsoft's
HoloLens may soon recognise when you're stressed with decorating - and offer
help
• Patent
describes a holographic headset with sensors to track stress levels
• Sensors could
include a heart rate monitor and a perspiration tracker
• When the
headset detects rising stress levels it would present help options
• These options
would be tailored based on the task or the wearer's location
By Victoria Woollaston for MailOnline
Published: 11:01 EST, 15 May 2015 | Updated: 11:02 EST,
15 May 2015
Microsoft's HoloLens has, until now, been mainly touted
as an entertainment device.
But a new patent reveals the tech giant has much bigger
plans for the headset, specifically combatting stress.
The filing describes a holographic headset fitted with
sensors that would track a wearer's stress levels and offer personalised help
based on the task they are doing.
Microsoft filed the patent in November 2012 and it was
awarded this week.
Called 'Augmented reality help', the paper explained that
the system would comprise 'a head-mounted display device including a plurality
of sensors and a display system for presenting holographic objects.'
HOLOLENS AND STRESS LEVELS
The filing describes a holographic headset fitted with
sensors that would track a wearer's stress levels and offer personalised help.
A range of sensors would track heart rate, increased
sweat levels, brinawave activity and blood oxygen to register a 'stress
response'.
Cameras on the headset would then determine what the
wearer is looking at before attempting to identify that object and offer
relevant help.
An example given in the patent involves building a
bookshelf using flat-pack instructions.
If the user becomes frustrated with the furniture, their
heart rate increases. The headset recognises the change and scans the wearer's
field of view.
After spotting the instructions, and pieces of furniture,
a help menu appears to offer support that could include a step-by-step guide or
images of the finished product.
The augmented reality help program would be configured to
'receive user biometric parameters from one or more of the sensors, determine
the user is experiencing a stress response and present default help content.'
Example sensors are listed as a heart rate monitor, pulse
oximeter to measure the oxygen saturation of the wearer's blood, an EEG to
monitor brainwave activity and a perspiration sensor to detect sweat levels.
An electrodermal response sensor could also track changes
in the skin's electrical resistance.
Elevated levels in each area could suggest the wearer is feeling
stressed, frustrated or angry.
Cameras on the headset would then determine what the
wearer is looking at before attempting to identify that object and offer
relevant help.
An example given in the patent involves building a
bookshelf using flat-pack instructions.
If the user becomes frustrated with the furniture, their
heart rate increases.
The headset recognises the change and scans the wearer's
field of view.
After spotting the instructions, and pieces of furniture,
a help menu appears to offer support that could include a step-by-step guide or
images of the finished product.
'Numerous situations may arise in which a person may
benefit from assistance in a variety of contexts' explained the patent.
'In some examples, assistance may be available via a
mobile computing device using a search engine.
'However, depending upon the context, locating and
accessing such information in a timely and convenient manner may prove
challenging and in some cases impractical.'
HOW HOLOLENS WORKS
The HoloLens uses a visor to project 'holographic' images
onto the wearer's field of view.
It can project 3D images into the wearer's field of view
- making it appear as if screens, games and even people are in front of them.
It uses sensors to track the wearer's head to ensure the hologram
is in the same way.
A projection system then beams the holographic images
into the wearer's eye, fooling the brain into thinking they are real.
The headset also has a camera to track the user's hands,
allowing them to interact with the holographic images.
The patent doesn't
specifically reference HoloLens, but the gadget is a holographic headset
unveiled by Microsoft in January.
It can project 3D images into the wearer's field of view
- making it appear as if screens, games and even people are in front of them.
It uses sensors to track the wearer's head to ensure the
hologram is in the same way.
A projection system then beams the holographic images
into the wearer's eye, fooling the brain into thinking they are real.
The headset also has a camera to track the user's hands,
allowing them to interact with the holographic images.
Microsoft has not revealed exactly how the technology
works and has not confirmed the stress response sensors will be included on the
device.
The headset is still a prototype being developed under
the codename Project Baraboo, and Microsoft did not say when the HoloLens would
go on sale.
Microsoft has not revealed exactly how its HoloLens
technology works and has not confirmed the stress response sensors will be
included on the device. The headset is still a prototype being developed under
the codename Project Baraboo and Microsoft did not say when the HoloLens would
go on sale
A recent HoloLend demonstration shows a user converting
his living room into a giant touchscreen
Comments
Post a Comment