{"id":84898,"date":"2019-02-25T17:17:29","date_gmt":"2019-02-25T17:17:29","guid":{"rendered":"https:\/\/news.microsoft.com\/?p=431495"},"modified":"2019-02-25T17:17:29","modified_gmt":"2019-02-25T17:17:29","slug":"new-hololens-2-gives-microsoft-the-edge-in-the-next-generation-of-computing","status":"publish","type":"post","link":"https:\/\/sickgaming.net\/blog\/2019\/02\/25\/new-hololens-2-gives-microsoft-the-edge-in-the-next-generation-of-computing\/","title":{"rendered":"New HoloLens 2 gives Microsoft the edge in the next generation of computing"},"content":{"rendered":"<div><img decoding=\"async\" src=\"http:\/\/www.sickgaming.net\/blog\/wp-content\/uploads\/2019\/02\/new-hololens-2-gives-microsoft-the-edge-in-the-next-generation-of-computing.jpg\" class=\"ff-og-image-inserted\" \/><\/div>\n<h2><strong>Technology for first-line workers<\/strong><\/h2>\n<p>Information workers \u2014 people who do much of their work at a computer to produce words, design things, respond to emails, manage people or make business decisions \u2014 have benefited from an explosion of technologies allowing them to learn nearly anything with the touch of a mouse and communicate instantaneously. That\u2019s driven unprecedented productivity gains for individuals and businesses.<\/p>\n<p>But most people don\u2019t work that way. People who use their hands to assemble, care for, repair, troubleshoot or interact with things have too often been an afterthought in this technological revolution. That\u2019s left an enormous opportunity to give first-line workers the technology they need to make similar productivity gains, said Lorraine Bardeen, Microsoft general manager for Dynamics 365 Mixed Reality at Work.<\/p>\n<p>\u201cThe first-line workforce in so many companies is vital not only to day-to-day operations, but also in the way they craft their products. And they\u2019re often the majority of employees,\u201d Bardeen said. \u201cAnd yet they\u2019ve experienced very little of the empowerment that technology has brought to people who work in offices or more traditionally compute-friendly environments.\u201d<\/p>\n<p>When Microsoft started asking companies about how mixed reality could benefit them, the same needs bubbled up across industries. They wanted help connecting workers in remote locations or disparate workplaces with experts to troubleshoot problems, in envisioning how equipment or furniture or physical objects will actually fit in three-dimensional spaces and in training new employees who need their hands free to perform work.<\/p>\n<p>To deliver more out-of-the-box value \u2014 in the way that programs like Microsoft Word and Excel helped people find value in a new operating system called Windows \u2014 Microsoft has created <a href=\"https:\/\/dynamics.microsoft.com\/en-us\/mixed-reality\/overview\/\">mixed reality applications for Microsoft Dynamics 365<\/a>. These allow companies to almost immediately use HoloLens 2 to meet workplace needs without needing to hire a small army of developers.<\/p>\n<p>Dynamics 365 Guides now joins Dynamics 365 <a href=\"https:\/\/dynamics.microsoft.com\/en-us\/mixed-reality\/remote-assist\/\">Remote Assist<\/a> and Dynamics 365 <a href=\"https:\/\/dynamics.microsoft.com\/en-us\/mixed-reality\/layout\/\">Layout<\/a> as Microsoft\u2019s pioneering mixed reality applications for business. Guides allows companies to move training materials from flat paper and screens into an immersive three-dimensional experience.<\/p>\n<p>\u201cEveryone here wants to be successful, and the ability to get new employees in and make them productive quickly is invaluable,\u201d said Rob Branson, senior director of global technologies and operations for PACCAR ITD, which has worked with an early version of Dynamics 365 Guides.<\/p>\n<p>\u201cIf you think about the way adults learn, it\u2019s very visual. And the ability to see step-by-step instructions overlaid on an actual physical object will really accelerate how an employee learns a new task,\u201d he said.<\/p>\n<p>HoloLens 2 was designed with these workers in mind \u2014 it\u2019s lighter and far more comfortable than the previous generation of HoloLens, with a more balanced center of gravity, so a person can wear it all day. A new flip-up visor lets workers switch easily between physical and holographic worlds.<\/p>\n<div class=\"video-container responsive-youtube oembed-container\"><span class=\"embed-youtube\"><\/p>\n<p id=\"ariaLabel_5c7452f1352b4\" class=\"screen-reader-text\">YouTube Video<\/p>\n<p><button class=\"cookie-consent-btn\">Load third party embed<\/button><\/p>\n<p><\/span><\/div>\n<p>Wearing a device that slips on as easily as a hat, PACCAR employees are able to access step-by-step holographic instructions to guide them through unfamiliar tasks like assembling a truck door. In Dynamics 365 Guides, lighted arrows create a path from each instruction card to the precise hole where a wire needs to be threaded or to the location of the correct tool on the factory floor.<\/p>\n<p>Holographic drawings superimposed on the actual door show how to perform that task and light up structures behind the steel panel that normally can\u2019t be seen without superpowers like X-ray vision.<\/p>\n<p>In industries with aging workforces, there\u2019s also an urgent need to impart workplace wisdom that employees have accumulated through years of apprenticeship or decades on the job to the next generation of workers.<\/p>\n<p>At Alaska Airlines, for instance, it can take roughly two years for a new mechanic to get fully trained and up to speed. The hope is that mixed reality tools might reduce that learning curve significantly. The immersive training environment also resonates with employees who have grown up with video games and nearly instantaneous access to digital information.<\/p>\n<p>\u201cIt brings the paper to life,\u201d said Mike Lorengo, director of Architecture and Strategy at Alaska Airlines. \u201cRather than seeing a flat piece of paper, I\u2019m seeing 3D projected onto an engine.\u201d<\/p>\n<h2><strong>Intelligent conversations between people and things<\/strong><\/h2>\n<p>Mixed reality is even more powerful when it takes advantage of the intelligent edge and intelligent cloud\u2019s different capabilities.<\/p>\n<p>In some scenarios, you want to quickly process information on the intelligent edge without sending that data to the cloud, such as in cameras that can alert you to imminent safety risks or algorithms that control braking systems. On a factory floor, not all the data from each sensor on each piece of equipment is relevant at any given time. So running less-complicated AI services on the edge can help filter out irrelevant information or perform tasks that don\u2019t require the power of the cloud.<\/p>\n<p>If you need a hologram to help potential customers envision how a new car or potential remodel will look with different options, a single HoloLens 2 using on-board capabilities in a showroom or living room will offer plenty of computing power and resolution.<\/p>\n<p>But connecting that device to the new Azure Remote Rendering mixed reality cloud service can quickly produce intricate, three-dimensional digital models that begin to rival the sculpted clay or detailed architectural models that a company might spend days or months building today. That simply wouldn\u2019t be possible without the graphics processing power of the cloud.<\/p>\n<p>\u201cSuddenly mixed reality goes from something that\u2019s a novel way to augment what you\u2019re already doing to being able to replace an entire business process \u2014 for example, using full digital construction in a way that just couldn\u2019t happen before,\u2019\u201d said White.<\/p>\n<div class=\"wp-caption alignleft\">\n<p class=\"wp-caption-text\">PTC\u2019s IoT and mixed reality tools help companies minimize downtime by empowering on-site workers to quickly diagnose and repair machines that are critical to their operations.<\/p>\n<p><a href=\"https:\/\/www.ptc.com\/\">PTC<\/a>, one of Microsoft\u2019s partners, has developed integrated systems that combine <a href=\"https:\/\/www.ptc.com\/en\/partners\/microsoft\/\">IoT edge solutions, the Azure cloud and mixed reality tools<\/a> to digitally transform businesses of all kinds, from aerospace and defense contractors to clothing brands and life science companies.<\/p>\n<p>Think about a lab technician who comes into work one morning and finds a critical machine that processes blood samples isn\u2019t working, said Jim Heppelmann, president and CEO of PTC.<\/p>\n<p>Several years ago, a blinking light or vague error message might be the only clue to what\u2019s wrong. She\u2019d probably call the manufacturer, who might or might not be able diagnose the problem over the phone. Mostly likely, they\u2019d have to dispatch a repair person for that specialized machine who might or might not work in that city. It could take hours or days of downtime to get it back up and running. Meanwhile, patients worried about their blood results would be left in the dark.<\/p>\n<p>Today, with the <a href=\"https:\/\/www.ptc.com\/en\/partners\/microsoft\/thingworx-for-azure\">ThingWorx for Azure<\/a> service, she could put on a HoloLens 2 device and see a holographic dashboard with each component\u2019s health and status mapped onto the physical machine. The data collected by tiny IoT sensors and sent to the Azure cloud might diagnose a problem with one of the cartridges. The lab tech could access step-by-step holographic instructions showing her how to open the cover, which lever to flip, how to insert the new part. If she can\u2019t figure it out, a repair expert sitting in the manufacturer\u2019s office in Nebraska could look at a screen, see exactly what she sees through HoloLens 2 and walk her through the job.<\/p>\n<p>\u201cIt\u2019s a closed loop between humans and things,\u201d Heppelmann said. \u201cThe IoT devices tell me what\u2019s wrong, and the mixed reality solutions allow me to repurpose that blood test technician into someone who\u2019s able to fix a simple problem that saves time and money on airplane tickets and rental cars.\u201d<\/p>\n<p>For any first-line worker who might wear a mixed reality headset for a good portion of the day, the improved comfort and larger field of view in HoloLens 2 \u2014 which allows people to see multiple holograms, read text and view intricate details in 3D \u2014 will be transformative, Heppelmann said.<\/p>\n<p>\u201cThose two things take HoloLens from a device that\u2019s interesting to play with and prototype with to one that could be put into widespread production in factories, in hospitals, in construction sites today. This is a big step forward,\u201d he said.<\/p>\n<p>Those features are also important to <a href=\"https:\/\/www.bentley.com\/en\/solutions\/project-delivery\/construction\">Bentley Systems<\/a>, another Microsoft partner that develops software for engineers, architects and construction firms building massively complicated infrastructure projects.<\/p>\n<p>When overhauling an urban train station or building a new soccer stadium with lots of moving parts and heavy equipment, looking down to access information on a phone or tablet can be dangerous, said Noah Eckhouse, Bentley senior vice president for project delivery. HoloLens headsets allow workers to access digital information while remaining aware of their physical surroundings.<\/p>\n<p>Through HoloLens, the company\u2019s <a href=\"https:\/\/www.bentley.com\/en\/products\/brands\/synchro\">SYNCHRO<\/a> software allows workers to zoom in on a particular location on the construction site and access important digital information, like safety guidelines or installation instructions, for that particular job or area. Managers can see in three dimensions what the project is expected to look like two days or three weeks from now \u2014 based on constantly changing realities and projections \u2014 and anticipate any scheduling conflicts.<\/p>\n<p>\u201cA construction site is like a giant ballet \u2014 it\u2019s a very highly choreographed operation with movements of materials and people that all have to exist within a certain space,\u201d he said. \u201cAnd the plan changes the first day you\u2019re on the job.\u201d<\/p>\n<p>While it might be possible to store and update plans for a two-bedroom bungalow on a single device, it would be impossible to track all the moving parts on a massive infrastructure project without the cloud, Eckhouse said.<\/p>\n<p>By connecting each HoloLens device on a job site to a master model that\u2019s constantly updating in Azure, SYNCRHO ensures that everyone works from the same shared reality, with the latest information to sequence jobs, plan crane movements, track progress and keep workers safe.<\/p>\n<p>\u201cThe cloud connectivity is critical because in these large projects the amount of information going back and forth between the field and the engineers and designers is continual,\u201d Eckhouse said. \u201cAnd the consequences of working on infrastructure projects in the physical world are very real.\u201d<\/p>\n<div>\n<div class=\"video-container responsive-youtube oembed-container\"><span class=\"embed-youtube\"><\/p>\n<p id=\"ariaLabel_5c7452f1355cd\" class=\"screen-reader-text\">YouTube Video<\/p>\n<p><button class=\"cookie-consent-btn\">Load third party embed<\/button><\/p>\n<p><\/span><\/div>\n<p class=\"wp-caption-text\">Bentley Systems is working with HoloLens 2 to merge digital construction models with physical reality and keep large infrastructure projects on track.<\/p>\n<h2><strong>Bringing powerful perception tools to the edge<\/strong><\/h2>\n<p>Two defining achievements in computer vision and AI contribute to HoloLens 2\u2019s immersive experience. The ability to interpret physical spaces with semantic understanding allows the device to differentiate between walls and windows or a couch and coffee table. Natural hand-tracking now allows people to grasp, rotate and expand the holograms more instinctively, rather than having to learn gestures that mimic mouse movements.<\/p>\n<p>Those advances are enabled by the fourth generation of Kinect, combined with AI tools that operate on the edge. That depth- and motion-sensing technology was originally developed nearly a decade ago to create a gesture-recognition accessory for Xbox. But the ability to sense depth accurately and pinpoint how human bodies are moving in space turned out to have far broader applications than gaming.<\/p>\n<p><a href=\"http:\/\/ocuvera.com\/\">Ocuvera<\/a>, for instance, is working with Azure Kinect in a system that aims to help prevent the roughly 1 million falls that occur in U.S. hospitals each year, and even more worldwide. It can sense when a patient who needs help walking is trying to get out of bed unassisted, with enough advance warning to alert a nurse to go help.<\/p>\n<p>Using a depth-sensing camera and AI algorithms, the system recognizes patterns of movements before a patient gets out of bed, like sitting up or swinging their legs around. Initial results from pilot studies at 11 clinical sites found that unassisted and unobserved bed exits decreased by more than 90 percent after the technology was implemented.<\/p>\n<p>CEO Steve Kiene said Ocuvera\u2019s team has investigated every depth-sensing camera in the world and even tried to build its own. When it comes to distinguishing whether a patient is moving forward or just rolling over or detecting the first wiggle of a foot, none have come close to the accuracy and resolution of Azure Kinect.<\/p>\n<p>\u201cIt\u2019s like looking for tells when you\u2019re playing poker,\u201d he said. \u201cOnly Azure Kinect gives us the data to really see what\u2019s going on with a patient in a hospital bed and predict their intent with enough accuracy. When we do a pilot with a hospital, they often tell us that\u2019s just not possible, but then they find out it does work, and they\u2019re amazed. It\u2019s kind of like magic.\u201d<\/p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Technology for first-line workers Information workers \u2014 people who do much of their work at a computer to produce words, design things, respond to emails, manage people or make business decisions \u2014 have benefited from an explosion of technologies allowing them to learn nearly anything with the touch of a mouse and communicate instantaneously. That\u2019s [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":84899,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[49],"tags":[474,50],"class_list":["post-84898","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-microsoft-news","tag-mwc","tag-recent-news"],"_links":{"self":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/84898","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/comments?post=84898"}],"version-history":[{"count":0,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/84898\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media\/84899"}],"wp:attachment":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media?parent=84898"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/categories?post=84898"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/tags?post=84898"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}