{"id":128822,"date":"2022-10-12T23:42:34","date_gmt":"2022-10-12T23:42:34","guid":{"rendered":"https:\/\/news.microsoft.com\/?p=447359"},"modified":"2022-10-12T23:42:34","modified_gmt":"2022-10-12T23:42:34","slug":"haleon-harnesses-microsofts-seeing-ai-technology-to-make-health-product-information-more-accessible","status":"publish","type":"post","link":"https:\/\/sickgaming.net\/blog\/2022\/10\/12\/haleon-harnesses-microsofts-seeing-ai-technology-to-make-health-product-information-more-accessible\/","title":{"rendered":"Haleon harnesses Microsoft\u2019s Seeing AI technology to make health product information more accessible"},"content":{"rendered":"

For Marc Powell, a seemingly simple trip to the store to buy medication or other consumer health products is often an onerous, complicated undertaking.<\/p>\n

Powell, who is blind, usually must ask a store employee to help find what he needs and then read the information on the packaging to him, which can feel intrusive. At home he\u2019ll ask his partner, who has partial sight, for help, but the print is sometimes too small for her to read. In a pinch, he\u2019ll scour the internet or wait until a family member stops by and can read aloud to him the information he needs.<\/p>\n

\u201cI\u2019m incredibly reliant on somebody else to let me know about the product \u2014 what I\u2019m meant to do with it, how many tablets I can take or what it contains,\u201d says Powell, the accessibility innovation lead for the U.K.-based Royal National Institute of Blind People (RNIB), who lives in Cambridge, England. \u201cIt\u2019s crazy to say that, isn\u2019t it?\u201d<\/p>\n

\"Head
Marc Powell.<\/figcaption><\/figure>\n

A new collaboration between Microsoft and global consumer health company Haleon aims to make health product information more accessible for people who are blind or have partial vision, or individuals with low literacy. The companies worked together to expand the functionality of Microsoft\u2019s Seeing AI app to provide detailed audio information for more than 1,500 Haleon products in the U.S. and the U.K., including brands such as Centrum, Sensodyne and Emergen-C. The initiative was launched in recognition of World Sight Day Oct. 13.<\/p>\n

Using Seeing AI, users can now scan the bar code on Haleon products and hear the same information that is provided on the packaging, such as the product name, usage instructions and ingredients. When users point a phone at a Haleon product, the Seeing AI app guides them to the bar code with a series of intensifying beeps. After scanning the code, users can navigate between sections to get the specific information they want, a feature that has been well-received by partially sighted people who tried out the functionality before its launch.<\/p>\n

\u201cWe have had great feedback from people who are blind and have low vision,\u201d says Tamara Rogers, global chief marketing officer at Haleon. \u201cThey really value the increased independence that comes from being empowered to access our product information themselves.\u201d<\/p>\n

\"Black
Tamara Rogers.<\/figcaption><\/figure>\n

The new functionality was developed not just for people who are blind or have low vision, but also for those who have literacy challenges, Rogers says. \u201cThere\u2019s a classic health industry saying which is, \u2018Always read the label, always read the instructions,\u2019 and for some, that just isn\u2019t possible,\u201d she says.<\/p>\n

\u201cThis initiative will make Haleon products more accessible to people who are blind or have low vision. It will also provide more independence to people with low literacy levels. This is a great way of being able to communicate in a different way, audibly, rather than asking people to read.\u201d<\/p>\n

Launched in 2017, Microsoft\u2019s Seeing AI application is an AI camera-based app that can read text such as documents or signs, describe scenes, recognize currency and even identify friends. Available in 19 languages, the app has become a multipurpose tool that is helping people who are blind or have low vision navigate their daily lives. The newly enhanced functionality helps consumers in the U.S. and U.K. read packaging details in English. Previously, there wasn\u2019t an easy way for Seeing AI to read detailed information on packaging without a user moving a camera around the text.<\/p>\n

The collaboration with Haleon \u201cis really important and exciting, because Seeing AI has always been able to recognize products, but the challenge has been having access to data that is really rich, and that comes from the manufacturer,\u201d says Saqib Shaikh, an engineering manager at Microsoft who led the team that developed Seeing AI.<\/p>\n

\u201cNow you can just scan the barcode and hear exactly what was written on the package. It\u2019s directly what the manufacturer wanted you to hear. The information is really accurate, and you\u2019re getting it all in one place. You\u2019re not having to scan all the different sides of the package to find the bits you want. It\u2019s all right there once you\u2019ve scanned the barcode.<\/p>\n

\u201cNow you can give more information, and trustworthy information,\u201d Shaikh says. \u201cHaleon is leading the way in doing this.\u201d<\/p>\n

Shaikh hopes more companies will follow Haleon\u2019s lead and use technology to provide audio information for people who are blind or who have low vision, or those with literacy challenges. Doing so could provide important information not just for health products, he says, but for food items and countless other things people use in their daily lives.<\/p>\n

\u201cI\u2019d love to make every product out there accessible so you can just scan it, whether by bar code or some other future technology, and know what it is,\u201d he says. \u201cThis data is out there. It\u2019s just that all the data\u2019s in siloes. What we were able to do here was, by the companies having the will, to break down these siloes.\u201d<\/p>\n

\"Close-up
Using the Seeing AI app, detailed audio information will be available for detailed audio information for more than 1,500 Haleon products in the U.S. and the U.K.<\/figcaption><\/figure>\n

More than 3 million people in the United States and more than 2 million in the U.K. are living with sight loss, and millions more struggle with poor literacy. A study commissioned by Haleon found that 93 percent of respondents didn\u2019t think health products were accessible enough, and almost one in five said they had taken an incorrect dosage of a product because they couldn\u2019t read the packaging.<\/p>\n

Haleon saw technology as a tool to address those issues, Rogers says, but wanted to build on an existing platform rather than creating new technology that people who are blind or have low vision would need to adopt. Haleon approached Microsoft about using the Seeing AI app to create audio guides for its products, and the two companies worked closely together to build out the new functionality for Haleon\u2019s bar codes. Microsoft developed an end-to-end pipeline that allows Haleon to control the data for its consumer products, which is stored in Azure, and update information or add new items as needed.<\/p>\n

Powell says to his knowledge, Haleon \u2014 a spinoff of GlaxoSmithKline created in July 2022 to focus on consumer health products \u2014 is the first consumer health company to provide accessible information through Seeing AI for its products.<\/p>\n

\u201cI think this will be really useful,\u201d he says. \u201cThis allows us as blind people to have the same level of knowledge and understanding as someone who can read the packaging. So this is a really good step.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"

For Marc Powell, a seemingly simple trip to the store to buy medication or other consumer health products is often an onerous, complicated undertaking. Powell, who is blind, usually must ask a store employee to help find what he needs and then read the information on the packaging to him, which can feel intrusive. At […]<\/p>\n","protected":false},"author":2,"featured_media":128823,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[49],"tags":[63,50],"class_list":["post-128822","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-microsoft-news","tag-accessibility","tag-recent-news"],"_links":{"self":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/128822","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/comments?post=128822"}],"version-history":[{"count":0,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/128822\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media\/128823"}],"wp:attachment":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media?parent=128822"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/categories?post=128822"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/tags?post=128822"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}