{"id":121500,"date":"2020-12-03T01:16:24","date_gmt":"2020-12-03T01:16:24","guid":{"rendered":"https:\/\/news.microsoft.com\/?p=440143"},"modified":"2020-12-03T01:16:24","modified_gmt":"2020-12-03T01:16:24","slug":"seeing-ai-empowers-people-who-are-blind-or-with-low-vision-for-everyday-life","status":"publish","type":"post","link":"https:\/\/sickgaming.net\/blog\/2020\/12\/03\/seeing-ai-empowers-people-who-are-blind-or-with-low-vision-for-everyday-life\/","title":{"rendered":"Seeing AI empowers people who are blind or with low vision for everyday life"},"content":{"rendered":"<h3><em>A mother and daughter celebrate the first anniversary of the app\u2019s<\/em><em>&nbsp;Japanese-language version<\/em><\/h3>\n<p><strong>By Kumiko Tezuka, <\/strong><br \/><strong>Microsoft Japan<\/strong><\/p>\n<figure id=\"attachment_113505\" aria-describedby=\"caption-attachment-113505\" class=\"wp-caption alignright\"><a href=\"https:\/\/www.sickgaming.net\/blog\/wp-content\/uploads\/2020\/12\/seeing-ai-empowers-people-who-are-blind-or-with-low-vision-for-everyday-life.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-113505\" src=\"https:\/\/www.sickgaming.net\/blog\/wp-content\/uploads\/2020\/12\/seeing-ai-empowers-people-who-are-blind-or-with-low-vision-for-everyday-life.jpg\" alt=\"A mother and young daughter read a book\" width=\"300\" height=\"400\"><\/a><figcaption id=\"caption-attachment-113505\" class=\"wp-caption-text\">Akiko Ishii and her daughter Ami using Seeing AI to read a picture book together.<\/figcaption><\/figure>\n<p>Akiko Ishii sits in her living room holding a picture book and balancing her four-year-old daughter, Ami, on her lap. It looks like a typical domestic scene in a typical Tokyo neighborhood, but there\u2019s something special going on here.<\/p>\n<p>Akiko is blind and her smartphone is doing the reading for her.<\/p>\n<p>As the phone\u2019s camera scans each page, Microsoft\u2019s Seeing AI app reads out the text aloud. Akiko and Ami smile as they listen. With this technology, they can spend invaluable time reading together and bonding \u2014 just like mothers and children do anywhere.<\/p>\n<p><strong>Power of artificial intelligence<\/strong><\/p>\n<p>Seeing AI is a free app that narrates the world for the blind and low vision community. It\u2019s the product of an ongoing research project that harnesses the power of artificial intelligence (AI) to open up the visual world by describing nearby people, text and objects.<\/p>\n<p>It\u2019s currently available in 70 countries and a number of languages. The Japanese-language version was launched a year ago.<\/p>\n<p>Seeing AI uses AI technology not only to recognize and read short text passages, documents, product labels and so on, but also to describe people and scenery captured by a mobile phone camera.<\/p>\n<p>Akiko, who lost her sight as a result of surgery, was already using the English-language version of Seeing AI before the Japanese version was released.<\/p>\n<blockquote>\n<h2><span><strong>\u201cI\u2019ve been using the Japanese-language version of Seeing AI now for about a year, and I can say with conviction that it has become indispensable to honing my own individuality.\u201d<\/strong><\/span><\/h2>\n<\/blockquote>\n<p>She says that while there are a number of other applications available in Japan for assisting people with visual impairments, they tend to be designed for a single, specific purpose, and don\u2019t provide such a wide range of easy-to-use functions all in one package.<\/p>\n<p>With Seeing AI she can carry out all sorts of everyday life by using her phone. Apart from reading, she can use it to check the brightness of lights in a room and for describing her surroundings and identifying people and objects as she moves about. Watch the following video:<\/p>\n<div class=\"video-container responsive-youtube oembed-container\"><button class=\"cookie-consent-btn cookie-consent-btn--image\"><img decoding=\"async\" src=\"https:\/\/www.sickgaming.net\/blog\/wp-content\/uploads\/2020\/12\/seeing-ai-empowers-people-who-are-blind-or-with-low-vision-for-everyday-life-1.jpg\">   <\/button><\/div>\n<p>The app\u2019s Japanese audio readout is so speedy that someone not familiar with it might find it too fast to follow. \u201cIt\u2019s difficult to keep up, isn\u2019t it?\u201d Akiko says with a laugh.<\/p>\n<p>\u201cIt is much faster than the speed of normal conversation and I\u2019m okay with that because I\u2019m blind and do everything through my ears. Things like reading or looking at something, that people can do in an instant, I have to listen and take in before I can act.<\/p>\n<figure id=\"attachment_113507\" aria-describedby=\"caption-attachment-113507\" class=\"wp-caption alignleft\"><a href=\"https:\/\/www.sickgaming.net\/blog\/wp-content\/uploads\/2020\/12\/seeing-ai-empowers-people-who-are-blind-or-with-low-vision-for-everyday-life-2.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-113507\" src=\"https:\/\/www.sickgaming.net\/blog\/wp-content\/uploads\/2020\/12\/seeing-ai-empowers-people-who-are-blind-or-with-low-vision-for-everyday-life-2.jpg\" alt=\"a bento\" width=\"283\" height=\"283\"><\/a><figcaption id=\"caption-attachment-113507\" class=\"wp-caption-text\">A bento that Akiko made for Ami, rice balls on the right and an array of morsels on the left.<\/figcaption><\/figure>\n<p>\u201cThat is why I have gotten used to listening at high speed. The English-language version could not recognize Japanese text. When I used it to describe my surroundings and such like, I couldn\u2019t listen at this speed, since I\u2019m not a native English speaker and don\u2019t have a good enough grasp of the language.\u201d<\/p>\n<p>The Japanese version has empowered Akiko to do much more by herself. For instance, she can now read notes from Ami\u2019s kindergarten that tell her what Ami needs to take the next day. Before she had Seeing AI Akiko would have to scan each handout and use optical character recognition software to generate digital text that could be read out on her PC. Now it is just a matter of using her phone.<\/p>\n<p>Being able to easily carry out tasks has given her more independence and confidence to do things she enjoys, such as cooking.<\/p>\n<p>She uses Seeing AI\u2019s \u201cshort text\u201d function to read grocery labels, check use-by dates and identify ingredients. The app has a color recognition function that, for instance, can say whether a bell pepper is red, yellow or green.<\/p>\n<p><strong>Recognizing people, colors and much more<\/strong><\/p>\n<p>\u201cI really enjoy making Ami\u2019s bento these days with Seeing AI,&nbsp;I can think about the color of the ingredients as I prepare the lunchbox, so I might for example use a piece of yellow bell pepper to match the egg in tomorrow\u2019s bento.\u201d<\/p>\n<p>Akiko\u2019s phone contains a wealth of family photos, many of them are shots of her with her husband, Yoshimi, and Ami.<\/p>\n<p>\u201cI have set up Seeing AI\u2019s person function to recognize Ami and my husband, so it can now pick out their faces in the photos I\u2019ve taken.\u201d<\/p>\n<figure id=\"attachment_113508\" aria-describedby=\"caption-attachment-113508\" class=\"wp-caption alignright\"><a href=\"https:\/\/www.sickgaming.net\/blog\/wp-content\/uploads\/2020\/12\/seeing-ai-empowers-people-who-are-blind-or-with-low-vision-for-everyday-life-3.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-113508\" src=\"https:\/\/www.sickgaming.net\/blog\/wp-content\/uploads\/2020\/12\/seeing-ai-empowers-people-who-are-blind-or-with-low-vision-for-everyday-life-3.jpg\" alt=\"Mother, daughter and father\" width=\"401\" height=\"268\"><\/a><figcaption id=\"caption-attachment-113508\" class=\"wp-caption-text\">Akiko, Ami and husband Yoshimi at an amusement park.<\/figcaption><\/figure>\n<p>In the past, Akiko had no way of knowing what each photo showed, but now she uses Seeing AI\u2019s scene function to describe photos to her. And by pre-setting the app to recognize Ami and her husband, she can also go through photos showing a lot of people to find only those shots in which Ami or her husband appear.<\/p>\n<p>\u201cI always want my photos of Ami and the family close at hand. They\u2019re also a record of her growth, so I do not want to delete any of them.\u201d<\/p>\n<p>Akiko says her use of the app continues to evolve at home and also at work in her role leading an organization that helps people with disabilities become more independent and attain a better quality of life.<\/p>\n<p>\u201cI see a disability as a unique individuality,\u201d says Akiko. \u201cAnd by honing that individuality (disability), I think that we can turn each rough stone into a glittering diamond. I\u2019ve been using the Japanese language version of Seeing AI now for about a year, and I can say with conviction that it has become indispensable to honing my own individuality.\u201d<\/p>\n<figure id=\"attachment_113506\" aria-describedby=\"caption-attachment-113506\" class=\"wp-caption alignnone\"><a href=\"https:\/\/www.sickgaming.net\/blog\/wp-content\/uploads\/2020\/12\/seeing-ai-empowers-people-who-are-blind-or-with-low-vision-for-everyday-life-4.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-113506 size-full\" src=\"https:\/\/www.sickgaming.net\/blog\/wp-content\/uploads\/2020\/12\/seeing-ai-empowers-people-who-are-blind-or-with-low-vision-for-everyday-life-4.jpg\" alt=\"Moter and young daughter\" width=\"2560\" height=\"1707\"><\/a><figcaption id=\"caption-attachment-113506\" class=\"wp-caption-text\">Akiko and Ami happily relaxing.<\/figcaption><\/figure>\n<p><em>TOP IMAGE: Akiko Ishii and her daughter Ami use Seeing AI to read a picture book.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p>A mother and daughter celebrate the first anniversary of the app\u2019s&nbsp;Japanese-language version By Kumiko Tezuka, Microsoft Japan Akiko Ishii and her daughter Ami using Seeing AI to read a picture book together. Akiko Ishii sits in her living room holding a picture book and balancing her four-year-old daughter, Ami, on her lap. It looks like [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":121501,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[49],"tags":[50,1249],"class_list":["post-121500","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-microsoft-news","tag-recent-news","tag-seeing-ai"],"_links":{"self":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/121500","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/comments?post=121500"}],"version-history":[{"count":0,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/121500\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media\/121501"}],"wp:attachment":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media?parent=121500"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/categories?post=121500"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/tags?post=121500"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}