{"id":117528,"date":"2020-09-03T16:24:46","date_gmt":"2020-09-03T16:24:46","guid":{"rendered":"https:\/\/news.microsoft.com\/?p=438930"},"modified":"2020-09-03T16:24:46","modified_gmt":"2020-09-03T16:24:46","slug":"microsoft-expressive-pixels-new-platform-for-creativity-inclusion-and-innovation","status":"publish","type":"post","link":"https:\/\/sickgaming.net\/blog\/2020\/09\/03\/microsoft-expressive-pixels-new-platform-for-creativity-inclusion-and-innovation\/","title":{"rendered":"Microsoft Expressive Pixels: new platform for creativity, inclusion and innovation"},"content":{"rendered":"<p>\u201cEmojis are already ubiquitous in digital communication platforms, including text-based messaging, email and social media. They require fewer \u2018clicks\u2019 to express intent, add context, or set tone. A single emoji can dramatically alter or enhance the interpretation of a message. We think they can be leveraged as a supplemental expressive proxy for people who may not have access to speech or the muscles that drive facial expression,\u201d Paradiso says. \u201cOur PALS collaborators have been some of the funniest, most thoughtful and creative people I\u2019ve known, but their expressive range can be limited by the constraints of disability as well as today\u2019s speech devices and their underlying technologies. We know that people want to express a lot more with their AAC devices than basic transactional communication. We wanted to create something that would help people stay more actively engaged in conversations, be visible in low light and from a distance, and provide another avenue for unique expression, playfulness and connection.\u201d<\/p>\n<p>The team looked at different types of secondary displays, but they kept coming back to LED displays, for several reasons: they\u2019re low-cost, they work reasonably well and \u201cthey have kind of a cool factor.\u201d The team\u2019s collaborators in PALS also made it clear they didn\u2019t want to use anything that could have unintended negative social consequences for the users.<\/p>\n<p>\u201cWatching somebody living with ALS and being able to empower them to do something that they previously had given up all hope of being able to do is enough to inspire you to want to do more,\u201d says Dwayne Lamb, a developer who specializes in User Experience and User Interface creation who joined the Enable Group in early 2017. \u201cMost of the time when you\u2019re trying to communicate with somebody who can only use their eyes to communicate, they\u2019re using their eyes to type into a keyboard on a device right in front of them, and although it\u2019s not socially good etiquette, you commonly find yourself kind of looking over their shoulder to try and see what they\u2019re typing.\u201d<\/p>\n<p>Expressive Pixels evolved in part from wanting to solve that problem.<\/p>\n<figure id=\"attachment_174697\" aria-describedby=\"caption-attachment-174697\" class=\"wp-image wp-image--caption aligncenter\"><a href=\"https:\/\/www.sickgaming.net\/blog\/wp-content\/uploads\/2020\/09\/microsoft-expressive-pixels-new-platform-for-creativity-inclusion-and-innovation.png\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-174697 size-full\" src=\"https:\/\/www.sickgaming.net\/blog\/wp-content\/uploads\/2020\/09\/microsoft-expressive-pixels-new-platform-for-creativity-inclusion-and-innovation.png\" alt=\"Face emoji\" width=\"2252\" height=\"1443\"><\/a><figcaption id=\"caption-attachment-174697\" class=\"wp-caption-text\">Emoji in the Expressive Pixels app<\/figcaption><\/figure>\n<p>And with Expressive Pixels, it\u2019s possible to create animations on displays of many sizes, up to 64 x 64 pixels, says Christopher O\u2019Dowd, who helped fill the hardware gaps on the project. He points out that LED displays are ubiquitous at Maker Faires, on houses during the holidays, etc. LED displays are so versatile, you often even find them on fabric (face masks, caps and backpacks, for instance) or banners.<\/p>\n<p>One early way the team incorporated LED displays was through <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/microsoft-hands-free-music\/\">hands-free music<\/a>, an award-winning SXSW project.<\/p>\n<p>There, they used a custom midi-enabled, music synced LED array as a supplemental visualization to an eye controlled, physical drum rig designed for one of their collaborators, a Seattle area musician living with ALS. The project, which won the 2018 SXSW Interactive Innovation Award: Music and Audio Innovation, features a suite of novel eye-controlled applications for music performance, collaboration and composition.<\/p>\n<p>\u201cHow does someone without access to speech or movement compose or perform music, command a stage, or connect with a live audience? What about collaborating with other musicians in rehearsed or improvisational scenarios? How can we lower the barriers to making school music programs more inclusive without \u2018othering\u2019 or minimizing the students with disabilities? These were some of our foundational questions,\u201d Paradiso recalled. \u201cWe wanted to adapt our technology and designs to align with a person\u2019s creative goals and real-life scenarios, rather than the way around.\u201d<\/p>\n<p>Lamb came up with the idea to add Musical Instrument Digital Interface (MIDI) capability, with the core idea to send out different signals to different instruments \u2013 an idea that would transfer to Expressive Pixels.<\/p>\n<div class=\"c-video c-video--caption-center c-video--lazy\" data-js=\"c-video\" data-embed-id=\"7VshX3V9ivQ\" data-embed-provider=\"YouTube\" data-video-title=\"Galactic Bell Star music demo\" data-id>\n<figure class=\"c-video__wrapper\">\n<div class=\"c-video__embed\"> <a href=\"https:\/\/youtu.be\/7VshX3V9ivQ\" class=\"c-video__trigger\" data-js=\"c-video-trigger\" title=\"Play Video\" target=\"_blank\" rel=\"noopener noreferrer\" aria-label=\"Click to Play Video\"><br \/><img decoding=\"async\" class=\"c-video__image lazyload\" src=\"https:\/\/www.sickgaming.net\/blog\/wp-content\/uploads\/2020\/09\/microsoft-expressive-pixels-new-platform-for-creativity-inclusion-and-innovation-1.png\" data-src=\"https:\/\/i.ytimg.com\/vi\/7VshX3V9ivQ\/maxresdefault.jpg\" role=\"presentation\"><br \/>\n<\/a> <\/div>\n<\/figure>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>\u201cEmojis are already ubiquitous in digital communication platforms, including text-based messaging, email and social media. They require fewer \u2018clicks\u2019 to express intent, add context, or set tone. A single emoji can dramatically alter or enhance the interpretation of a message. We think they can be leveraged as a supplemental expressive proxy for people who may [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":117529,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[49],"tags":[1144,50],"class_list":["post-117528","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-microsoft-news","tag-innovation","tag-recent-news"],"_links":{"self":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/117528","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/comments?post=117528"}],"version-history":[{"count":0,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/117528\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media\/117529"}],"wp:attachment":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media?parent=117528"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/categories?post=117528"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/tags?post=117528"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}