{"id":125682,"date":"2022-06-13T13:17:26","date_gmt":"2022-06-13T13:17:26","guid":{"rendered":"https:\/\/news.microsoft.com\/?p=446507"},"modified":"2022-06-13T13:17:26","modified_gmt":"2022-06-13T13:17:26","slug":"how-microsoft-teams-uses-ai-and-machine-learning-to-improve-calls-and-meetings","status":"publish","type":"post","link":"https:\/\/sickgaming.net\/blog\/2022\/06\/13\/how-microsoft-teams-uses-ai-and-machine-learning-to-improve-calls-and-meetings\/","title":{"rendered":"How Microsoft Teams uses AI and machine learning to improve calls and meetings"},"content":{"rendered":"<p><!-- Your share button code --> <\/p>\n<p>As schools and workplaces begin resuming in-person operations, we project a permanent increase in the volume of online meetings and calls. And while communication and collaboration solutions have played a critical role in enabling continuity during these unprecedented times, early stress tests have revealed opportunities to improve and enhance meeting and call quality.<\/p>\n<p>Disruptive echo effects, poor room acoustics, and choppy video are some common issues that hinder the effectiveness of online calls and meetings. Through AI and machine learning, which have become fundamental to our strategy for continual improvement, we\u2019ve identified and are now delivering innovative enhancements in <a href=\"https:\/\/www.microsoft.com\/microsoft-teams\/group-chat-software\">Microsoft Teams<\/a> that improve such audio and video challenges in ways that are both user-friendly and scalable across environments.<\/p>\n<p>Today, we\u2019re announcing the availability of new Teams features including echo cancellation, adjusting audio in poor acoustic environments, and allowing users to speak and hear at the same time without interruptions. These build on AI-powered features recently released like expanding background noise suppression.<\/p>\n<h2>Voice quality improvements<\/h2>\n<h3>Echo cancellation<\/h3>\n<p>During calls and meetings, when a participant has their microphone too close to their speaker, it\u2019s common for sound to loop between input and output devices, causing an unwanted echo effect. Now, Microsoft Teams uses AI to recognize the difference between sound from a speaker and the user\u2019s voice, eliminating the echo without suppressing speech or inhibiting the ability of multiple parties to speak at the same time.<\/p>\n<h3>\u201cDe-reverberation\u201d adjusts for poor room acoustics <\/h3>\n<p>In specific environments, room acoustics can cause sound to bounce, or reverberate, causing the user\u2019s voice to sound shallow as if they\u2019re speaking within a cavern. For the first time, Microsoft Teams uses a machine learning model to convert captured audio signal to sound as if users are speaking into a close-range microphone.<\/p>\n<h3>Interruptibility, for more natural conversations<\/h3>\n<p>A natural element of conversation is the ability to interrupt for clarification or validation. This is accomplished through full-duplex (two-way) transmission of audio, allowing users to speak and hear others at the same time. When not using a headset, and especially when using devices where the speaker and microphone are very close to each other, it is difficult to remove echo while maintaining full-duplex audio. Microsoft Teams uses a model \u201ctrained\u201d with 30,000 hours of speech samples to retain desired voices while suppressing unwanted audio signals resulting in more fluid dialogue.<\/p>\n<h3>Background noise suppression <\/h3>\n<p>Each of us has first-hand experience of a meeting disrupted by the unexpected sounds of a barking dog, a car alarm, or a slammed door. Over two years ago, we announced the release of <a href=\"https:\/\/techcommunity.microsoft.com\/t5\/microsoft-teams-blog\/reduce-background-noise-in-microsoft-teams-meetings-with-ai\/ba-p\/1992318\" target=\"_blank\" rel=\"noreferrer noopener\">AI-based noise suppression in Microsoft Teams<\/a> as an optional feature for Windows users. Since then, we\u2019ve continued a cycle of iterative development, testing, and evaluation to further optimize our model. After recording significant improvements across key user metrics, we have enabled <a href=\"https:\/\/techcommunity.microsoft.com\/t5\/microsoft-teams-blog\/expanding-background-noise-suppression-across-platforms-and\/ba-p\/3300366\" target=\"_blank\" rel=\"noreferrer noopener\">machine learning-based noise suppression<\/a> as default for Teams customers using Windows (including Microsoft Teams Rooms), as well as Mac and iOS users. A future release of this feature is planned for Teams Android and web clients.<\/p>\n<p>These AI-driven audio enhancements are rolling out and are expected to be generally available in the coming months.<\/p>\n<h2>Video quality improvements<\/h2>\n<p>We have also recently released <a href=\"https:\/\/techcommunity.microsoft.com\/t5\/microsoft-teams-blog\/ai-based-video-and-screen-sharing-quality-optimization-in\/ba-p\/2943935\" target=\"_blank\" rel=\"noreferrer noopener\">AI-based video and screen sharing quality optimization breakthroughs<\/a> for Teams. From adjustments for low light to optimizations based on the type of content being shared, we now leverage AI to help you look and present your best.<\/p>\n<h3>Real-time screen optimization adjusts for the content you\u2019re sharing<\/h3>\n<p>The impact of presentations can often depend on an audience\u2019s ability to read on-screen text or watch a shared video. But different types of shared content require varied approaches to ensure the highest video quality, particularly under bandwidth constraints. Teams now uses machine learning to detect and adjust the characteristics of the content presented in real-time, optimizing the legibility of documents or smoothness of video playback.<\/p>\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" width=\"1024\" height=\"576\" loading=\"lazy\" src=\"https:\/\/www.sickgaming.net\/blog\/wp-content\/uploads\/2022\/06\/how-microsoft-teams-uses-ai-and-machine-learning-to-improve-calls-and-meetings.jpg\" alt=\"Teams automatically adjusts for the type of content being shared. Demonstrating smooth versus crisp with image of astronaut tethered to the International Space Station. \" class=\"wp-image-248742\"><\/figure>\n<h3>AI-based optimization ensures your video looks great, even under bandwidth constraints<\/h3>\n<p>Unexpected issues with network bandwidth can lead to a choppy video that can quickly shift the focus of your presentation. AI-driven optimizations in Teams help adjust playback in challenging bandwidth conditions, so presenters can use video and screen sharing worry-free.<\/p>\n<h3>Brightness and focus filters that put you in the best light<\/h3>\n<p>Though you can\u2019t always control the surrounding lighting for your meetings, new AI-powered filters in Teams give you the option to adjust brightness and add a soft focus for your meetings with a simple toggle in your device settings, to better accommodate for low-light environments.<\/p>\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" width=\"1024\" height=\"519\" loading=\"lazy\" src=\"https:\/\/www.sickgaming.net\/blog\/wp-content\/uploads\/2022\/06\/how-microsoft-teams-uses-ai-and-machine-learning-to-improve-calls-and-meetings-1.jpg\" alt=\"Adjust brightness and focus settings in Microsoft Teams. Screen shows gentleman on start screen of a Teams meeting with split screen for brightness on and off.\" class=\"wp-image-248745\"><\/figure>\n<h2>Microsoft Teams: Engineered for clearer audio and fewer distractions<\/h2>\n<p>The past two years have made clear how important communication and collaboration platforms like <a href=\"https:\/\/www.microsoft.com\/microsoft-teams\/group-chat-software\">Microsoft Teams<\/a> are to maintaining safe, connected, and productive operations. In addition to bringing new features and capabilities to Teams, we\u2019ll continue to explore new ways to use technology to make online calling and meeting experiences more natural, resilient, and efficient.<\/p>\n<p>Visit the Tech Community Teams blog for more technical details about how we leverage AI and machine learning for <a href=\"https:\/\/techcommunity.microsoft.com\/t5\/microsoft-teams-blog\/new-ai-based-speech-enhancements-for-microsoft-teams\/ba-p\/3490168\" target=\"_blank\" rel=\"noreferrer noopener\">audio quality improvements<\/a> as well as <a href=\"https:\/\/techcommunity.microsoft.com\/t5\/microsoft-teams-blog\/ai-based-video-and-screen-sharing-quality-optimization-in\/ba-p\/2943935\" target=\"_blank\" rel=\"noreferrer noopener\">video and screen sharing optimization<\/a> in Microsoft Teams.<\/p>\n<div class=\"border-top border-bottom mt-3 mt-md-3\">\n<nav class=\"pt-4 pb-2\" aria-labelledby=\"category-header\">\n<h3 id=\"category-header\" class=\"sr-only sr-only-focusable\"> Categories <\/h3>\n<\/nav><\/div>\n","protected":false},"excerpt":{"rendered":"<p>As schools and workplaces begin resuming in-person operations, we project a permanent increase in the volume of online meetings and calls. And while communication and collaboration solutions have played a critical role in enabling continuity during these unprecedented times, early stress tests have revealed opportunities to improve and enhance meeting and call quality. Disruptive echo [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":125683,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[49],"tags":[156,50],"class_list":["post-125682","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-microsoft-news","tag-microsoft-teams","tag-recent-news"],"_links":{"self":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/125682","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/comments?post=125682"}],"version-history":[{"count":0,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/125682\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media\/125683"}],"wp:attachment":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media?parent=125682"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/categories?post=125682"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/tags?post=125682"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}