{"id":130661,"date":"2022-12-19T17:50:26","date_gmt":"2022-12-19T17:50:26","guid":{"rendered":"https:\/\/news.microsoft.com\/?p=447951"},"modified":"2022-12-19T17:50:26","modified_gmt":"2022-12-19T17:50:26","slug":"research-at-microsoft-in-2022-a-look-back-at-accelerating-progress-in-ai","status":"publish","type":"post","link":"https:\/\/sickgaming.net\/blog\/2022\/12\/19\/research-at-microsoft-in-2022-a-look-back-at-accelerating-progress-in-ai\/","title":{"rendered":"Research at Microsoft in 2022: A look back at accelerating progress in AI"},"content":{"rendered":"<figure class=\"wp-block-image size-full\"><img decoding=\"async\" loading=\"lazy\" width=\"2560\" height=\"1441\" src=\"https:\/\/www.sickgaming.net\/blog\/wp-content\/uploads\/2022\/12\/research-at-microsoft-in-2022-a-look-back-at-accelerating-progress-in-ai.jpg\" alt=\"2022 Microsoft Research - Year in review graphic\" class=\"wp-image-907740\"><\/figure>\n<aside id=\"accordion-544e245c-01b5-4070-910e-5a15bd848403\" class=\"msr-table-of-contents-block accordion mb-5 pb-0\" data-bi-area=\"table-of-contents\"> <button class=\"btn btn-collapse bg-gray-100 mb-0 display-flex justify-content-between\" type=\"button\" data-mount=\"collapse\" data-target=\"#accordion-collapse-544e245c-01b5-4070-910e-5a15bd848403\"> <span class=\"msr-table-of-contents-block__label subtitle\">In this article<\/span> <span class=\"msr-table-of-contents-block__current mr-4 text-gray-600 font-weight-normal\" aria-hidden=\"true\"><\/span> <\/button> <span class=\"msr-table-of-contents-block__progress-bar\"><\/span><br \/>\n<\/aside>\n<p>2022 has seen remarkable progress in foundational technologies that have helped to advance human knowledge and create new possibilities to address some of society\u2019s most challenging problems. Significant advances in AI have also enabled Microsoft to bring new capabilities to customers through our products and services, including <a href=\"https:\/\/github.blog\/2022-06-21-github-copilot-is-generally-available-to-all-developers\/\" target=\"_blank\" rel=\"noreferrer noopener\">GitHub Copilot<\/a>, an AI pair programmer capable of turning natural language prompts into code, and a preview of <a href=\"https:\/\/www.microsoft.com\/en-us\/microsoft-365\/blog\/2022\/10\/12\/new-tools-from-microsoft-365-edge-and-bing-bridge-the-gap-between-productivity-and-creativity\/\" target=\"_blank\" rel=\"noreferrer noopener\">Microsoft Designer<\/a>, a graphic design app that supports the creation of social media posts, invitations, posters, and one-of-a-kind images.<\/p>\n<p>These offerings provide an early glimpse of how new AI capabilities, such as large language models, can enable people to interact with machines in increasingly powerful ways. They build on a significant, long-term commitment to fundamental research in computing and across the sciences, and the research community at Microsoft plays an integral role in advancing the state of the art in AI, while working closely with engineering teams and other partners to transform that progress into tangible benefits.<\/p>\n<p>In 2022, Microsoft Research established <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/lab\/microsoft-research-ai4science\/\" target=\"_blank\" rel=\"noreferrer noopener\">AI4Science<\/a>, a global organization applying the latest advances in AI and machine learning toward fundamentally transforming science; added to and expanded the capabilities of the company\u2019s family of foundation models; worked to make these models and technologies more adaptable, collaborative, and efficient; further developed approaches to ensure that AI is used responsibly and in alignment with human needs; and pursued different approaches to AI, such as causal machine learning and reinforcement learning.<\/p>\n<p>We shared our advances across AI and many other disciplines during our second annual <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/event\/microsoft-research-summit-2022\/\" target=\"_blank\" rel=\"noreferrer noopener\">Microsoft Research Summit<\/a>, where members of our research community gathered virtually with their counterparts across industry and academia to discuss how emerging technologies are being explored and deployed to bring the greatest possible benefits to humanity.&nbsp;&nbsp;<\/p>\n<p>Plenary sessions at the event focused on the transformational impact of deep learning on the way we practice science, research that empowers medical practitioners and reduces inequities in healthcare, and emerging foundations for planet-scale computing. Further tracks and sessions over three days provided deeper dives into the future of the cloud; efficient large-scale AI; amplifying human productivity and creativity; delivering precision healthcare; building user trust through privacy, identity, and responsible AI; and enabling a resilient and sustainable world.<\/p>\n<div class=\"wp-block-columns\">\n<div class=\"wp-block-column\">\n<div class=\"annotations\" data-bi-area=\"citation\">\n<ul class=\"annotations__list card depth-16 bg-body p-4 \">\n<li class=\"annotations__list-item\"> <span class=\"annotations__type d-block text-uppercase font-weight-semibold text-gray-500 small\">Blog<\/span> <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/introducing-the-microsoft-climate-research-initiative\/\" class=\"annotations__link font-weight-semibold text-decoration-none\" data-bi-type=\"annotated-link\" aria-label=\"Microsoft Climate Research Initiative (MCRI)\" data-bi-area=\"citation\" data-bi-cn=\"Microsoft Climate Research Initiative (MCRI)\"> Microsoft Climate Research Initiative (MCRI)&nbsp;<span class=\"glyph-append glyph-append-chevron-right glyph-append-xsmall\"><\/span> <\/a>\n<p class=\"annotations__caption text-gray-700 mt-2\">In June, the Microsoft Climate Research Initiative (MCRI) announced its first phase of collaborations among multidisciplinary researchers working together to accelerate cutting-edge research and transformative innovation in climate science and technology.<\/p>\n<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<div class=\"wp-block-column\">\n<div class=\"annotations\" data-bi-area=\"citation\">\n<ul class=\"annotations__list card depth-16 bg-body p-4 \">\n<li class=\"annotations__list-item\"> <span class=\"annotations__type d-block text-uppercase font-weight-semibold text-gray-500 small\">Publication<\/span> <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/microsoft-new-future-of-work-report-2022\/\" class=\"annotations__link font-weight-semibold text-decoration-none\" data-bi-type=\"annotated-link\" aria-label=\"New Future of Work Report 2022\" data-bi-area=\"citation\" data-bi-cn=\"New Future of Work Report 2022\"> New Future of Work Report 2022&nbsp;<span class=\"glyph-append glyph-append-chevron-right glyph-append-xsmall\"><\/span> <\/a>\n<p class=\"annotations__caption text-gray-700 mt-2\">In May, researchers across Microsoft published the New Future of Work Report 2022, which summarizes important recent research developments related to hybrid work. It highlights themes that have emerged in the findings of the past year and resurfaces older research that has become newly relevant.<\/p>\n<\/li>\n<\/ul>\n<\/div>\n<\/div>\n<\/div>\n<p>In this blog post, we look back at some of the key achievements and notable work in AI and highlight other advances across our diverse, multidisciplinary, and global organization.<\/p>\n<h2 id=\"heading-advancing-ai-foundations-and-accelerating-progress\">Advancing AI foundations and accelerating progress<\/h2>\n<p>Over the past year, the research community at Microsoft made significant contributions to the rapidly evolving landscape of powerful large-scale AI models. Microsoft Research and the <a href=\"https:\/\/turing.microsoft.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">Microsoft Turing team<\/a> unveiled <a href=\"https:\/\/blogs.bing.com\/search-quality-insights\/october-2022\/Microsoft-Turing-Universal-Language-Representation-model,-T-ULRv6,-tops-both-XTREME-and-GLUE-leaderb\" target=\"_blank\" rel=\"noreferrer noopener\">a new Turing Universal Language Representation model capable of performing both English and multilingual understanding tasks<\/a>. In computer vision, advancements for the <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/project-florence-vl\/\" target=\"_blank\" rel=\"noreferrer noopener\">Project Florence-VL (Florence-Vision and Language)<\/a> team spanned still imagery and video: its <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/git-a-generative-image-to-text-transformer-for-vision-and-language\/\" target=\"_blank\" rel=\"noreferrer noopener\">GIT<\/a> model was the first to surpass human performance on the image captioning benchmark TextCaps; <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/lavender-unifying-video-language-understanding-as-masked-language-modeling\/\" target=\"_blank\" rel=\"noreferrer noopener\">LAVENDER<\/a> showed strong performance in video question answering, text-to-video retrieval, and video captioning; and <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/grounded-language-image-pre-training\/\" target=\"_blank\" rel=\"noreferrer noopener\">GLIP<\/a> and <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/glipv2-unifying-localization-and-vision-language-understanding\/\" target=\"_blank\" rel=\"noreferrer noopener\">GLIPv2<\/a> combined localization and vision-language understanding. The group also introduced <a href=\"https:\/\/nuwa-infinity.microsoft.com\/#\/\" target=\"_blank\" rel=\"noreferrer noopener\">NUWA-Infinity<\/a>, a model capable of converting text, images, and video into high-resolution images or long-duration video. Meanwhile, the <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/group\/visual-computing\/\" target=\"_blank\" rel=\"noreferrer noopener\">Visual Computing Group<\/a> <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/swin-transformer-supports-3-billion-parameter-vision-models-that-can-train-with-higher-resolution-images-for-greater-task-applicability\/\" target=\"_blank\" rel=\"noreferrer noopener\">scaled up its Transformer-based general-purpose computer vision architecture, Swin Transformer<\/a>, achieving applicability across more vision tasks than ever before.<\/p>\n<p>Researchers from Microsoft Research Asia and the Microsoft Turing team also introduced <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/image-as-a-foreign-language-beit-pretraining-for-all-vision-and-vision-language-tasks\/\" target=\"_blank\" rel=\"noreferrer noopener\">BEiT-3<\/a>, a general-purpose multimodal foundation model that achieves state-of-the-art transfer performance on both vision and vision-language tasks. In BEiT-3, researchers introduce Multiway Transformers for general-purpose modeling, where the modular architecture enables both deep fusion and modality-specific encoding. Based on the shared backbone, BEiT-3 performs masked \u201clanguage\u201d modeling on images (Imglish), texts (English), and image-text pairs (\u201cparallel sentences\u201d) in a unified manner. The code and pretrained models will be available at <a href=\"http:\/\/aka.ms\/beit3\" target=\"_blank\" rel=\"noreferrer noopener\">GitHub<\/a>.<\/p>\n<p>One of the most crucial accelerators of progress in AI is the ability to optimize training and inference for large-scale models. In 2022, the <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/deepspeed-advancing-moe-inference-and-training-to-power-next-generation-ai-scale\/\" target=\"_blank\" rel=\"noreferrer noopener\">DeepSpeed team<\/a> made a number of breakthroughs to improve mixture of experts (MoE) models, making them more efficient, faster, and less costly. Specifically, they were able to reduce training cost by 5x, reduce MoE parameter size by up to 3.7x, and reduce MoE inference latency by 7.3x while offering up to 4.5x faster and 9x cheaper inference for MoE models compared to quality-equivalent dense models.<\/p>\n<h2 id=\"heading-transforming-scientific-discovery-and-adding-societal-value\">Transforming scientific discovery and adding societal value<\/h2>\n<p>Our ability to comprehend and reason about the natural world has advanced over time, and the new AI4Science organization, announced in July, <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/ai4science-to-empower-the-fifth-paradigm-of-scientific-discovery\/\" target=\"_blank\" rel=\"noreferrer noopener\">represents another turn in the evolution of scientific discovery<\/a>. Machine learning is already being used in the natural sciences to model physical systems using observational data. AI4Science aims to dramatically accelerate our ability to model and predict natural phenomena by creating deep learning emulators that learn by using computational solutions to fundamental equations as training data.<\/p>\n<p>This new paradigm can help scientists gain greater insight into natural phenomena, right down to their smallest components. Such molecular understanding and powerful computational tools can help accelerate the discovery of new materials to combat climate change, and new drugs to help support the prevention and treatment of disease.&nbsp;&nbsp;<\/p>\n<p>For instance, AI4Science\u2019s <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/project-carbonix\/\" target=\"_blank\" rel=\"noreferrer noopener\">Project Carbonix<\/a> is working on globally accessible, at-scale solutions for decarbonizing the world economy, including reverse engineering materials that can pull carbon out of the environment and recycling carbon into materials. Collaborating on these efforts through the <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/introducing-the-microsoft-climate-research-initiative\/\" target=\"_blank\" rel=\"noreferrer noopener\">Microsoft Climate Research Initiative (MCRI)<\/a> are domain experts from academia, industry, and government. Announced in June, MCRI is focused on areas such as carbon accounting, climate risk assessments, and decarbonization.<\/p>\n<p>As part of the <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/generative-chemistry\/\" target=\"_blank\" rel=\"noreferrer noopener\">Generative Chemistry<\/a> project, Microsoft researchers have been working with the global medicines company Novartis to develop and execute machine learning tools and human-in-the-loop approaches to enhance the entire drug discovery process. In April, they introduced <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/moler-creating-a-path-to-more-efficient-drug-design\/\" target=\"_blank\" rel=\"noreferrer noopener\">MoLeR, a graph-based generative model for designing compounds<\/a> that is more reflective of how chemists think about the process and is more efficient and practical than an earlier generative model the team developed.&nbsp;<\/p>\n<p>While AI4Science is focused on computational simulation, we have seen with projects like <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/project\/medical-image-analysis\/\" target=\"_blank\" rel=\"noreferrer noopener\">InnerEye<\/a> that AI can have societal value in many other ways. In March, <a href=\"https:\/\/news.microsoft.com\/2022\/03\/04\/microsoft-completes-acquisition-of-nuance-ushering-in-new-era-of-outcomes-based-ai\/\" target=\"_blank\" rel=\"noreferrer noopener\">Microsoft acquired Nuance Communications Inc.<\/a>, further cementing the companies\u2019 shared commitment to outcome-based AI across industries, particularly in healthcare. Tools like the integration of Microsoft Teams and Dragon Ambient eXperience (Nuance DAX) to <a href=\"https:\/\/cloudblogs.microsoft.com\/industry-blog\/health\/2022\/03\/04\/microsoft-and-nuance-supporting-the-resilience-of-healthcare\/\" target=\"_blank\" rel=\"noreferrer noopener\">help ease the administrative burden of physicians and support meaningful doctor-patient interactions<\/a> are already making a difference.<\/p>\n<h2 id=\"heading-making-ai-more-adaptable-collaborative-and-efficient\">Making AI more adaptable, collaborative, and efficient&nbsp;<\/h2>\n<p>To help accelerate the capabilities of large-scale AI while building a landscape in which everyone can benefit from it, the research community at Microsoft aimed to drive progress in three areas: adaptability, collaboration, and efficiency.<\/p>\n<p>To provide consistent value, AI systems must respond to changes in task <em>and <\/em>environment. Research in this area includes multi-task learning with task-aware routing of inputs, knowledge-infused decoding, model repurposing with data-centric ML, pruning and cognitive science or brain-inspired AI. A good example of our work toward adaptability is <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/godel-combining-goal-oriented-dialog-with-real-world-conversations\/\" target=\"_blank\" rel=\"noreferrer noopener\">GODEL<\/a>, or <strong>G<\/strong>rounded\u202f<strong>O<\/strong>pen\u202f<strong>D<\/strong>ialogu<strong>e<\/strong>\u202f<strong>L<\/strong>anguage Model, which ushers in a new class of pretrained language models that enable chatbots to help with tasks and then engage in more general conversations.&nbsp;&nbsp;<\/p>\n<p>Microsoft\u2019s research into more collaborative AI includes <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/partnering-people-with-large-language-models-to-find-and-fix-bugs-in-nlp-systems\/\" target=\"_blank\" rel=\"noreferrer noopener\">AdaTest<\/a>, which leverages human expertise alongside the generative power of large language models to help people more efficiently find and correct bugs in natural language processing models. Researchers have also explored expanding the use of AI in creative processes, including a project in which science fiction writer Gabrielle Loisel <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/video\/keynote-with-guests-toward-ai-that-empowers-more-people-more-of-the-time\/\" target=\"_blank\" rel=\"noreferrer noopener\">used OpenAI\u2019s GPT-3 to co-author a novella and other stories<\/a>.&nbsp;<\/p>\n<p>To enable more people to make use of AI in an efficient and sustainable way, Microsoft researchers are pursuing several new architectures and training paradigms. This includes new modular architectures and novel techniques, such as <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/deepspeed-compression-a-composable-library-for-extreme-compression-and-zero-cost-quantization\/\" target=\"_blank\" rel=\"noreferrer noopener\">DeepSpeed Compression<\/a>, a composable library for extreme compression and zero-cost quantization, and <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/microsoft-translator-enhanced-with-z-code-mixture-of-experts-models\/\" target=\"_blank\" rel=\"noreferrer noopener\">Z-Code Mixture of Experts models<\/a>, which boost translation efficiency and were deployed in Microsoft Translator in 2022.&nbsp;&nbsp;<\/p>\n<p>In December, researchers unveiled <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/autodistil-few-shot-task-agnostic-neural-architecture-search-for-distilling-large-language-models\/\" target=\"_blank\" rel=\"noreferrer noopener\">AutoDistil<\/a>, a new technique that leverages knowledge distillation and neural architecture search to improve the balance between cost and performance when generating compressed models. They also introduced <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/adamix-mixture-of-adaptations-for-parameter-efficient-model-tuning\/\" target=\"_blank\" rel=\"noreferrer noopener\">AdaMix<\/a>, which improves the fine-tuning of large pretrained models for downstream tasks using mixture of adaptations modules for parameter-efficient model tuning. And vision-language model compression <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/finding-the-dominant-winning-ticket-in-pre-trained-language-models\/\" target=\"_blank\" rel=\"noreferrer noopener\">research on the lottery ticket hypothesis<\/a> showed that pretrained language models can be significantly compressed without hurting their performance.<\/p>\n<div class=\"annotations\" data-bi-area=\"citation\">\n<ul class=\"annotations__list card depth-16 bg-body p-4 \">\n<li class=\"annotations__list-item\"> <span class=\"annotations__type d-block text-uppercase font-weight-semibold text-gray-500 small\">Blog<\/span> <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/cloud-intelligence-aiops-infusing-ai-into-cloud-computing-systems\/\" class=\"annotations__link font-weight-semibold text-decoration-none\" data-bi-type=\"annotated-link\" aria-label=\"Infusing AI into cloud computing systems\" data-bi-area=\"citation\" data-bi-cn=\"Infusing AI into cloud computing systems\"> Infusing AI into cloud computing systems&nbsp;<span class=\"glyph-append glyph-append-chevron-right glyph-append-xsmall\"><\/span> <\/a>\n<p class=\"annotations__caption text-gray-700 mt-2\">Cloud Intelligence\/AIOps is a rapidly emerging technology trend and an interdisciplinary research direction across system, software engineering, and AI\/ML communities. In this blog post from November, the researchers behind Microsoft\u2019s AIOps work outline a research vision to make the cloud more autonomous, proactive, and manageable.<\/p>\n<\/li>\n<\/ul>\n<\/div>\n<h2 id=\"heading-building-and-deploying-ai-responsibly\">Building and deploying AI responsibly<\/h2>\n<p>Building AI that maximizes its benefit to humanity, and does so equitably, requires considering both the opportunities and risks that come with each new advancement in line with our guiding principles: fairness, reliability and safety, privacy and security, inclusiveness, transparency, and accountability.<\/p>\n<p>Helping to put these principles into practice is Microsoft\u2019s Responsible AI Standard, which <a href=\"https:\/\/blogs.microsoft.com\/on-the-issues\/2022\/06\/21\/microsofts-framework-for-building-ai-systems-responsibly\/\" target=\"_blank\" rel=\"noreferrer noopener\">the company made publicly available in June<\/a>. The standard comprises tools and steps that AI practitioners can execute in their workflows today to help ensure that building AI responsibly is baked into every stage of development. These standards will evolve as the tools and resources to responsibly build AI evolve in response to the rapid pace of AI advancement, particularly pertaining to the <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/video\/lightning-talks-responsible-ai-the-challenge-of-big-models\/\" target=\"_blank\" rel=\"noreferrer noopener\">growing size of AI models and the new challenges they bring<\/a>.&nbsp;<\/p>\n<p>With <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/fedkd-communication-efficient-federated-learning-via-knowledge-distillation-communication-efficient-federated-learning-via-knowledge-distillation\/\" target=\"_blank\" rel=\"noreferrer noopener\">FedKD<\/a> and <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/no-one-left-behind-inclusive-federated-learning-over-heterogeneous-devices\/\" target=\"_blank\" rel=\"noreferrer noopener\">InclusiveFL<\/a>, researchers tackled some of the obstacles in applying federated learning, an ML method for protecting privacy, to model training. Two separate teams explored solutions for the harmful language that large generative models can reproduce\u2014one presenting a <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/unified-detoxifying-and-debiasing-in-language-generation-via-inference-time-adaptive-optimization\/\" target=\"_blank\" rel=\"noreferrer noopener\">unified framework for both detoxifying and debiasing models<\/a> and another introducing <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/detoxigen-leveraging-large-language-models-to-build-more-robust-hate-speech-detection-tools\/\" target=\"_blank\" rel=\"noreferrer noopener\">methods for making content moderation tools more robust<\/a>. Meanwhile, researchers sought to strengthen human-AI collaboration by <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/self-explaining-deep-models-with-logic-rule-reasoning\/\" target=\"_blank\" rel=\"noreferrer noopener\">giving users more insight into how models arrive at their outputs via explanations provided by the models themselves<\/a>.<\/p>\n<p>The responsible development of AI also means deploying technologies that operate the way they were designed to\u2014and the way people expect them to. In a pair of blog posts, researchers draw on their respective experiences developing a technology to <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/assessing-ai-system-performance-thinking-beyond-models-to-deployment-contexts\/\" target=\"_blank\" rel=\"noreferrer noopener\">support social agency in children who are born blind<\/a> and another to <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/ai-models-vs-ai-systems-understanding-units-of-performance-assessment\/\" target=\"_blank\" rel=\"noreferrer noopener\">support mental health practitioners in guiding patient treatment<\/a> to stress the need for multiple measures of performance in determining the readiness of increasingly complex AI systems and the incorporation of domain experts and user research throughout the development process.<\/p>\n<h2 id=\"heading-advancing-ai-for-decision-making\">Advancing AI for decision making<\/h2>\n<p>Building the next generation of AI requires continuous research into fundamental new AI innovations. Two significant areas of study in 2022 were causal ML and reinforcement learning.<\/p>\n<h3 id=\"heading-causal-ml\">Causal ML<\/h3>\n<p>Identifying causal effects is an integral part of scientific inquiry. It helps us understand everything from <a href=\"https:\/\/blogs.microsoft.com\/ai\/eedi-online-math-quiz\/\" target=\"_blank\" rel=\"noreferrer noopener\">educational outcomes<\/a> to the effects of social policies to risk factors for diseases. Questions of cause and effect are also critical for the design and data-driven evaluation of many technological systems we build today.\u202f&nbsp;<\/p>\n<p>This year, Microsoft Research continued its work on causal ML, which combines traditional machine learning with causal inference methods. To help data scientists better understand and deploy causal inference, Microsoft researchers built the <a href=\"https:\/\/github.com\/microsoft\/dowhy\" target=\"_blank\" rel=\"noreferrer noopener\">DoWhy<\/a> library, an end-to-end causal inference tool, in 2018. To broaden access to this critical knowledge base, DoWhy has now migrated to an independent open-source governance model in a new <a href=\"https:\/\/github.com\/py-why\/\" target=\"_blank\" rel=\"noreferrer noopener\">PyWhy GitHub organization<\/a>. As part of this new collaborative model, Amazon Web Services is contributing new technology based on structural causal models.<\/p>\n<p>At this year\u2019s <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/event\/neurips-2022\/\" target=\"_blank\" rel=\"noreferrer noopener\">Conference on Neural Information Processing Systems (NeurIPS)<\/a>, researchers presented a <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/publication\/a-causal-ai-suite-for-decision-making\/\" target=\"_blank\" rel=\"noreferrer noopener\">suite of open-source causal tools and libraries<\/a> that aims to simultaneously provide core causal AI functionality to practitioners and create a platform for research advances to be rapidly deployed. This includes <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/video\/introduction-to-showwhy-user-interfaces-for-causal-decision-making\/\" target=\"_blank\" rel=\"noreferrer noopener\">ShowWhy<\/a>, a no-code user interface suite that empowers domain experts to become decision scientists. We hope that our work accelerates use-inspired basic research for improvement of causal AI.<\/p>\n<h3 id=\"heading-reinforcement-learning-rl\">Reinforcement learning (RL)<\/h3>\n<p>Reinforcement learning is a powerful tool for learning which behaviors are likely to produce the best outcomes in a given scenario, typically through trial and error. But this powerful tool faces some challenges. Trial and error can consume enormous resources when applied to large datasets. And for many real-time applications, there\u2019s no room to learn from mistakes.&nbsp;&nbsp;&nbsp;<\/p>\n<p>To address RL\u2019s computational bottleneck, Microsoft researchers developed <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/ppe-a-fast-and-provably-efficient-rl-algorithm-for-exogenous-noise\/\" target=\"_blank\" rel=\"noreferrer noopener\">Path Predictive Elimination<\/a>, a reinforcement learning method that is robust enough to remove noise from continuously changing environments. Also in 2022, a Microsoft team released <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/mocapact-training-humanoid-robots-to-move-like-jagger\/\" target=\"_blank\" rel=\"noreferrer noopener\">MoCapAct<\/a>, a library of pretrained simulated models to enable advanced research on artificial humanoid control at a fraction of the compute resources currently required.&nbsp;&nbsp;<\/p>\n<p>Researchers also developed a <a href=\"https:\/\/www.microsoft.com\/en-us\/research\/blog\/a-game-theoretic-approach-to-provably-correct-and-scalable-offline-rl\/\" target=\"_blank\" rel=\"noreferrer noopener\">new method for using offline RL<\/a> to augment human-designed strategies for making critical decisions. This team deployed game theory to design algorithms that can use existing data to learn policies that improve on current strategies.<\/p>\n<h4 id=\"heading-readers%e2%80%99-choice-notable-blog-posts-for-2022\">Readers\u2019 choice: Notable blog posts for 2022&nbsp;<\/h4>\n<h3 id=\"heading-thank-you-for-reading\">Thank you for reading<\/h3>\n<p>2022 was an exciting year for research, and we look forward to the future breakthroughs our global research community will deliver. In the coming year, you can expect to hear more from us about our vision, and the impact we hope to achieve. We appreciate the opportunity to share our work with you, and we hope you will <a href=\"https:\/\/info.microsoft.com\/ww-landing-microsoft-research-newsletter.html?wt.mc_id=S-webpage_msr-homepage\" target=\"_blank\" rel=\"noreferrer noopener\">subscribe to the Microsoft Research Newsletter<\/a> for the latest developments.<\/p>\n<div class=\"wp-block-columns\">\n<div class=\"wp-block-column\">\n<p><strong>Writers and Editors<\/strong><br \/>Elise Ballard<br \/>Kristina Dodge<br \/>Kate Forster<br \/>Chris Stetkiewicz<br \/>Larry West<\/p>\n<\/div>\n<div class=\"wp-block-column\">\n<p><strong>Managing Editor<\/strong><br \/>Amber Tingle<\/p>\n<p><strong>Project Manager<\/strong><br \/>Amanda Melfi<\/p>\n<\/div>\n<div class=\"wp-block-column\">\n<p><strong>Graphic Designer<\/strong><br \/>Matt Sanderson<\/p>\n<p><strong>Editor in Chief<\/strong><br \/>Matt Corwine<\/p>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>In this article 2022 has seen remarkable progress in foundational technologies that have helped to advance human knowledge and create new possibilities to address some of society\u2019s most challenging problems. Significant advances in AI have also enabled Microsoft to bring new capabilities to customers through our products and services, including GitHub Copilot, an AI pair [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":130662,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[49],"tags":[159,50],"class_list":["post-130661","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-microsoft-news","tag-microsoft-research","tag-recent-news"],"_links":{"self":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/130661","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/comments?post=130661"}],"version-history":[{"count":0,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/130661\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media\/130662"}],"wp:attachment":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media?parent=130661"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/categories?post=130661"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/tags?post=130661"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}