{"id":130299,"date":"2022-12-06T17:36:35","date_gmt":"2022-12-06T17:36:35","guid":{"rendered":"https:\/\/news.microsoft.com\/?p=447840"},"modified":"2022-12-06T17:36:35","modified_gmt":"2022-12-06T17:36:35","slug":"a-conversation-with-kevin-scott-whats-next-in-ai","status":"publish","type":"post","link":"https:\/\/sickgaming.net\/blog\/2022\/12\/06\/a-conversation-with-kevin-scott-whats-next-in-ai\/","title":{"rendered":"A conversation with Kevin Scott: What\u2019s next in AI"},"content":{"rendered":"

For example, I\u2019ve been playing around with an experimental system I built for myself using GPT-3 designed to help me write a science fiction book, which is something that I\u2019ve wanted to do since I was a teenager. I have notebooks full of synopses I\u2019ve created for theoretical books, describing what the books are about and the universes where they take place. With this experimental tool, I have been able to get the logjam broken. When I wrote a book the old-fashioned way<\/a>, if I got 2,000 words out of a day, I\u2019d feel really good about myself. With this tool, I\u2019ve had days where I can write 6,000 words in a day, which for me feels like a lot. It feels like a qualitatively more energizing process than what I was doing before.<\/p>\n

This is the \u201ccopilot for everything\u201d dream\u2014that<\/span> you would have a copilot that could sit alongside you as you\u2019re doing any kind of cognitive work, helping you not just get more done, but also enhancing your creativity in new and exciting ways.<\/p>\n

This increase in productivity is clearly a boost to your satisfaction. Why do these tools bring more joy to work? <\/strong><\/p>\n

All of us use tools to do our work. Some of us really enjoy acquiring the tools and mastering them and figuring out how to deploy them in a super effective way to do the thing that we\u2019re trying to do. I think that is part of what\u2019s going on here. In many cases, people now have new and interesting and fundamentally more effective tools than they\u2019ve had before. We did a study<\/a> that found using no-code or low-code tools led to more than an 80% positive impact on work satisfaction, overall workload and morale by users. Especially for tools that are in their relatively early stages, that\u2019s just a huge benefit to see.<\/p>\n

For some workers, it\u2019s literally enhancing that core flow that you get into when you\u2019re doing the work; it speeds you up. It\u2019s like having a better set of running shoes to go run a race or marathon. This is exactly what we\u2019re seeing with the experiences developers are having with Copilot; they are reporting<\/a> that Copilot helps them stay in the flow and keeps their minds sharper during what used to be boring and repetitive tasks.  And when AI tools can help to eliminate drudgery from a job, something that is super repetitive or annoying or that was getting in their way of getting to the thing that they really enjoy, it unsurprisingly improves satisfaction.<\/p>\n

Personally, these tools let me be in flow state longer than I was before. The enemy of creative flow is distraction and getting stuck. I get to a point where I don\u2019t know quite how to solve the next thing, or the next thing is, like, \u201cI\u2019ve got to go look this thing up. I\u2019ve got to context switch out of what I was doing to go solve the subproblem.\u201d These tools increasingly solve the subproblem for me so that I stay in the flow.<\/p>\n

In addition to GitHub Copilot and DALL\u2219E 2, AI is showing up in Microsoft products and services in other ways. How is next-generation AI improving current products such as Teams and Word?<\/strong><\/p>\n

\"An<\/a>This is the big untold story of AI. To date, most of AI\u2019s benefits are spread across 1,000 different things where you may not even fully appreciate how much of the product experience that you\u2019re getting is coming from a machine learned system.<\/p>\n

For example, we\u2019re sitting here in this Teams<\/a> call on video and, in the system, there are all these parameters that were learned by a machine learning algorithm. There are jitter buffers for the audio system to smooth out the communication. The blur behind you on your screen is a machine learning algorithm at work. There are more than a dozen machine learning systems that make this experience more delightful for the both of us. And that is certainly true across Microsoft.<\/p>\n

We\u2019ve gone from machine learning in a few places to literally 1,000 machine learning things spread across different products, everything from how your Outlook email client works, your predictive text in Word, your Bing search experience, to what your feed looks like in Xbox Cloud Gaming and LinkedIn. There\u2019s AI all over the place making these products better.<\/p>\n

One of the big things that has changed in the past two years is it used to be the case that you would have a model that was specialized to each one of these tasks that we have across all our products. Now you have a single model that gets used in lots of places because they\u2019re broadly useful. Being able to invest in these models that become more powerful with scale\u2014and<\/span> then having all the things built on top of the model benefit simultaneously from improvements that you\u2019re making\u2014is<\/span> tremendous.<\/p>\n

Microsoft\u2019s AI research and development continues through initiatives such as <\/strong>AI4Science<\/strong><\/a> and <\/strong>AI for Good<\/strong><\/a>. What excites you most about this area of AI?<\/strong><\/p>\n

\"An<\/a>The most challenging problems we face as a society right now are in the sciences. How do you cure these intractably complicated diseases?<\/a> How do you prepare yourself for the next pandemic<\/a>? How do you provide affordable, high-quality healthcare to an aging population<\/a>? How do you help educate more kids at scale<\/a> in the skills that they will need for the future? How do you develop technologies that will reverse<\/a> some of the negative effects of carbon emissions into the atmosphere? We\u2019re exploring how to take some of these exciting developments in AI to those problems.<\/p>\n

The models in these basic science applications have the same scaling properties as large language models. You build a model, you get it into some self-supervised mode where it\u2019s learning from a simulation or it\u2019s learning from its own ability to observe a particular domain, and then the model that you get out of it lets you dramatically change the performance of an application\u2014whether<\/span> you\u2019re doing a computational fluid dynamics simulation or you\u2019re doing molecular dynamics for drug design<\/a>.<\/p>\n

There\u2019s immense opportunity there. This means better medicines, it means maybe we can find the catalyst<\/a> we don\u2019t have yet to fix our carbon emission problem, it means across the board accelerating how scientists and other folks with big ideas can work to try to solve society\u2019s biggest challenges.<\/p>\n

How have breakthroughs in computing techniques and hardware contributed to the advances in AI?<\/strong><\/p>\n

The fundamental thing underlying almost all of the recent progress we\u2019ve seen in AI is how critical the importance of scale has proven to be. It turns out that models trained on more data with more compute power just have a much richer and more generalized set of capabilities. If we want to keep driving this progress further\u2014and<\/span> to be clear, right now we don\u2019t see any end to the benefits of increased scale\u2014we<\/span> need to optimize and scale up our compute power as much as we possibly can.<\/p>\n

We announced our first Azure AI supercomputer<\/a> two years ago, and at our Build developer conference this year I shared that we now have multiple supercomputing systems that we\u2019re pretty sure are the largest and most powerful AI supercomputers in the world today. We and OpenAI use this infrastructure to train nearly all of our state-of-the-art large models, whether that\u2019s our Turing<\/a>, Z-code<\/a> and Florence<\/a> models at Microsoft or the GPT, DALL\u2219E and Codex models at OpenAI.<\/a> And we just recently announced a collaboration with NVIDIA<\/a> to build a supercomputer powered by Azure infrastructure combined with NVIDIA GPUs.<\/p>\n

\"Supercomputer<\/a><\/p>\n

Some of this progress has just been via brute force compute scale with bigger and bigger clusters of GPUs. But maybe even a bigger breakthrough is the layer of software that optimizes how models and data are distributed across these giant systems, both to train the models and then to serve them to customers. If we\u2019re going to put forth these large models as platforms that people can create with, they can\u2019t only be accessible to the tiny number of tech companies in the world with enough resources to build giant supercomputers.<\/p>\n

So, we\u2019ve invested a ton in software like DeepSpeed<\/a> to boost training efficiency, and the ONNX Runtime<\/a> for inference. They optimize for cost and latency and generally help us make bigger AI models more accessible and valuable for people. I\u2019m super proud of the teams we have working on these technologies because Microsoft is really leading the industry here, and we\u2019re open sourcing all of it so others can keep improving.<\/p>\n

These advances are all playing out amid an ongoing concern that AI is going to impact jobs. How do you think about the issue of AI and jobs?<\/strong><\/p>\n

We live in a time of extraordinary complexity and historic macroeconomic change, and as we look out 5, 10 years into the future, even to just achieve a net neutral balance for the whole world, we\u2019re going to need new forms of productivity for all of us to be able to continue enjoying progress. We want to be building these AI tools as platforms that lots of people can use to build businesses and solve problems. We believe that these platforms democratize access to AI to far more people. With them, you\u2019ll get a richer set of problems solved and you\u2019ll have a more diverse group of people being able to participate in the creation of technology.<\/p>\n

With the previous instantiation of AI, you needed a huge amount of expertise just to get started. Now you can call Azure Cognitive Services<\/a>, you can call the Azure OpenAI Service<\/a> and build complicated products on top of these things without necessarily having to be so expert at AI that you\u2019ve got to be able to train your own large model from scratch.<\/p>\n","protected":false},"excerpt":{"rendered":"

For example, I\u2019ve been playing around with an experimental system I built for myself using GPT-3 designed to help me write a science fiction book, which is something that I\u2019ve wanted to do since I was a teenager. I have notebooks full of synopses I\u2019ve created for theoretical books, describing what the books are about […]<\/p>\n","protected":false},"author":2,"featured_media":130300,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[49],"tags":[555,135],"class_list":["post-130299","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-microsoft-news","tag-ai-blog","tag-artificial-intelligence"],"_links":{"self":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/130299","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/comments?post=130299"}],"version-history":[{"count":0,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/130299\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media\/130300"}],"wp:attachment":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media?parent=130299"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/categories?post=130299"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/tags?post=130299"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}