{"id":126675,"date":"2022-07-18T13:44:25","date_gmt":"2022-07-18T13:44:25","guid":{"rendered":"https:\/\/news.microsoft.com\/?p=446718"},"modified":"2022-07-18T13:44:25","modified_gmt":"2022-07-18T13:44:25","slug":"microsoft-launches-project-airsim-an-end-to-end-platform-to-accelerate-autonomous-flight","status":"publish","type":"post","link":"https:\/\/sickgaming.net\/blog\/2022\/07\/18\/microsoft-launches-project-airsim-an-end-to-end-platform-to-accelerate-autonomous-flight\/","title":{"rendered":"Microsoft launches Project AirSim, an end-to-end platform to accelerate autonomous flight"},"content":{"rendered":"<p>Project AirSim uses the power of Azure to generate massive amounts of data for training AI models on exactly which actions to take at each phase of flight, from takeoff to cruising to landing. It will also offer libraries of simulated 3D environments representing diverse urban and rural landscapes as well as a suite of sophisticated pretrained AI models to help accelerate autonomy in aerial infrastructure inspection, last-mile delivery and urban air mobility.<\/p>\n<p>Project AirSim is available today in limited preview. Interested customers can&nbsp;<a href=\"https:\/\/aka.ms\/projectairsim\">contact the Project AirSim<\/a> team&nbsp;to learn more.<\/p>\n<p>It arrives as advances in AI, computing and sensor technology are beginning to transform how we move people and goods, said Gurdeep Pall, Microsoft corporate vice president for Business Incubations in Technology &amp; Research. And this isn\u2019t just happening in remote areas home to wind farms; with urban density on the rise, gridlocked roads and highways simply can\u2019t cut it as the quickest way to get from Point A to Point B. Instead, businesses will look to the skies and autonomous aircraft.<\/p>\n<p>\u201cAutonomous systems will transform many industries and enable many aerial scenarios, from the last-mile delivery of goods in congested cities to the inspection of downed power lines from 1,000 miles away,\u201d Pall said. \u201cBut first we must safely train these systems in a realistic, virtualized world. Project AirSim is a critical tool that lets us bridge the world of bits and the world of atoms, and it shows the power of the industrial metaverse \u2013 the virtual worlds where businesses will build, test and hone solutions and then bring them into the real world.\u201d<\/p>\n<h2>Accelerating aerial autonomy<\/h2>\n<p>High-fidelity simulation was at the heart of AirSim, an earlier open-source project from Microsoft Research that is being retired but inspired today\u2019s launch. AirSim was a popular research tool, but it required deep expertise in coding and machine learning.<\/p>\n<p>Now, Microsoft has transformed that open-source tool into an end-to-end platform that allows Advanced Aerial Mobility (AAM) customers to more easily test and train AI-powered aircraft in simulated 3D environments.<\/p>\n<p>\u201cEveryone talks about AI, but very few companies are capable of building it at scale,\u201d said Balinder Malhi, engineering lead for Project AirSim. \u201cWe created Project AirSim with the key capabilities we believe will help democratize and accelerate aerial autonomy \u2013 namely, the ability to accurately simulate the real world, capture and process massive amounts of data and encode autonomy without the need for deep expertise in AI.\u201d<\/p>\n<p>With Project AirSim, developers will be able to access pretrained AI building blocks, including advanced models for detecting and avoiding obstacles and executing precision landings. These out-of-the-box capabilities eliminate the need for deep machine learning expertise, helping expand the universe of people who can start training autonomous aircraft, Malhi said.<\/p>\n<figure id=\"attachment_2495\" aria-describedby=\"caption-attachment-2495\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/www.sickgaming.net\/blog\/wp-content\/uploads\/2022\/07\/microsoft-launches-project-airsim-an-end-to-end-platform-to-accelerate-autonomous-flight.png\"><img decoding=\"async\" loading=\"lazy\" class=\"wp-image-2495 size-full\" src=\"https:\/\/www.sickgaming.net\/blog\/wp-content\/uploads\/2022\/07\/microsoft-launches-project-airsim-an-end-to-end-platform-to-accelerate-autonomous-flight.png\" alt=\"A simulated drone flying next to a wind turbine.\" width=\"1920\" height=\"1080\"><\/a><figcaption id=\"caption-attachment-2495\" class=\"wp-caption-text\">North Dakota-based Airtonomy uses Project AirSim to train autonomous aerial vehicles that inspect critical infrastructure like wind turbines. Photo courtesy of Airtonomy.<\/figcaption><\/figure>\n<p class>Airtonomy, which participated in an early access program for Project AirSim, used it to help customers launch remote inspections of critical infrastructure quickly and safely, without the time, expense and risk of sending a crew to remote locations \u2013 and without deep technical backgrounds.<\/p>\n<p>\u201cWe create autonomous capture routines for the frontline worker \u2013 people who don\u2019t use drones and robots on a regular basis but need them to act like any other tool within their service vehicle,\u201d Riedy said. With Airtonomy, not only does the drone inspect the asset automatically, the captured data is automatically contextualized at the moment of capture. These features can be extended to any asset in any industry, enabling novel and automated end-to-end workflows.<\/p>\n<p>\u201cIt\u2019s amazing to see those responsible for our nation\u2019s infrastructure use these tools literally with a push of a button and have a digital representation at their fingertips for things like outages, disaster response or route maintenance. Project AirSim is transforming how robotics and AI can be used in an applied fashion,\u201d he said.<\/p>\n<p>Using data from Bing Maps and other providers, Project AirSim customers will also be able to create millions of detailed 3D environments and also access a library of specific locations, like New York City or London, or generic spaces, like an airport.<\/p>\n<p>Microsoft is also working closely with industry partners to extend accurate simulation to weather, physics and \u2013 crucially \u2013 the sensors an autonomous machine uses to \u201csee\u201d the world. A collaboration with Ansys leverages their high-fidelity physics-based sensor simulations to enable customers with rich ground truth information for autonomous vehicles. Meanwhile, Microsoft and MathWorks are working together so customers can bring their own physics models to the AirSim platform using Simulink.<\/p>\n<p>As simulated flights occur, huge volumes of data get generated. Developers capture all that data and use it to train AI models through various machine learning methods.<\/p>\n<p>Gathering this data is impossible to do in the real world, where you can\u2019t afford to make millions of mistakes, said Matt Holvey, director of intelligent systems at&nbsp;<a href=\"https:\/\/www.bellflight.com\/\">Bell<\/a><u>,&nbsp;<\/u>which also participated in Project AirSim\u2019s early access program. Often, you can\u2019t afford to make one.<\/p>\n<p>Given that, Bell is turning to Project AirSim to hone the&nbsp;<a href=\"https:\/\/customers.microsoft.com\/en-us\/story\/861665-bell-autonomous-systems\">ability of its drones to land autonomously<\/a>. It\u2019s a tough problem. What if the landing pad is covered in snow, or leaves or standing water? Will the aircraft be able to recognize it? What if the rotor blades kick up dust, obscuring the vehicle\u2019s vision? AirSim let Bell train its AI model on thousands of \u2018what if\u2019 scenarios in a matter of minutes, helping it practice and perfect a critical maneuver before attempting it in the real world.<\/p>\n<h2>The future of autonomous flight<\/h2>\n<p>The emerging world of advanced aerial mobility will launch a diverse cast of vehicles into the skies, from hobbyist drones to sophisticated eVTOLs (electric vertical take-off and landing) aircraft carrying passengers. And the potential use cases are almost limitless, Microsoft says: inspecting powerlines and ports, ferrying packages and people in crowded cities, operating deep inside cramped mines or high above farmlands.<\/p>\n<figure id=\"attachment_2496\" aria-describedby=\"caption-attachment-2496\" class=\"wp-caption aligncenter\"><a href=\"https:\/\/www.sickgaming.net\/blog\/wp-content\/uploads\/2022\/07\/microsoft-launches-project-airsim-an-end-to-end-platform-to-accelerate-autonomous-flight-1.png\"><img decoding=\"async\" loading=\"lazy\" class=\"wp-image-2496 size-full\" src=\"https:\/\/www.sickgaming.net\/blog\/wp-content\/uploads\/2022\/07\/microsoft-launches-project-airsim-an-end-to-end-platform-to-accelerate-autonomous-flight-1.png\" alt=\"Four simulated drones fly through forest settings.\" width=\"1920\" height=\"1080\"><\/a><figcaption id=\"caption-attachment-2496\" class=\"wp-caption-text\">In Project AirSim\u2019s high-fidelity environments, AI models learn through trial and error exactly which actions to take at each phase of flight. Image from Microsoft.<\/figcaption><\/figure>\n<p class>But technology alone won\u2019t usher in the world of autonomous flight. The industry must also chart a pathway through the world\u2019s airspace monitoring systems and regulatory environments. The Project AirSim team is actively engaged with standards bodies, civil aviation and regulatory agencies in shaping the necessary standards and means of compliance to accelerate this industry.<\/p>\n<p>Microsoft also plans to work with global civil aviation regulators on how Project AirSim might help with the certification of safe autonomous systems, Pall said, potentially creating scenarios inside AirSim that an autonomous vehicle must successfully navigate. In one case there is blinding rain, in one case deep winds, in one case it loses GPS connectivity. If the vehicle can still get from Point A to Point B every time, Pall said, that could be an important step toward certification.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Project AirSim uses the power of Azure to generate massive amounts of data for training AI models on exactly which actions to take at each phase of flight, from takeoff to cruising to landing. It will also offer libraries of simulated 3D environments representing diverse urban and rural landscapes as well as a suite of [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":126676,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[49],"tags":[135,50],"class_list":["post-126675","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-microsoft-news","tag-artificial-intelligence","tag-recent-news"],"_links":{"self":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/126675","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/comments?post=126675"}],"version-history":[{"count":0,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/126675\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media\/126676"}],"wp:attachment":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media?parent=126675"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/categories?post=126675"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/tags?post=126675"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}