Posted on Leave a comment

Microsoft at RSA Conference 2020: News resources in advance of next week’s big security event

Delivering on the promise of security AI to help defenders protect today’s hybrid environments

Technology is reshaping society — artificial intelligence is enabling us to increase crop yields, protect endangered animals and improve access to healthcare. Technology is also transforming criminal enterprises, which are developing increasingly targeted attacks against a growing range of devices and services. Using the cloud to harness the largest and most diverse set of signals — with the right mix of AI and human defenders — we can turn the tide in cybersecurity. Microsoft is announcing new capabilities in AI and automation available today to accelerate that change.

Read More

Posted on Leave a comment

Microsoft Office 365 and Dynamics 365 now available from new German datacenter regions

Microsoft Office 365 and Dynamics 365 are now available for organizations and enterprises from our new cloud datacenters in Germany, building on the late 2019 availability of Azure from our German new cloud regions. This is the first new datacenter launch by Microsoft in 2020, continuing a series of datacenter openings with United Arab Emirates, South Africa, and Switzerland also coming online in the last 9 months. This year, we will continue to extend our global offerings by delivering Office 365 and Dynamics 365 and Power Platform from new datacenter regions in Norway.

Microsoft is continuously making new investments in local infrastructure in response to growing customer demand as more industry leaders choose Microsoft’s cloud services to further their digital transformations. The new regions are designed to address the evolving needs of German customers with a range of innovative regional Microsoft cloud services to enable their businesses to move faster and achieve more. The new datacenter regions offer Microsoft’s full featured global cloud offering, full connectivity to our global cloud network, and customer data residency in Germany. This provides our customers with trusted cloud services that help them meet local compliance and policy requirements. In addition, replication of customer data in multiple datacenters across Germany gives customers reliable in-country services for business continuity in both pure cloud and hybrid scenarios.

Office 365, the world’s leading cloud-based productivity solution, helps customers enable the modern workplace and empower their employees with real-time collaboration and cloud-powered intelligence while maintaining security, compliance, and in-country customer data residency. Microsoft’s cloud-based productivity solutions provide email, collaboration, conferencing, enterprise social networking, and business intelligence. Microsoft Teams, in addition to Exchange Online, Sharepoint Online, and OneDrive for Business, are all delivered from the new German datacenter regions with local customer data storage.

In addition, Microsoft’s suite of intelligent business applications and tools that include Dynamics 365 Customer Service, Dynamics 365 Field Service, Dynamics 365 Sales and Dynamics 365 Project Service Automation are now open for first customers and partners and will be successively available for further customers in the coming months. Power BI, Power Automate, Power Apps, and Dynamics 365 for Finance and Supply Chain Management will follow later.

We see German organizations of all sizes and across all industries currently investing in new ways of empowering their employees with modern tools to enable secure, flexible, and mobile working that fosters collaboration. Office 365 from the Microsoft cloud in Germany is already seeing strong demand, especially with the new opportunity to store customer data at rest locally.

In-country data residency for core customer data helps Office 365 customers meet regulatory requirements, which is particularly important and relevant in industries such as financial services and public sector. This latest step will enable organizations and enterprises adopting Office 365 to accelerate their digital transformation journey. Some of the initial customers embracing this opportunity in the German regions include SAP, Deutsche Bank, ADAC, and Rohde & Schwarz.

“The general availability of Office 365 and Dynamics 365 via the new datacenter regions marks a significant step in the development of cloud computing in Germany. For many partners and customers, the local storage of their data remains a very high priority—whether for geopolitical or emotional reasons. This barrier has now been overcome and we expect further significant boost for the already fast-growing cloud market.”

—Florian Gerken, Senior Manager, Ingram Micro Distribution GmbH

“The Staff Department IT and Digitization is very much looking forward to the strategic and operative cooperation with Microsoft. By outsourcing large parts of our cloud management, we will be able to offer the countless volunteers in our diocese, but also the employees in the administration as well as in our approximately 1,000 parishes and numerous kindergartens, completely new opportunities for collaboration, including the development of own applications. This partnership will take the digitalization of the diocese a big step further. With Microsoft as a strategic partner, we have developed a very sustainable concept, which is also based on very high security standards.”

—Dr. Rudolf Scheid, Head of Staff Department IT and Digitization, Diocese of Augsburg

The new cloud regions in Germany are connected to Microsoft’s other regions via our global network, one of the largest and most innovative on the planet—spanning more than 100,000 miles (161,000 kilometers) of terrestrial fiber and subsea cable systems to deliver services to customers.

With this latest development bringing Office 365 and Dynamics 365 to the German datacenter regions, Microsoft enables companies of all sizes to drive their digital transformation while meeting local security and compliance requirements—to drive innovation and realize the benefits of the cloud.

Learn more about empowering your organization with Office 365.

Posted on Leave a comment

Reimagining healthcare: Partnering for a better future

There has never been a more exciting time to be working in healthcare and life sciences at Microsoft. Our investments across our organization in research and development, world-class talent, and strategic partnerships reflect our CEO Satya Nadella’s vision that many of the next health breakthroughs will come from healthcare and life sciences organizations working in partnership with technology companies like Microsoft. With our partners and our customers, we are just beginning to unlock the power of technology and innovation to advance our shared understanding of human health.

This unique opportunity to make a lasting, positive impact on healthcare is one of the reasons I joined Microsoft. For decades, Microsoft has built a reputation as a trusted partner, now counting more than 168,000 healthcare organizations around the world who rely on us. As we’ve built out platforms for cloud infrastructure, productivity and collaboration, and artificial intelligence, we’ve developed an ecosystem of hundreds of thousands of partners who are building on our technologies and bringing added value to our mutual customers.

A patient and a doctor examining a neuro scan on a large computer monitor

Innovation in medical imaging

Being new to Microsoft and a neuroradiologist, one of the areas I am most excited about is how we are helping our customers and partners reimagine healthcare and specifically explore the possibilities in medical imaging. In this area that is so critical to healthcare overall, we’re fortunate to work with some of the leaders in the industry.

GE Healthcare customers in the United States can take advantage of solutions running on Microsoft Azure such as the newly developed Edison™ Datalogue™ Connect, which was designed to provide secure image and data exchange to physicians working in their care settings.

Philips’ Azurion image-guided therapy platform empowers providers through image-guided minimally invasive therapies. Built for HoloLens 2, the work-in-progress Azurion mixed reality platform brings live imaging and other sources of vital data — currently displayed on large external 2D screens — into a 3D holographic environment that can be controlled by the physician.

Nuance, a leader in radiology reporting solutions with its PowerScribe platform, continues to lead the way in bringing ambient technologies to healthcare. We recently announced a strategic partnership with Nuance to accelerate that innovation, bringing together Nuance’s healthcare-optimized AI powered clinical documentation and decision support solutions and Microsoft Azure, advanced conversational AI, and natural language understanding.

Working together with researchers and industry partners, we’re also moving forward to create a broad range of cloud-based tools and solutions that touch many aspects of the development and delivery of effective care, including:

  • Azure Quantum solutions at work with Case Western Reserve University to accelerate and improve the accuracy of MRI scanners.
  • New opportunities to accelerate medical imagining with GraphCore and the Intelligence Processing Unit (IPU).
  • Empowering health team collaboration with Microsoft 365. Intelligent meetings and modern collaboration in a secure platform that integrates with clinical systems, from electronic health records to imaging software.
  • Research projects in registration and segmentation. Two of the fundamental problems that clinical researchers and practitioners are dealing with when working with 3D medical imaging modalities.
  • The Azure Stack Edge, a new Azure-managed appliance that brings the compute, storage, and intelligence of Azure to the edge for new healthcare scenarios including hardware acceleration with FPGA and GPU.

As part of our ongoing commitment to making health data easier to manage, in October we announced the general availability of the Azure API for FHIR. FHIR is quickly becoming the preferred standard for exchanging electronic health information and enabling the management of PHI data in the cloud. A rapidly growing number of healthcare delivery and healthcare technology companies are already using the Azure API for FHIR to improve interoperability within their own IT systems, including Great Ormond Street Hospital (GOSH) of the NHS, Darena Solutions, Northwell Health, and Humana. With the release of the Azure API for FHIR, Microsoft now provides a fully managed, enterprise-grade service for health data in the FHIR format. Building on this announcement, a few weeks ago we announced the IoMT FHIR Connector for Azure – an open-source tool enabling our customers to more easily ingest data from health and medical devices, including a FHIR framework for Apple HealthKit.

This investment in innovation with our partners and customers puts us on a path to make a meaningful impact in medical imaging. Together we can empower providers with an enterprise imaging platform that enables reliability and security, manages growing patient data with strong controls for privacy and compliance, and provides insights from the data to improve patient care.

Learn more at RSNA

We will be engaging with more than 50,000 clinicians in radiology at the Radiological Society of North America (RSNA) conference in Chicago. Stop by our Microsoft Booth #10745 in the AI Showcase to learn more about our work and see how we are collaborating with partners and customers to reimagine healthcare. Our partners: Agfa HealthCare, Lunit, NucleusHealth, RamSoft, SOPHiA GENETICS, Volpara, 7 Medical and others will be on hand to share their innovative work. In a special session, I’ll be sharing Microsoft’s view on the opportunities to reimagine healthcare and specifically medical imaging. Several of our partners will join to share how they’re using technology, from the cloud to quantum computing to mixed reality and teleradiology, to help radiologists today.

Posted on Leave a comment

Cancer researchers embrace AI to accelerate development of precision medicine

YouTube Video

Biomedical researchers are embracing artificial intelligence to accelerate the implementation of cancer treatments that target patients’ specific genomic profiles, a type of precision medicine that in some cases is more effective than traditional chemotherapy and has fewer side effects.

The potential for this new era of cancer treatment stems from advances in genome sequencing technology that enables researchers to more efficiently discover the specific genomic mutations that drive cancer, and an explosion of research on the development of new drugs that target those mutations.

To harness this potential, researchers at The Jackson Laboratory, an independent, nonprofit biomedical research institution also known as JAX and headquartered in Bar Harbor, Maine, developed a tool to help the global medical and scientific communities stay on top of the continuously growing volume of data generated by advances in genomic research.

The tool, called the Clinical Knowledgebase, or CKB, is a searchable database where subject matter experts store, sort and interpret complex genomic data to improve patient outcomes and share information about clinical trials and treatment options.

The challenge is to find the most relevant cancer-related information from the 4,000 or so biomedical research papers published each day, according to Susan Mockus, the associate director of clinical genomic market development with JAX’s genomic medicine institute in Farmington, Connecticut.

“Because there is so much data and so many complexities, without embracing and incorporating artificial intelligence and machine learning to help in the interpretation of the data, progress will be slow,” she said.

That’s why Mockus and her colleagues at JAX are collaborating with computer scientists working on Microsoft’s Project Hanover who are developing AI technology that enables machines to read complex medical and research documents and highlight the important information they contain.

While this machine reading technology is in the early stages of development, researchers have found they can make progress by narrowing the focus to specific areas such as clinical oncology, explained Peter Lee, corporate vice president of Microsoft Healthcare in Redmond, Washington.

“For something that really matters like cancer treatment where there are thousands of new research papers being published every day, we actually have a shot at having the machine read them all and help a board of cancer specialists answer questions about the latest research,” he said.

Peter Lee stands with arms crossed behind some plants
Peter Lee, corporate vice president of Microsoft Healthcare. Photo by Dan DeLong.

Curating CKB

Mockus and her colleagues are using Microsoft’s machine reading technology to curate CKB, which stores structured information about genomic mutations that drive cancer, drugs that target cancer genes and the response of patients to those drugs.

One application of this knowledgebase allows oncologists to discover what, if any, matches exist between a patient’s known cancer-related genomic mutations and drugs that target them as they explore and weigh options for treatment, including enrollment in clinical trials for drugs in development.

This information is also useful to translational and clinical researchers, Mockus noted.

The bottleneck is filtering through the more than 4,000 papers published every day in biomedical journals to find the subset of about 200 related to cancer, read them and update CKB with the relevant information on the mutation, drug and patient response.

“What you want is some degree of intelligence incorporated into the system that can go out and not just be efficient, but also be effective and relevant in terms of how it can filter information. That is what Hanover has done,” said Auro Nair, executive vice president of JAX.

The core of Microsoft’s Project Hanover is the capability to comb through the thousands of documents published each day in the biomedical literature and flag and rank all that are potentially relevant to cancer researchers, highlighting, for example, information on gene, mutation, drug and patient response.

Human curators working on CKB are then free to focus on the flagged research papers, validating the accuracy of the highlighted information.

“Our goal is to make the human curators superpowered,” said Hoifung Poon, director of precision health natural language processing with Microsoft’s research organization in Redmond and the lead researcher on Project Hanover.

“With the machine reader, we are able to suggest that this might be a case where a paper is talking about a drug-gene mutation relation that you care about,” Poon explained. “The curator can look at this in context and, in a couple of minutes, say, ‘This is exactly what I want,’ or ‘This is incorrect.’”

Hoifung Poon sits on a yellow chair
Hoifung Poon , director of precision health natural language processing with Microsoft’s research organization, is leading the development of Project Hanover, a machine reading technology. Photo by Jonathan Banks.

Self supervision

To be successful, Poon and his team need to train machine learning models in such a way that they catch all the potentially relevant information – ensure there are no gaps in content – and, at the same time, weed out irrelevant information sufficiently to make the curation process more efficient.

In traditional machine reading tasks such as finding information about celebrities in news stories, researchers tend to focus on relationships contained within a single sentence, such as a celebrity name and a new movie.

Since this type of information is widespread across news stories, researchers can skip instances that are more challenging such as when the name of the celebrity and movie are mentioned in separate paragraphs, or when the relationship involves more than two pieces of information.

“In biomedicine, you can’t do that because your latest finding may only appear in this single paper and if you skip it, it could be life or death for this patient,” explained Poon. “In this case, you have to tackle some of the hard linguistic challenges head on.”

Poon and his team are taking what they call a self-supervision approach to machine learning in which the model automatically annotates training examples from unlabeled text by leveraging prior knowledge in existing databases and ontologies.

For example, a National Cancer Institute initiative manually compiled information from the biomedical literature on how genes regulate each other but was unable to sustain the effort beyond two years. Poon’s team used the compiled knowledge to automatically label documents and train a machine reader to find new instances of gene regulation.

They took the same approach with public datasets on approved cancer drugs and drugs in clinical trials, among other sources.

This connect-the-dots approach creates a machine learned model that “rarely misses anything” and is precise enough “where we can potentially improve the curation efficiency by a lot,” said Poon.

Collaboration with JAX

The collaboration with JAX allows Poon and his team to validate the effectiveness of Microsoft’s machine reading technology while increasing the efficiency of Mockus and her team as they curate CKB.

“Leveraging the machine reader, we can say here is what we are interested in and it will help to triage and actually rank papers for us that have high clinical significance,” Mockus said. “And then a human goes in to really tease apart the data.”

Over time, feedback from the curators will be used to help train the machine reading technology, making the models more precise and, in turn, making the curators more efficient and allowing the scope of CKB to expand.

“We feel really, really good about this relationship,” said Nair. “Particularly from the standpoint of the impact it can have in providing a very powerful tool to clinicians.”

Related:

John Roach writes about Microsoft research and innovation. Follow him on Twitter.

Posted on Leave a comment

Artificial intelligence makes a splash in efforts to protect Alaska’s ice seals and beluga whales

When Erin Moreland set out to become a research zoologist, she envisioned days spent sitting on cliffs, drawing seals and other animals to record their lives for efforts to understand their activities and protect their habitats.

Instead, Moreland found herself stuck in front of a computer screen, clicking through thousands of aerial photographs of sea ice as she scanned for signs of life in Alaskan waters. It took her team so long to sort through each survey — akin to looking for lone grains of rice on vast mounds of sand — that the information was outdated by the time it was published.

“There’s got to be a better way to do this,” she recalls thinking. “Scientists should be freed up to contribute more to the study of animals and better understand what challenges they might be facing. Having to do something this time-consuming holds them back from what they could be accomplishing.”

Woman sits on boat with iceberg behind her
NOAA scientist Erin Moreland felt sure there was a technological solution to help her team sort through millions of aerial images of ice each year. She hit the jackpot with artificial intelligence. (Photo provided by NOAA)

That better way is now here — an idea that began, unusually enough, with the view from Moreland’s Seattle office window and her fortuitous summons to jury duty. She and her fellow National Oceanic and Atmospheric Administration scientists now will use artificial intelligence this spring to help monitor endangered beluga whales, threatened ice seals, polar bears and more, shaving years off the time it takes to get data into the right hands to protect the animals.

The teams are training AI tools to distinguish a seal from a rock and a whale’s whistle from a dredging machine’s squeak as they seek to understand the marine mammals’ behavior and help them survive amid melting ice and increasing human activity.

Moreland’s project combines AI technology with improved cameras on a NOAA turboprop airplane that will fly over the Beaufort Sea north of Alaska this April and May, scanning and classifying the imagery to produce a population count of ice seals and polar bears that will be ready in hours instead of months. Her colleague Manuel Castellote, a NOAA affiliate scientist, will apply a similar algorithm to the recordings he’ll pick up from equipment scattered across the bottom of Alaska’s Cook Inlet, helping him quickly decipher how the shrinking population of endangered belugas spent its winter.

The data will be confirmed by scientists, analyzed by statisticians and then reported to people such as Jon Kurland, NOAA’s assistant regional administrator for protected resources in Alaska.

Scientist Manuel Castellote (right) goes out in Alaska’s Cook Inlet each spring and fall to collect microphones at the bottom of the sea. He and his team first ping the equipment, instructing it to release the microphone so it can resurface. Then they bring it onboard to download the data before guiding the equipment back down to the ocean floor, where it will listen for another six months. (Photo by Daniela Huson with Ocean Conservation Research)

Kurland’s office in Juneau is charged with overseeing conservation and recovery programs for marine mammals around the state and its waters and helping guide all the federal agencies that issue permits or carry out actions that could affect those that are threatened or endangered.

Of the four types of ice seals in the Bering Sea — bearded, ringed, spotted and ribbon — the first two are classified as threatened, meaning they are likely to become in danger of extinction within the foreseeable future. The Cook Inlet beluga whales are already endangered, having steadily declined to a population of only 279 in last year’s survey, from an estimate of about a thousand 30 years ago.

Individual groups of beluga whales are isolated and don’t breed with others or leave their home, “so if this population goes extinct, no one else will come in; they’re gone forever,” says Castellote. “Other belugas wouldn’t survive there because they don’t know the environment. So you’d lose that biodiversity forever.”

Yet recommendations by Kurland’s office to help mitigate the impact of human activities such as construction and transportation, in part by avoiding prime breeding and feeding periods and places, are hampered by a lack of timely data.

“There’s basic information that we just don’t have now, so getting it will give us a much clearer picture of the types of responses that may be needed to protect these populations,” Kurland says. “In both cases, for the whales and seals, this kind of data analysis is cutting-edge science, filling in gaps we don’t have another way to fill.”

A man and a woman stand in front of a helicopter.
Erin Moreland’s first ice seal survey was in 2007, flying in a helicopter based on an icebreaker. Scientists collected 90,000 images and spent months scanning them but only found 200 seals. It was a tedious, imprecise process. (Photo provided by NOAA)

The AI project was born years ago, when Moreland would sit at her computer in NOAA’s Marine Mammal Laboratory in Seattle and look across Lake Washington toward Microsoft’s headquarters in Redmond, Washington. She felt sure there was a technological solution to her frustration, but she didn’t know anyone with the right skills to figure it out. 

She hit the jackpot one week while serving on a jury in 2018. She overheard two fellow jurors discussing AI during a break in the trial, so she began talking with them about her work. One of them connected her with Dan Morris from Microsoft’s AI for Earth program, who suggested they pitch the problem as a challenge that summer at the company’s Hackathon, a week-long competition when software developers, programmers, engineers and others collaborate on projects. Fourteen Microsoft engineers signed up to work on the problem.

“Across the wildlife conservation universe, there are tons of scientists doing boring things, reviewing images and audio,” Morris says. “Remote equipment lets us collect all kinds of data, but scientists have to figure out how to use that data. Spending a year annotating images is not only a bad use of their time, but the questions get answered way later than they should.”

Moreland’s idea wasn’t as simple as it may sound, though. While there are plenty of models to recognize people in images, there were none — until now — that could find seals, especially real-time in aerial photography. But the hundreds of thousands of examples NOAA scientists had classified in previous surveys helped technologists, who are using them to train the AI models to recognize which photographs and recordings contained mammals and which didn’t.

“Part of the challenge was that there were 20 terabytes of data of pictures of ice, and working on your laptop with that much data isn’t practical,” says Morris. “We had daily handovers of hard drives between Seattle and Redmond to get this done. But the cloud makes it possible to work with all that data and train AI models, so that’s how we’re able to do this work, with Azure.”

Can you spot the seals in this aerial photograph (left)? Look at the thermal image (right), and then back at the photo — can you even see them now? This is what AI will help NOAA scientists sort through. (Photo provided by NOAA, from a survey of Alaska’s Kotzebue Sound, where the ice had melted, forcing the seals closer together than normal.)

Moreland’s first ice seal survey was in 2007, flying in a helicopter based on an icebreaker. Scientists collected 90,000 images and spent months scanning them but only found 200 seals. It was a tedious, imprecise process.

Ice seals live largely solitary lives, making them harder to spot than animals that live in groups. Surveys are also complicated because the aircraft have to fly high enough to keep seals from getting scared and diving, but low enough to get high-resolution photos that enable scientists to differentiate a ring seal from a spotted seal, for example. The weather in Alaska — often rainy and cloudy — further complicates efforts.

Subsequent surveys improved by pairing thermal and color cameras and using modified planes that had a greater range to study more area and could fly higher up to be quieter. Even so, thermal interference from dirty ice and reflections off jumbled ice made it difficult to determine what was an animal and what wasn’t.

And then there was the problem of manpower to go along with all the new data. The 2016 survey produced a million pairs of thermal and color images, which a previous software system narrowed down to 316,000 hot spots that the scientists had to manually sort through and classify. It took three people six months.

Posted on Leave a comment

Microsoft Connected Vehicle Platform: trends and investment areas

This post was co-authored by the extended Azure Mobility Team.

The past year has been eventful for a lot of reasons. At Microsoft, we’ve expanded our partnerships, including Volkswagen, LG Electronics, Faurecia, TomTom, and more, and taken the wraps off new thinking such as at CES, where we recently demonstrated our approach to in-vehicle compute and software architecture.

Looking ahead, areas that were once nominally related now come into sharper focus as the supporting technologies are deployed and the various industry verticals mature. The welcoming of a new year is a good time to pause and take in what is happening in our industry and in related ones with an aim to developing a view on where it’s all heading.

In this blog, we will talk about the trends that we see in connected vehicles and smart cities and describe how we see ourselves fitting in and contributing.

Trends

Mobility as a Service (Maas)

MaaS (sometimes referred to as Transportation as a Service, or TaaS) is about people getting to goods and services and getting those goods and services to people. Ride-hailing and ride-sharing come to mind, but so do many other forms of MaaS offerings such as air taxis, autonomous drone fleets, and last-mile delivery services. We inherently believe that completing a single trip—of a person or goods—will soon require a combination of passenger-owned vehicles, ride-sharing, ride-hailing, autonomous taxis, bicycle-and scooter-sharing services transporting people on land, sea, and in the air (what we refer to as “multi-modal routing”). Service offerings that link these different modes of transportation will be key to making this natural for users.

With Ford, we are exploring how quantum algorithms can help improve urban traffic congestion and develop a more balanced routing system. We’ve also built strong partnerships with TomTom for traffic-based routing as well as with AccuWeather for current and forecast weather reports to increase awareness of weather events that will occur along the route. In 2020, we will be integrating these routing methods together and making them available as part of the Azure Maps service and API. Because mobility constitutes experiences throughout the day across various modes of transportation, finding pickup locations, planning trips from home and work, and doing errands along the way, Azure Maps ties the mobility journey with cloud APIs and iOS and Android SDKs to deliver in-app mobility and mapping experiences. Coupled with the connected vehicle architecture of integration with federated user authentication, integration with the Microsoft Graph, and secure provisioning of vehicles, digital assistants can support mobility end-to-end. The same technologies can be used in moving goods and retail delivery systems.

The pressure to become profitable will force changes and consolidation among the MaaS providers and will keep their focus on approaches to reducing costs such as through autonomous driving. Incumbent original equipment manufacturers (OEMs) are expanding their businesses to include elements of car-sharing to continue evolving their businesses as private car ownership is likely to decline over time.

Connecting vehicles to the cloud

We refer holistically to these various signals that can inform vehicle routing (traffic, weather, available modalities, municipal infrastructure, and more) as “navigation intelligence.” Taking advantage of this navigation intelligence will require connected vehicles to become more sophisticated than just logging telematics to the cloud.

The reporting of basic telematics (car-to-cloud) is barely table-stakes; over-the-air updates (OTA, or cloud-to-car) will become key to delivering a market-competitive vehicle, as will command-and-control (more cloud-to-car, via phone apps). Forward-thinking car manufacturers deserve a lot of credit here for showing what’s possible and for creating in consumers the expectation that the appearance of new features in the car after it is purchased isn’t just cool, but normal.

Future steps include the integration of in-vehicle infotainment (IVI) with voice assistants that blend the in- and out-of-vehicle experiences, updating AI models for in-market vehicles for automated driving levels one through five, and of course pre-processing the telemetry at the edge in order to better enable reinforcement learning in the cloud as well as just generally improving services.

Delivering value from the cloud to vehicles and phones

As vehicles become more richly connected and deliver experiences that overlap with what we’ve come to expect from our phones, an emerging question is, what is the right way to make these work together? Projecting to the IVI system of the vehicle is one approach, but most agree that vehicles should have a great experience without a phone present.

Separately, phones are a great proxy for “a vehicle” in some contexts, such as bicycle sharing, providing speed, location, and various other probe data, as well as providing connectivity (as well as subsidizing the associated costs) for low-powered electronics on the vehicle.

This is probably a good time to mention 5G. The opportunity 5G brings will have a ripple effect across industries. It will be a critical foundation for the continued rise of smart devices, machines, and things. They can speak, listen, see, feel, and act using sensitive sensor technology as well as data analytics and machine learning algorithms without requiring “always on” connectivity. This is what we call the intelligent edge. Our strategy is to enable 5G at the edge through cloud partnerships, with a focus on security and developer experience.

Optimizations through a system-of-systems approach

Connecting things to the cloud, getting data into the cloud, and then bringing the insights gained through cloud-enabled analytics back to the things is how optimizations in one area can be brought to bear in another area. This is the essence of digital transformation. Vehicles gathering high-resolution imagery for improving HD maps can also inform municipalities about maintenance issues. Accident information coupled with vehicle telemetry data can inform better PHYD (pay how you drive) insurance plans as well as the deployment of first responder infrastructure to reduce incident response time.

As the vehicle fleet electrifies, the demand for charging stations will grow. The way in-car routing works for an electric car is based only on knowledge of existing charging stations along the route—regardless of the current or predicted wait-times at those stations. But what if that route could also be informed by historical use patterns and live use data of individual charging stations in order to avoid arriving and having three cars ahead of you? Suddenly, your 20-minute charge time is actually a 60-minute stop, and an alternate route would have made more sense, even if, on paper, it’s more miles driven.

Realizing these kinds of scenarios means tying together knowledge about the electrical grid, traffic patterns, vehicle types, and incident data. The opportunities here for brokering the relationships among these systems are immense, as are the challenges to do so in a way that encourages the interconnection and sharing while maintaining privacy, compliance, and security.

Laws, policies, and ethics

The past several years of data breaches and elections are evidence of a continuously evolving nature of the security threats that we face. That kind of environment requires platforms that continuously invest in security as a fundamental cost of doing business.

Laws, regulatory compliance, and ethics must figure into the design and implementation of our technologies to as great a degree as goals like performance and scalability do. Smart city initiatives, where having visibility into the movement of people, goods, and vehicles is key to doing the kinds of optimizations that increase the quality of life in these cities, will confront these issues head-on.

Routing today is informed by traffic conditions but is still fairly “selfish:” routing for “me” rather than for “we.” Cities would like a hand in shaping traffic, especially if they can factor in deeper insights such as the types of vehicles on the road (sending freight one way versus passenger traffic another way), whether or not there is an upcoming sporting event or road closure, weather, and so on.

Doing this in a way that is cognizant of local infrastructure and the environment is what smart cities initiatives are all about.

For these reasons, we have joined the Open Mobility Foundation. We are also involved with Stanford’s Digital Cities Program, the Smart Transportation Council, the Alliance to Save Energy by the 50×50 Transportation Initiative, and the World Business Council for Sustainable Development.

With the Microsoft Connected Vehicle Platform (MCVP) and an ecosystem of partners across the industry, Microsoft offers a consistent horizontal platform on top of which customer-facing solutions can be built. MCVP helps mobility companies accelerate the delivery of digital services across vehicle provisioning, two-way network connectivity, and continuous over-the-air updates of containerized functionality. MCVP provides support for command-and-control, hot/warm/cold path for telematics, and extension hooks for customer/third-party differentiation. Being built on Azure, MCVP then includes the hyperscale, global availability, and regulatory compliance that comes as part of Azure. OEMs and fleet operators leverage MCVP as a way to “move up the stack” and focus on their customers rather than spend resources on non-differentiating infrastructure.

Innovation in the automotive industry

At Microsoft, and within the Azure IoT organization specifically, we have a front-row seat on the transformative work that is being done in many different industries, using sensors to gather data and develop insights that inform better decision-making. We are excited to see these industries on paths that are trending to converging, mutually beneficial paths. Our colleague Sanjay Ravi shares his thoughts from an automotive industry perspective in this great article.

Turning our attention to our customer and partner ecosystem, the traction we’ve gotten across the industry has been overwhelming:

The Volkswagen Automotive Cloud will be one of the largest dedicated clouds of its kind in the automotive industry and will provide all future digital services and mobility offerings across its entire fleet. More than 5 million new Volkswagen-specific brand vehicles are to be fully connected on Microsoft’s Azure cloud and edge platform each year. The Automotive Cloud subsequently will be rolled out on all Group brands and models.

Cerence is working with us to integrate Cerence Drive products with MCVP. This new integration is part of Cerence’s ongoing commitment to delivering a superior user experience in the car through interoperability across voice-powered platforms and operating systems. Automakers developing their connected vehicle solutions on MCVP can now benefit from Cerence’s industry-leading conversational AI, in turn delivering a seamless, connected, voice-powered experience to their drivers.

Ericsson, whose Connected Vehicle Cloud connects more than 4 million vehicles across 180 countries, is integrating their Connected Vehicle Cloud with Microsoft’s Connected Vehicle Platform to accelerate the delivery of safe, comfortable, and personalized connected driving experiences with our cloud, AI, and IoT technologies.

LG Electronics is working with Microsoft to build its automotive infotainment systems, building management systems and other business-to-business collaborations. LG will leverage Microsoft Azure cloud and AI services to accelerate the digital transformation of LG’s B2B business growth engines, as well as Automotive Intelligent Edge, the in-vehicle runtime environment provided as part of MCVP.

Global technology company ZF Friedrichshafen is transforming into a provider of software-driven mobility solutions, leveraging Azure cloud services and developer tools to promote faster development and validation of connected vehicle functions on a global scale.

Faurecia is collaborating with Microsoft to develop services that improve comfort, wellness, and infotainment as well as bring digital continuity from home or the office to the car. At CES, Faurecia demonstrated how its cockpit integration will enable Microsoft Teams video conferencing. Using Microsoft Connected Vehicle Platform, Faurecia also showcased its vision of playing games on the go, using Microsoft’s new Project xCloud streaming game preview.

Bell has revealed AerOS, a digital mobility platform that will give operators a 360° view into their aircraft fleet. By leveraging technologies like artificial intelligence and IoT, AerOS provides powerful capabilities like fleet master scheduling and real-time aircraft monitoring, enhancing Bell’s Mobility-as-a-Service (MaaS) experience. Bell chose Microsoft Azure as the technology platform to manage fleet information, observe aircraft health, and manage the throughput of goods, products, predictive data, and maintenance.

Luxoft is expanding its collaboration with Microsoft to accelerate the delivery of connected vehicle solutions and mobility experiences. By leveraging MCVP, Luxoft will enable and accelerate the delivery of vehicle-centric solutions and services that will allow automakers to deliver unique features such as advanced vehicle diagnostics, remote access and repair, and preventive maintenance. Collecting real usage data will also support vehicle engineering to improve manufacturing quality.

We are incredibly excited to be a part of the connected vehicle space. With MCVP, our ecosystem partners and our partnerships with leading automotive players, both vehicle OEMs and automotive technology suppliers, we believe we have a uniquely capable offering enabling at global scale the next wave of innovation in the automotive industry as well as related verticals such as smart cities, smart infrastructure, insurance, transportation, and beyond.

Posted on Leave a comment

Along with our customers and partners, Microsoft will drive mobility in the next decade

As we embark upon a new decade, the automotive industry is reaching the most transformative point in its long, pre-digital history. It is predicted that by 2030, there will be a $4 trillion opportunity focused on new mobility services, as the automotive and transportation sectors converge.

Sanjay Ravi
Sanjay Ravi.

Nowhere was the breadth and scale of this opportunity more evident than at CES 2020, held earlier this year in Las Vegas. At this year’s show, two key themes really stood out for me in terms of the transformations that are happening around connected, autonomous, shared and electric (C.A.S.E.) scenarios, and the underlying technologies that are enabling them.

First, the C.A.S.E. technologies that were introduced during the past decade have advanced significantly. And second, over the next 10 years, we will see these capabilities merge.

The C.A.S.E. technologies that were introduced during the past decade have advanced significantly. At CES, we were proud to share in some important announcements with our customers and partners around these advancements, demonstrating how Microsoft technology is helping to accelerate new business models and consumer experiences.

Re-inventing the in-vehicle experience

When it comes to connected vehicles, capabilities such as in-car productivity and entertainment are critical for competitive differentiation. Faurecia, a global leader in automotive technology, is collaborating with Microsoft to develop services that improve comfort, wellness and infotainment, as well as bring digital continuity from the home or office to the car, through access to content on demand or through collaborative working platforms.

A cloud-connected cockpit gives automakers, mobility providers and consumers the ability to upgrade their traveling environment, for example, through enhancing sound, and personalizing entertainment options or in-cabin services. At CES, Faurecia demonstrated how its cockpit integration will enable Microsoft Teams videoconferencing. Using Microsoft Connected Vehicle Platform, Faurecia also showcased its vision of playing games on the go, using Microsoft’s new Project xCloud streaming game preview.

A demo of the connected Faurecia cockpit.
Jean-Philippe Courtois, Microsoft executive vice president, and president of Global Sales, Marketing and Operations, experiences Faurecia’s cockpit demo at CES 2020.

Cerence, a global leader in creating unique, moving experiences for the automotive world, is working with Microsoft to integrate Cerence Drive products with the Microsoft Connected Vehicle Platform (MCVP). This new integration is part of Cerence’s ongoing commitment to delivering a superior user experience in the car through interoperability across voice-powered platforms and operating systems. Automakers developing their connected vehicle solutions on MCVP can now benefit from Cerence’s industry-leading conversational artificial intelligence (AI), in turn delivering a seamless, connected, voice-powered experience to drivers and passengers using their technology.

Speeding up the drive to full autonomy

Mainstream autonomous mobility is coming. IHS Markit, a world leader in critical information, analytics and solutions, cites significant growth in the availability and standardization of advanced driver-assistance systems (ADAS) and automated driving, as people become more comfortable with these technologies.

Microsoft is collaborating with the industry to bring us closer to an autonomous future by accelerating autonomous driving development and testing with the Azure ecosystem. For example, Elektrobit, an award-winning global supplier of embedded and connected software products and services for the automotive industry, accelerates development of ADAS and AD systems with a new, cloud-based, end-to-end solution for software validation.

Available on Azure, the new EB Assist Test Lab provides distributed teams with a single solution to more easily manage petabytes of driving-scene data generated in real and simulated test drives during the validation and verification process, allowing those teams to collaborate and ultimately bring the latest features into production more quickly.

Pioneering the mobility experiences of the future 

The next decade will see the creation of standardized platforms for smart mobility services that are built to support commercial solutions, meet consumer demands at global scale and re-invent experiences. Bell’s digital mobility platform, AerOS, will give fleet operators a 360-degree view into their aircraft fleet. By leveraging technologies like AI and IoT, AerOS provides powerful capabilities like fleet master scheduling and real-time aircraft monitoring, enhancing Bell’s Mobility-as-a-Service (MaaS) experience. In building AerOS, Bell chose Microsoft’s Azure cloud as the foundation, and teamed up with Microsoft’s engineers to gain architectural insight, developer support and best practices.

Mobility services will also be a major catalyst for the development of advanced IoT capabilities that make it possible to securely transmit data in complex environments across edge devices such as vehicles, phones, traffic lights or charging stations, and the cloud. We are already seeing the converging of the automotive retail and energy industries, thanks to what is happening with smart charging. Now, the entire energy grid is coming together in a connected way to redefine how we power our cars.

FlashParking, a leader in parking technology, has unveiled their Mobility Hub Operating System, a platform built on Microsoft Azure that is powering the evolution of isolated parking assets into connected mobility hubs that are more efficient, intelligent and adaptable than the garages and surface lots of the past.

Merging advanced technologies to power the future of the automotive industry

The convergence of advanced technologies is playing a key role in enabling the automotive ecosystem and delivering smart mobility services. This is where Microsoft comes in. Along with our extensive global partner network, we support automotive and mobility companies in their evolution to becoming sustainable mobility service providers.

Global technology company ZF Friedrichshafen is transforming into a provider of software-driven mobility solutions, leveraging Azure cloud services and developer tools to promote faster development and validation of connected vehicle functions at a global scale.

LG Electronics is working with Microsoft to build its automotive infotainment systems, building management systems and other business-to-business collaborations. LG will leverage Microsoft Azure cloud and AI services to accelerate the digital transformation of LG’s B2B business growth engines.

Accelerating the connected vehicle opportunity

Many of the value-added services that were on display at CES from our customers and partners are powered by the Microsoft Connected Vehicle Platform (MCVP). It provides underlying capabilities that our partners and OEMs can use to quickly and cost-effectively create their own connected vehicle solutions. These include digital services ranging from assisted and autonomous driving to in-vehicle AI telemetry and advanced navigation.

For example, leveraging Azure Maps, Microsoft has built strong partnerships with TomTom, a leading independent location technology specialist, for traffic-based routing. In addition, we are working with TomTom and Moovit on developing a multi-modal trip planner, and with AccuWeather for weather reports and forecasts to increase awareness of weather events that will occur along a driver’s route.

A growing number of car makers and partners are taking advantage of MCVP, including Volkswagen and Renault-Nissan-Mitsubishi Alliance. At CES, Kal Mos, alliance global VP of connected car service at Renault-Nissan-Mitsubishi, explained the evolution of Nissan’s customer connected services and shared his views for the future.

The Volkswagen Automotive Cloud will be one of the largest dedicated clouds of its kind in the automotive industry and will provide all future digital services and mobility offerings across its entire fleet. More than 5 million new Volkswagen-specific brand vehicles are to be fully connected on Microsoft’s Azure cloud and edge platform each year. The Automotive Cloud subsequently will be rolled out on all Volkswagen Group brands and models.

Volkswagen intends to assemble more than 10,000 digital experts together in its new Car.Software organization, with a group-wide responsibility for software in the vehicle by 2025. The organization will develop cross-brand software in five clusters: Connected Car & Device Platform; Intelligent Body & Cockpit; Automated Driving; Vehicle Motion & Energy; and Digital Business & Mobility Services. The objective is to establish one uniform software architecture across the Volkswagen Group, and bring together parallel development paths in the brands. The clusters will cover the development work on one standard vehicle operating system, “vw.os,” for all Volkswagen Group vehicles and their connection to the Volkswagen Automotive Cloud.

Ericsson is integrating its Connected Vehicle Cloud, which connects more than 4 million vehicles across 180 countries, with Microsoft’s Connected Vehicle Platform to accelerate the delivery of safe, comfortable and personalized connected driving experiences. The integrated solution allows automakers to more quickly and easily deploy and scale global vehicle services such as fleet management, over-the-air software upgrades and connected safety services, while reducing costs.

Luxoft, a digital strategy and software engineering firm, is expanding its collaboration with Microsoft to accelerate the delivery of connected vehicle solutions and mobility experiences. By leveraging MCVP, Luxoft will enable and accelerate the delivery of vehicle-centric solutions and services that will allow automakers to deliver unique features such as advanced vehicle diagnostics, remote access and repair, and preventive maintenance. Collecting real usage data will also support vehicle engineering to improve manufacturing quality.

Posted on Leave a comment

CVP Rik van der Kooi on Black History Month: Leaning in

White, Dutch, male and writing about Black History Month?

As an executive at Microsoft, a resident of the United States and a human being, it is important to me to use my voice to support the many communities around me, to give back, to empower others and to be a catalyst for change. It was with that idea in mind that I reached out to Kathleen Hogan, our executive vice president of Human Resources some years ago and asked if I could be a sponsor for the Employee Resource Group that supports our black and African American community at Microsoft called Blacks at Microsoft (BAM).

Being part of BAM for the last three years as co-sponsor has been an absolute honor and a privilege. Thanks to the generosity of the BAM community, I have had the opportunity to listen and learn much more directly about what’s top of mind for the community and explore my own understandings and assumptions. I’ve learned things about black history in the United States that I knew embarrassingly little about. And I’ve been deeply impressed with the cohesion and support BAM members provide each other and the external community. For me, the opportunity to influence others by actively participating in events and tune in to learn from others, to speak up when I observe behaviors inconsistent with our values or beliefs on inclusion, and to amplify stories that need to be told to help address injustices in society is some of the most rewarding work I have done while at Microsoft.

Black History Month, in the U.S. and Canada, is an opportunity for all of us to “knock on the door” to increase our awareness and understanding – from African history to slavery to the Jim Crow South to the civil rights movement to present-day inequities. It is also an opportunity to recognize and honor more recent examples of achievement from the black community and to reflect on what it means to create a truly equitable society.

I encourage everyone – community member or ally – to set aside some time this month to better understand black history, to be intentionally inclusive and to get acquainted with those who are different, with the intention of deepening empathy and understanding. In doing so, we become aware of our own biases, get curious about other points of view and gain the courage to have challenging conversations. Let every Black History Month be an opportunity to understand a little more, to be more connected and to deepen our sense of community.

Tags: , ,

Posted on Leave a comment

ElectionGuard pilot in Fulton, Wisconsin, is another step in making elections more secure

Tomorrow I’ll be in Fulton, Wisconsin, with a team of people from Microsoft taking one of many steps needed to prepare our ElectionGuard technology for broad adoption. Together with election officials from the state of Wisconsin and the election technology company VotingWorks, we will be piloting ElectionGuard in an actual election for the first time.

As voters in Fulton go to their polling place tomorrow to cast ballots in a primary election for Wisconsin Supreme Court candidates, the official count will be tallied using paper ballots as usual. However, ElectionGuard will also provide an encrypted digital tally of the vote that will enable voters to confirm their votes have been counted and not altered. Tomorrow’s pilot is one step in a deliberate and careful process to get ElectionGuard right before it’s used more broadly across the country.

Preparing technology for wide adoption is accomplished through incremental steps that enable iteration and improvement. We first demonstrated an implementation of ElectionGuard to cybersecurity experts and others at the annual Aspen Security Forum last summer. Then, in September, we shared the code for ElectionGuard as an open source project on GitHub so voting machine manufacturers, security researchers and others could begin testing it. We announced a bug bounty program, offering up to $15,000 to people who report security vulnerabilities with ElectionGuard so they can be fixed. The code was also tested for security vulnerabilities by NCC Group. Tomorrow’s pilot gives us the first chance to see ElectionGuard in action in a real election, to assess its performance and observe voter reaction. We hope to learn from this so we can continue to work with election officials in Wisconsin and other states – and with technology partners such as VotingWorks – to improve ElectionGuard. This is by no means the last step in our preparation; we anticipate many more pilots of ElectionGuard technology as we get it ready for prime time.

To be clear, the biggest credit for tomorrow’s pilot goes to the Wisconsin Election Commission and its Administrator Meagan Wolfe, as well as Rock County Clerk Lisa Tollefson for making the decision to try ElectionGuard so they can evaluate it for future use, and to VotingWorks, which designed and built much of the physical voting experience used in Fulton tomorrow. We’ve worked closely with the Commission and VotingWorks in recent months to test the system and voting machines for pilot use tomorrow, to conduct a public test of the machines even before the pilot, and to train polling place workers. We are also grateful to Connie Zimmerman, the Fulton Town Clerk, for enabling and supporting this pilot in the polling place she’s run for years, and to the Fulton Town Board, which voted to approve the pilot.

Tomorrow’s voting experience includes a three-step process. First, a voter will select candidates on a touchscreen and verify their choices. Second, the voter will print and review for accuracy a paper ballot and simultaneously receive a separate tracking code. Third, the voter will deposit their ballot into a ballot box for counting.

Behind the scenes, we will be able to tally the vote electronically, and compare the result to the official count. We will be able to test voter reaction to the great voting experience that VotingWorks has enabled using ElectionGuard. And we will be able to test, with the voters of Fulton, the verifiability of votes using ElectionGuard – which should enable voters to individually confirm that their vote was counted.

ElectionGuard, which we announced in May 2019, is open source software that will make elections more secure and end-to-end verifiable, enabling people to confirm their votes were counted and not altered and allowing news organizations or non-profits to build verifiers to confirm that election results were properly tabulated. ElectionGuard was built with the flexibility to be used in systems where paper ballots provide the primary vote count or where paper ballots are used as a backup. Additionally, ElectionGuard has been built to help ensure voting is accessible for people with disabilities and to give everyone a modern, fast and efficient voting experience.

Tomorrow’s pilot will occur at the Fulton Town office where we expect a few hundred votes to be cast. Both Microsoft and VotingWorks will have technical staff on site, and the town of Fulton has certified backup machines used in previous elections on hand should they be needed.

Tags: , , ,

Posted on Leave a comment

State of Decay 2: Juggernaut Edition launches March 13

Summary

  • Launching on Xbox/Xbox Game Pass/Win10/Steam on March 13
  • Includes all three add-on packs released to-date: Independence Pack, Daybreak Pack, and State of Decay 2: Heartland
  • Everything you love about state of Decay 2 and adds tons of new content and improvements for veteran and new players alike.

Today, we are thrilled to announce State of Decay 2: Juggernaut Edition, an expanded and improved version that takes everything you love about State of Decay 2 and adds tons of new content and improvements for veteran and new players alike. Best of all, this is a free, automatic upgrade for all existing owners of State of Decay 2, including all Xbox Game Pass members.

Launching with Xbox Game Pass as well as Steam
on March 13, here are some highlights of the many visual and gameplay
improvements included in Juggernaut Edition.

We created a brand-new open world map for players to explore in a rugged logging
town named Providence Ridge, and we completely rebuilt the post-tutorial experience to better teach players the key facets of
playing State of Decay 2.There’s also a new category of heavy melee weapons that reward player
skill and timing, a wide range of graphical
improvements
(including better lighting and foliage optimization for better
performance), and dodge and stealth are now split into separate commands as
part of an improved control scheme.

We also fixed dozens of mission and gameplay bugs to ensure a better experience for all
players, improved the audio experience,
including additional music that doubles the total amount in the game, and more.

State of Decay 2 - Juggernaut Edition

Juggernaut Edition also includes all three
add-on packs released to date: Independence
Pack
, Daybreak
Pack
, and State
of Decay 2: Heartland
.

And, if you already own Daybreak, Heartland, or purchased the Ultimate Edition of State of Decay 2, we’re sending you some exclusive in-game gifts that won’t be available anywhere else. Simply log in on launch day to collect them!

Juggernaut Edition is also available for all  Xbox Game Pass members, and launching for the
first time on Steam with cross-network play across all
platforms. Join Xbox Game
Pass
, or pre-order now and be ready to join a thriving community of six
million survivors!

State of Decay 2: Juggernaut Edition is the biggest and best State of Decay 2 experience. We can’t
wait to share it with you on Friday, March 13.

How will you survive?