Posted on Leave a comment

Medical imaging, AI and the cloud: what’s next?

Today marks the start of RSNA 2020, the annual meeting of the Radiological Society of North America. I participated in my first RSNA 35 years ago and I am super excited—as I am every year—to reconnect with my radiology colleagues and friends and learn about the latest medical and scientific advances in our field. Of course, RSNA will be very different this year. Instead of traveling to Chicago to attend sessions and presentations, and wander the exhibits, I’ll experience it all online. While I will miss the fun, excitement, and opportunities to connect that come with being there in person, I am amazed by what a rich and comprehensive conference the organizers of RSNA 2020 have put together using the advanced digital tools that we have at hand now.

It would be an understatement to say that this has been a year in which nearly everything is very different. From the tragic loss of life and rampant sickness to the economic disruption and the impact on our professions and our children’s education, so much of what we have been through because of COVID-19 has been extremely difficult. But the resilience of the response that so many people and institutions have shown in the face of all these challenges has been remarkable. And if it is possible to say there has been some good in all this, it would have to be the unprecedented transformation of the global healthcare ecosystem as hospitals, clinicians, and researchers have embraced a new generation of advanced digital health technologies that have helped them respond to the coronavirus crisis and laid the foundation for a more effective, affordable, and equitable future for healthcare.

Trends

As we move forward and the digital transformation of healthcare continues to accelerate, I see three significant trends that will influence the future of health and wellness.

One is the rapid emergence of virtual care through digital tools such as telehealth and remote monitoring that have made it safer and more convenient for patients to connect with their doctors during the pandemic, and that is empowering individuals to take charge of their health in entirely new ways. Virtual care has the capacity to personalize, accelerate, and augment treatment and prevention, saving time and money while improving outcomes. The ability to engage patients without requiring an in-person visit to a clinic will help ensure that they receive the right level of care and enable healthcare facilities to better manage the flow of patients into clinics and emergency rooms.

The second trend is the growing clarity of the promise of AI-driven precision medicine to serve as a major catalyst for improving health outcomes. As platforms for precision medicine and real-world evidence mature, we’ll see exciting opportunities to improve treatment and prevention as we personalize patient care and transform how we diagnose infectious disease, cancer, and autoimmune disorders.

And, finally, where healthcare organizations have long been reluctant to move data offsite due to security, trust, and privacy concerns, we have seen a historic shift to the cloud over the last nine months. Now, driven by regulatory changes, the massive increase in medical data, and the critical need to access and analyze all that data by providers, payers, public health agencies, and researchers, it’s clear to everyone that moving to the cloud is both essential and hugely beneficial, both to providers and to patients.

Microsoft Cloud for Healthcare

As part of Microsoft’s ongoing commitment to help healthcare customers and partners continue to make progress toward recovery and build more resilient and effective systems of care, in late October we announced the general availability of Microsoft Cloud for Healthcare. This powerful industry-specific solution provides integrated capabilities for automated and efficient high-value workflows, and advanced data analysis functionally for structured and unstructured data so that healthcare organizations can truly transform information into insight and insight into action.

Built on the trusted capabilities of Microsoft 365, Microsoft Azure, Microsoft Dynamics 365, and Microsoft Power Platform, Microsoft Cloud for Healthcare is designed to enhance patient engagement to make it easier for patients to interact with caregivers, empower health team collaboration to facilitate more efficient and rich real-time communication and collaboration across the care continuum, and improve clinical and operational data insights with the ability of healthcare organizations to connect data from across their systems to predict risk and help improve patient care and operational efficiencies. Our robust partner ecosystem extends the power of Microsoft Cloud for Healthcare by building and extending advanced health solutions to meet the most demanding challenges in healthcare.

Radiology

All of this makes it a particularly exciting time to be a radiologist. In many ways, our field has always been at the forefront of advances in the technologies that improve the movement, management, and analysis of large amounts of health data. This shouldn’t really be a surprise, given that medical imaging accounts for nearly three-quarters of all health data, and analyzing 3D medical images can require up to 50 GB of bandwidth a day.

At Microsoft, streamlining the flow of health data, including medical imaging data, has been a significant focus of our work over the past few years. With the release of the Medical Imaging Server for DICOM (Digital Imaging and Communications in Medicine) in September, we offer developers powerful tools to ingest and persist medical imaging data in the cloud. Elevating interoperability, this is the first cloud technology to bring together DICOM data standard and FHIR (Fast Healthcare Interoperability Resources) which allows for persisting medical imaging metadata alongside other clinical data and sets the stage for multiple scenarios in research and diagnosis which may be too difficult or expensive to execute today.

Now, with Project InnerEye and the open-source InnerEye Deep Learning Toolkit, we’re making machine learning techniques available to developers, researchers, and partners that they can use to pioneer new approaches by training their own ML models, with the aim of augmenting clinician productivity, helping to improve patient outcomes, and refining our understanding of how medical imaging can be combined with other types of data to advance personalized medicine.

Learn more about our latest medical imaging offerings at the RSNA industry hour lunch and learn on December 3, 12:30 PM – 1:30 PM Central Time.

Partners

Reimagining an industry that is as complex and touches as many lives as healthcare is a massive undertaking and at Microsoft, we have the privilege of working with amazing partners who stand at the forefront of innovation and progress in medical imaging technology.

Our partners are building transformative solutions to address some of the most difficult challenges in medical imaging. The amount of data generated by medical diagnostic imaging and connected devices is growing exponentially. Healthcare stakeholders, therefore, need effective ways of handling these data at scale.

This prompted Siemens Healthineers to build a dedicated cloud environment for Healthcare: The teamplay digital health platform. Through a certified gateway, the teamplay receiver, health data from connected medical devices can be aggregated. The teamplay cloud infrastructure is based on Azure, allowing secured processing of data within or outside a hospital’s network.

GE Healthcare’s Centricity™ Universal Viewer Zero Footprint (ZFP) connects advanced diagnostic tools and system-wide image management platforms across the care continuum to help healthcare organizations improve diagnostic speed and confidence. ZFP users can now open Microsoft Teams with one click and share studies with other clinicians via the secure and compliant channels.1

SOPHiA GENETICS, the company pioneering the Data-Driven Medicine movement—trusted by over 1000 healthcare institutions in 85 countries—is highlighting their radiomics capabilities through the universal SOPHiA Platform for oncology and COVID CT imaging. Radiomics transforms standard medical imaging into mineable data assets that can be analyzed and combined with genomic data for improved decision support of precision medicine. SOPHiA Radiomics Solutions offer comprehensive workflows for multiple research and disease indication needs. SOPHiA multimodal platform is deployed on Microsoft Azure Cloud.

Microsoft and Sectra are partnering on cloud-based enterprise imaging and AI. In our joint RSNA webinar, Reap the benefits of enterprise imaging in the cloud with Microsoft & Sectra on December 3, we will introduce the brand new all-Azure and hybrid Microsoft Azure Stack offering as well as a demo of how Teams integration will help radiologists to cope in the new virtual world. We will hear Judy Bartlett from our joint customer John Muir share her experiences about moving from on-prem to running the Sectra Enterprise Imaging Solution as a Service on Azure.

With the imminent release of a new version of iConnect Enterprise Archive, IBM Watson Health will start to bring to market solutions that support a containerized deployment, in addition to VMWare, on both the IBM Cloud and Azure. The containerization of this portfolio is one of IBM Watson Health’s key initiatives, starting with their VNA foundation and leveraging IBM’s Red Hat OpenShift technology to ensure build once and deploy anywhere to be cloud native and agnostic.

With NVIDIA Clara Imaging, developers and researchers have the ability to accelerate data annotation, build domain-specialized AI models, and deploy intelligent imaging workflows with state-of-the-art pre-trained models and reference applications. Working closely with Azure, these innovators can jumpstart their development in the cloud and also address tough medical imaging challenges faster with Project InnerEye. During the current pandemic, our partnership is heavily accelerating progress Research in drug discovery (UC, Riverside; UCB Covid Moonshot) using GPUs on Azure for quantum mechanics model as well as using AI for SARS COVID-19 risk evaluation in Italy (Hospital San Raffaele, Milan). This partnership also enables the development and deployment of smart hospital solutions, running on NVIDIA Clara Guardian and Azure.

And finally, Flywheel is a cloud-scale informatics platform for biomedical research and collaboration. What is exciting about our differentiated work is the ability to securely leverage cloud at the edge with Microsoft Azure Stack Hub and transform these image analytics with Microsoft AI enabling tools and Flywheel’s depth in medical imaging data management and automated workflows.

Microsoft is the only cloud that extends to the edge from Microsoft Azure Edge Zone for 5G to Microsoft Azure Sphere for security. We’re removing all barriers by covering all security and data sovereignty concerns in the cloud. With over 168,000 partners around the world, the network for innovation and collaboration runs deep. We cannot wait to see how together we will build solutions that transform healthcare around the world.

For more information on Microsoft Cloud for Healthcare, AI imaging tools, or to learn more about partnership visit the Microsoft virtual booth at RSNA or connect with us at our featured demo on November 29, 2:00 PM – 2:30 PM Central Time.


[1] Technology in development that represents ongoing research and development efforts. These technologies are not products and may never become products. Not for sale. Not cleared or approved by the U.S. FDA or any other global regulator for commercial availability.

Posted on Leave a comment

Minecraft: Education Edition at this week’s ISTE20 Live

ISTE20 Live is fully virtual this year, and we’ll be right there to help educators explore ways to use Minecraft: Education Edition to support student learning across the curriculum—whether you’re teaching online or in person. We’ll be joining the Microsoft Education team to beam onto your screen with tips, tricks, and advice for game-based learning.

All of our sessions are 15 minutes long, and they’ll be taking place in the Microsoft Content Room, so all you need to do is tune into the stream when there’s a session that interests you. You’ll find sessions on topics from remote learning and inclusive teaching to computer science and digital citizenship. We’ll have moderators from our team in each of the sessions to make sure we’re answering any questions you might have. We’re excited to connect!

To make things easy for you, here’s an at-a-glance schedule of the sessions featuring Minecraft: Education Edition.

Sunday, November 29

10:45 AM PT: Nathan Richards, Remote learning with Minecraft: Education Edition
With learning models changing in ways we’ve never seen before, teachers are adapting to how students learn, connect, and collaborate with one another. Discover ways that Minecraft: Education Edition can help students explore, build, and learn together online when they can’t share the same physical classroom.

Thursday, December 3

11:30 AM PT: Felisa Ford, Good Trouble – Teaching Social Justice in Minecraft: Education Edition
Take a trip through time and across the globe with civil rights activist and Congressman John Lewis to learn about people who changed the world by leading social justice movements. Students embark on a journey that includes Black Lives Matter, the US Civil Rights movement, Gandhi’s struggle for Indian independence, and more. This session unpacks the ways that the Good Trouble lesson can help students understand the impact of these movements and their leaders, and explores how learners can contribute to building a better world.

11:45 AM PT: Becky Keene, Experiencing History and Deep-thinking Skills with Minecraft: Education Edition
See how students engage in learning about history, coding, engineering, and more through the immersive experience of the World War I Toybox in Minecraft: Education Edition.

12:00 PM PT: Suzannah Calvery, Mindful Mining – Infusing Social-emotional Learning with Minecraft
We all need to build our social-emotional intelligence, and the tools available through Minecraft: Education Edition provide opportunities to build mindfulness, communication, and collaboration skills. See how the Mindful Knight lesson teaches mindfulness, empathy, self-regulation, and resilience, then discover more lessons that foster creativity and collaboration.

12:15 PM PT: Bob Irving, Promoting Digital Citizenship – Immersive Roleplay in Minecraft: Education Edition
Learn about how Minecraft: Education Edition’s new Digital Citizenship world provides an immersive tool for teaching students about digital theft, media literacy, sharing, and harassment, preparing them to collaborate successfully with peers online.

12:30 PM PT: Sarah Red-Laird, Build with Bees! STEM Lessons in Minecraft: Education Edition
Turn students’ fear of bees into feelings of fascination and fun with the founder and director of the Bee Girl nonprofit. Explore 11 NGSS-aligned STEM lessons designed to help students understand the importance of bees in our ecosystem, their biology, and how we can contribute to bee health!

1:30 PM PT: Felisa Ford, Good Trouble – Teaching Social Justice in Minecraft: Education Edition
Take a trip through time and across the globe with civil rights activist and Congressman John Lewis to learn about people who changed the world by leading social justice movements. Students embark on a journey that includes Black Lives Matter, the US Civil Rights movement, Gandhi’s struggle for Indian independence, and more. This session unpacks the ways that the Good Trouble lesson can help students understand the impact of these movements and their leaders, and explores how learners can contribute to building a better world.

2:15 PM PT: James Protheroe, Minecraft Hour of Code for Elementary Students: Block-based Coding
The world of computer science can be an intimidating place for those of us who come from non-STEM backgrounds, but bringing code and computational thinking into your classroom doesn’t have to be overwhelming. Join this session to learn more about fostering your own understanding while also introducing computer science principles at a beginner level through this year’s Minecraft Hour of Code block-based coding tutorial.

2:30 PM PT: Andrew Balzer, Minecraft Hour of Code for Intermediate Coders: Text-based Python Coding
The world of computer science can be an intimidating place for those of us who come from non-STEM backgrounds, but bringing code and computational thinking into your classroom doesn’t have to be overwhelming. Join this session to learn more about fostering your own understanding while also introducing computer science principles at an intermediate level through this year’s Minecraft Hour of Code Python activities.

2:45 PM PT: Peter Doherty, Coding in Minecraft: Fun Computer Science for Middle School
Coding in Minecraft is a remote-ready computer science credential and CSTA-aligned curriculum program delivered through Minecraft: Education Edition. This curriculum immerses students in a Minecraft world to develop and demonstrate their coding skills using MakeCode and JavaScript or Python. In this session, you’ll hear from educators who are seeing success with this content.

Friday, December 4

12:15 PM PT: Steve Isaacs, Learning Through Creative Competition with eSports in Minecraft: Education Edition
With the number of eSports spectators now eclipsing that of the NFL in the US, how can educators harness students’ passion for competitive gaming to drive learning outcomes in classrooms and after-school clubs? In this session, learn about ways that Minecraft: Education Edition is entering this exciting new arena.

Saturday, December 5

10:45 AM PT: Nathan Richards, Remote Learning with Minecraft: Education Edition
With learning models changing in ways we’ve never seen before, teachers are adapting to how students learn, connect, and collaborate with one another. Discover ways that Minecraft: Education Edition can help students explore, build, and learn together online when they can’t share the same physical classroom.

Two men work together on a laptop in a large conference hall.

Two men work together on a laptop in a large conference hall.

You can find all of these sessions and more in the Microsoft ISTE20 Live schedule. Come connect with us, bring your questions, and enjoy the virtual conference experience with our team! If you’re curious about Minecraft: Education Edition and want to come to the table with a few questions, explore this powerful tool for game-based learning at education.minecraft.net.

Posted on Leave a comment

World Update II: USA for Microsoft Flight Simulator now available for free

In September, we shared our vision for continuously improving Microsoft Flight Simulator by bringing meaningful updates to the simulator on a monthly basis. Today, we are launching our second World Update, and we’re thrilled to provide simmers with an enhanced flight experience in the United States of America. With its motto of “E Pluribus Unum” (“Out of Many, One”), the United States of America is truly a vast collection of diverse territories – from coastal communities to colossal mountain ranges, from verdant plains to metropolitan skylines.

World Update II: USA features an improved digital elevation model with resolution up to one meter, new aerial textures that significantly improve the appearance in several states across the country, and four new hand-crafted airports (Atlanta, Dallas/Fort Worth, Friday Harbor, and New York Stewart). We’ve also made visual improvements to 48 other airports and added 50 new high-fidelity points of interest across the country to make your state-side journey stunning in every way.

And that’s not all – this update also includes exhilarating new activities on each coast. Enjoy a Discovery Flight through some of the most iconic locations on the eastern seaboard, and then jet out west for an epic new Bush Trip across the Alaskan wilderness.

Once you download the latest update for Microsoft Flight Simulator, be sure to head to the in-sim Marketplace to claim World Update II: USA and partake in the majesty on display in the Land of the Free and the Home of the Brave. 

World Update II: USA is free to all Microsoft Flight Simulator players starting today on Xbox Game Pass for PC, Windows 10, and Steam.

Posted on Leave a comment

Achieving 100 percent renewable energy with 24/7 monitoring in Microsoft Sweden

Earlier this year, we made a commitment to shift to 100 percent renewable energy supply in our buildings and datacenters by 2025. On this journey, we recognize that how we track our progress is just as important as how we get there.

Today, we are announcing that Microsoft will be the first hyperscale cloud provider to track hourly energy consumption and renewable energy matching in a commercial product using the Vattenfall 24/7 Matching solution for our new datacenter regions in Sweden, which will be available in 2021.

Vattenfall and Microsoft are also announcing that the 24/7 hourly matching solution—the first commercial product of its kind—is now generally available. Vattenfall is a leading European energy company with a strong commitment to make fossil-free living possible within one generation. The solution is built using Microsoft’s Azure services, including Azure IoT Central and Microsoft Power BI.

Today’s announcement builds on last year’s partnership announcement with Vattenfall when the 24/7 Matching solution was first introduced. Since then, the solution has been in pilot in Vattenfall headquarters in Solna and the new Microsoft headquarters in Stockholm, which has seen 94 percent of the total office building energy consumption matched with Swedish wind and 6 percent matched with Swedish hydro power.

We continually invest in new ways to make our buildings and datacenters more energy efficient and sustainable. As part of today’s announcement, Microsoft is signing a power purchase agreement (PPA) to cover 100 percent of Microsoft’s energy consumption in Sweden. Microsoft will ensure that the company’s operations in Sweden use renewable energy.

The Vattenfall 24/7 Matching solution enables us to have a more accurate picture of energy used to match with Guarantees of Origin (GOs). This marks another important step in our commitment to be carbon negative by 2030 and use 100 percent renewable energy by 2025.

Advancing the path toward 100 percent renewable energy 1

Vattenfall and Microsoft 24/7 matching of renewable energy. Source: Vattenfall and Microsoft pilot world’s first hourly matching (24/7) of renewable energy.

Increasing transparency and accuracy of renewable energy matching

Fulfilling our 100 percent renewable energy commitment requires a better way of tracking renewable electricity. Today, the industry is using Energy Attribute Certificates, called Guarantees of Origin (GOs) in Europe and Renewable Energy Certificates (RECs) in the US. These ensure that the amount of electricity sold corresponds to the amount produced. GOs allow end consumers to choose electricity from a specific source; this enables them to choose electricity exclusively from renewable sources such as wind, solar, or hydropower.

While we have seen remarkable progress toward renewable sourcing and commitments, there is a fundamental flaw in monitoring the source and quantity of energy consumed. For any given hour, a business does not know the source of the energy they are consuming. That energy may come from renewable sources, or it may be produced from fossil fuel. The current system has no way of matching the supply of renewable energy with demand for that energy on an hourly basis. And without the transparency of supply and demand, market forces cannot work to ensure that renewable energy demand is supplied from renewable sources.

Through this solution, Microsoft Sweden’s new home is powered by renewable energy through the procurement of GOs, which traces electricity from renewable sources to provide information to electricity customers on the source of their energy—not just on a monthly or yearly basis, but on an hourly basis.

The 24/7 matching of GOs and renewable energy credits (RECs) offers the following benefits:

  • Businesses can see if their commitment to 100 percent renewable energy cover each hour of consumption and translate sourcing of renewable energy into climate impact.
  • Energy providers can more easily understand demands for renewable energy hour-by-hour and take action to help production meet demand.
  • 24/7 matching of consumption to production drives true market demand for renewable energy. As 24/7 hourly renewable products are rolled out across the world, they will incentivize investment in energy storage such that energy companies can store renewable energy when it is generating, so they can continue to supply their customers with renewable energy when it is not. Over time, this storage will allow electricity grids to supply 100 percent decarbonized power.
  • The system can inspire regulatory change in how GOs and RECs are created, acquired and retired.

You can learn more about the advantages of 24/7 monitoring by watching the Vattenfall 24/7 solution video.

IoT for more accurate energy monitoring

IoT enables companies to gain near real-time insights of the physical world, connecting objects to give you insights into the health of a system or process, predict failures before they happen and gain overall efficiencies in operations.

The Vattenfall 24/7 hourly monitoring solution leverages Azure IoT Central to manage the full picture of energy consumption in a given building. Azure IoT Central helps solution builders move beyond proof of concept to building business-critical applications they can brand and sell directly or through Microsoft AppSource. Today, Microsoft offers two IoT Central energy app templates for solar panel and smart meter monitoring to help energy solution builders accelerate development.

Commitment to building world-class, sustainable datacenters

We believe that our datacenters should be positive contributors to the grid, and we continue to innovate in energy technology and monitoring resources to support our corporate commitment to be carbon negative by 2030.

Posted on Leave a comment

Making credit flow again in India during the pandemic

When COVID-19 created a massive health crisis across India this year, it also triggered an unprecedented credit freeze. Millions of people were ordered to stay at home for months on-end, so lenders and customers could not meet face-to-face–a traditional prerequisite for doing business.

No meetings meant almost no new loans.

“The lending business came to a standstill to almost zero from April to June as the whole country was under a lockdown,” recalls Gaurav Aggarwal, head of unsecured loans at Paisabazaar.com, India’s largest marketplace for personal lending products.

The worst of the lockdowns appears over, at least for now. But India is far from being out of the pandemic woods and is working hard on two prime tasks–getting on top of the virus and getting its economy going.

To achieve the latter, credit must again flow freely.

Now a six-year-old fintech startup, Paisabazaar.com has stepped up with a new solution. It’s using cloud computing and machine learning to digitally overhaul the processes surrounding personal loan applications and approvals so money that can get to consumers and businesspeople faster.

What used to take anywhere between five days to a week before the pandemic is now being done in less than 24 hours, and in some cases as quickly as five hours.

Applying for a personal bank loan or a credit card in the traditional way can be a drawn-out affair. Either a customer visits a bank, or a bank representative comes to them to verify their identity. Paper application forms are filled out and supporting documents are collected for manually checking.

When the lockdowns were imposed, these physical and in-person processes were broken, and lending more or less stopped.

The time was ripe for disruption and Paisabazaar.com found itself in the right place at the right time.

In August, the startup launched the ‘Paisabazaar Stack’–a solution that enables lending companies, like banks and non-banking financial corporations (NBFCs), to disburse unsecured loans in a presence-less, completely digital manner.

Embracing a culture of innovation

Photo of a man smiling at the camera.
Gaurav Aggarwal, head of unsecured lending business, Paisabazaar.com

The lending process typically consists of four elements–offering the loan seeker the best offer based on their need and eligibility; collecting documents to establish their identity and ability to repay the loan; verifying those documents; and finally, signing the loan agreement and payment terms.

“One of the big realizations that we had that we if we had to change something, it had to be changed from end-to-end,” says Aggarwal.

As the pandemic brought the whole lending industry down to its knees, Paisabazaar.com, which translates into money (paisa) market (bazaar) in Hindi, embarked on its quest to digitize the entire process.

To make it happen, the startup embraced a culture of innovation. A recent study by IDC commissioned by Microsoft identifies this as the synergy between technology, process, data, and people, that allows organizations to drive sustained innovation.

The study looked at organizations that regard a time of crisis as an opportunity for transformation. It found that they are 1.5 times more confident about recovering within six months and growing their revenues compared with their peers. This is clearly the case with Paisabazaar.com.

“We were trying to create this stack for six months before the pandemic hit us. We wanted to create paperless digital programs, but things were not moving because the industry was not ready,” says Mukesh Sharma, Paisabazaar.com’s chief technology officer (CTO.) “But when it (the lockdown) happened, we were the first to launch this digital stack.”

One of the first challenges the startup had to overcome was to improve the loan approval rates. Even before the pandemic, almost 40% of loans were getting rejected on the platform as customers weren’t aware how the lending industry and regulations function. They’d get swayed by marketing gimmicks, and end up submitting multiple loan applications. This had an adverse effect on their credit worthiness and further reduced their chance of approvals.

When Paisabazaar.com’s team studied the data from rejected applications on their platform, they realized they could help customers by guiding them toward other offers, which had a higher chance of approval.

“We kept monitoring our funnels and data on these rejected applications, did detailed retrospection, and spoke to the customers and lenders to find the root cause (of loan rejections). We could clearly see the customers’ pain, especially when they are in dire need for money or a credit card,” says Sharma.

Paisabazaar.com’s machine learning team created a model based on lending data of over 50 partner banks and financial institutions over the last six years.

Photo of the Paisabazaar website on a laptop screen
The chance of approval feature, which gets more intelligent with every loan disbursed through Paisabazaar.com, has helped increase approval rate by nearly 25 percent in the first 12 months (Photo by Amit Verma)

The model, which is built on Microsoft Azure and uses technologies like Azure Kubernetes services, Azure Container Service, and Azure Virtual Machine Scale Sets, matches a borrower’s profile like income, credit score, age, among others, with the various lending criteria of different lenders. It then provides customers with the odds of getting their loan application approved—excellent, good, fair, or poor—against each lender.

The team also looked at how they could digitize the “Know Your Customer” (KYC) process, which involves verifying who they said they were. Using Azure Cognitive Services, Paisabazaar.com created digital KYC processes, including Video KYC, where they not only verify the borrower’s identity but also their location and liveliness—ensuring they were real people and not bots.

To verify documents to determine the customer’s loan eligibility, they created algorithms using Optical Character Recognition APIs on Azure. These identify and confirm a customer’s monthly income from their bank account statements and digitize a lot of backend work that used to be done manually.

A tectonic shift

Paisabazaar.com now offers this entire end-to-end digitization stack to banks and NBFCs on its platform and the results are overwhelming.

The chance of approval feature, which gets more intelligent with every loan disbursed through Paisabazaar.com, has helped increase approval rate by nearly 25 percent in the first 12 months.

Photo of the Paisabazaar website shown on a laptop screen
The Paisabazaar Stack, which did not exist a few months ago, now accounts for more than half of all personal loans disbursed from the platform (Photo by Amit Verma)

Even though many COVID-19 lockdown restrictions have now been eased, lenders continue to rely on the digital process to disburse loans.

The Paisabazaar Stack, which did not exist a few months ago, now accounts for more than half of all personal loans disbursed from the platform and the company is optimistic that business will be back to pre-pandemic levels by early next year.

“The Paisabazaar Stack is a fundamental and tectonic shift in the lending industry,” says Aggarwal, the head of unsecured loans business.

Photo of a man smiling at the camera.
Mukesh Sharma, CTO, Paisabazaar.com

Meanwhile, for Paisabazaar.com’s CTO, the experience has only strengthened his resolve to innovate faster and launch new products. The use of cloud, AI, and machine learning has enabled Sharma to empower his team to experiment and build new experiences and products for their customers and partners. Every member of his team, he reckons, is an entrepreneur, which is core to the company’s DNA.

“We’ve a language-agnostic, idea-agnostic, and platform-agnostic framework where people can come and pitch in. Microsoft Azure not only brings out the best of the industry standards to us but also cutting-edge technologies. We were one of the earliest organizations in the country to use Kubernetes on Azure and Azure Cognitive Services at such a large scale,” says Sharma.

Paisabazaar.com is now working on new models that will provide access to credit to a wider swathe of India’s population. The expectation is that the digitization of processes for existing customers would eventually help them create models that would bring financial inclusion to those who currently fall outside the credit net.

“The flow of credit will eventually move to segments that are currently underserved,” says Aggarwal. “The quality of data we’re getting due to the digitization of processes is much higher than what was being collected physically. These gains will start flowing back into the system and lenders will start getting comfortable with the processes. The “fintech revolution” that was happening in the pre-COVID days now has a high potential of going mainstream.”

Sharma agrees. He recalls how, a couple of years ago, they worked with their fintech lending partners to create alternate models to underwrite small loans ranging from INR 10,000 to INR 50,000 (approximately USD 135 to USD 700) largely to first time salary earners. Most large lenders like banks would not traditionally cater to this segment, due to the small loan size as well as the fact that the borrowers were new to credit and would not meet the banks’ eligibility conditions. This also helped Paisabazaar.com cater to customers from smaller cities and towns.

Now PaisaBazaar.com is developing a new product aimed at owners of small businesses, which would enable them to raise loans in the range of INR 30,000-50,000 (approximately USD 400-650), which they can pay back and keep raising again, for working capital or other needs.

“Technology is the key enabler here,” Sharma says. “The straightforward answer to choosing Microsoft is that we fundamentally believe in what Microsoft does, which is to empower every person and every organization on the planet to achieve more. Both the companies are trying to solve the one common problem, which is how we can use technology to solve customer problems.”

Sambit Satpathy also contributed to this report.

Posted on Leave a comment

Research reveals three distinct parent mindsets about remote and hybrid learning

As a veteran teacher, I usually had a pretty good idea of how I could support parents and guardians with their students’ education. But sometimes a family-teacher conference would reveal something I didn’t know. I realized that together, we could work on a solution.

That was before the pandemic—back when the learning environment was still fully in the classroom and educators could meet with families face-to-face. In this new remote and hybrid learning environment, we don’t have the experience to know what our families need from us.  And with social distancing in place, it’s more challenging to find out.

So, Microsoft did the asking to find even better solutions for the current environment.

I’m part of an independent research team, Program 11, that reached out to parents to learn more about how families are dealing with remote and hybrid learning. There’s been a lot of speculation about what parents and guardians are struggling with (and our team had our own personal experiences as parents and educators), but we wanted to hear it from a broader audience.

The question was: How could Microsoft tools and technology help parents and families support their students’ remote and hybrid learning even more?

Our interviews and survey results revealed that even though parents share some challenges and beliefs, their experiences are not universal. So, there can be no “one-size-fits-all” approach to supporting families. Luckily, three sizes cover most!

We found that most families fall within one of three different categories. Families feel like they’re either thriving, coping, or overwhelmed. I’ll go over some of the research data1,2, and describe the three parent mindsets. Then I’ll show you what we’re doing to help educators get families the resources they’ve asked for.

What parents and guardians agree on

To say that educators are working tirelessly is an understatement. You continue to provide amazing instruction, focus on student well-being, and communicate with parents despite all the challenges that accompany remote and hybrid learning. The results of our research show that parents know this, and they appreciate it.

The majority of parents are satisfied or very satisfied with teacher communication, one-on-one time and the resources teachers are providing to support remote learning.

Even though parents and guardians are impressed by teachers, many feel schools and districts are asking too much of parents during remote or hybrid learning. Parents continue to worry about their student’s health, online safety, and social-emotional well-being. They want resources to help them more effectively engage in their student’s learning, especially when they don’t feel confident in their ability to offer support.

About 45 percent of parents “worry a lot” about both COVID-19 and their student staying on track in school.

Different parent mindsets

I’m sure it comes as no surprise that even though parents share some similar opinions, some are having vastly different experiences. You’ve likely witnessed this in your own practice.

Some parents feel like their families are thriving in the remote or hybrid learning environment. These parents are deeply engaged in their student’s learning and are seeking ways to take their student’s academic education to the next level. These parents often have older students or students who perform above grade-level.

Others feel like they are coping. These parents have concerns about their student’s social and emotional well-being and health that sometimes overshadow academic concerns. They feel the pressures of balancing school with other responsibilities but feel more engaged in their student’s learning than ever before.

And other parents feel overwhelmed by the demands placed on them due to remote and hybrid learning. These parents are concerned about meeting their family’s basic needs and do not feel confident they have the skills or resources to support their student’s education right now. These families are more likely to have younger students.

Parent mindsets are not fixed. With support, even the most overwhelmed parents can begin to feel like they’re thriving!

Supporting educators in supporting families

This data really helps us better understand how families are experiencing remote and hybrid learning. But what’s really important to an educator is what education technology companies like Microsoft can do to help.

And here it is: an easy to navigate webpage where you can send your families to learn which parent mindset describes their experience. From there, they can find resources picked specifically for them, based on their needs and preferences.

We hope that these resources help parents and families feel more confident about supporting their student’s education. Teachers, if you’d like to provide the families of your students with more information, please download this infographic to send with your next correspondence, or you can provide them with a link to the parent mindset webpage. You can also urge parents and families to join the free remote learning family workshop series that Microsoft is hosting.

You can download the full Parent and Family Remote and Hybrid Learning research brief here.


About the author:

Teagan Carlson is an education consultant and writer whose work has been featured in Edsurge. She joined the education research team at Program 11 as a subject matter expert, having taught ELA and ELD for fourteen years. She has her M.A. in Educational Psychology.

Footnotes:

1. Microsoft, “Survey Data Helps Microsoft Uncover Three Distinct Parent Mindsets When It Comes to Remote and Hybrid Learning.” https://aka.ms/MSParentSurveyChartsDeck

2. Microsoft, “Microsoft Education Parent and Family Research.” https://aka.ms/MSParentSurveyResearchBrief

Posted on Leave a comment

Microsoft Federal delivering solutions for secure digital transformation

Note: In Part 2 of a two-part series, Rick Wagner shares Microsoft Federal’s 2020 progress in delivering solutions and tools for digital transformation and efficient mission-focused operations. Please see Part 1 for examples of federal agencies achieving success in addressing pandemic impacts and meeting diverse missions.  

In Microsoft CEO Satya Nadella’s 2020 letter to shareholders, he reflects on the past year and the opportunity ahead. I was struck by one of his statements, which captures why I’m honored to lead Microsoft Federal: “I’m proud of how our ecosystem of customers and partners has stepped up over the past year to help people and organizations in every country use technology to be resilient and transform during the most trying of circumstances.” This is especially true in the United States, where our Microsoft Federal team and partners provide trusted leading-edge cloud and AI solutions to empower federal agencies in addressing extraordinary challenges, fulfilling demanding requirements and enabling secure, agile digital transformation. It’s also why our first-ever digital Government Leaders Summit on Dec. 7 will focus on mission and leadership resiliency.

Best-in-class technology

Looking back over the year, Microsoft has made significant progress in providing best-in-class technology for our federal customers to quickly achieve commercial parity while meeting the highest levels of government security and compliance. We’re delivering the latest cloud and AI innovation directly to U.S. federal agencies. For example:

  • We’re excited to join other companies in supporting the Advanced Battle Management System (ABMS), the U.S. Air Force’s top modernization priority. Our technologies will help integrate the Air Force ABMS capabilities into the larger Joint All-Domain Command and Control, the Department of Defense concept to connect sensors from all military branches into a single network.
  • FedScoop recently reported that the U.S. Navy is working to integrate all telework capabilities into a long-term solution powered by Microsoft 365. According to the article: “The goal is to be able to sync up more features, including a link between email and calendars,” and “by 2021 to have as many services as possible be digital and cloud-native to support both teleworking and in-person needs once more workers can come back to bases and the Pentagon.” Microsoft 365 is a great example of a product that enables remote government access, empowers cross-agency collaboration and complies with stringent security requirements.
  • Last month, Microsoft took the next giant leap in cloud computing – to space. Azure Space is aimed at making Azure the platform and ecosystem of choice for the mission needs of the space community – on or off the planet. By combining a new set of offerings, a partner ecosystem and a global strategy focused on innovation, Azure Space will offer an integrated cloud and satellite experience connecting to almost any device anywhere. It also will serve as the bridge between the Pentagon and satellite providers.
  • Another recent blog showcased our Power Platform return to the workplace solution, which enables enterprises and government agencies to prepare facilities and employees when a return to the physical workplace makes sense. We partnered with CBRE, the world’s largest commercial real estate services and investment firm, to develop this comprehensive, end-to-end solution for location readinessworkplace care managementemployee health and safety management, and location management.
  • In late March, we confirmed that Azure Government Secret achieved provisional authorization to host government data classified as secret, meeting Department of Defense (DOD) Impact Level 6, Intelligence Community Directive (ICD) 503 and facility accreditation ICD 705. We also announced:
    • A new third secret region to provide increased availability for national security missions to stay ahead of unique threats.
    • The release of 48 new Azure Government services, bringing our total FedRAMP High services to 101.

It’s worth noting that this most recent Azure Government news comes after a three-year series of news highlighting significant advancements to meet government and DOD requirements:

Embracing technology

As the world around us continues to evolve in unpredictable ways, we’re seeing dramatic shifts in how the federal government is embracing technology with speed and agility to achieve objectives, better serve citizens, and further efficiency and effectiveness. The government customers I talk with are focused on digital transformation and seizing opportunities at the accelerated pace required to deliver modern mission outcomes. Microsoft Federal and our partners are committed to supporting the success of U.S. government agencies by continuously investing in our trusted cloud and AI capabilities.

You’re invited: Microsoft Government Leaders Summit

Another part of our investment is the Microsoft Government Leaders Summit,10 a.m. to noon ET, Dec. 7. On behalf of our Microsoft Federal team, it’s my pleasure to invite you to a digital event dedicated to helping federal government leaders reimagine a future of innovation and transformation to advance our nation.

Tags: , ,

Posted on Leave a comment

3 years in, sparking technology across America

For an audio recording of the blog, listen below.


Three years ago, Microsoft President Brad Smith joined North Dakota Governor Doug Burgum in downtown Fargo to launch a new project called Microsoft TechSpark. This civic initiative was formed to foster economic impact and job creation through deep partnerships and collaboration. Corporate engagements with communities are nothing new, but the pivot here was to dive deep in just six specific regions, and focus on rural and remote communities, a change from often traditional outreach in larger, more urban metropolitans.

If we could find communities that embraced collaboration and would help test new resources and technologies, we knew we would learn a great deal. To gain a greater understanding of these differing ecosystems, we selected six regions with varying backgrounds, sizes, and demographics. We chose Cheyenne, Wyoming, Southern Virginia and central Washington State as they housed Microsoft data centers, while Fargo was a natural fit with an already large Microsoft employee campus. We wanted to engage a few regions, too, where we had little to no Microsoft presence. Given their strong engagement in our computer science education efforts, we also launched TechSpark in northeast Wisconsin, and then moved south to El Paso, Texas, before quickly adding in bordering Juarez, Mexico, to explore bi-national projects.

Brad Smith in Fargo
Microsoft President Brad Smith, left, talks to North Dakota Governor Doug Burgum during the launch of TechSpark

One essential ingredient in this plan was to find and hire TechSpark managers who lived in and knew the community. Some might have thought it would have been easier to send a team from company headquarters or rotated in visiting experts, but that’s not what we were going for. We’ve found that a member of the community who has resided in, worked alongside these neighbors, and previously led some of the region’s organizations, accelerates the work instantly with established credibility, presence, trust, network and awareness. This 24/7 approach to community engagement ensures constant communication, and many TechSpark ideas and approaches began with a conversation in the grocery store line or local coffee shop.

The team was charged with driving community and economic development through partnership, and delivery of Microsoft resources, keying in on a few pillars, including:

  • Collaboration with local nonprofits, and empowering these community organizations to do more through tech enablement and digital transformation
  • Driving opportunities in these regions for reskilling, or skilling that leads directly to employability in the community
  • Connecting these local regions to high-speed internet and working with Microsoft’s Airband Initiative toward the goal of bringing broadband access to 3 million Americans living in unserved rural areas of the United States
  • Empowering local partners to help build a more signature regional project, larger in scale and scope, and created for sustainability and longer-term impact
A man uses a computer
Student participant at the TEALS Packers Fair in Wisconsin

These signature projects have underscored our mission of growing each region’s plan organically and collaboratively. Several local leaders have shared the phrase, “Meet the community where they are.” Three years in, we’re proud to see these signature projects in planning and/or execution in all six of our TechSpark regions:

  • Green Bay, Wisconsin celebrated the one-year anniversary of TitletownTech this summer. This partnership between Microsoft and the Green Bay Packers, has created an exciting venture lab and studio, across the street from iconic Lambeau Stadium, and is now shepherding more than 20 new startups into formation, with many beginning operations in Northeast Wisconsin.
  • In North Dakota, a partnership with the innovative organization Emerging Prairie, has started the Grand Farm. This farm of the future will bring together students, teachers and industry to explore precision agriculture on a 60-acre experimental farm and test bed, alongside a digital academy and plug and play agriculture accelerator.
  • Near our Boydton, Virginia, data center, and together with the MidAtlantic Broadband Corporation, the new Southern Virginia Innovation HUB will open its doors early next year (2021). The first new in the region for decades will house area nonprofits working to drive skilling, tech training and community partnerships.
  • This fall, companies from both Mexico and the U.S. are coming together weekly, for our third cohort in the El Paso-Juarez Bridge Accelerator. This unique bi-national project has tapped the network of the Juarez Technology HUB and local partners to unite manufacturers, startups and other regional companies, sharing resources, best practices and training over a 12-week program. Already, the Bridge Accelerator’s first two cohorts have produced nearly $4 million in new sales, over $500,000 in new VC investment, and 110 new jobs.
  • Cheyenne, Wyoming, is bringing together the great work of gener8tor to drive new business and startups in the state, and then leverage those new opportunities with the innovative curriculum of the Array School of Coding and the unique apprenticeship training of the Techtonic software and tech team.
  • And in central Washington state, skilling through remote training has become a key mission of rural resilience, in partnership with area leaders like the Greater Wenatchee Tech Alliance, the Columbia Basin Foundation and Washington State University.
The El Paso-Juarez Bridge Accelerator program
Mike Egan, front left, with TechSpark managers J.J. Childress and Omar Saucedo with graduates from the launch of the Bridge Accelerator in Juarez, Mexico

The daily connection and communication with these communities has informed our processes, priorities and programs. To summarize a few learnings and key takeaways across all regions:

  • Partners before projects: The partner is key to any engagement. And finding the right partner first, and then building the plan and project second, is instrumental to every regional engagement. One can’t quickly recreate the relationships, know-how, infrastructure, network and knowledge that an established local partner brings. These organizations are already doing great work, and in some cases, are simply in need of additional resourcing, connections and a bright north star to dream bigger and accelerate their mission. Collectively, TechSpark has now partnered with 314 nonprofits across these regions, supporting more than 303,000 individuals.
  • Back to school: We have found a strong common denominator in every rural or remote region with the local university, community or technical college. These higher education institutions often serve as the barometer for future employment and local workforce trends. Strong collaboration with these schools has produced new curriculum, planning and training opportunities like mentoring, apprenticeship and distance learning. From larger schools like the University of Texas at El Paso, North Dakota State University, the University of Wyoming and the University of Wisconsin at Green Bay to great local community colleges like Washington’s Big Bend, Southside Virginia and Wyoming’s Laramie, we’re finding engaged faculties and innovative administrations willing to collaborate to educate the next workforce. Together, these TechSpark partnerships have impacted 52,000 college students. Additionally, the team has worked to help bring the TEALS computer science teaching program into 135 high schools in the TechSpark regions, training over 150 high school teachers and 7,500 students.
  • Connect: Access to high-speed internet is the electricity of this era, and in communities without strong internet, the struggle for business, education and health-care connections is exacerbated. Understanding the challenge with real numbers to identify demand, and incentivizing providers to move in, is a constant quest. From students doing homework in cars near new Wi-Fi hotspots, to agricultural projects growing through FarmBeats and data collection, the connection remains a foundational priority for economic and community growth. The work of Microsoft’s Airband team is helping to drive these projects across the globe, and finding partnership in states from Wyoming to Wisconsin, Texas to North Dakota.
  • No cookie cutter: The varying backgrounds of these diverse regions has demanded regional approaches and individual attention. As we began to work to land AI for Good grants in each community, we quickly learned that a small nonprofit organization with a staff of one or two may not have the bandwidth to quickly absorb and implement an AI project. A flexible toolkit, with resources to help enable technology, is essential and must be inventoried uniquely by each region. With the necessary support, TechSpark has delivered 14 AI for Good grants across these regions. As well, the continuing work with local partners, has delivered skills training and a path to employability, for over 54,000 individuals in these TechSpark communities.
  • Multiply: As the TechSpark program moves into year four, the ability to sustain these efforts and inspire replication becomes paramount. Our ability to multiply seed funding has become a metric across all these regions with a minimum goal of 3X. If we can help serve as a catalyst for other local and national partners, to help support a regional nonprofit, we’re a step closer to long-term sustainment. This work has already secured an additional $25m in funding from other partners (local and national) in addition to our TechSpark support, a 4X multiplier. Additionally, this effort underscores our hope for TechSpark-like projects to spring up in other communities across the globe. Providing a toolbox of best practices and lessons learned will spur other regions to scale through partnership.
  • More alike than different: As much as we focus on differences between rural and urban, we are often struck by the greater array of similarities we all share. Regardless of the region’s population, we’ve witnessed the same hope shared by many; to provide for and educate their family, leave behind a stronger community, and give their children a better future. Likewise, we are hearing from many young people and new graduates, who express an eagerness to return to their roots, find a home near extended family, and continue the community building of their parents. Many may leave for school or adventure, but that instinctual path back to the hometown is strong, if only they can find the workplace opportunity.

The pandemic has caused many to push a reset button, as we have heard daily from local nonprofits and small businesses, struggling for survival. We’ve been able to support over 100,000 individuals in these regions through Covid-19 relief projects and, now more than ever, the work is critical to expand these local recovery and rebuilding efforts.

After three years, it is clear to us that no one organization, public or private, corporate or nonprofit, can transform these challenges alone. It is also clear that the desire to build up these ecosystems, digitally enable local businesses, provide skills for 21st-century jobs and redistribute opportunity is at the forefront for community leaders at all levels. This mission transcends political stripes across the spectrum.

The reception from these communities continues to be both welcoming and beyond appreciative. We look forward to this ongoing learning, community engagement and economic development as the spark started three years ago in Fargo continues to light.

Mike Egan is the Senior Director of TechSpark for Microsoft. Mike began his career picking raspberries in the fields of his hometown Puyallup, Washington, and working at the State Fair.

Tags: , , ,

Posted on Leave a comment

Full lineup of Xbox Black Friday and Cyber Monday deals announced

It has been a big year for gaming fans. From the launch of a new generation of Xbox consoles, to a creatively diverse lineup of games that look and play best on Xbox, and a library of high-quality games available with Xbox Game Pass, there’s never been a better time than now to join the Xbox family!

We have seen overwhelming global demand from our fans for the next generation of Xbox consoles, and we encourage you to check in with your local retailers directly for more details on availability in your market. While Xbox Series X|S consoles are not part of our holiday deals, we’re thrilled to offer an incredible discount on Xbox Game Pass Ultimate – the must-have gift for the gamer in your life – and deals on games as well as Xbox controllers. As a reminder, at Xbox we’ve made a promise to compatibility; you can be assured that when you purchase Xbox One gaming accessories or a game on Xbox One today, your game library, progression and entire gaming legacy moves forward with you whenever you choose to jump into the next generation with Xbox Series X|S.

See below for the full lineup of Black Friday and Cyber Monday deals you need to know about, and be sure to check with Xbox.com, Microsoft Store and participating retailers worldwide for more details on availability and pricing as deals will vary between regions and retailers.

Gift Over 100 Games with Xbox Game Pass Ultimate – Save Up to 40% Off Three Months

Available on Sunday, Nov. 22 – Monday, Nov. 30 [1] (See retailer for offer details and code distribution info) at participating retailers, you will receive up to 40% off when you purchase three months of Xbox Game Pass Ultimate! Xbox Game Pass Ultimate is the perfect way to discover your next favorite game. For just $14.99 a month, you can get all the benefits of Xbox Live Gold, over 100 high-quality games across Android mobile devices from the cloud (Beta), console and PC, and Ultimate Perks like a 30-day trial of Disney+.[2]

Also, EA Play is already available on Xbox consoles as part of Xbox Game Pass Ultimate, and beginning December 15, members with an Xbox Game Pass Ultimate or Xbox Game Pass for PC subscription will be able to download and play games from The Play List on EA Play using Windows 10 PCs via the EA Desktop app (beta).  That means more than 60 of EA’s biggest and best console and PC games like Star Wars Jedi: Fallen Order, FIFA 20Titanfall 2 and Need for Speed Heat are available for Xbox Game Pass Ultimate and Xbox Game Pass for PC members at no extra cost. And, some of the best EA Play games will also be available for Xbox Game Pass Ultimate members on Android devices via cloud gaming (Beta). Xbox Game Pass Ultimate is the gift that keeps on giving throughout the holidays and into the new year! It’s also the best way to have fun and stay connected with friends and family, together or apart. 

Amp Up Your Library with the Hottest Titles for Console and PC – At A Discount

From Friday, Nov. 20 – Thursday, Dec. 3, on Xbox.com and Microsoft Store only, we’re offering up to 55% off select digital titles on some of the hottest games this season on your Xbox such as Far Cry 5, Forza Horizon 4, Marvel`s Avengers, Watch Dogs: Legion, FIFA 21 and NBA 2K21. And with Smart Delivery, supported titles like Forza Horizon 4 will deliver the best version when you’re ready to upgrade your console, at no additional cost.

To give you even more value in the leadup to the holidays, we’ll also be offering up to 60% off select PC titles such as Age of Empires II: Definitive Edition, Forza Horizon 4 Standard Edition and Gears 5.

Take Your Gaming to the Next Level with a New Controller

This holiday, we have a new lineup of Xbox Wireless Controllers, giving you more options than ever to customize how you play. Available Sunday, Nov. 22 – Monday, Nov. 30 at the Microsoft Store and participating retailers, get up to $20 off select Xbox controllers including the new Carbon BlackRobot White, and Shock Blue, starting at $39.99.  

Xbox has something for everyone on your list, at every price point. Be sure to scoop up these deals while they last and visit Xbox.comMicrosoft Store and participating retailers for more details on availability and pricing as deals will vary between regions and retailers.


[1] Valid through 11/22/20-11/30/20 at participating retailers while supplies last; exclusions apply. Limit 1 per person/account. See retailer for offer details and code distribution info.

[2] Valid for new Disney+ subscribers only. 18+ only. After trial, Disney+ automatically renews at the then-current monthly pricing until you cancel. Subject to Disney+ Subscriber Agreement https://www.disneyplus.com/legal/subscriber-agreement. Limited time offer. One per account. Available in AU, AT, BE, CA, DK, FI, DE, IE, IT, NL, NZ, NO, PT, ES, SE, CH, GB, US. Claim by 1/31/21. Redeem by 3/2/21.

Posted on Leave a comment

The future of work unbound: 2020 and the strange new mobility of space and time

For those of us who have transitioned to working from home over the course of the last year, we must navigate a strange new manifestation of mobility.

Far-flung colleagues appear almost magically in grid format on a screen right in front of our faces, despite their remote locations. Yet at the same time, a document, presentation, piece of content, or part of a running application already at our fingertips is awkward to share with others on the same video call.

It’s a paradoxical science fiction world where far is near, and the close-at-hand dilates impossibly beyond our reach. Perhaps these surreal distortions of time and space explain in part why “video-conferencing syndrome” feels so draining.

And even as we’re stranded within the confines of our improvised home offices, we’re somehow supposed to navigate this otherworldly place—a jumbled chaos terrain of home and work, personal and professional, private and semi-public.

Moving between these realities, sometimes moment by moment, makes us nimble in a way we’ve never experienced before: our activity is mobile even as we stay put in the same location. We work in the same physical spaces, but as we navigate these transitions, we’re not in the same human places.

While 2020 has accelerated this trend, perhaps it’s inevitable—and indeed, as we point out below, in many ways this strange new mobility has been a long time coming.

Microsoft researchers are creating technologies to help people succeed in this new way of life. We are working to develop systems that help us to navigate these changes. A new world where these transitions feel less strange—and more empowering. A place appropriate to our current task, locality, and context, where “mobility” means technology that rises to the universal human need to connect and work with others seamlessly.

To that end, Microsoft researchers have published three papers—two of which appear at this year’s ACM Symposium on User Interface Software and Technology (UIST 2020)—on new technologies that redefine how we interpret this concept of place.

The first explores SurfaceFleet, a system to decouple computing from individual devices and places. The second presents Ambrosia, a system which uses resilient distributed programming techniques to unbind running programs and their state from any particular device (CPU). The third circles back on this notion of place, showing how nuanced social cues such as tilt and orientation of a display, on the adjustable Microsoft Surface Studio, can support elegant and natural transitions between different tasks and ways of using such a display.

SurfaceFleet: Mobility as transitions of user activity from one ‘place’ to another

What the Fleet system is in brief:

  • A distributed system leveraging a robust, performant declarative database foundation and building on the Ambrosia runtime
  • An exploration of novel implications for migration of user experiences across devices
  • A platform for Applets: lightweight, distributed user interface elements that unbind interactions from devices, applications, users, and time
  • A collaboration tool enabling people to work across devices and act at synchronous or asynchronous times.

The COVID-19 pandemic has brought the collision of home and work—of activity in limited physical spaces that must transition between different human places—to a critical juncture.

But two trends, manifested over the past decade already, are influencing the future of human experiences with computing technology.

The first trend concerns hardware and systems architecture. With Moore’s Law at an end, yet networking and storage exhibiting exponential gains, the future appears to favor systems that emphasize seamless mobility of data—favoring techniques that consume network and storage bandwidth rather than those using a particular CPU. Accelerated by pervasive cloud services and 5G, these computational shifts show no sign of slowing.

The second trend is one of human behavior. People now interact with more devices than ever before. Modern information work increasingly relies on multi-device workflows and distributed workspaces, with connected and interdependent devices—smartphones, desktops, tablets, and perhaps even emerging new form factors. The problem here lies in that transitioning from device to device, and more broadly place to place, can cost us precious efficiency or resources, like time or attention, leaving our activities marooned on islands of glass instead of creating a new interconnected world.

What’s needed is an ecosystem of technologies that seamlessly transitions from place to place, whether that “place” takes the form of a literal location, a different device form factor, the presence of a collaborator, or the availability of the pieces of information needed to complete a particular task at a given time. Such a “Society of Technologies” favors techniques that establish meaningful relationships between the members of this society, rather than with any particular device, to afford mobility of user activity from one place to another, in a very general sense of the word.

Through this lens, we can view the essence of mobility as the transition of user activity from one place to another. SurfaceFleet is a working system, development toolkit, and user experience that explores some implications of these challenges by decoupling computation—including its representation in the graphical user interface—from the current device.  

Yet, once user interface mechanisms are decoupled from a single device, we discovered that this also has interesting carry-on implications for unbinding interaction from the current application, the current user, and the current time, as well. The Fleet system handles transitions in place—bridging the resulting gaps—across all four of these dimensions. See the embedded video above for demonstrations that show how user interfaces can “float” above the screen and transcend program state that is confined to the current device. 

The Fleet system unbinds UI elements from not only the device but also the current application, user, and time. In the visible UI, Applets unbind controls from applications. Portfolios unbind tools, inputs, behaviors, and content from the current device and user. Promises unbind actions from time. Read more in the SurfaceFleet paper.

But authoring distributed programs is difficult and requires considerable expertise. How do we reimagine this notion of “device” that is so deeply baked into current development practices? This is where our journey crosses paths with a new distributed-systems technology known as Ambrosia.

Ambrosia: Programming as if failure doesn’t matter

What the Ambrosia runtime does in brief:

  • Introduces the notion of “virtual resiliency,” which allows programmers of distributed applications to program as if failure doesn’t matter
  • Facilitates recovery and replay of logged messages that include mechanisms to correctly handle non-determinism
  • Achieves highly performant remote procedure calls through database techniques such as batching, high-performance log writing, high-performance serialization concepts, and group commit strategies
  • Provides the technical foundation of the Fleet system

Programmers face complex decisions and coding tasks when coping with failure in distributed systems—especially when applications modify state that is shared across devices. Unfortunately, a lot can go wrong even in simple scenarios of passing messages between distributed services. Connections can drop. Distributed clients can crash at any moment. A remote procedure call (RPC) might even fail just as it sends a remote message, creating uncertainty of what has been sent or received that must be reconciled. All of these cases and error conditions must be correctly anticipated, handled, and implemented correctly, and in an efficient manner. This is why distributed services are so hard to program and deploy correctly.

But using Ambrosia, a developer can write the code for their client as if failure doesn’t matter. We call this virtual resiliency, similar to virtual memory, where one can author programs as if limits on physical memory don’t exist.

Virtual resilience for “Alice’s” running client, where the Ambrosia runtime intercepts all outgoing and incoming remote procedure calls and logs them to resilient storage, such as in the cloud, before Alice acts on them. Ambrosia automatically replays this log to recover from failures in a way that ensures deterministically ordered, one-time delivery of requests.

The developer simply wraps their service (“Alice” in the figure above) in the Ambrosia runtime. Ambrosia intercepts each message and logs it to resilient storage before sending it over the network via RPC. Whenever a remote service (“Bob”) responds, Ambrosia likewise logs these return messages before Alice’s code acts on their contents.

Ambrosia encapsulates the many possible failure conditions, factoring all the distributed-systems complexity of the resulting client code. If Alice goes down, Ambrosia automatically recovers by replaying the log, allowing Alice’s code to pick up where it left off. Likewise, if Bob crashes, the system can automatically recover from that, too, so long as Bob is wrapped in the Ambrosia runtime, as well. And since network connection state is also logged to resilient storage in the cloud via Azure, we also can automatically self-heal disruptions such as intermittent connections or changing network addresses via a subsystem known as the Common Runtime for Applications (CRA).

Programming distributed applications in this way, as if failure doesn’t matter, is a nifty trick. But the true secret sauce of Ambrosia is that it provides this virtual resiliency with high performance. It does so by applying decades-old wisdom that has been used to build performant, reliable, and available database systems. For instance, Ambrosia makes extensive use of batching, high-performance log writing, high-performance serialization concepts, and group commit strategies. It also includes mechanisms to properly handle non-determinism by logging any such events, as well. These carefully implemented techniques allow Ambrosia to deterministically provide virtual resiliency with little or no reduction in throughput, depending on message size, as compared to popular RPC frameworks that lack resilience mechanisms.

With a distributed system built on these abstractions, we end up with two coordinated instances of the Ambrosia runtime surrounding the running services Alice and Bob:

The running services “Alice” and “Bob” are encapsulated in coordinated instances of the Ambrosia runtime to ensure mutual resiliency of the distributed system.

This basic architecture not only encapsulates many types of distributed-system failures, but it also allows for interesting variations, such as standing up multiple active instances of a service (so-called active/active configurations) so that we can quickly failover to “Bob 2” or “Alice 2” if one of the services dies or is slow to recover.

But such a failover might not reflect a networking or system failure at all.

Perhaps it is a matter of choice—the end user’s preference.

Maybe a user of the Alice service shuts off their desktop at the end of a hectic day and picks up their tablet instead. “Desktop Alice” halts, and “Tablet Alice” resumes where they left off. Instead of a network or hardware crash, it’s simply a failover to their preferred device.

This leads us to a key insight. Circling back to the Fleet system, where we started, we can now cast transitions of user activity from one device to another as a special case of failover. In this case, it’s a transition from one device to another.

But migration of program state to a new device is just one special case of mobility. If we have the right feedback and user interface mechanisms in place, we can generalize this as transitions of user activity from one place to another, in many senses of the word place. How best to do this is still an open problem. Our work explores some possibilities and hints at solutions. This suggests that cross-device and distributed systems will have major impact on user interfaces going forward, even if the full vista of interactive systems and human experiences this makes possible has only just begun to dawn.

Next, we take this up a level by looking at a simple example of how sensing shifts in context—such as responding appropriately when a user tilts a display—can drive lightweight and natural transitions from one human activity to another.

Changes in display orientation as a nuanced transition in ‘place’

What tilt-responsive techniques for digital drawing boards do in brief:

  • Run on a Microsoft Surface Studio 2 using a C# module for sampling the sensors and implementing signal conditioning and a JavaScript-based client
  • Demonstrate how a variety of everyday applications can use sensed display adjustments to drive context-appropriate transitions, such as shifts between reading versus writing, displays of public versus personal information, face-to-face video versus screen sharing of documents in remote work, and other nuances of input and feedback contingent on display angle—with continuous interactive responses tailored to each use case.

During the long incubation and technical development of the distributed-systems advances discussed above, we kept circling back at odd intervals to another endeavor: we had outfitted the Microsoft Surface Studio with an extra sensor to detect its angle. The Microsoft Surface Studio is a 27” screen that supports multi-touch and pen input and can be adjusted smoothly from a vertical display to a drafting table–like 20 degrees. In this device, we saw a parallel between its use and people’s behaviors and expectations outside the digital world.

In everyday life, people naturally reposition objects, such as paper documents, to allow shared visibility, partial viewing, and even concealment. Such motions are completely natural and perhaps even subconscious. How we position an object depends on what we intend to do. For example, a doctor might hold a medical chart “close to the vest” at first, but then turn it toward their patient when ready to share particular results. Similarly, the appropriate display orientation depends on the task and situation at hand. A vertical monitor makes for easier reading but not necessarily easier writing with a stylus. Angled drafting tables in a design studio encourage sketching and freeform brainstorming, but the preference when presenting refined versions of those same ideas may be a vertical screen. Display angle is not one size fits all. We wondered, could we tap into our most natural ways of mediating information exchange by sensing the tilt of a display?

We explored system responses to the sensed tilt of an adjustable Microsoft Surface Studio display, such as during transitions from vertical to low-angled, drafting table–like postures. This transforms the current application’s user experience via continuous, interactive, sensor-driven transitions.

By adding an off-the-shelf tilt sensor to the Microsoft Surface Studio, we discovered a series of designs, techniques, and interactions that can respond appropriately to the user’s context of use, as sensed by the current display angle. In doing so, we begin to shift the burden of adapting the inputs, tools, modes, and graphical layout of applications from the user to the system. For example, one demonstration we built explores a teleconferencing scenario in which the typical talking-head video feed of “person-space” appears when the screen is vertical but transitions to a shared document that users can mark up with a digital pen when the screen is tilted down like a drafting board. As the display tilts, we fade out the camera feed to let the user avoid unbecoming video angles. This also selectively focuses the remote audience’s attention on the shared document rather than the video feed—in effect, a remote way of steering a remote participant’s attention in a manner analogous to angling a paper document toward a collaborator nearby.

As the demo reel above illustrates, displays can respond to tilt by transitioning between reading and writing, public versus personal, authoring versus presenting, and other nuances of input and feedback—and in ways that often can delight and entertain, as well.

Amid our above distributed-systems research, this curiosity-driven work was a completely unrelated side project. Or so we thought. After we finished writing up tilt-responsive techniques for publication, we had an epiphany. As you adjust the angle of a display, you’re:

In the same physical location.

On the same device.

Using the same screen.

Running the same application.

But the new screen orientation doesn’t afford the same tasks and activities—you’ve transitioned to a different place.

This subtly shifts your expectations of what is appropriate. And with just a tiny bit of awareness, well-designed software could provide a sort of intelligence by responding appropriately in kind. That is, the angle of a digital display is just another form of mobility. Here, the mobility is on the micro-level, moving from one screen orientation to another, as opposed to the more macro-level transitions that are the current focus of the Fleet system, such as moving from one device to another or across local and remote locations.

Closing thoughts

We have discussed how the Fleet system explores new ways to think about mobility, and we’ve shown how it builds on an exciting new distributed-systems technology known as Ambrosia. These technologies work to build and implement applications that not only go beyond the current device, but also unbind other dimensions of mobility—the current user, the current application, the current time—as well. Beyond that, as hinted at by our final example above, our research shows how sensors can bridge transitions from the current (sensed) context to another—by responding appropriately to natural human activity.

At the highest level, these advances hint at how devices can be better together—complementing one another across an ecosystem of technologies—instead of competing to add ever more complexity with each new device or service.