{"id":126734,"date":"2022-07-21T14:20:44","date_gmt":"2022-07-21T14:20:44","guid":{"rendered":"https:\/\/news.microsoft.com\/?p=446768"},"modified":"2022-07-21T14:20:44","modified_gmt":"2022-07-21T14:20:44","slug":"ai-equipped-drones-study-dolphins-on-the-edge-of-extinction","status":"publish","type":"post","link":"https:\/\/sickgaming.net\/blog\/2022\/07\/21\/ai-equipped-drones-study-dolphins-on-the-edge-of-extinction\/","title":{"rendered":"AI-equipped drones study dolphins on the edge of extinction"},"content":{"rendered":"

Small in size and with distinctive, rounded dorsal fin, M\u0101ui dolphins are one of the rarest and most threatened dolphins<\/a> in the sea, with a known population of just 54. Decades of fishing practices, such as gillnetting off the west coast of New Zealand in the South Pacific have pushed this sub-species to near extinction.<\/p>\n

\"Maui<\/a>
Photo courtesy of MAUI63.<\/figcaption><\/figure>\n

Now scientists and conservationists are using a combination of drones, AI and cloud technologies to learn more about these rare marine mammals. They say the solution can also be applied to study other species fighting for survival in the world\u2019s oceans.<\/p>\n

The effort is part of a growing trend toward using AI and other technologies<\/a> to more effectively collect and analyze data for environmental conservation. For example, Microsoft AI for Earth<\/a>\u2019s<\/u> partner, Conservation Metrics<\/a>,<\/u> combines machine learning, remote sensing and scientific expertise to increase the scale and effectiveness of wildlife surveys. NatureServe<\/a>, another partner organization, leverages Esri ArcGIS tools and Microsoft cloud computing to generate high-resolution habitat maps for imperiled species.<\/p>\n

The scientists and conservationists with the not-for-profit group MAUI63<\/a> are using AI and other tools to support the conservation of the M\u0101ui dolphins, named after the Polynesian demigod, M\u0101ui.<\/p>\n

\"MAUI63<\/a>
From left, Willy Wang, MAUI63 co-founder, Hayley Nessia, pilot, Pete Carscallen, pilot and Tane van der Boon, MAUI63 co-founder, pose after a survey flight. Photo courtesy of MAUI63.<\/figcaption><\/figure>\n

M\u0101ui dolphins play an important part of the ecological and spiritual fabric of Aotearoa <\/em>\u2014 the M\u0101ori name for New Zealand. They inhabit the waters off the west coast of the country\u2019s North Island \u2014 also known as Te Ika-a-M\u0101ui<\/em>, which translates to \u201cthe Fish of M\u0101ui.\u201d<\/p>\n

Weighing 50 kilograms and measuring up to 1.7 meters when fully grown, M\u0101ui dolphins are one of the smallest members of the marine dolphin family and among the most elusive. They have white, grey and black markings and black rounded dorsal fins. Unlike human facial features, the markings don\u2019t vary between animals, meaning individuals can\u2019t be identified with the naked eye. Conventional ways of monitoring and studying these fast-moving animals at sea have proved problematic and costly. Researchers admit relatively little is known about their behavior, particularly in winter when weather conditions deteriorate.<\/p>\n

Now, MAUI63 believes it has a solution: an AI-powered drone that can efficiently find, track and identify dolphins. The aim of their work, according to co-founder and marine biologist, Professor Rochelle Constantine, is to \u201cgive certainty to our uncertainty.\u201d<\/p>\n

\u201cCurrently everything we know about them is from summer. We know virtually nothing about them in winter,\u201d she says.<\/p>\n

Constantine, together with technology and innovation specialist Tane van der Boon and drone enthusiast Willy Wang, formed MAUI63 in 2018. At the time, the M\u0101ui dolphin population was estimated at 63 individuals. That figure has since dropped to 54.<\/p>\n

Over drinks at a pub, Van der Boon, who is the group\u2019s CEO, and Wang came up with the idea of leveraging drones, machine learning and cloud computing to study the dolphins. \u201cI was getting interested in computer learning \u2014 I really saw how teaching computers to see is quite an amazing thing. All the things that we could start to solve and do really intrigued me,\u201d he says.<\/p>\n

The M\u0101ui dolphins\u2019 rounded fins differ from the more pointed-shaped fins of other dolphins. That meant existing computer vision models were not fit for identifying M\u0101ui dolphins. So, van der Boon spent \u201ca couple of months of nights and weekends\u201d teaching himself how to build a model. He then painstakingly tagged M\u0101ui dolphin images from internet footage to train it to identify them.<\/p>\n

\"Close<\/a>
M\u0101ui dolphins, including young calf, swim off the coast of Hamiltons Gap in Auckland, New Zealand. Photo courtesy of University of Auckland, Oregon State and the Department of Conservation.<\/figcaption><\/figure>\n

It was the first challenge of many. Four years of development, testing and fundraising followed. The team also had to gain specialist qualifications to fly their 4.5 meter-wingspan drone out to sea. They spotted their first M\u0101ui dolphins earlier this year.<\/p>\n

\u201cIt was pretty exciting. We were sitting in the van, the drone was 16 kilometers down the coast, and we could see the AI detecting dolphins as we were doing circles around them,\u201d van der Boon says.<\/p>\n

Development has been helped along by funding under New Zealand\u2019s Cloud and AI Country plan, which includes funding for projects with sustainable societal impact, as well as support from Microsoft Philanthropies ANZ. The solution combines an 8K ultra high-definition still camera and a full HD gimbal camera with an object detection model for spotting dolphins, and an open-source algorithm originally developed for facial recognition. Hosted on Microsoft Azure, it gathers data that will be used to identify individual animals by the shape and size of their dorsal fins and any scratches and marks on them.<\/p>\n

MAUI63 is also developing an app called Sea Spotter, funded by Microsoft, which uses Azure Functions<\/a> to allow people to upload photos of M\u0101ui sightings and use an AI algorithm to learn which individual they saw. Being able to pinpoint the M\u0101ui dolphin\u2019s habitat is crucial for understanding how to protect them against threats, according to the conservationists.<\/p>\n

Constantine says the risk of M\u0101ui dolphins being caught as bycatch in the nets of fishing boats is now \u201cextremely low\u201d thanks to a marine sanctuary that was put in place around their known habitat in 2008 and expanded in 2020. Nonetheless, they may stray outside these protected areas. That is why MAUI63 is working on an integration project with fishing companies to ultimately notify their crews of sightings made by the drone in real time.<\/p>\n

\"Three<\/a>
MAUI63 uses an object detection computer vision model to spot dolphins from the drone footage that was collected as a part of a survey. Photo courtesy of MAUI63.<\/figcaption><\/figure>\n

Another threat is toxoplasmosis, a disease caused by a parasite that lives in cat feces. It enters the marine food chain through runoff from the land, causing stillbirths and death in marine mammals. \u201cIf you understand where dolphins are on a regular basis, you can start to look at the areas where toxoplasmosis might be entering the water and maybe something can be done about that,\u201d says van der Boon.<\/p>\n

MAUI63\u2019s aim is to provide scientifically robust information to conservation decision-makers. \u201cWe\u2019re just trying to collect the data and make it available to anyone who needs it. We\u2019re not here to make decisions on how they should or shouldn\u2019t be protected. That\u2019s key to us because everyone has quite different views on it,\u201d says van der Boon. At this stage, he says, it is far from certain that MAUI63\u2019s work will help prevent extinction, but what everyone can agree on is that it is worth trying.<\/p>\n

M\u0101ui dolphins hold a special significance for many indigenous M\u0101ori \u2014 they are considered to be kaitiaki<\/em> (guardians) that helped guide the waka<\/em> (canoes) of their ancestors when they first came to Aotearoa <\/em>hundreds of years ago.<\/p>\n

Environmental scientist Dr. Aroha Spinks says protecting them is essential to increasing the mauri<\/em>, or life force, of the environment. \u201cFrom a M\u0101ori point of view \u2014 which is also backed up by science \u2014 the health of the environment affects the health and wellbeing of the people,\u201d she says.<\/p>\n

MAUI63 plans to make its learnings and technology available to people working with other marine species, such as a potential project in Antarctica with the European Union Environmental Council. Constantine hopes the high-tech approach will be as game changing for other researchers as it has been for her. \u201cIt makes such a huge difference to my world and the conversations I can have, and the information we can give to governments and the public about how to make conservation decisions that really matter.\u201d<\/p>\n

Top image: MAUI63 uses a combination of drones, AI and cloud technologies to learn more about Maui dolphins. Video courtesy of MAUI63.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

Small in size and with distinctive, rounded dorsal fin, M\u0101ui dolphins are one of the rarest and most threatened dolphins in the sea, with a known population of just 54. Decades of fishing practices, such as gillnetting off the west coast of New Zealand in the South Pacific have pushed this sub-species to near extinction. […]<\/p>\n","protected":false},"author":2,"featured_media":126735,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[49],"tags":[135,50],"class_list":["post-126734","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-microsoft-news","tag-artificial-intelligence","tag-recent-news"],"_links":{"self":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/126734","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/comments?post=126734"}],"version-history":[{"count":0,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/126734\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media\/126735"}],"wp:attachment":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media?parent=126734"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/categories?post=126734"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/tags?post=126734"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}