{"id":129505,"date":"2021-06-06T14:00:56","date_gmt":"2021-06-06T14:00:56","guid":{"rendered":"https:\/\/developer.apple.com\/news\/?id=zl9wxkjd"},"modified":"2021-06-06T14:00:56","modified_gmt":"2021-06-06T14:00:56","slug":"challenge-build-an-app-using-built-in-sound-classification","status":"publish","type":"post","link":"https:\/\/sickgaming.net\/blog\/2021\/06\/06\/challenge-build-an-app-using-built-in-sound-classification\/","title":{"rendered":"Challenge: Build an app using built-in Sound Classification"},"content":{"rendered":"
\"Speaker<\/div>\n

With Sound Classification, you can create experiences for camera, video, productivity, and game apps on all Apple platforms \u2014 and for this challenge, we\u2019re inviting you to explore a sample project and build your own.<\/p>\n

When you use the built-in sound classifier in Sound Analysis you have access to over 300 different sound classes trained on a massive amount of data to ensure great model performance. The model won\u2019t predict just a single sound at once: It returns multiple labels with individual confidence scores for each so that you can understand all the sounds being heard at a given time.<\/p>\n

The API in Sound Analysis provides a full list of all trained classes, you decide which ones you care about, ignoring all others. You could use the speech detector, for example, to identify when someone has finished speaking. Even further, you have control over the sampling window for the prediction and can apply sound-specific confidence thresholds to greatly improve the real world accuracy of the features you will create.<\/p>\n

Begin the challenge<\/h3>\n

For this challenge, we invite you to brainstorm how you could incorporate Sound Classification into an existing app or a brand new app idea. You can use sound classifiers on all Apple platforms \u2014 Mac, iPhone, iPad, Apple Watch, or Apple TV \u2014 allowing you to explore a variety of different ideas and situations. For example, a camera app could enable people to quickly locate the precise moment in personal videos where things like laughter occurred, or listen for specific sounds during video capture to trigger special effects and overlays in the camera frame. A video editing or productivity app could leverage sound classification to help someone quickly organize media assets based on the sounds that are in them. Or an interactive game experience could be developed that leverages recognized sounds in the environment as a trigger for unlocking special modes where characters mimic what they’re hearing.<\/p>\n

We\u2019ve provided the \u201cClassifying live audio input with a built-in sound classifier\u201d project to help you get started. From here, we invite you to come up with an app of your own that uses the microphone or another audio source to listen to and identify sounds. What will you make? Show off the creative ways you can apply this built-in capability. <\/p>\n

\n
\n
<\/a> <\/section>\n
<\/p>\n

Discover built-in sound classification in SoundAnalysis<\/h4>\n

Explore how you can use the Sound Analysis framework in your app to detect and classify discrete sounds from any audio source \u2014 including live sounds from a microphone or from a video or audio file \u2014 and identify precisely in a moment where that sound occurs. Learn how the built-in sound…<\/p>\n

<\/a> <\/section>\n<\/section>\n<\/section>\n

Classifying Live Audio Input with a Built-in Sound Classifier<\/a><\/p>\n

Need support, or want help from the community as you explore Sound Classification? You can share your progress in the Developer Forums.<\/p>\n

Visit the Apple Developer Forums<\/a><\/p>\n

Resources<\/h3>\n

Sound Analysis<\/a><\/p>\n

Read the WWDC21 Challenges Terms and Conditions<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

With Sound Classification, you can create experiences for camera, video, productivity, and game apps on all Apple platforms \u2014 and for this challenge, we\u2019re inviting you to explore a sample project and build your own. When you use the built-in sound classifier in Sound Analysis you have access to over 300 different sound classes trained […]<\/p>\n","protected":false},"author":2,"featured_media":129506,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[55],"tags":[],"class_list":["post-129505","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-apple-developer-news"],"_links":{"self":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/129505","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/comments?post=129505"}],"version-history":[{"count":0,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/129505\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media\/129506"}],"wp:attachment":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media?parent=129505"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/categories?post=129505"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/tags?post=129505"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}