{"id":128172,"date":"2021-06-11T01:00:09","date_gmt":"2021-06-11T01:00:09","guid":{"rendered":"https:\/\/developer.apple.com\/news\/?id=ivsjgxq1"},"modified":"2021-06-11T01:00:09","modified_gmt":"2021-06-11T01:00:09","slug":"challenge-explore-spatial-audio-soundscapes","status":"publish","type":"post","link":"https:\/\/sickgaming.net\/blog\/2021\/06\/11\/challenge-explore-spatial-audio-soundscapes\/","title":{"rendered":"Challenge: Explore spatial audio soundscapes"},"content":{"rendered":"
\"Person<\/div>\n

When you support multichannel audio in your app, game, or audiovisual content, you can add dimensionality to your storytelling, transport listeners out of a conventional audio experience, and bring people further into the worlds you\u2019re creating. In this challenge, we invite you to explore a soundscape in intentional stereo, stereo spatialization, and multichannel formats, consider the differences between each, and brainstorm how spatial audio could enhance your own stories.<\/p>\n

Begin the challenge<\/h3>\n

In the demo for \u201cImmerse your app in spatial audio,\u201d the presenter, Simon, has his spatial audio demonstration video \u2018fail\u2019 on him. After a few moments of panic and quick thinking, he decides he\u2019s going to describe the events of this failed video \u2014 and as he does, those events begin to come to life. In each scene, different audio techniques create a fully-imagined environment for the audience to inhabit, drawing them into Simon\u2019s described world.<\/p>\n

\n
\n
<\/a> <\/section>\n
<\/p>\n

Immerse your app in spatial audio<\/h4>\n

Discover how spatial audio can help you provide a theater-like experience for media in your apps and on the web. We\u2019ll show you how you can easily bring immersive audio to those listening with compatible hardware, and how to automatically deliver different listening experiences depending on…<\/p>\n

<\/a> <\/section>\n<\/section>\n<\/section>\n

For this challenge, we\u2019re inviting you to explore this demo and listen to the differences as you move between intentional stereo, spatialized stereo, and multichannel formats. You\u2019ll need a pair of spatial audio-compatible accessories, like AirPods Pro, as well as a device running iOS 14 or macOS Big Sur. To explore the spatialized stereo format, you\u2019ll need a device running iOS 15 or macOS Monterey. As you listen, consider how each version of the experience feels different.<\/p>\n

Listen to the demo in intentional stereo<\/strong>
\nWatch the session on iOS 14 or macOS Big Sur in the Developer app or on developer.apple.com. You\u2019ll hear this demo delivered in stereo, with visual cues on screen indicating the full surround experience.<\/p>\n

What do you notice, listening to this experience? How does the audio shift and change as we move through each of Simon\u2019s soundscapes?<\/p>\n

Listen to the demo for “Immerse your app in spatial audio” in the Developer app<\/a><\/p>\n

Listen to the demo in spatialized stereo<\/strong>
\nTo hear the spatialized stereo version of \u201cImmerse your app in spatial audio,\u201d watch this demo on a device running the iOS 15 or macOS Monterey developer betas.<\/p>\n

How does this change the experience for the listener compared to the intentional stereo version? Are there sounds or moments you find yourself noticing that you haven\u2019t before?<\/p>\n

Listen to the demo for “Immerse your app in spatial audio” in the Developer app<\/a><\/p>\n

Listen to the demo in multichannel<\/strong>
\nYou can stream a full multichannel mix of this demo in spatial audio on either iOS 14 or iOS 15 using the link below.<\/p>\n

As you listen to this multichannel mix, divide the world into three distances: Background, foreground, and personal space. Think about where the sounds are coming from. What do these different distances and orientations add to the experience? How does the positioning of sound further enhance this story?<\/p>\n

Listen to the demo for “Immerse your app in spatial audio” in multichannel audio<\/a><\/p>\n

Now, think about a moment from your app, game or audiovisual content. How does the audio currently sound in this moment? How can you improve that experience by bringing distance and orientation into your soundscape? Where could supporting multichannel and spatial audio help draw people into your story?<\/p>\n

Spatialize your experiences<\/strong>
\nWith more support for spatial audio experiences coming with iOS 15 and macOS Monterey later this year, now is a great time to consider how you currently approach telling stories through audio. Listen to your stereo experiences on the developer betas and listen to how they change when played back in spatialize stereo. Consider how you can augment those existing moments by creating multichannel mixes. And explore what kinds of entirely new experiences you can provide listeners with spatial audio. For game designers, we also recommend watching \u201cDiscover geometry-aware audio with the Physical Audio Spatialization Engine (PHASE)\u201d to learn about new ways you can create spatial audio experiences that adapt to the environment of your game.<\/p>\n

\n

Note: if you\u2019re curious about experimenting further with multichannel, you can try creating a multichannel audio experience of your own by exploring the binaural and surround mixing tools in digital audio workstations (DAWs) like Logic Pro X. (To properly mix and play back your audio in surround, however, you\u2019ll need a multichannel speaker setup.)<\/em><\/p>\n

\n

Want to share your thoughts on this demo, or how you\u2019d adapt your existing experiences for spatial audio? Head over to the Developer Forums.<\/p>\n

Visit the Apple Developer Forums<\/a><\/p>\n

Resources<\/h3>\n
\n
\n
<\/a> <\/section>\n
<\/p>\n

Immerse your app in spatial audio<\/h4>\n

Discover how spatial audio can help you provide a theater-like experience for media in your apps and on the web. We\u2019ll show you how you can easily bring immersive audio to those listening with compatible hardware, and how to automatically deliver different listening experiences depending on…<\/p>\n

<\/a> <\/section>\n<\/section>\n<\/section>\n

\n
\n
<\/a> <\/section>\n
<\/p>\n

Discover geometry-aware audio with the Physical Audio Spatialization Engine (PHASE)<\/h4>\n

Explore how geometry-aware audio can help you build complex, interactive, and immersive audio scenes for your apps and games. Meet PHASE, Apple\u2019s spatial audio API, and learn how the Physical Audio Spatialization Engine (PHASE) keeps the sound aligned with your experience at all times \u2014 helping…<\/p>\n

<\/a> <\/section>\n<\/section>\n<\/section>\n

Read the WWDC21 Challenges Terms and Conditions<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

When you support multichannel audio in your app, game, or audiovisual content, you can add dimensionality to your storytelling, transport listeners out of a conventional audio experience, and bring people further into the worlds you\u2019re creating. In this challenge, we invite you to explore a soundscape in intentional stereo, stereo spatialization, and multichannel formats, consider […]<\/p>\n","protected":false},"author":2,"featured_media":128173,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[55],"tags":[],"class_list":["post-128172","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-apple-developer-news"],"_links":{"self":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/128172","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/comments?post=128172"}],"version-history":[{"count":0,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/128172\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media\/128173"}],"wp:attachment":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media?parent=128172"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/categories?post=128172"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/tags?post=128172"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}