Our focus this week is a skilled player who enjoys taking the road less traveled. This Crucible warrior wields weapons that are often passed over by others, and does so with elegance. 

Please meet CammyCakes. 

Tell us a little bit about yourself and your role in the Destiny Community.

CC: I don’t do intros. Well, at least I don’t on YouTube. 

Hi, I’m Cammy and long story short: I was lucky and somehow built a humble following by using terrible weapons not so terribly.

As far as my role in the community goes, on occasion I stumble onto something both equally genius and idiotic. I find I’m constantly asking myself, “If I don’t do this, then who will?” Then it leads to putting this madness in practice, which ends up resulting in a missile Titan’s Thundercrash Super going through a Gambit teleporter and somehow taking out the only player with 15 motes. 

Practical madness. Got it. Where can we find you on the internet?

I’m going right now to smash that “like” button. What has been your favorite subclass and weapon?

CC: My favorite is most definitely the Warlock’s Attunement of Grace. I feel like Oprah when I play it. “Check under your seats! YOU get a healing ‘nade. EVERYONE gets a healing ‘nade!”

Fun fact: I was a cheerleader in high school. It’s actually how I ended up with the nickname CammyCakes. When I play healer Warlock, I am the encapsulating definition of a cheerleader, and I love it. 

As for weapon? I can’t name just one. It’s the whole package. It’s a lifestyle. I’m referring to the SnipeLion. I used Fighting Lion when it hit 57 with splash damage. I thought it was overpowered back then. Now it delivers tactical nukes without the need for a killstreak. 

And that’s not even the best part. Pair this baby with a snipe, and you’ll have the capabilities to either snipe someone outright, or clean them up around the corner with a lion bank shot. You would think shotgunners would be an issue. But dust off that Geometry doctorate, and angle the lion at the floor or ceiling to increase travel distance, so you can detonate right in their face and show them what Mindbender’s ambition truly means.

It’s always great seeing creative uses of the sandbox. What can we expect to see on your channels?

CC: I’ve been partial to live commentaries, where I either give tips on the fly in a match, or make terrible jokes to pass the time. I’ll also do weapon/armor reviews, and discuss the pros and cons of interesting builds. On occasion I’ll post competitive tips, and highlights from great matches. On Twitch, I drink tea and shoot things in a cave for hours.

Not all of your jokes are terrible. What is one of your favorite moments playing Destiny 2?

CC: Before the Forsaken changes were implemented, I understood that the days of the primary were numbered. I knew every callout, crevice, and subclass quirk. I cranked the headphones up and learned every sound. I paid attention to nuanced things like shadows and dust particles.

Never have I felt so in tune with my team, my aim, and my decision making. Despite not liking the Wormhusk, Dire Promise, and Graviton Lance/Tractor Cannon, I played my heart out in the competitive playlist, and made so many great memories with awesome friends. Nothing beats the feeling of a fancy strafe 3 tap with a 110RPM handcannon. 

What are your first impressions of the Season of the Forge so far?

CC: I’ll break down my first impressions of Black Armory’s Forge into likes, dislikes, and how it can be improved.

Likes: it’s a bite-sized activity with guaranteed unique loot. Great to laugh with friends and have a (responsible) drink with.

Dislikes: It’s fairly predictable and could be grindy soon as a result.

How it can be improved: Provide PvP alternatives for weapon charging. More random elements during the activity to spice it up. Continually reward time investment with more deterministic rewards. 

My thoughts on the raid are mixed. I appreciate the setting and scale, because nothing feels more bad-ass than an urban assault. I particularly liked the free-roam nature of the final boss. The difficulty on launch leaves a bit to be desired after experiencing Last Wish.

Anything else you would like to add?

CC: Be nice to your fellow Guardian. Shoot someone a compliment every now and then. Reach out and make new friends. Don’t blindly be swayed by a content creator. Test things out yourself and add to the conversation in a constructive way.

Thanks for being awesome, Destiny community. 

Well said. Thank you for taking the time to tell us more about yourself and your channels.

Make sure you stop by and see some of Cammy’s videos. He has a lot of content to keep you entertained when you are away from your console/PC. As always, if you have an idea of who we should write about in the future, let us know on the forums using the tag #CommunityFocus.

Forza fans might have December 13^th circled on their calendars, and for good reason. After all, tomorrow is the launch day the first expansion for the game – Fortune Island – allowing FH4 players the opportunity to explore a brand-new island location full of danger, treasure, and epic driving adventures. Alongside the launch of Fortune Island, Playground Games is also releasing the fourth update for Forza Horizon 4. This update is bringing new content and experiences to Forza Horizon 4, along with lots of fixes and improvements to the game overall.

Here’s a look at some of the highlights coming with Update 4:

Horizon Life MP Update

With this update, Playground has made some improvements to Horizon Life multiplayer events. Now when you create a multiplayer event, you can post it to the Activity Panel and then return to Freeroam while you wait for other players to join. The previous 40-second limit has been removed, and now you can wait for as long as you like for players to join before you start the session.

Photo Mode Improvements

Forzatographers, rejoice! New improvements to Photo Mode are coming. Now you separately toggle vehicle lights, drivers, wildlife, and crowds to specify elements you want in your photographic masterpieces. In addition, there are new bokeh, focus, and sampling options, as well as more freedom of movement with the photo camera.

Horizon Holiday Party

It’s the holiday season and Forza Horizon 4 players can celebrate with a load of new holiday-themed items available with the latest update. Twelve new festive clothing options are all available from Season Events, The Trial, Wheelspins, and the #Forzathon Shop.

Other Improvements

In addition to new content, Update 4 is bringing with it new improvements across various areas of the game. Highlights include fixing an exploit in Route Creator which allowed players to create routes to easily gain a large number of skill points, as well as fixing an exploit in Rivals which allowed players from being able to use the cars that did not meet the event restrictions. Elsewhere, emotes can now occasionally be found for purchase in the #Forzathon Shop, and the team has added improved visibility of driving line on mini-map in various colorblind modes.

For the full list of fixed in Update 4, check out the Release Notes on the Forza Support section on our Web site.

Don’t forget, Playground Games will be giving fans a world premier of the Fortune Island expansion live from PG HQ on December 13. The show starts at 7 a.m. Pacific/3 p.m. GMT on the official Forza Mixer and Twitch channels and the PG team will be exploring Fortune Island and answering community questions as well. Following Playground’s Fortune Island stream, we’ll have with the December update of “Forza Monthly” which kicks off at 10 a.m. Pacific/6 p.m. GMT, where we’ll be joined by members of Playground to dive further into the Fortune Island expansion. Don’t miss the shows live!

In recent months, Nintendo has taken a strong stance against video game piracy worldwide. In an effort to continue the good fight, Nintendo is now taking legal action against a man located in Orange County, California who has allegedly been selling hacked consoles, pirated versions of the company’s games and tools to help users modify their own systems – violating the Digital Millennium Copyright Act.

Mikel Euskaldunak has reportedly been selling modified services for the Switch, allowing users to play unauthorised games. He’s also been selling hacked NES Classic Mini preloaded with 800 pirated titles and selling them above the retail price.

In addition to direct copyright infringement, Nintendo believes Euskaldunak and “countless” other currently unnamed defendants are encouraging users to infringe the company, which also makes them liable for contributory copyright infringement. Adding to this are claims the defendants are infringing and diluting trademarks.

Attorney Kenneth Parker said how defendants were providing users with the instructions and tools to infringe in a manner that was least likely to be caught or arouse suspicion. Nintendo is asking the court to order an injunction, barring defendants from continued distribution and sale of the technology.

Epic Games has grown into a global video game powerhouse thanks to the Unreal Engine and internally developed video games such as the insanely popular free-to-play title Fortnite. Since the breakout success of the battle royale game, the American-based developer hasn’t wasted any time expanding its empire.

In a recent news post over on the official website, it was revealed the company would be making a large set of cross-platform game services free to all developers in 2019. These services were originally built for Fortnite and have already been thoroughly tested by 200 million players across seven different platforms. Here’s exactly what the company had to say:

Throughout 2019, we’ll be launching a large set of cross-platform game services originally built for Fortnite, and battle-tested with 200,000,000 players across 7 platforms. These services will be free for all developers, and will be open to all engines, all platforms, and all stores. As a developer, you’re free to choose mix-and-match solutions from Epic and others as you wish.

All services will be operated in a privacy-friendly, GDPR-compliant manner.

The service launch will begin with a C SDK encapsulating our online services, together with Unreal Engine and Unity integrations. We’ll start with a core set of features and expand over time.

These service features will cover Switch and include cross-platform logging, friends, presence, profile and entitlements (Q2-3 2019). There’ll also be cross-platform voice communication (Q3 2019), parties and matchmaking, data storage and cloud-saving for all-platforms (Q3-4 2019).

Epic says these are just the first steps in helping develop the next-generation of socially-connected games.

What do you think about this? Are you a fan of cross-platform online services? Do you like the idea of more socially-connected gaming experiences? Tell us below.

While many Embedded Linux Conference talks cover emerging technologies, some of the most useful are those that survey the embedded development tools and techniques that are already available. These summaries are not only useful for newcomers but can be a helpful reality check and a source for best practices for more experienced developers.

In “Strategies for Developing and Deploying your Embedded Applications and Images,” Mirza Krak, an embedded developer at Mender.io, surveys the many options for prepping and deploying software on devices. These range from cross-device development strategies between the desktop and embedded platforms to using IDEs to working with Yocto/OE-Core with package managers. Krak, who spoke at this October’s ELC Europe conference in Edinburgh, also covered configuration management tools, network boot utilities, and update solutions such as swupdate and Mender.

Basic desktop/embedded cross development

It’s easier to do your development on a desktop PC rather than directly on an embedded device, said Krak. Even if your device can run the required development software and distributions, you cannot easily integrate all the tools that are available on the desktop. In addition, compile times tend to be very slow.

On the desktop, “everything is available to you via apt-get install, and there is high availability of trace and debug tools,” said Krak. “You have a lot more control when doing things like running a binary, and you can build, debug, and test on the same machine so there are usually very short development cycles.”

Eventually, however, you’ll probably need to do some cross-device development. “You can use some mock hardware to do some basic sanity testing on the desktop, but you are not testing on the hardware where the software will run, which may have some constraints.”

A typical approach for cross-device development is to run Yocto Project or Buildroot on your PC and then cross compile and transfer the binaries to the embedded device. This adds to the complexity because you are compiling the code on one device and you may need to transfer it to multiple devices for testing.

You can use the secure copy (scp) command or transfer data by USB stick. However, “It’s a lot of manual work and prone to error, and it’s hard to replicate across many devices,” said Krak. “I’m surprised at how many people don’t go beyond this entry point.”

IDEs and Package Managers

An easier and more reliable approach is to use an IDE such as Eclipse or Qt Creator, which have plug-ins to cross compile. “IDEs usually have post-build hooks that transfer the binary to the device and run it,” said Krak. “With Qt Creator, you can launch the debug server on the device and do remote debugging remotely.”

IDEs are great for simpler projects, especially for beginning or casual developers, but they may lack the flexibility required for more complex jobs. Krak generally prefers package managers — collections of tools for automating the processing of installing, upgrading, configuring, and removing software — which are much the same as those you’d find on a desktop Linux PC.

“Package managers give you more sanity checks and controls, and the ability to state dependencies,” said Krak. Package managers for embedded targets include deb, rpm, and opkg, and you can also turn to package utilities like apt, yum, dnf, pacman, zipper, and smart.

“If you’re compiling your Debian application in a build system you could say ‘make dpkg’, which will package your binary and any configuration files you might have,” said Krak. “You can then transfer the binary to your device and install. This is less error prone since you have dependency tracking and upstream and custom package feeds.”

Package managers are useful during prototyping and early development, but you typically won’t make them available to the embedded end user, said Krak. In addition, not all embedded devices support platforms such as Ubuntu or Raspbian that include package managers.

Krak typically works with a Yocto Project/Open Embedded environment and uses the OE-core Angstrom distribution, which maintains opkg package feeds. “You can include meta-angstrom in your Yocto build and set DISTRO = ‘angstrom’ to you get package feeds,” said Krak. “But there’s a lot more to Angstrom that you may not want, so you may want to create a more customized setup based on Poky or something.”

Yocto generates package feeds when you do an image build, giving you a choice of rpm, deb, or ipk. Yet, “these are only packages, not a complete package feed,” said Krak. To enable a feed, “there’s a bitbake package-index command that generates the files. You expose the deploy server where all your packages are to make it available on your device.”

While this process handles the “service side” package feed, you still need tools on your embedded device. Within Yocto, “there’s an EXTRA_IMAGE_FEATURES setting you can set to package-management,” said Krak. “There’s also a recipe in meta-openembedded/meta-oe called distro-feed-configs.bb. If you include it in your build it will generate the config files needed for your package manager.”

Config management, network boot, and update solutions

Krak went on to discuss configuration management tools such as CFEngine, Puppet, Chef, and Ansible. “These are very common in the enterprise server world if you need to manage a fleet of servers,” said Krak. “some apply workflows to embedded devices. You install a golden image on all your devices, and then set up connectivity and trust between the CM server and device. You can then script the configuration.”

Krak also surveyed solutions for more complex projects in which the application extends beyond a single binary. “You may be developing a specialized piece of hardware for a very specific use case or perhaps you depend on some custom kernel options,” said Krak.

Network booting is useful here because you can “deploy all the resources necessary to boot your device,” said Krak. “On boot, the system fetches the Linux kernel device tree and file system, so you just need to reboot the device to update the software. The setup can be complex, but it has the advantage of being easily extended to boot multiple devices.”

Typical network booting schemes such as PXELINUX and PXE boot use a tftp server setup on a laptop where you put the build artifacts you want to deploy. Alternatively, you can script it using the NFS root file-system.

A final alternative for complex systems is to use an update solution such as Mender, rauc, or swupdate. “You can use these early in the development process to deploy your builds,” said Krak. “If you build the same device in production, you can use the same software to test it throughout the development process, which builds confidence. Some use image-based updates, which is nice because your devices are stateless, which simplifies testing. Updaters fit well into development workflow and make it easier to integrate build artifacts. They often have features to avoid bricking devices.”

As a developer for Mender.io, Krak is most familiar with Mender, which provides an A/B image update strategy. “You have two copies of the OS and you do image-based updates so you always update the whole system,” explained Krak. You can watch the complete presentation below.

Product Strategist Amos Miller

Episode 54, December 12, 2018

Amos Miller is a product strategist on the Microsoft Research NeXT Enable team, and he’s played a pivotal role in bringing some of MSR’s most innovative research to users with disabilities. He also happens to be blind, so he can appreciate, perhaps in ways others can’t, the value of the technologies he works on, like Soundscape, an app which enhances mobility independence through audio and sound.

On today’s podcast, Amos Miller answers burning questions like how do you make a microwave accessible, what’s the cocktail party effect, and how do you hear a landmark? He also talks about how researchers are exploring the untapped potential of 3D audio in virtual and augmented reality applications, and explains how, in the end, his work is not so much about making technology more accessible, but using technology to make life more accessible.

Related:

Episode Transcript

Amos Miller: Until you are out there in the wind, in the rain, with the people, experiencing, or at least trying to get a sense for the kind of experience they’re going through, you’ll never understand the context in which your technology is going to be used. It’s not something you can imagine, or glean from secondary data, or even from video or anything. Until you are there, seeing how they grapple with issues that they are dealing with, it’s almost impossible to really understand that context.

(music plays)

Host: You’re listening to the Microsoft Research Podcast, a show that brings you closer to the cutting-edge of technology research and the scientists behind it. I’m your host, Gretchen Huizinga.

Host: Amos Miller is a product strategist on the Microsoft Research NeXT Enable team, and he’s played a pivotal role in bringing some of MSR’s most innovative research to users with disabilities. He also happens to be blind, so he can appreciate, perhaps in ways others can’t, the value of the technologies he works on, like Soundscape, an app which enhances mobility independence through audio and sound.

On today’s podcast, Amos Miller answers burning questions like how do you make a microwave accessible, what’s the cocktail party effect, and how do you hear a landmark? He also talks about how researchers are exploring the untapped potential of 3D audio in virtual and augmented reality applications, and explains how, in the end, his work is not so much about making technology more accessible, but using technology to make life more accessible. That and much more on this episode of the Microsoft Research Podcast.

Host: Amos Miller, welcome to the podcast.

Amos Miller: Thank you. It’s great to be here.

Host: You are unique in the Microsoft Research ecosystem. Your work is mission-driven. Your personal life strongly informs your professional life and, we’ll get more specific in a bit. But for starters, in broad strokes, tell us what gets you up in the morning. Why do you do what you do?

Amos Miller: I’ve always been passionate about technology from a very young age. But, really, in the way that it impacts people’s lives. And it’s not a mission that I necessarily knew about when I went through my career and experiences with technology. But when I look back, I see that those are the areas where I could see that a person feels differently about themselves or about the environment as a result of their interaction with that technology. That’s where I thought okay, that is having meaning to this person. And I have this huge, wonderful opportunity to do what I do in Microsoft Research to actually have turned that passion into my day job, which is very… I feel extremely fortunate with that. And I sometimes have to pinch myself to see that it’s not a dream.

Host: Well, tell us a little bit about your background and how that plays into what you are doing here.

Amos Miller: I’m very much a person that grew up in the technology world. I also moved a number countries over my career, and my life. I grew up in Israel. I spent many years in the UK, in London. I spent a few other years in Asia, in Singapore, and now I’m here, so all of these aspects of my life have been very important to me. I also happen to be blind. I suffer from a genetic eye condition called retinitis pigmentosa. It was diagnosed when I was five and I gradually lost my sight. I started university with good enough sight to manage and finish university with a service dog and any kind of technology I could find to help me read the whiteboard, to help me read the text on the computer. And I’d say by the age of 30, I totally stopped using my sight. And that’s when I really started living life as a fully blind person.

Host: Let’s talk about your job for a second. You are a product strategist at Microsoft Research, so how would you describe what you do?

Amos Miller: So, I work in a part of the organization at Microsoft Research that looks at really transferring technology ideas into impact. Into a way that they impact business, impact people. A good idea will only have an impact when it’s applied in the right way, in the right environment, so that the social, the business, the technological context in which it operates is going to make it thrive. Otherwise it doesn’t matter how good it is, it’s not going to have an impact.

Host: Right. So, let’s circle over to this previous role you had which was in Microsoft’s Digital Advisory program. And I bring it up in as much as it speaks to how often our previous work can inform our current work, and you referred to that time as your “customer-facing life.” How does it inform your role as a strategist today?

Amos Miller: What always energizes me is when I see and observe the meaning and the impact that technology can really have for people. And I don’t say it lightly. Until you are out there in the wind, in the rain, with the people, experiencing, or at least trying to get a sense for the kind of experience they are going through, you’ll never understand the context in which your technology is going to be used. It’s not something you can imagine, or glean from secondary data, or even from video or anything. Until you are there, seeing how they grapple with the issues that they are dealing with, it’s almost impossible to really understand that context. And the work that I’ve done in, actually, my first nine years in Microsoft, I worked in a customer-facing part of the business, in the Strategic Advisory Services, today known as the Digital Advisory Services. It’s work that we do with our largest customers around the world to really help them figure out how they can transform their own businesses and leverage advancements in technology.

Host: Right. So now, as you are working in Microsoft Research, as a product strategist, how does that transfer to what you do today?

Amos Miller: First of all, I want to introduce, for a moment, the team that I work with, which is the Enable team in Microsoft Research. And the Enable team is looking at technological innovations, especially with disabilities in mind. In our case, our two primary groups are people with ALS and people who are blind. As a product strategist, my role is to work across the research, engineering, marketing and our customer segment and really figure out and understand how we can harness what we have from a technology perspective and, as an organization, to maximize and have that impact that we aspire to have with that community. And that takes a great deal of – again, going back to my earlier point – spending time with that community, going out there and spending time, in my case, with other people who are blind because I only know my own experience. I don’t have everybody else’s experience. The only way for me to learn about that is to be out there. And in our team, every developer goes out there to spend time with end users because that’s the only way you can really get under the covers and understand what’s going on.

Host: Right.

(music plays)

Host: So, the website says you drive a research program that “seeks to understand and invent accessibility in a world” – this is the fun part – “where AI agents and mixed reality are the primary forms of interaction.” It sounds kind of sci-fi to me…

Amos Miller: A little bit. Let me unpack that a little bit. When we traditionally think about accessibility, we think about, how do you make something accessible? So how do you make a microwave more accessible? Well, there isn’t anything inherently inaccessible in putting a piece of pizza and warming it up in the microwave. The only reason it’s inaccessible is because the microwave was designed in an inaccessible way. It could have been accessible from the beginning.

Host: Sure.

Amos Miller: But the world we are moving to is, it’s not about me operating the microwave, it’s not about the accessibility of the microwave, it’s about me preparing dinner for my family. That’s the experience that I’m in. And there’s a bunch of technologies that support that experience. And that experience is what I am seeking to make an accessible and inclusive experience.

Host: Okay.

Amos Miller: That means that we are no longer talking about the microwave, we are talking about a set of interactions that involve people, that involve technology, that involves physical things in the environment. It’s not about making the technology accessible, it’s about using technology to make life more accessible, whether you are going for a walk with a friend, whether you are going to see a movie with a friend, whether it’s sitting in a meeting and brainstorming a storyboard for video. All of these are experiences, and the goal is, how do you make those experiences accessible experiences? That kind of gets you thinking about accessibility in a very different way, where your interaction is with the person that you are sitting in front of. The technology is just there in support of that interaction.

Host: Right. As I’m researching the interview, I’m find myself thinking of the various solutions – maybe the “technical guide dog” mentality – like let’s replace all these things, with technology, that people have traditionally used for independence. And the technology as it enters that ecosystem, some people might think the aim is to replace those things, but I don’t think that’s the point of what’s going on here. Am I right?

Amos Miller: That’s right. There is a tendency, when you come at a problem with a technology solution, to look at what you are currently doing and replace that with something that’s automatic. Right? Oh, you are using a guide dog? How can I replace that guide dog and give you a robot? So, I work on technology that enhances mobility independence through audio and sound, which we’ll talk about in a minute.

Host: Right.

Amos Miller: But often people ask me, how would that work for people who can’t hear? And the natural inclination to them is to say, oh, okay, well you’ll have to deliver the information in a different way. The thing is that people get a sense of their space and their surroundings using the senses that they have. To me, the question is not, how do we shortcut that? It’s how do they sense their space today? They do. They don’t sit there feeling completely disconnected. And if you are going to intervene in that, you better be consistent with how they’re experiencing it today.

Host: Yeah, and that leads me right into the next question because you and I talked earlier about the fundamental role that design plays in the success of human computer interaction. And I’m really eager to have you weigh in on the topic. Let’s frame this broadly in terms of assumptions. And that’s kind of what you were just referring to.

Amos Miller: Yeah.

Host: You know, if I’m looking at you and I think, well my solution to how you interact with the world with technology would be Braille, that’s an assumption. So, I’m just going to give you free reign here. Tell us what you want us to know about this from your perspective.

Amos Miller: We all make assumptions about other people’s other people’s experience of life. You are referring to Bill Buxton who was on your podcast a few weeks ago.

Host: Right.

Amos Miller: And he’s actually been a very close friend and mentor throughout the work that we are doing on Soundscape, which we’ll talk about in a minute. And he’s really brought to our attention that what we’ve done, of going out there and experiencing the real situation that people are experiencing, is about empathy and it’s about trying to understand and probe ideas that challenge your assumptions about what effect they will have. But, really seeing, observing and understanding their experience in that particular situation, and then maybe applying, from your learning, some form of intervention into that experience and observing how that affects that experience. It doesn’t have to be a complete piece of software or technology, it’s just an intervention. It can be completely low-fi. That helps you to start expanding your understanding. And you don’t have to do it with 100 people. Do it with two… three people. You will discover a whole new world you didn’t know about. I’m sorry, but you don’t need 200 data points to support that experience, you’ve just seen it. And you can build on that. So, can you enhance that, in any way, to give them an even richer awareness of their surrounding? And those are the kind of questions that taking design through that very experiential lens has led us to the work that we are actually doing our work on Soundscape, which is the technology that we’ve been developing over the last few years, to really see how far we can take this notion of how people perceive the world and how you can enhance that so their perception is enhanced.

(music plays)

Host: Well, let’s talk about 3D sound and an exciting launch earlier this year in the form of Microsoft’s Soundscape. This is such a cool technology with so many angles to talk about. First, just give our listeners an overview of Soundscape. What is it, who is it for, how does it work, how do people experience it?

Amos Miller: Soundscape is a technology that we developed in collaboration with Guide Dogs, certainly in the early stages, and still do. And the idea is very much using audio that’s played in 3D. Using a stereo headset, you can hear the landmarks that are around you and you can, thereby, really enrich your awareness of your surroundings, of what’s where in a very natural, easy way. And that really helps you feel more independent, more confident, to explore the world beyond what you know.

Host: How do you hear a landmark?

Amos Miller: How do you hear a landmark? So, for example, if you are standing and Starbucks is in front of you and to the right, we will say the word Starbucks, but we won’t say it’s in front of you and to the right, it will sound like it is over there where Starbucks is.

Host: Oh.

Amos Miller: OK? And that’s generated using, the technical term is head rotation transfer of synthetic binaural audio. So, it’s work that actually was developed in Microsoft Research, over a number of years, by Ivan Tashev and his team. And effectively, you can generate sound to make it sound like it’s not in between your ears. You can hear it as though it’s out in the space around you. It’s really quite amazing. And we also use non-audio cues. For example, one of the ideas that we built into Soundscape is this notion of a virtual audio beacon. Not to be confused with Bluetooth beacons! It’s completely virtual. But let’s suppose that you are standing on a street corner and you are heading to a restaurant that’s a block and a half away. What you can do with Soundscape is play some audio beacon that will sound like it’s coming from that restaurant, so no matter which way you’re standing, which way you’re heading, you can always hear that “click-click” sound so you know exactly where that restaurant is. You can see it with your ears.

Host: How do you do that? How do you place a beacon someplace, technically?

Amos Miller: Binaural audio is when you have a slightly different sound in each ear which tricks the brain into having a sense of, that sound is three dimensional. It’s exactly the same way that 3D images work. Audio works almost the same. If Ivan was here, he’ll say it’s not exactly the same, but by generating a slightly different soundwave in each ear, you’re able to make sound, sound like it’s coming from a specific direction. But by playing it in each ear slightly differently, it will actually sound like it’s coming from in front of you and to the right. OK? Now how do we know where to place that beacon?

Host: Right.

Amos Miller: At present, we – it’s largely designed to be used outdoors – so, we use GPS, so we know where you are standing. We know where that restaurant is, so we have two coordinates to work with. We also estimate which way you are facing. So, if you were facing the restaurant, we would want to play that beacon right in front of you. If you were standing at 90 degrees to the restaurant, we’d want to make that beacon sound like it’s coming not only from your right ear, but 100 meters away to your right.

Host: Unbelievable…

Amos Miller: Yeah? And so, taking all of those sensory inputs and taking the information from the map, the GPS location, the direction, we reproduce the sound image in your stereo headset so that you can hear the direction of the sound and where the thing is. And the most amazing thing is, this is all done in real time, completely dynamic. So, as you walk down the street, that restaurant may sound in front of you at 45 degrees to your right, and as you progress, you’ll hear it getting closer and closer and further and further to your right and further and further to your right. And if you overshoot it, it’ll start to sound behind you a little bit, yeah? Now, why is this so important? Because I’m not going to the restaurant on my own. I’m there with my kid or with my wife, or with my friend. And, if I were to hold a phone with the GPS instructions and all of that, I can’t hold a conversation with that person at the same time because I’m so engaged with the technology. And we talked earlier about, how do you get technology to be in the background? That beacon sound is totally in the background. You don’t have to think about it, you don’t have to attend to it mentally, it’s just there. So, you know where the restaurant is, and you continue to have a conversation with the person you are with, or you can daydream, or you can read your emails, listen to a podcast, and all of that happens at the same time. Because it’s played in 3D space, because it’s non-intrusive. You minimize the use of language. And all of these subtle aspects are absolutely crucial for this kind of technology to be relevant to this situation. You’re not sitting in front of the computer and it’s the only thing you are doing. You are outdoors. There’s a ton of things happening all the time that you have to deal with. You can’t expect the person to disassociate themselves from all of that. You know, Soundscape is one way of addressing this very, very interesting and important question. Throughout history, technology has always changed the way that we do things. But I think that we’re starting to see that, as technology developers, we really have to be much more mindful about just from the subtleties of how we design something on, what is the relationship between the technology and the person in that situation? How can a technology do exactly the same as it has done, but do so in a way that makes the person feel empowered and develop a new skill. Great runners learn to feel their heartbeat. But if they have a heart monitor, they’ll stop feeling that heartbeat because the device on their wrist tells them what it is. Well, that’s only because that’s how it was designed. If the heart monitor, instead of telling you, you are at, I don’t know, 150, it’d say, what do you think you’re at? And you’d say, oh, I’m at 140, and it’ll say, oh, you are actually at 150. You will have learned something new from that. It’s exactly the same function, but you have developed yourself as a result of that interaction. And I think that that’s the kind of opportunity that we need to start looking for.

Host: I want to circle back to this 3D audio and the technology behind it, and something that you referred to as “the cocktail party effect.” Can you explain that a little bit and how Microsoft Research is sort of leading the way here?

Amos Miller: The cocktail party effect is an effect, in the world of psycho-acoustics, that is very simple. If you imagine you’re sitting around a table in a cocktail party having a very exciting conversation with somebody, and there are lots of other similar conversations happening around you at the same time, because all of those conversations are happening in 3D space, you are actually able to hear all of those conversations even though you are attending just to yours. You are listening and you can understand and engage in your conversation, but if your name came up in any of those other conversations, you’ll immediately turn your head and say, hey guys, what are you talking about there? And that’s an incredible capability of the brain to manage a very rich set of inputs in the auditory space that is very much under-utilized today in the technology space. We always feel that if we need to convert something into audio, it’s got to be sequenced, because we can only hear one thing at a time. When it’s in 3D, that’s no longer the case. And that’s a huge opportunity. We play a lot of that in VR and augmented reality and we spend a lot of time on the visual aspect of virtual reality and really pushing the envelope on how far we can take the use of immersive experiences in objects in all directions. But the same is available with audio. Even more with audio because your eyes are no longer engaged. Audio is in 360. If we block our ears for a moment, all of a sudden, our awareness level drops. But we are so unaware of the power of audio because vision just takes over everything. And I think the work that we have done, both in the acoustic work on 3D audio, and the application, especially in the disability space where we placed the constraints on the team – there is no vision, now let’s figure it out – and that leads to new frontiers of discovery and innovation in this space that I think could be applicable and would be applicable in many other spaces. And that, you know, that heads-up experience when you are out and about in the streets, not focused on the screen, but engaged in your surroundings. And that’s a perfect situation where audio has huge advantages that we can look at.

(music plays)

Host: I ask each of my guests some version of the question, what keeps you up at night? Because I’m interested in how researchers are addressing unintended consequences of the work they’re doing. Is there anything that concerns you, Amos? Anything that keeps you up at night?

Amos Miller: I think things keeps me up at night because they are so interesting and yet unsolved. You know, we talked a bit about, how do you really express and portray the physical space around you in ways that utilize your other senses and really maximize the ability of the brain to make sense of places without vision? And I really think that, with Soundscape, we’ve only started to scratch the surface of that question. Over half of the brain is devoted to perception. And I think that, when we find ways to really engage, even further engage that incredible human capability, we will discover a whole new frontier of machine and human interaction in ways that we don’t understand today.

Host: You said you arrived at Microsoft Research from “left field.” What’s your story on how you came to be working on research in accessibility at Microsoft Research?

Amos Miller: I started life as a developer, and I did a business degree and joined the Strategic Advisory Services in Microsoft Consulting in the UK. And I think it was a very special moment in Microsoft, over the last few years, when we really started to understand the meaning of impacting every person on the planet with technology and seeing that as our mission. And that led to a series of conversations that opened an opportunity for us to actually get behind that statement and we basically joined Microsoft Research through that mission, through the work that we’re doing in Soundscape. And because we already had very strong relationships, thanks to some wonderful people in the company, and strong relationships here in Microsoft Research and in other parts of the company.

Host: Before we close, Bill Buxton asked me to ask you about the kayak regatta that you organized.

Amos Miller: Uh huh. Oh, we didn’t talk about that.

Host: Just tell that story quickly because I do have one question I want to wrap up with before we go.

Amos Miller: Okay. Well we talked about Soundscape as a technology that really enables you to hear signals in 3D around you. And that was largely designed to be used in the street, right? And then we thought, what would happen if we placed that audio beacon on a lake? So, we got a bunch of people during the summer hackathon and said, okay, well let’s try it out. So, we organized an event on Lake Sammamish. We hacked Soundscape to work on the lake and placed some virtual audio beacons around the lake and invited a group of people who are blind to come and kayak with us and see how they enjoy it. And they absolutely loved it. And I think that was a real eye-opener for us. You have to understand the difference here, you know? Could they kayak before? Sure, no problem, because a sighted person would be with them and tell them, okay, now you go straight, now you row left… But I’m sorry, that’s a very boring experience. You are not in control, you are not independent, you are just doing the work. And by being able to hear where those beacons are, you are truly in the driving seat. And that is a sense of independence that we’ve not really seen to that extent before we did this event.

Host: I like how you called it an eye-opening event!

Amos Miller: It was!

Host: There are so many metaphors about vision that we just sort of take for granted, right?

Amos Miller: Maybe it’s because I have prior sight, maybe not, but I, first of all, I use those metaphors all the time, and I also feel, you know, I could close my eyes and feel that my eyes are closed and open them and feel that they’re open. And I definitely take everything in in a very different way, even though the eyes don’t actually do the scientific aspect of what they’re designed to do.

Host: As we close, I always ask my guests to offer some parting advice to our listeners whether that be in the form of inspiration for future research or challenges that remain to be solved or personal advice on next steps along the career path, whether you have a guide dog with you or Soundscape… What would you say to your 25-year old self if you were just getting started in this arena?

Amos Miller: I honestly would say, get real life experience. Especially in the areas that you are passionate about. Be passionate about them with even more energy and see the work that you do in the context of what you are passionate about. Because you can only really apply your personal experiences to what you do. It’s so great here, in Microsoft Research, to see the interns coming here in the summer. And the creativity and passion, and new perspectives that they bring to our work here. And there’s a little bit of a side of me that worried they’ll jump into the job before they went out and explored the world. And I think it’s important that they find a way to do something that gives them that meaningful context to the work that they’ll be doing here.

(music plays)

Host: Amos Miller, thank you for joining us today. It’s been – can I say it? – an eye-opening experience!

Amos Miller: Sure. My pleasure. Thanks so much for having me.

To learn more about Amos Miller and the latest innovations in audio, sound and accessibility technology, visit Microsoft.com/research

Alongside the Texas campus, the company plans new or expanded sites in Seattle, Pittsburgh, Colorado and more over the next three years.

Workers at Apple’s Reno, Nevada data center

Apple is spending $1 billion to build a new campus for engineering, research and customer support in Austin and is doing so as part of U.S.-wide expansion plans. The new 133-acre campus will initially house 5,000 new staff and together with Austin’s existing 6,200 Apple employees is expected to make the company the largest private employer in the city.

“Talent, creativity and tomorrow’s breakthrough ideas aren’t limited by region or zip code,” said Apple CEO Tim Cook. “Apple is proud to bring new investment to cities across the United States and significantly deep our quarter-century partnership with the city and people of Austin. And with this new expansion, we’re redoubling our commitment to cultivating the high-tech sector and workforce nationwide.”

The new Austin campus, situated a mile from the current one, will continue Apple’s policy of being powered by 100 percent renewable energy. In addition to a building ultimately able to house 15,000 people, the site will also feature 50 acres of preserved open space.

Alongside the Austin campus, Apple announced that over the next three years it is planning to enlarge workforces in Seattle, San Diego and Culver City to over 1,000 employees each. It’s also intending to expand existing facilities in Boulder, Colo., as well as Boston, New York, Pittsburgh and Portland, Ore.

Apple’s projected US employment by 2022 (Credit: Apple)

Apple currently employs 90,000 people across all 50 states, including 6,000 who have been added this year. This year’s new hires are part of a five-year plan to add 20,000 jobs in America and contribute $350 billion to the economy.

These figures are to do with direct spending by Apple but the company claims that its work is also enabling a much wider indirect impact on American employment. In all, Apple says it is responsible for the creation and support of two million jobs in the U.S. including employees at some 9,000 supply firms and 1.5 million jobs related to the App Store.

“Apple is among the world’s most innovative companies and an avid creator of jobs in Texas and across the country,” said Texas Governor Greg Abbot. “Their decision to expand operations in our state is a testament to the high-quality workforce and unmatched economic environment that Texas offers.”

Apple also announced plans to invest $10 billion in data centers across the U.S. in a program due to take five years. Presently the existing data centers in North Carolina, Arizona and Nevada are being expanded while a new one is being planned for Waukee, Iowa.

Keep up with AppleInsider by downloading the AppleInsider app for iOS, and follow us on YouTube, Twitter @appleinsider and Facebook for live, late-breaking coverage. You can also check out our official Instagram account for exclusive photos.

Feral Interactive have finally revealed the release date for Rome: Total War’s Android port. Originally launching on iPads just over two years ago, Creative Assembly’s iconic strategy game was finally made universal earlier this year.

Now, our Android Brothers and Sisters can also get in on the action come next Wednesday, December 19th.

That’s the day after Tropico for iPad releases, incidentally. We’re not going to be doing a dedicated review of Rome: Total War, but we’ll update our existing one accordingly and probably push it to the front page as a reminder.

If you’re wondering whether or not your device can actually run RTW, here’s Feral’s official list of supported devices:

• Google Pixel
• Google Pixel XL
• Google Pixel 2
• Google Pixel 2 XL
• Google Pixel 3
• Google Pixel 3 XL
• HTC U12+
• Huawei Nexus 6P
• Huawei Honor 8
• Huawei Mate 10
• Huawei Mate 20
• LG V30+
• Motorola Moto Z2 Force
• Nokia 8
• OnePlus 3T
• OnePlus 5T
• OnePlus 6T
• Razer Phone
• Samsung Galaxy S7
• Samsung Galaxy Note8
• Samsung Galaxy S8
• Samsung Galaxy Note9
• Samsung Galaxy S9
• Samsung Galaxy Tab S4
• Sony Xperia Z5 Dual
• Sony Xperia XZ1
• Sony Xperia XZ2 Compact
• Xiaomi Mi 6

In addition, they had this to add:

If your device is updated to Android 7 or later, has 3GB of RAM, and uses one of the following chipsets:

• Qualcomm Snapdragon 810
• HiSilicon Kirin 950
• Samsung Exynos 8890
• MediaTek Helio P20

… It may be capable of running the game but will not meet the standard of performance, graphics or stability required for official support.

Are any of our android readers planning on picking this up next week? Let us know!