{"id":130599,"date":"2022-12-16T17:00:00","date_gmt":"2022-12-16T17:00:00","guid":{"rendered":"https:\/\/developer.apple.com\/news\/?id=23ksaoks"},"modified":"2022-12-16T17:00:00","modified_gmt":"2022-12-16T17:00:00","slug":"spotlight-on-apple-pencil-hover","status":"publish","type":"post","link":"https:\/\/sickgaming.net\/blog\/2022\/12\/16\/spotlight-on-apple-pencil-hover\/","title":{"rendered":"Spotlight on: Apple Pencil hover"},"content":{"rendered":"
<\/div>\n

When it comes to designing creative interactions, the Procreate<\/em> team knows how to get the job done. <\/p>\n

The illustration app kicked off in 2011 with touch-based controls \u2014 “just five fingers of input,” says CEO James Cuda \u2014 and won a rare pair of Apple Design Awards over the next decade for their innovative approaches to digital drawing, sketching, and painting.<\/p>\n

While finger painting remains a core part of the app, Apple Pencil has become a significant part of Procreate’s<\/em> story. Apple Pencil gives artists customization and control of their line width and opacity, stroke style, and quick-access controls. And with the introduction of Apple Pencil hover, the Procreate<\/em> team is investing even more heavily in the stylus. \u201cIt\u2019s truly made a profound impact in our design phase,\u201d says Cuda. <\/p>\n

\"Hover<\/p>\n
\n

Hover over your canvas, and X marks the spot.<\/p>\n<\/div>\n<\/div>\n

As with pretty much any other digital or analog drawing tool, Apple Pencil operates on the X and Y axes of a canvas, requiring direct input from the stylus nib to draw a line or select a tool. The second-generation Apple Pencil also adds support for direct input along the side of the stylus \u2014 which gives developers an option to add shortcuts within their apps. Now, Apple Pencil hover is bringing tool and previewing shortcuts into an entirely new dimension. (The Z-axis, specifically.)<\/p>\n

\u201c[It’s] a whole new layer of interaction,” says Cuda. \u201cEverything springs to life as your Apple Pencil comes near.\u201d<\/p>\n

\"With<\/p>\n
\n

With ColorDrop, you can precisely preview your colors before tapping your canvas.<\/p>\n<\/div>\n<\/div>\n

Apple Pencil hover activates when the nib is up to 12 mm above the display on iPad Pro with the M2 chip. Developers can customize what the feature does within their app, including offering tool variations, menu selection, and even previewing lines themselves \u2014 so artists can draw, sketch, and color with even greater control. “The ability to not make a commitment or damage the artwork is transformative,” Cuda says. <\/p>\n

And the feature’s functionality is only half the fun. \u201cIt makes everything feel so playful,\u201d says Claire d\u2019Este, Procreate\u2019s<\/em> chief product officer. \u201cI find myself rolling up and down menus just to see it responding. There\u2019s something so nice about everything lighting up as I\u2019m thinking about what to do next.\u201d<\/p>\n

\n

The ability to not make a commitment or damage the artwork is transformative. <\/p>\n

James Cuda, Procreate CEO<\/cite><\/p><\/blockquote>\n

The Procreate<\/em> team has hidden these sorts of playful moments throughout the entire app. In the gallery view, hovering over thumbnails expands the image or previews animations. Tools like the color picker or menu buttons react as you move across them. And then, of course, there’s the canvas.<\/p>\n

\"With<\/p>\n
\n

With your iPad on a desk or table, hover works in conjunction with Multi-Touch capabilities.<\/p>\n<\/div>\n<\/div>\n

\u2018Your mind starts racing\u2019<\/h3>\n

“There are two phases with something like this,\u201d says Procreate<\/em> chief technology officer Lloyd Bottomley. \u201cThe first is the initial, \u2018Wow, this is cool.\u2019 But then your mind starts racing because you\u2019re trying to think of all the things you could do with it.\u201d<\/p>\n

With so many possibilities open to them, the Procreate<\/em> team had to approach each idea with care and scrutiny to ensure they were aiding and improving design and creation workflows rather than hindering them. \u201cWe\u2019re obsessed with keeping people focused on that point of interaction,\u201d Bottomley says.<\/p>\n

One area that proved surprisingly challenging: the brush cursor. \u201cHonestly, we thought we’d have just one design through the entire brush library,” says Cuda. \u201cThe problem was there’s not one singular representation of that hover mark, because our brushes can do anything \u2014 you can have brushes inside brushes; you can have brushes that move across each other. To represent all that in a hover state was really challenging.\u201d<\/p>\n

\n

We’re obsessed with keeping people focused on that point of interaction.<\/p>\n

Lloyd Bottomley, Procreate chief technology officer<\/cite><\/p><\/blockquote>\n

After a few weeks of back and forth, the team landed on a solution: customizable cursors that change with different brushes. \u201cWe needed to move away from that idea of \u2018one thing to rule them all\u2019 to a series of settings that could get us there,\u201d says Cuda. \u201cNow, all the brush-makers out there can customize what their hover state will look like.\u201d<\/p>\n

A second target was the app’s ColorDrop feature, which instantly fills a section of your artwork when you drag and drop a color on it, paint-by-numbers style. Using Apple Pencil hover, people can preview of what the artwork will look like before committing to a color, speeding up the process dramatically. “If you\u2019re doing inking \u2014 comic book art, for instance \u2014 it\u2019s huge,\u201d says d\u2019Este.<\/p>\n

\n

If you\u2019re doing inking \u2014 comic book art, for instance \u2014 it\u2019s huge.<\/p>\n

Claire d\u2019Este, Procreate chief product officer<\/cite><\/p><\/blockquote>\n

It\u2019s also a timely example of how a small change can make a massive improvement in an artistic workflow. \u201cThose kinds of interactions take a surprising amount of time,\u201d says Bottomley. \u201cEven moving your arm across the screen takes time. Now you barely have to move.\u201d<\/p>\n

\"Hover<\/p>\n
\n

Hover over your color, then drop it on your canvas.<\/p>\n<\/div>\n<\/div>\n

The saga of the sliders<\/h3>\n

While the Procreate<\/em> team delighted in improving interactions for brush cursors and ColorDrop, they had a much bigger problem they hoped Apple Pencil hover would solve: a little piece of UI that had been bothering the team since the app’s very first days.<\/p>\n

\u201cOur goal is to put absolute focus on the artist\u2019s content,\u201d says Cuda. Procreate’s<\/em> interface has long championed minimalistic tool windows and intuitive gestures like tap-to-undo to keep the canvas clear for the work. But they hit a proverbial artistic wall when trying to build UI for repetitive interactions like adjusting brush size or opacity. <\/p>\n

Iterations came and went; the pair tried variations on pinching and zooming and tapping and holding, but nothing felt properly connected to the rest of the Procreate<\/em> experience. \u201cWe ditched it all,\u201d says Bottomley, \u201cand went with that very conventional set of sliders you see on the left hand side of the screen.\u201d<\/p>\n

The sliders were functional. They were intuitive enough. But whenever the team thought about features they really liked about the app, the sliders were conspicuously absent \u2014 until Apple Pencil hover. \u201cOnce hover was announced, we realized we could work with Multi-Touch like we couldn\u2019t before,\u201d says Cuda. <\/p>\n

With Apple Pencil hover, could they at last kill the sidebar? \u201cWe developed a gesture we thought would be just so ubiquitous and approachable,\u201d says Cuda. \u201cThe idea was you would use two fingers to pinch and zoom while you\u2019ve got hover up, so you could clearly see where your brush is and how it changes in size before you mark the screen. We were convinced it would be the way of the future.\u201d<\/p>\n

And then they began testing. <\/p>\n

\"Place<\/p>\n
\n

Place iPad on a surface to use hover with MultiTouch gestures\u2026<\/p>\n<\/div>\n<\/div>\n

“We realized we were wrong as soon as we put it in practice,” says Cuda. The gesture worked brilliantly when iPad was sitting on a table or against a stand \u2014 a common-enough use case \u2014 but anyone using the tablet on a couch had a different experience. “You\u2019re clutching the device with two hands,” he says. “And as soon as you pinch and hover, the device is no longer, uh, in your clutches.\u201d<\/p>\n

\n

We had to put our egos aside and go, \u2018OK, maybe we were wrong.\u2019<\/p>\n

James Cuda, Procreate CEO<\/cite><\/p><\/blockquote>\n

The challenge was enough to send the team back to the drawing board. \u201cThe gesture is useful; it\u2019s just not the singular interface methodology were hoping to create,\u201d says Cuda. \u201cWe had to put our egos aside and go, \u2018OK, maybe we were wrong.\u2019 And we had to think about what was best for the customer.\u201d<\/p>\n

For customers holding the device, it meant the return of the sliders. \u201cWe\u2019re keeping them for mobile drawing,\u201d Cuda says. \u201cOn a desk or stand, when you\u2019ve got both hands free, the sidebar goes away and we get exactly what we wanted. So it was a wild ride for a couple of weeks making those calls.\u201d<\/p>\n

\"\u2026<\/p>\n
\n

\u2026 or use the sliders on the edge of the screen.<\/p>\n<\/div>\n<\/div>\n

\u2018It\u2019s hard to go back\u2019<\/h3>\n

People using iPad Pro with the M2 chip and the second-generation Apple Pencil, can explore Procreate’s<\/em> Apple Pencil hover features now. But Cuda and the team are focused strongly on the future, regarding hover as an important new tool in the shed \u2014 enough so that Cuda says it already \u201csolves a bunch of things\u201d in regards to upcoming projects.<\/p>\n

\u201cIt doesn\u2019t feel like we\u2019re tapping into a technology but creating a natural extension of what you could already do,\u201d d\u2019Este says. \u201cOnce you\u2019ve experienced this, it\u2019s hard to go back.\u201d<\/p>\n

Read Behind the Design with Procreate<\/a><\/p>\n

Download Procreate from the App Store<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

When it comes to designing creative interactions, the Procreate team knows how to get the job done. The illustration app kicked off in 2011 with touch-based controls \u2014 “just five fingers of input,” says CEO James Cuda \u2014 and won a rare pair of Apple Design Awards over the next decade for their innovative approaches […]<\/p>\n","protected":false},"author":2,"featured_media":130600,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[55],"tags":[],"class_list":["post-130599","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-apple-developer-news"],"_links":{"self":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/130599","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/comments?post=130599"}],"version-history":[{"count":0,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/posts\/130599\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media\/130600"}],"wp:attachment":[{"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/media?parent=130599"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/categories?post=130599"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sickgaming.net\/blog\/wp-json\/wp\/v2\/tags?post=130599"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}