Apple may be preparing to push its stylus technology beyond iPads and into physical spaces like desks and walls. A newly granted U.S. patent (No. US12353649) reveals a future version of the Apple Pencil equipped with a trackball-style tip and optical sensors, allowing users to write or draw on non-touch-sensitive surfaces.
According to the patent, the next-gen stylus will use optical flow and laser speckle flow sensors to track movement. These sensors detect motion, orientation, and spatial displacement by analyzing how light reflects off various surfaces. The result is a stylus that doesn’t need a touchscreen. You could sketch on a tabletop or even an ordinary wall, and the Pencil would still register your input.
A Stylus That Sees Motion, Not Touch
Apple’s approach replaces capacitive touch with optical sensing. The patent details two primary sensing methods: optical flow and laser speckle flow. Optical flow relies on changes in image brightness across frames to estimate motion. The stylus would have a built-in LED to project light onto a surface and a sensor to capture reflected light, even under ambient conditions.
Laser speckle sensors work differently. They use a laser, such as a VCSEL (Vertical-Cavity Surface-Emitting Laser), to project coherent light, producing speckle patterns. These patterns shift with movement, and an internal sensor reads those changes to track the stylus’s motion and angle. Both sensor types could be used with or without lenses, depending on design constraints.
Expanding the Pencil’s Capabilities
Beyond detecting motion, these sensors could gather data on tilt, rotation, and pressure. Apple outlines how the Pencil might also integrate inertial sensors, magnetic field measurements, and even computer vision systems. Together, these would allow the stylus to create detailed input, from handwritten notes to 3D models, without a traditional screen.
The tip itself, according to the patent diagrams, may be made of optically transparent material, helping the embedded sensors function more precisely. That makes it less of a stylus and more of a portable input device capable of generating content across physical environments.
This innovation could blur the line between digital and physical workflows. Imagine using a regular desk as your canvas, with input data syncing in real time to your Mac or iPad.
The details come from a U.S. Patent and Trademark Office document officially granted to Apple. The patent is titled Input Device with Optical Sensor for Generating Content Without Touch-Sensitive Surface and includes detailed illustrations showing the envisioned Apple Pencil design.
The information was first reported by Patently Apple, which tracks Apple’s filings and notes that the optical sensors could make the stylus usable on nearly any surface, including non-digital ones.
Whether this concept will make it into a shipping product remains unknown, but the patent clearly signals Apple’s interest in redefining how users interact with their devices beyond the screen.
