Sony AI Camera Anticipates Gamer Button Presses

A newly filed Sony patent details the company's strategy to minimize latency in future gaming hardware by leveraging an AI model supported by additional sensors.

Sony launched its first official upscaling technology, PlayStation Spectral Super Resolution (PSSR), with the PlayStation 5 Pro. Although PSSR can upscale lower resolutions to 4K, newer graphical techniques like frame generation often add latency as a side effect. This means that while your games may display more frames, they could feel less responsive as a result.

GPU manufacturers AMD and Nvidia have tackled this with Radeon Anti-Lag and Nvidia Reflex, respectively. Now, it seems Sony is developing its own proprietary solution.

First spotted by Tech4gamers, the Sony patent WO2025010132, titled “TIMED INPUT/ACTION RELEASE,” aims to optimize the “timed release of user commands” by predicting which button players are likely to press next.

Sony explains the motivation behind the patent: “There can be latency between the user’s input action and the system’s subsequent processing and execution of that command. This leads to delayed command execution and unintended gameplay outcomes.”

The proposed solution uses multiple components working together: a machine-learning AI model designed to anticipate upcoming inputs, along with an external sensor—such as a camera aimed at the controller—to detect which button the player is preparing to press. The patent states: “In one example, the method includes using camera input as a data source for a machine-learning model. The camera input can indicate the first user command.”

Another possibility involves using the controller's own buttons as sensors. Given Sony’s history with analog button technology, the company may incorporate this approach into a next-generation controller.

While the technology outlined in the patent may not appear in the PlayStation 6 exactly as described—patent filings rarely translate directly to final products—this signals Sony's interest in applying similar innovations to reduce latency. This is especially relevant given the adoption of frame-generating technologies like FSR 3 and DLSS 3, which can introduce additional frame latency on any system they run on.

Such advancements would especially benefit fast-paced genres like twitch shooters, which rely on both high framerates and minimal latency. Whether this particular patent will materialize in future hardware, however, remains to be seen.