From Prompt to Pointer Engineering: DeepMind tries to reinvent the mouse cursor for the AI era

DeepMind outlined a pointer-based AI interaction concept that uses the mouse cursor to gather visual context for Gemini.

Users could issue short commands like fix, move, or edit based on what is under the pointer, reducing the need for long prompts.

The idea is being integrated into Gemini in Chrome and will debut on the upcoming Googlebook as Magic Pointer.

The goal is to make everyday AI tasks faster and more natural, while still leaving detailed prompting for complex work.