Exclusive: Honor debuts a new AI agent that can read and understand your screen

Rate this post

He chose a restaurant, but then could not finish the process, as the place he chose required a credit card to confirm the reservation, at that moment the user had to take over. You can be flexible in your request – in another example, asking him to book a “highly appreciated” restaurant means that he will look at reviews with high results, although the agent is not doing more research than it. This is not a crossing of optical examinations with data from other parts of the network, especially since all these data are processed on a device and not sent to the cloud.

This type of agent artificial intelligence is Current fashion word in the technological sphereS My colleague will knight AI assistant recently tested This can look at the network and perform tasks online. Google at the end of last year revealed its Twin model 2 AI Trained to take action on your behalf. It also renews the idea of a generative user interface for smartphones – at MWC 2024, we have seen several companies that work in ways to Interact with applications without using applications at allInstead, lean on AI assistants to generate a user interface while issuing a command.

The approach of honor feels somewhat as the rabbit – of the infamously known Rabbit r1– made with Learn modeWhere you train his assistant to manually accomplish a task. There is no need to access the application programming interface (API), which is the traditional way to communicate with each other. The agent remembers the process, allowing you to then issue the command and complete the task.

But Honor says that his independent AI performance model is not trained to follow strict steps-he is capable of multimodal recognition of the context of the screen to perform tasks autonomously. Instead of having to train the assistant to learn every part of the Opentable app, he is able to understand the semantic elements of the user interface and will follow with a multi -stage process to execute your request. Honor stressed that this process is more rated: “Unlike competitors like Apple, Samsung and Google, who rely on external APIs -with higher operating costs -the Honor agent independently manages a wide range of tasks.”