The Microsoft Copilot can now view the network and perform action for you

For him 50th birthdayMicrosoft teaches its AI-feeding Copilot Chatbot several new tricks.

Copilot can now take action on “most websites”, says Microsoft, allowing him to book tickets, reserve restaurants and more. The bot has acquired the ability to remember specific things about you, Like Chatgpt of OpenaiLike your favorite food and movies. And it can now analyze the video in real time from your phone by answering questions in the context of what it “sees”.

Upgrades come as Microsoft is According to messages Reflecting on the reconstruction of Copilot, which is historically powered by AI models from Openai, with more than its own internal technology. Copilot often lags behind rivals Chatgpt and Google’s Twinswhich in recent months have only increased the pace of functions.

As of Friday Copilot can perform tasks on the web in order of how “agent” instruments like Openai’s operator Do it. Microsoft says he has partnered with 1-800-Flowers.com, Booking.com, Expedia, Kayak, Opentable, Priceline, Tripadvisor, Skyscanner, Via and VRBO for day compatibility. Enter prompted “Submit a bouquet to my partner”-and Copilot will try to check this particular item with a task on your list.

Taking a page from the search engine book for bewildermentCopilot can also track online deals for you. Tell Bota to seek a decline in prices and sales of an item and this will notify you when they happen – and will present you a purchase link.

Exactly how Copilot performs different obligations is not clear. Microsoft has given some details about how the ability works and, unlike some of its competitors, does not post data showing areas where Copilot can fight or need a person to intervene.

It is likely that websites may block Copilot, just as they are able to block Openai’s operator. A company can do it if so Worried, for example, that fewer people visit its application directly It can harm advertising revenue.

Fortunately, the other new functions of Copilot are less vague and potentially filled with dispute.

Improved copywriting can generate “podcasts” similar to audio reviews in Notebooklm on GoogleS Given a website, study or some other source, Copilot will create a dialogue back and forth between two synthetic hosts. As with the audio review, you can interrupt the hosts at any time to ask a question and they will recognize it and answer.

On Android and iOS Copilot can now see what is visible from the camera of your phone or in your photo gallery and answer questions about it (eg, “What is this strange flower?”). And in Windows, the updated Copilot application can view what’s on the screen of your search -box, change settings, organize files and more. It will first unfold for the Windows Insider program members early next week.

This reporter would hope that there are reasonable precautions to prevent Copilot reading from reading private files or making errors in violating the desktop. But the information was difficult to come before the press time.

Elsewhere, Copilot has a new feature for consolidating projects that draws heavy inspiration from Chatgpt Canvas and Claude artifacts of anthropic a tool. Pages puts notes and studies in a canvas that Copilot can help organize and become a document.

Additionally, on the pages, the new deep Copilot research feature finds, analyzes and combines information from online sources, documents and images to respond to more complicated requests, many like Chatgpt Deep Research and The deep studies of twinsS

Finally, as mentioned earlier, Copilot can now remember more about you. Microsoft says the bot will note your preferences while interacting with it, offering “personalized solutions”, “proactive suggestions” and reminders.

If a chatbot perspective remembers intimate details about your past conversations bothers you, there is a way to delete individual “memories” or to give up completely, Microsoft notes.

“Copilot (gives) controls you through the user dashboard and the ability to choose which types of information remembers you or to give up completely,” Microsoft wrote in a blog post provided to TechCrunch. “You remain controlled.”