Users Will Be Able To Post Images And Ask Questions About Them Through Microsoft's Bing AI Chatbot

To maintain its renewed momentum in the market, Microsoft Corp. is getting rid of the waitlist to test out its new OpenAI-based Bing search and chat and introduce capabilities like the ability to request and submit photographs. Users can query Bing, “How do I make this?” after searching for an image of something like a crocheted teddy bear.

The AI program then proposes websites with “how to crochet” instructions and different types of craft projects to look at. According to an interview with Microsoft vice president Yusuf Mehdi, the visual search feature will be accessible in the upcoming weeks to months. It utilizes the GPT-4 framework from OpenAI, which makes it possible for so-called multimodal elements to combine text and visuals.

OpenAI introduced that function in March, but thus yet, it hasn’t provided many examples. The ability to access third-party services like OpenTable and Wolfram Alpha through Bing chat and receive responses that include videos and charts is one of the new Bing capabilities available sooner, according to Mehdi. A user can type in, for example, “Find me a dinner reservation for two in New York City tonight” and receive a link to the OpenTable reservation service, as Bing employees demonstrated during a Manhattan demo.

Here is a tweet related to this topic:

Microsoft has expanded public access to its new AI-powered version of its Bing search engine, which combines language models like Open AI’s GPT-4 with a search index for results that are current, cited, and conversational – to anyone who wants to use it.https://t.co/BCpUMg8PM9 pic.twitter.com/SsndE1Asxb

— Channels Television (@channelstv) May 4, 2023

When Microsoft completely redesigned Bing in February, adding OpenAI’s ChatGPT and offering the possibility of new competition in a market long controlled by Alphabet Inc.’s Google, it upended the search market. Mehdi claims that in the last 90 days, the new platform has hosted half a billion chat sessions. The action forced Google to launch its own Bard AI tools, which it primarily kept in-house until Microsoft threatened the company’s extremely lucrative advertising division.

According to Mehdi, “Chat is the thing that resonates with people and is transforming search.” Microsoft has discovered that consumers who use the chat features for search-related chores complete significantly more searches. Approximately 70% of users who try out the chat tools do so.

Here we have some more recent news like this below:

Without providing further details, Microsoft CEO Satya Nadella stated last month that Bing app installations have doubled since the product’s launch and that Bing gained its market share in the US market during the quarter. The initiatives are part of a more significant corporate transformation at Microsoft, which aims to take advantage of the firm’s increased investment in OpenAI and integrate AI into all essential products.

As hundreds of millions of users test out the new product, the latest visual search features will present an increased challenge to the Microsoft Responsible AI team attempting to deal with biased, disturbing, or inappropriate content. Microsoft claims to have made strides but still strives to address problems such as inaccurate information and incomplete or wrong answers. Mehdi contended that the team’s efforts to ensure safety are one of the reasons the visual features aren’t currently ready.

Mehdi stated, “There is much work to examine technology and strategies against. “Is it dangerous? Does it show through? Is it open to all? Is it impartial or biased? The same procedure will be followed when working with photos; adding multimodality raises complexity.

At a press conference in New York, Microsoft unveiled the new features. Bing’s most recent features were showcased through a juice bar where the chatbot created drink recipes and personalized thank-you cards for guests.

Additionally, Bing will have improved long document summaries. Further, the company is enhancing the chat history feature. According to Microsoft, a sidebar running alongside its Edge browser will soon make accessing users’ search histories simple. Users will have the option to resume where they left off in earlier talks.

Our website, Pabaon.com, has been updated with similar information.