Google search quality raters shift focus to chatbot response rating

Google has prioritized rating chatbot prompt responses above rating the quality of search results, at least for some of its contract workers, since January, Insider reports.

Why we care. Google is clearly committing a lot of resources to Bard and other AI initiatives right now. Search remains its core product – and chief money-maker – so it’s interesting to learn that Google is so heavily invested in Bard that they have reportedly taken resources away from rating search results, which could potentially impact quality.

Reviewing AI prompts, not search. Raters are given a user prompt (e.g., a question, statment or instruction), along with two possible responses generated by an AI chatbot (the name “Bard” was not used). Raters were instructed to pick the best response.

But. Raters are finding themselves guessing vs. assessing and verifying the chatbot responses. That’s because some raters said they don’t have enough time to research which answer was better, especially on technical or complex topics they may not be familiar with, according to Insider.

So much for E-E-A-T. Google’s raters have a specific amount of time to complete their tasks, which vary from 60 seconds to several minutes.

  • “Three hours of research to complete a 60-second task, that’s a great way to frame the problem we’re facing right now,” a rater told Insider.

Search quality raters. Google has employed human raters since at least 2005 – tasking them to rate the quality of pages, websites and search results, using an extensive set of guidelines. Google has always said the feedback from raters doesn’t directly impact organic search rankings but their feedback could be used to evaluate changes.

Googlers also were asked to help improve Bard. Google asked its employees to spend 2-4 hours testing Bard, rewriting answers or providing other forms of feedback, as we reported in February.

Read the Insider report (warning: paywall). Google contractors say they don’t have enough time to verify correct answers from the company’s AI chatbot and end up guessing via Thomas Maxwell.

The post Google search quality raters shift focus to chatbot response rating appeared first on Search Engine Land.

Original source: https://searchengineland.com/google-chatbot-response-raters-395361

45 thoughts on “Google search quality raters shift focus to chatbot response rating”

  1. Das Verkaufen meines Autos in Hagen war ein Kinderspiel. Nachdem ich mein Auto online bewertet hatte, bekam ich schnell ein Angebot. Die Kommunikation war klar, und der Preis war fair. Besonders gut fand ich, dass der Abholservice im Preis inbegriffen war – das hat mir viel Zeit gespart. Ich würde den Service jederzeit.

  3. Good site! I truly love how it is easy on my eyes it is. I am wondering how I might be notified when a new post has been made. I’ve subscribed to your RSS which may do the trick? Have a great day!

  4. I have to say this post was certainly informative and contains useful content for enthusiastic visitors. I will definitely bookmark this website for future reference and further viewing. cheers a bunch for sharing this with us!

  7. I was suggested this website by my cousin. I am not sure whether this post is written by him as no one else know such detailed about my difficulty. You are wonderful! Thanks!

  10. Amazing! Your site has quite a few comment posts. How did you get all of these bloggers to look at your site I’m envious! I’m still studying all about posting articles on the net. I’m going to view pages on your website to get a better understanding how to attract more people. Thank you!

  12. Thanks for another great post. Where else may anybody get that type of info in such an ideal way of writing? I have a presentation next week, and I’m at the search for such information.

  20. I favored your idea there, I tell you blogs are so helpful sometimes like looking into people’s private life’s and work.At times this world has too much information to grasp. Every new comment wonderful in its own right.

  21. Профессиональный сервисный центр по ремонту бытовой техники с выездом на дом.
    Мы предлагаем: ремонт крупногабаритной техники в москве
    Наши мастера оперативно устранят неисправности вашего устройства в сервисе или с выездом на дом!

  22. Thanks for another great post. Where else may anybody get that type of info in such an ideal way of writing? I have a presentation next week, and I’m at the search for such information.

  23. Thanks , I’ve recently been searching for info about this topic for ages and yours is the best I have discovered so far. But, what concerning the bottom line? Are you certain concerning the source?

  30. I just couldn’t leave your website before suggesting that I really enjoyed the usual information an individual supply on your visitors? Is gonna be back often in order to investigate cross-check new posts

  40. Nice to meet you! We are a online retailer since 1988. Welcome to Elivera 1988-2023. EliveraGroup sells online natural cosmetics, beauty products, food supplements. We connect people with products and services in new and unexpected ways. The company ELIVERAGroup, is a Retailer, which operates in the Cosmetics industry. ELIVERA was established in 1988. © ELIVERA LTD was established in 2007. The first project was in 1988. It was carried out in trade with Russia, Belarus, Ukraine, Belgium, Hungary, Poland, Lithuania, Latvia and Estonia.

Comments are closed.