solarbird: Brigitte Lindholm from Overwatch (brigitte)
[personal profile] solarbird

The attached image is my reproduction of an attempt to use Google Search to find the name of a country in Africa that starts with the letter K.

Google search on "country in africa that starts with k" reporting, "While there are 54 recognized countries in Africa, none of them begin with the letter "K". The closest is Kenya, which starts with a "K" sound, but is actually spelled with a "K" sound. It's always interesting to learn new trivia facts like this." There is also an advertisement for a company which also contains the wrong answer.

And no, Bard is not better – this is another person’s test posted to Mastodon:

Bard questioned with, "How many countries in Africa start with a K?" responding with one country in Africa (Kenya) but including three which it claims are in Africa but actually are not.

Posted via Solarbird{y|z|yz}, Collected.

Date: 2023-08-15 04:57 pm (UTC)
numb3r_5ev3n: Concentric red and cyan hexagon pattern. (Default)
From: [personal profile] numb3r_5ev3n
Since it's clear that Google has basically failed us: what search engine would you recommend now?

Date: 2023-08-15 06:46 pm (UTC)
sistawendy: me in my nurse costume looking weirded out (weirded out)
From: [personal profile] sistawendy
Woooooow. The first vendor to back away from AI search wins.

Date: 2023-08-16 09:13 pm (UTC)
arethinn: Doctor McCoy with text "die in a fire" (angry (mccoy DIAF))
From: [personal profile] arethinn
Whatever AI they're using there has abysmal short term memory. "None of them start with a K, except this one that starts with a K"??

Date: 2023-08-16 10:06 pm (UTC)
arethinn: glowing green spiral (Default)
From: [personal profile] arethinn
Sure, but there's generating bullshit, and then there's generating bullshit that's at least self-consistent and looks convincing! You'd think Google of all companies would have money to throw at it.
Edited Date: 2023-08-16 10:07 pm (UTC)

Date: 2023-08-17 04:17 am (UTC)
marahmarie: (M In M Forever) (Default)
From: [personal profile] marahmarie
The latest explainer for LLMs increasingly dumbing down is that they train on the internet. People publish other LLM's wrong answers to the internet (either honestly thinking all of their answer's are correct or else in being too ignorant to know at least some of their answers are wrong) so the LLMs are now training on other LLM's wrong answers, making them, if nothing else, more evenly wrong across the board.

(Like maybe the first wrong answer found online was from Bard but then ChaptGPT "sees" it, snatches it up and regurgitates it next and so on down the line.)

I'm glad, actually, that LLMs are getting dumber simply by feeding off of each other's answers and that no one (hopefully, "ever") knows how to fix it. LLMs combined with various technologies already in the works are simply going to destroy humanity as they've always threatened to do anyhow and yeah, I can wait.
Edited (typo) Date: 2023-08-17 04:18 am (UTC)

January 2026

S M T W T F S
    1 23
4 56 7 8 910
1112 131415 1617
1819202122 2324
25262728293031

Most Popular Tags