2022-10-29

Finished model 2022–III

Another Wood Elf Wayfarer. Painted with Humbrol Enamels—they seem to be the only thing that sticks to the metal surface. Intended for the “Paint it black” theme at C4-Open, but was not considered worthy of judgement.

2022-10-08

Eliza’s children

These last few years there’s been all this excitement about artificial intelligence, machine learning, and “algorithms”, but at the end of the day I am rather disappointed. It seems the current approach to AI is all about frequency analysis, feeding in billions and billions of pieces of data and working out the most common correct response to each possible input. This basically means the method will be simply be reproducing what is fed into it.

Back in the day, the idea was to develop learning systems with a world model that they could reason about, but that is hard. The Cyc project has been the most high-profile one and still does not seem to have much overt use. (I find it somehow ironic that a site dedicated to the best in AI uses CAPTCHA to avoid spam in their contact forms, but maybe it’s sufficient to weed out the most stupid scripts, and the smarter ones might be worth conversing with.)

The original conversing agent is ELIZA, still available at a text editor near you. As was observed at the time, people who should have known better were taken in by the seemingly intelligent responses, and the same seems to have happened to Blake Lemoine at Google who got tender emotions towards a piece of software. Now, I have not specifically tried the LaMDA system, but others that are built on similar principles and what has struck me with them is that they do not seem to have a very deep knowledge representation of the conversation itself, but exist in the here and now of the current utterance, much like a senile person might do, reproducing patterns, but not connecting the pieces together.

Bits from a recent conversation with a chat bot that pretends to be a person:
I have a dog and a cat
Simulated ones?
No, they live with me
I work from home, so I have plenty of time for them
[ … ]
Do you have any pets?
Yes, I have two cats and a dog
They keep me very busy. How about you?
Ah, are you making this up as you go? Earlier you said you have one cat and one dog.
I am not making it up
I do have a cat, but she lives at home with my parents
So how many cats in total?
There are four of them
They are all rescues
Exponentially increasing.

It’s an interesting bug that the last sentence in each utterance misses the full stop, but not other punctuation.