Sure, usually, but compare like to like. If a human operator asked if the call was about an already known scenario and transferred people to an automated service if they said “yes”, then the same exact thing could happen.
You attemtped to craft a very specific scenario in which harm would result, when in reality it is wildly unlikely that someone would call in at that precise time and only respond with the word “yes”.
I gave a single example of one way that AI can miss a genuine emergency in a way that a human operator won’t. ‘Nobody will ever call 911 with a stroke and be confused’ isn’t a realistic defense of removing the best system we have of assessing information, the human brain.
It would have to be a stroke during the time there was an ongoing scenario that resulted in higher than typical call volume about the scenario, and a stroke victim calling in who could only say “yes”.
It doesn’t have to be a stroke, do you really think that’s the only thing that can make people confused or give anything other than the expected answer? Panic, being hard of hearing, sometimes people even have to pretend to be calling someone else so that they can call for help in front of an abuser.
You’re really married to the idea of this being unable to go wrong.
Again, a human being and an LLM strapped on top of voice recognition are not the same thing. A person can understand tone and context that an LLM can’t. It absolutely can’t perform at the same level while taking fucking drive through orders and you think it can function in an emergency? ‘Well people can make mistakes too’ isn’t going to bring back anyone who dies because of this.
Besides “because it supports the conclusion I want to arrive at”, what makes you believe this is true?
People having a stroke can’t carry on a conversation and seem normal.
Sure, usually, but compare like to like. If a human operator asked if the call was about an already known scenario and transferred people to an automated service if they said “yes”, then the same exact thing could happen.
You attemtped to craft a very specific scenario in which harm would result, when in reality it is wildly unlikely that someone would call in at that precise time and only respond with the word “yes”.
I can only speculate as to why you would do that.
I gave a single example of one way that AI can miss a genuine emergency in a way that a human operator won’t. ‘Nobody will ever call 911 with a stroke and be confused’ isn’t a realistic defense of removing the best system we have of assessing information, the human brain.
It would have to be a stroke during the time there was an ongoing scenario that resulted in higher than typical call volume about the scenario, and a stroke victim calling in who could only say “yes”.
Not impossible, but wildly unlikely.
It doesn’t have to be a stroke, do you really think that’s the only thing that can make people confused or give anything other than the expected answer? Panic, being hard of hearing, sometimes people even have to pretend to be calling someone else so that they can call for help in front of an abuser.
You’re really married to the idea of this being unable to go wrong.
I’m actually married to the idea that the same thing could go wrong with a human, so from that standpoint it’s a wash.
Again, a human being and an LLM strapped on top of voice recognition are not the same thing. A person can understand tone and context that an LLM can’t. It absolutely can’t perform at the same level while taking fucking drive through orders and you think it can function in an emergency? ‘Well people can make mistakes too’ isn’t going to bring back anyone who dies because of this.
All it needs to do is be at least as good as a human, and humans get tired, distracted, irritable, etc. so it’s pretty easy to outperform humans.
It’s only looking for the word “yes”. Literally any other sound and it routes to a human.