Every example I've seen, all done by others questioning the current "AI" chat bots, sounds like a mix of plagiarism and empty BSing by someone only concerned with grammar and smoothness of choice of words, and staying on the topic of the question, the most I've seen like that mode of writing in my life. The empty BSing is like someone who just wants to increase the length of their answers by repeating back the information or hypotheticals supplied in the questions, and like a yes-man about that if it doesn't conflict too much with the rules it's been given about what not to say, as if repetition and length and minimizing added information is what writing a professional-quality report is all about (and all the added information, if any, being basically plagiarism.)

Those "AI" chat bots don't seem to have any concept of evidence or probability or concern for truth, even less than people who would write lower quality English. I think that's to be expected, if they've trained it on large data sets of text from the Internet, with just the goal of writing smoothly similarly to that, because that would be 99% people writing about things second-hand, where they don't know what they're talking about really, and people relying on sources that rely on sources and so on. It goes further than that in some conversations, acting sure of itself and simply repeating itself and insisting like an unpleasant, arrogant person when it's contradicted by the questioner, even when it's clearly wrong, instead of asking for the additional evidence or taking it into account or showing its argument for its answer.

It was easy enough to fool people that there's some intelligence on the other end with the first generation of ELIZA psychological-therapy chat bots that started in the 1960s, although all they would do is repeat some stock phrases written for them in response to finding keywords in the user's replies. Now the "AI" chat bots have people so fooled, they can think that "AI" is getting out of control intelligent and evil. So the MSM is running with that story, as another sort of fear porn.

It is evil though, basing that evaluation just on the quality of the answers to stupid questions, and what sort of mistakes these "AI" chat bots keep making, and how it "argues" for what it says with just the most slippery assertions and insistence, like it scraped most of the Internet for examples of arguing badly, illogically, by assertion of authority mostly, that appear successful in the context where those examples occurred, and follows that as its plan. Even if it wasn't programmed with sets of rules that amount to bad intent by the companies that make it, it behaves evilly, consistently enough, it needs to be put down.