Friday, June 12, 2026

Misuse of Artificial Intelligence - Real Problems, but What Stands Out?

 

Here are examples of how people have been using AI to deceive, defraud, and commit other sharp practices.

The pictures above the headline of “’A cat-and-mouse game’” (Sarah Kessler, The New York Times, September 6th) show three receipts.  One is from the Midway Bar and Grill, giving the address, date, server, amount, tip, total, and credit card information.  Another says “FedEx Office” with a familiar logo, date and time, and information on a shipped package, including its cost.  The third is an itemized restaurant bill, with three courses and beverages.  All are apparently flawless, unimpeachable, and unremarkable, probably looking like millions of others submitted for expense reimbursement, but none are real.  Per the CEO of a company making “software used by finance teams to manage expenses,” producing such counterfeits is “too easy,” and employees often start with using AI to synthesize documentation for a legitimate expense for which they lost the receipt, and when they “don’t get caught, they do it again.”  Two other companies are involved in detecting this bogusness, but “A.I.-generated receipts will only get better from here,” and “to combat fraudulent A.I., we need to use A.I.”

We now have that technology built into web browsers.  I often pose questions to the pedestrian Google Chrome release I regularly use, and it may seem like little more than a convenience, but it’s natural to want to discover “How AI browsers open the door to new scams” (Kurt Knutsson, Fox News, September 20th).  Such tools “can stumble into scams faster than humans ever could,” with a “dangerous mix of speed and trust.”  When people direct AI to buy things, it may “confidently” complete transactions on “fake” store sites.  “Old phishing tactics,” such as sending false bank-identified emails with destructive links, have worked smoothly with AI software.  Clearly, we’re not ready yet to delegate such sensitive activities.

What can happen when the roles are reversed?  We will need to learn “How to spot and stop AI phishing scams” (Kurt Knutsson again, Fox News, October 14th).  Such things happen “when hackers use AI to make their scams more convincing,” by assembling “super-realistic emails, messages, voices and even videos.”  These communications rarely have the old-time tells of “typos and bad grammar,” and AI’s repertoire now includes “voice clone scams” and “deepfake video scams.”  Some of the red flags are unchanged, though, with Knutsson telling readers to beware of a “suspicious sender’s address,” “generic greetings like Dear Customer,” “unsolicited attachments” used to prompt action, email addresses with slight but real variations from official ones, and, perhaps most mentioned, a need for urgency.  With friends and family members, you can “set up and use a shared secret,” and with others you know, asking them something from the past not likely to be relevant now works well.  In a case I had, a Facebook friend and former high school football teammate asked me to participate in something believable but dicey, but when I asked him what position he played, “he” gave me the online equivalent of a blank stare.

How about misbehavior originating from AI providers themselves?  We think and hope there isn’t much of that anymore, but we had a case last fall where an “AI-enabled teddy bear… gave advice on B.D.S.M. sex and where to find knives.”  That was the springboard for “Public Shame Is the Most Effective Tool for Battling Big Tech” (Jessica Grose, The New York Times, January 14th).  The author described how consumers successfully pressured company Mattel to pause “the release of any A.I.- powered” toys.  Yet many corporate responses to even sexual material have been weak, such as X-platform spokespeople saying that “its policy is to “take action”” against lewd deepfakes, and other events, such as the federal government asserting its ability to override state AI laws, may be creating a foundation for further wrongdoing.  So, per Grose, “negative publicity” is most effective in getting solutions for these problems to be reached.

Finally, there were “Lawyers Barred for A.I.-Generated Citations to Fake Cases” (Neil Vigdor, The New York Times, June 9th).  When “all four lawyers on opposing sides in a civil trial” found themselves “removed from the case and fined” after “some of them, relying on artificial intelligence, cited fake legal cases in court filings,” one attorney said she had used “First Drafts, an A.I.-powered program for drafting legal documents.”  But the precedent here will be that due diligence with those tools will require more than was practiced this time.

What is noteworthy about these cases?  You may have been thinking that I picked only a few as samples for this post.  But, in nine months, this is all I saw.  For all of AI’s potential to do damage, it hasn’t been doing much.  Certainly, there has been more, especially in deepfakes, but it doesn’t look like a lot.  There is a message here - could it be that AI is not as compatible with crimes, and even vice, as we think?  Could it be that our laws and restrictions, as immature and makeshift as they seem to be, are working remarkably well?  It is time for us to consider these things, and, once again, look at how AI is actually turning out.

No comments:

Post a Comment