ChatGPT’s new picture generator is admittedly good at faking receipts

This month, ChatGPT unveiled a brand new picture generator as a part of its 4o mannequin that may be a lot higher at producing textual content inside photos. 

Persons are already utilizing it to generate faux restaurant receipts, probably including one other instrument to the already-extensive toolkit of AI deepfakes utilized by fraudsters.

Prolific social media poster and VC Deedy Das posted on X a photograph of a faux receipt for a (actual) San Francisco steakhouse that he says was created with 4o.

Others have been capable of replicate related outcomes, together with one with meals or drink stains to make it look much more genuine:

Essentially the most real-looking instance TechCrunch discovered was truly from France, the place a LinkedIn person posted a crinkled-up AI-generated receipt for an area restaurant chain:

TechCrunch examined 4o and was additionally capable of generate a faux receipt for an Applebee’s in San Francisco:

However our try had a few lifeless giveaways that it was faked. For one, the full makes use of a comma as an alternative of a interval. For one more, the maths doesn’t add up. LLMs nonetheless battle to do primary math, so this isn’t notably shocking.

Nevertheless it wouldn’t be exhausting for a fraudster to rapidly repair just a few of the numbers with both photograph enhancing software program or, probably, extra exact prompts.

It’s clear that making it very easy to generate faux receipts presents large alternatives for fraud. It wouldn’t be exhausting to think about this sort of tech being utilized by dangerous actors to get “reimbursed” for completely faux bills.

OpenAI spokesperson Taya Christianson informed TechCrunch that each one of its photos embrace metadata indicating they have been made by ChatGPT. Christianson added that OpenAI “takes motion” when customers violate its utilization insurance policies and that it’s “at all times studying” from real-world use and suggestions.

TechCrunch then requested why ChatGPT permits folks to generate faux receipts within the first place, and whether or not that is according to OpenAI’s utilization insurance policies (which ban fraud.)

Christianson replied that OpenAI’s “objective is to provide customers as a lot artistic freedom as attainable” and that faux AI receipts could possibly be utilized in non-fraud conditions like “instructing folks about monetary literacy” together with creating unique artwork and product advertisements.