So, what really is generative artificial intelligence (Gen AI)? It is a subfield of artificial intelligence that utilises generative models to generate data, content, text, images, videos, and music. It can learn human languages, programming languages, chemistry, biology or any other complex subject matter, analyse data, make recommendations and more. In simple terms, a set of powerful technologies that enable computers to perform a variety of tasks and functions. Examples include tools like ChatGPT, which generates text, and platforms like Adobe Firefly, which creates images. 

While there are many instances where Gen AI is being used positively, a major concern associated with this technology is that it may also be abused and exploited by scammers for illegitimate, malicious purposes.

Common Tactics Scammers Deploy by Using Generative AI

Phishing attacks

- AI may be used to carry out large-scale social engineering attacks via fraudulent messages. These scams are designed to deceive victims and trick them into disclosing confidential or sensitive information, such as their passwords and PINs.

- Using Business Email Compromise (BEC), a type of phishing scam that targets both businesses and individuals with specifically email communications, AI is increasingly being used by attackers to make BEC emails more convincing and personalised, posing a greater threat to businesses. 

Deepfakes

- An often encountered abuse of AI relates to “deepfakes” (derived from deep learning and fake media), where AI is used to create or manipulate images or videos to appear authentic in order to deceive victims that they are communicating with a real person. Deepfakes have garnered widespread attention for their use in creating scams, hoaxes and fake news.

Voice cloning

- Using an audio clip of someone’s voice, scammers can replicate a person’s voice to create a convincing fake version. These scams exploit the fact that cloned voices are incredibly convincing, making it difficult to distinguish them from the real thing.

Malicious accounts

- It has never been easier to launch large-scale attacks on individuals and businesses by using AI to target and defraud users through fabricated online profiles on social networking platforms. AI systems can also be used to manipulate existing online profiles or social media accounts to appear as the person being impersonated.

Chatbots

- While chatbots have widely been used to help customers with queries or issues online, scammers can also exploit AI-driven chatbots to trick and deceive victims. Once trust is gained, these bots can gently encourage victims to click on a malicious link or share sensitive information.

Fake websites

- Online ads promoting high-return investment opportunities or prize giveaways  are often used to direct traffic to fake, AI-generated websites that look identical to the legitimate ones. On visiting the fake websites victims are persuaded to enter their personal information, leading to instances of identity theft or fraud.

How can I protect myself from AI scams?

Protect yourself from AI related fraudulent activities by following the guidelines below:

Knowledge is key - Educate yourself on how AI works, what it is capable of and what are some of the  techniques scammers are using, especially as this technology continues to develop.

Pay close attention to details – Read emails carefully, look at web addresses before clicking on links and check the sender’s email address as these may look nearly identical to an actual sender or account but may utilize spelling tricks or special characters.

Look out for the ‘tell tale” signs of AI - Repetitive or formulaic language, unusual grammar and arrangement of words and phrases may be clues that the content is AI-generated or that you may be dealing with AI.

Scan images or videos received for inconsistencies - At first glance, AI images might appear convincing, but on closer inspection, you will probably notice errors such as incorrect body proportions, or videos may appear glitchy or warped.

Verify sources - When in doubt or suspicious, check and confirm the identity of the source and legitimacy of a request, especially if it arrives unexpectedly or seems unusual and before agreeing to requests or taking any action.

Safeguard confidential information – Take care and refrain from oversharing personal details on your social media pages, public websites or while online with chatbots.

Use strong security protocols - regularly update security software and protocols for your networks and devices to protect against phishing scams, deepfakes and other AI-related attacks.

What to do if you’ve been scammed

- Contact your financial institution immediately if funds have been taken from your account.

- Register a fraud case with the SAPS for investigation.

- Report the scam to implicated sources/organisations to help create awareness and prevent others from becoming victims.

- Apply for Protective Registration with the Southern African Fraud Prevention Service (SAFPS) to protect against further incidents of identity theft/fraud.

Report the scam and all details thereof to YIMA, a free service of the SAFPS designed to help protect people from online scams. For more advice on protecting yourself from online fraud, check out our fraud listicle.