www.darkreading.com Open in urlscan Pro
2606:4700::6811:7763  Public Scan

Form analysis
0 forms found in the DOM

Text Content

The Edge
DR Tech
Sections
Close
Back
Sections
Featured Sections
The Edge
Dark Reading Technology
Attacks / Breaches

Cloud

ICS/OT

Remote Workforce

Perimeter

Analytics
Security Monitoring

Security Monitoring
App Sec
Database Security

Database Security
Risk
Compliance

Compliance
Threat Intelligence

Endpoint
AuthenticationMobile SecurityPrivacy

AuthenticationMobile SecurityPrivacy
Vulnerabilities / Threats
Advanced ThreatsInsider ThreatsVulnerability Management

Advanced ThreatsInsider ThreatsVulnerability Management
Operations
Identity & Access ManagementCareers & People

Identity & Access ManagementCareers & People
Physical Security

IoT

DR Global
Middle East & Africa

Middle East & Africa
Black Hat news
Omdia Research
Events
Close
Back
Events
Events
 * SecTor - Canada's IT Security Conference Oct 23-26 - Learn More
   
 * Black Hat USA - August 5-10 - Learn More
   

Webinars
 * Best Practices and Tools for OT and IT Security
   Aug 16, 2023
 * The Dark Side of AI: Unmasking its Threats and Navigating the Shadows of
   Cybersecurity in the Digital Age
   Aug 22, 2023

Resources
Close
Back
Resources
Dark Reading Library >
Webinars >
Reports >
Slideshows >
White Papers >
Partner Perspectives: Microsoft
Tech Library >

Newsletter Sign-Up

The Edge
DR Tech
Sections
Close
Back
Sections
Featured Sections
The Edge
Dark Reading Technology
Attacks / Breaches

Cloud

ICS/OT

Remote Workforce

Perimeter

Analytics
Security Monitoring

Security Monitoring
App Sec
Database Security

Database Security
Risk
Compliance

Compliance
Threat Intelligence

Endpoint
AuthenticationMobile SecurityPrivacy

AuthenticationMobile SecurityPrivacy
Vulnerabilities / Threats
Advanced ThreatsInsider ThreatsVulnerability Management

Advanced ThreatsInsider ThreatsVulnerability Management
Operations
Identity & Access ManagementCareers & People

Identity & Access ManagementCareers & People
Physical Security

IoT

DR Global
Middle East & Africa

Middle East & Africa
Black Hat news
Omdia Research
Events
Close
Back
Events
Events
 * SecTor - Canada's IT Security Conference Oct 23-26 - Learn More
   
 * Black Hat USA - August 5-10 - Learn More
   

Webinars
 * Best Practices and Tools for OT and IT Security
   Aug 16, 2023
 * The Dark Side of AI: Unmasking its Threats and Navigating the Shadows of
   Cybersecurity in the Digital Age
   Aug 22, 2023

Resources
Close
Back
Resources
Dark Reading Library >
Webinars >
Reports >
Slideshows >
White Papers >
Partner Perspectives: Microsoft
Tech Library >
The Edge
DR Tech
Sections
Close
Back
Sections
Featured Sections
The Edge
Dark Reading Technology
Attacks / Breaches

Cloud

ICS/OT

Remote Workforce

Perimeter

Analytics
Security Monitoring

Security Monitoring
App Sec
Database Security

Database Security
Risk
Compliance

Compliance
Threat Intelligence

Endpoint
AuthenticationMobile SecurityPrivacy

AuthenticationMobile SecurityPrivacy
Vulnerabilities / Threats
Advanced ThreatsInsider ThreatsVulnerability Management

Advanced ThreatsInsider ThreatsVulnerability Management
Operations
Identity & Access ManagementCareers & People

Identity & Access ManagementCareers & People
Physical Security

IoT

DR Global
Middle East & Africa

Middle East & Africa
Black Hat news
Omdia Research
Events
Close
Back
Events
Events
 * SecTor - Canada's IT Security Conference Oct 23-26 - Learn More
   
 * Black Hat USA - August 5-10 - Learn More
   

Webinars
 * Best Practices and Tools for OT and IT Security
   Aug 16, 2023
 * The Dark Side of AI: Unmasking its Threats and Navigating the Shadows of
   Cybersecurity in the Digital Age
   Aug 22, 2023

Resources
Close
Back
Resources
Dark Reading Library >
Webinars >
Reports >
Slideshows >
White Papers >
Partner Perspectives: Microsoft
Tech Library >

--------------------------------------------------------------------------------

Newsletter Sign-Up
SEARCH
A minimum of 3 characters are required to be typed in the search bar in order to
perform a search.




Announcements
 1. 
 2. 
 3. 

Event
Where and When Automation Makes Sense For Enterprise Cybersecurity | August 29
LIVE Webinar <REGISTER>
Event
Best Practices and Tools for OT and IT Security | August 16 LIVE Webinar
<REGISTER>
Report
Black Hat USA 2022 Attendee Report | Supply Chain & Cloud Security Risks Are Top
of Mind | <READ IT NOW>
PreviousNext

Threat Intelligence

4 MIN READ

News



'FRAUDGPT' MALICIOUS CHATBOT NOW FOR SALE ON DARK WEB

The subscription-based, generative AI-driven offering joins a growing trend
toward "generative AI jailbreaking" to create ChatGPT copycat tools for
cyberattacks.
Elizabeth Montalbano
Contributor, Dark Reading
July 25, 2023
Source: Tierney via Adobe Stock Photo
PDF


Threat actors riding on the popularity of ChatGPT have launched yet another
copycat hacker tool that offers similar charbot services to the real generative
AI-based app but is aimed specifically at promoting malicious activity.



Researchers have found ads posted on the Dark Web for an AI-driven hacker tool
dubbed "FraudGPT," which is sold on a subscription basis and has been
circulating on Telegram since Saturday, researchers from Netenrich revealed in a
post published July 25. FraudGPT starts at $200 per month and goes up to $1,700
per year, and it's aimed at helping hackers conduct their nefarious business
with the help of AI. The actor claims to have more than 3,000 confirmed sales
and reviews so far for FraudGPT.

Another similar, AI-driven hacker tool, WormGPT, has been in circulation since
July 13, and was outlined in detail in a report by SlashNext. Like ChatGPT,
these emerging adversarial AI tools also are based on models trained on large
data sources, and they can generate human-like text based on the input they
receive.

The tools "appear to be among the first inclinations that threat actors are
building generative AI features into their tooling," John Bambenek, principal
threat hunter at Netenrich, tells Dark Reading. "Prior to this, our discussion
of the threat landscape has been theoretical."



FraudGPT — which in ads is touted as a "bot without limitations, rules, [and]
boundaries" — is sold by a threat actor who claims to be a verified vendor on
various underground Dark Web marketplaces, including Empire, WHM, Torrez, World,
AlphaBay, and Versus.




CYBERCRIMINALS NOW ARMED WITH AI CHATBOTS

Both WormGPT and FraudGPT can help attackers use AI to their advantage when
crafting phishing campaigns, generating messages aimed at pressuring victims
into falling for business email compromise (BEC), and other email-based scams,
for starters.

FraudGPT also can help threat actors do a slew of other bad things, such as:
writing malicious code; creating undetectable malware; finding non-VBV bins;
creating phishing pages; building hacking tools; finding hacking groups, sites,
and markets; writing scam pages and letters; finding leaks and vulnerabilities;
and learning to code or hack. 

Even so, it does appear that helping attackers create convincing phishing
campaigns is still one of the main use cases for a tool like FraudGPT, according
to Netenrich. The tool's proficiency at this was even touted in promotional
material that appeared on the Dark Web that demonstrates how FraudGPT can
produce a draft email that "will entice recipients to click on the supplied
malicious link," Krishnan said.




JAILBREAKING CHATGPT'S ETHICAL GUARDRAILS



While ChatGPT also can be exploited as a hacker tool to write socially
engineered emails, there are ethical safeguards that limit this use. However,
the growing prevalence of AI-driven tools like WormGPT and FraudGPT demonstrate
that "it isn’t a difficult feat to re-implement the same technology without
those safeguards," Krishnan wrote.

In fact, FraudGPT and WormGPT are yet more evidence of what one security expert
calls "generative AI jailbreaking for dummies," in which bad actors are misusing
generative AI apps to bypass ethical guardrails for generative AI that OpenAI
has actively been combatting — a battle that's been mostly uphill.

"It's been an ongoing struggle," says Pyry Avist, co-founder and CTO at Hoxhunt.
"Rules are created, rules are broken, new rules are created, those rules are
broken, and on and on."

While one can't "just tell ChatGPT to create a convincing phishing email and
credential harvesting template sent from your CEO," someone "can pretend to be
the CEO and easily draft an urgent email to the finance team demanding them to
alter an invoice payment," he says.


DEFENDING AGAINST AI-ENABLED CYBER THREATS

Indeed, across the board, generative AI tools provide criminals the same core
functions that they provide technology professionals: "the ability to operate at
greater speed and scale," Bambenek says. "Attackers can now generate phishing
campaigns quickly and launch more simultaneously."

As phishing remains one of the primary ways that cyberattackers gain initial
entry onto an enterprise system to conduct further malicious activity, it's
essential to implement conventional security protections against it. These
defenses can still detect AI-enabled phishing, and, more importantly, subsequent
actions by the threat actor.

"Fundamentally, this doesn’t change the dynamics of what a phishing campaign is,
nor the context in which it operates," Bambenek says. "As long as you aren't
dealing with phishing from a compromised account, reputational systems can still
detect phishing from inauthentic senders, i.e., typosquatted domains, invoices
from free Web email accounts, etc."

Implementing a defense-in-depth strategy with all the security telemetry
available for fast analytics also can help organizations identify a phishing
attack before attackers compromise a victim and move on to the next phase of
attack, he says.

"Defenders don’t need to detect every single thing an attacker does in a threat
chain, they just have to detect something before the final stages of an attack —
that is, ransomware or data exfiltration — so having a strong security data
analytics program is essential," Bambenek says.

Other security professionals also promote using AI-based security tools, the
numbers of which are growing, to fight adversarial AI, in effect fighting fire
with fire to combat the increased sophistication of the threat landscape.

Attacks/BreachesEndpointApplication Security
Keep up with the latest cybersecurity threats, newly-discovered vulnerabilities,
data breach information, and emerging trends. Delivered daily or weekly right to
your email inbox.
Subscribe

More Insights
White Papers
 * 
   9 Traits You Need to Succeed as a Cybersecurity Leader
 * 
   The Ultimate Guide to the CISSP

More White Papers
Webinars
 * 
   Best Practices and Tools for OT and IT Security
 * 
   The Dark Side of AI: Unmasking its Threats and Navigating the Shadows of
   Cybersecurity in the Digital Age

More Webinars
Reports
 * 
   How to Use Threat Intelligence to Mitigate Third-Party Risk
 * 
   Concerns Mount Over Ransomware, Zero-Day Bugs, and AI-Enabled Malware

More Reports

Editors' Choice
10 Free Purple Team Security Tools to Check Out
Ericka Chickowski, Contributing Writer, Dark Reading
Black Hat Offers Pen-Testing Certification Exam
Dark Reading Staff, Dark Reading
Microsoft 365 Breach Risk Widens to Millions of Azure AD Apps
Tara Seals, Managing Editor, News, Dark Reading
Microsoft Relents, Offers Free Critical Logging to All 365 Customers
Becky Bracken, Editor, Dark Reading
Webinars
 * Best Practices and Tools for OT and IT Security
 * The Dark Side of AI: Unmasking its Threats and Navigating the Shadows of
   Cybersecurity in the Digital Age
 * Where and When Automation Makes Sense For Enterprise Cybersecurity
 * Implementing Zero-Trust With A Remote Workforce

More Webinars
Reports
 * How to Use Threat Intelligence to Mitigate Third-Party Risk
 * Concerns Mount Over Ransomware, Zero-Day Bugs, and AI-Enabled Malware
 * Everything You Need to Know About DNS Attacks
 * Securing the Remote Worker: How to Mitigate Off-Site Cyberattacks
 * The Promise and Reality of Cloud Security

More Reports

White Papers
 * 9 Traits You Need to Succeed as a Cybersecurity Leader
 * The Ultimate Guide to the CISSP
 * Rediscovering Your Identity
 * Cybersecurity in 2023 and beyond: 12 leaders share their forecasts
 * Know your customer: Enable a 360-degree view with customer identity & access
   management

More White Papers
Events
 * SecTor - Canada's IT Security Conference Oct 23-26 - Learn More
 * Black Hat USA - August 5-10 - Learn More

More Events
More Insights
White Papers
 * 
   9 Traits You Need to Succeed as a Cybersecurity Leader
 * 
   The Ultimate Guide to the CISSP

More White Papers
Webinars
 * 
   Best Practices and Tools for OT and IT Security
 * 
   The Dark Side of AI: Unmasking its Threats and Navigating the Shadows of
   Cybersecurity in the Digital Age

More Webinars
Reports
 * 
   How to Use Threat Intelligence to Mitigate Third-Party Risk
 * 
   Concerns Mount Over Ransomware, Zero-Day Bugs, and AI-Enabled Malware

More Reports

DISCOVER MORE FROM INFORMA TECH

 * Interop
 * InformationWeek
 * Network Computing
 * ITPro Today

 * Data Center Knowledge
 * Black Hat
 * Omdia

WORKING WITH US

 * About Us
 * Advertise
 * Reprints

FOLLOW DARK READING ON SOCIAL

 * 
 * 
 * 
 * 
 * 
 * 


 * Home
 * Cookies
 * Privacy
 * Terms



Copyright © 2023 Informa PLC Informa UK Limited is a company registered in
England and Wales with company number 1072954 whose registered office is 5
Howick Place, London, SW1P 1WG.





Cookies Button


ABOUT COOKIES ON THIS SITE

We and our partners use cookies to enhance your website experience, learn how
our site is used, offer personalised features, measure the effectiveness of our
services, and tailor content and ads to your interests while you navigate on the
web or interact with us across devices. You can choose to accept all of these
cookies or only essential cookies. To learn more or manage your preferences,
click “Settings”. For further information about the data we collect from you,
please see our Privacy Policy

Accept All
Settings



COOKIE PREFERENCE CENTER

When you visit any website, it may store or retrieve information on your
browser, mostly in the form of cookies. This information might be about you,
your preferences or your device and is mostly used to make the site work as you
expect it to. The information does not usually directly identify you, but it can
give you a more personalized web experience. Because we respect your right to
privacy, you can choose not to allow some types of cookies. Click on the
different category headings to find out more and change our default settings.
However, blocking some types of cookies may impact your experience of the site
and the services we are able to offer.
More information
Allow All


MANAGE CONSENT PREFERENCES

STRICTLY NECESSARY COOKIES

Always Active

These cookies are necessary for the website to function and cannot be switched
off in our systems. They are usually only set in response to actions made by you
which amount to a request for services, such as setting your privacy
preferences, logging in or filling in forms.    You can set your browser to
block or alert you about these cookies, but some parts of the site will not then
work. These cookies do not store any personally identifiable information.

Cookies Details‎

PERFORMANCE COOKIES

Performance Cookies

These cookies allow us to count visits and traffic sources so we can measure and
improve the performance of our site. They help us to know which pages are the
most and least popular and see how visitors move around the site.    All
information these cookies collect is aggregated and therefore anonymous. If you
do not allow these cookies we will not know when you have visited our site, and
will not be able to monitor its performance.

Cookies Details‎

FUNCTIONAL COOKIES

Functional Cookies

These cookies enable the website to provide enhanced functionality and
personalisation. They may be set by us or by third party providers whose
services we have added to our pages.    If you do not allow these cookies then
some or all of these services may not function properly.

Cookies Details‎

TARGETING COOKIES

Targeting Cookies

These cookies may be set through our site by our advertising partners. They may
be used by those companies to build a profile of your interests and show you
relevant adverts on other sites.    They do not store directly personal
information, but are based on uniquely identifying your browser and internet
device. If you do not allow these cookies, you will experience less targeted
advertising.

Cookies Details‎
Back Button


BACK



Search Icon
Filter Icon

Clear
checkbox label label
Apply Cancel
Consent Leg.Interest
checkbox label label
checkbox label label
checkbox label label

 * 
   
   View Cookies
   
    * Name
      cookie name

Confirm My Choices