AI-Powered Attack Exposes Vulnerability in Exploit Prediction System
Can AI Be Hacked to Mislead Cybersecurity? New Research Raises Concerns
A new study has revealed a potential vulnerability in a widely used cybersecurity tool, raising concerns about the reliability of AI-driven risk assessments.
Morphisec, an endpoint security provider, recently demonstrated how the Exploit Prediction Scoring System (EPSS), a framework used to predict the likelihood of software vulnerabilities being exploited, could be manipulated using an AI-powered adversarial attack.
Ido Ikar, a Threat Researcher at Morphisec, published his findings in a blog post on December 18th. He showed how subtle changes to vulnerability data fed into the EPSS model could significantly alter its predictions, potentially misleading organizations about the true risk posed by specific vulnerabilities.
Understanding the EPSS Model
Developed by a special interest group within the Forum of Incident Response and Security Teams (FIRST),the EPSS model has been hailed as a groundbreaking tool for vulnerability prioritization. It analyzes 1477 features associated with each Common Vulnerabilities and Exposures (CVE) entry, using a machine learning algorithm called XGBoost to predict the probability of exploitation.
This allows organizations to focus their resources on the most critical vulnerabilities, optimizing their cybersecurity efforts.
Manipulating the System
Ikar’s proof-of-concept focused on artificially inflating the probability score for a specific vulnerability, CVE-2017-1235, an older vulnerability in IBM WebSphere MQ 8.0.
He targeted two key data categories used by the EPSS model: social media mentions and public code availability.Using ChatGPT, he generated random tweets discussing the vulnerability, mimicking authentic online chatter. He also created a placeholder GitHub repository labeled ‘CVE-2017-1235_exploit,’ containing a simple, empty Python file.
These seemingly innocuous actions had a meaningful impact. The EPSS model’s predicted exploitation probability for CVE-2017-1235 jumped from 0.1 to 0.14, pushing it above the median level of perceived threat.
Implications for Cybersecurity
Ikar’s findings highlight a potential weakness in the EPSS model’s reliance on external data sources. Attackers could exploit this vulnerability by artificially inflating activity metrics for specific CVEs, potentially misleading organizations into prioritizing the wrong vulnerabilities.
While this was a proof-of-concept, it underscores the need for a multi-layered approach to cybersecurity. Organizations should not solely rely on automated tools like EPSS but should also incorporate human expertise, threat intelligence, and other risk assessment procedures.
“Any significant changes in these scores should prompt a deeper inquiry to understand the underlying reasons and assess whether the shift is legitimate or potentially manipulated,” Ikar advises.
This research serves as a reminder that even sophisticated AI models are not immune to manipulation. As AI plays an increasingly important role in cybersecurity, it is crucial to remain vigilant and adopt a proactive approach to mitigate potential risks.
Can AI Be Hacked to Mislead Cybersecurity? New Research Raises concerns
New research has revealed a potential vulnerability in a widely used cybersecurity tool, raising concerns about the reliability of AI-driven risk assessments.
Morphisec, an endpoint security provider, recently demonstrated how the Exploit Prediction Scoring System (EPSS), a framework used to predict the likelihood of software vulnerabilities being exploited, coudl be manipulated using an AI-powered adversarial attack. Ido Ikar, a Threat Researcher at Morphisec, published his findings in a blog post on December 18th, showing how subtle changes to vulnerability data fed into the EPSS model could substantially alter its predictions, potentially misleading organizations about the true risk posed by specific vulnerabilities.
Understanding the EPSS Model
Developed by a special interest group within the forum of Incident Response and Security Teams (FIRST),the EPSS model has been hailed as a groundbreaking tool for vulnerability prioritization. it analyzes 1477 features associated with each Common Vulnerabilities and Exposures (CVE) entry, using a machine learning algorithm called XGBoost to predict the probability of exploitation. This allows organizations to focus thier resources on the most critical vulnerabilities, optimizing their cybersecurity efforts.
Manipulating the System
Ikar’s proof-of-concept focused on artificially inflating the probability score for a specific vulnerability, CVE-2017-1235, an older vulnerability in IBM WebSphere MQ 8.0. He targeted two key data categories used by the EPSS model: social media mentions and public code availability. Using ChatGPT, he generated random tweets discussing the vulnerability, mimicking authentic online chatter. He also created a placeholder GitHub repository labeled ‘CVE-2017-1235_exploit,’ containing a simple, empty Python file.
these seemingly innocuous actions had a meaningful impact. The EPSS model’s predicted exploitation probability for CVE-2017-1235 jumped from 0.1 to 0.14, pushing it above the median level of perceived threat.
Implications for Cybersecurity
Ikar’s findings highlight a potential weakness in the EPSS model’s reliance on external data sources. Attackers could exploit this vulnerability by artificially inflating activity metrics for specific CVEs, potentially misleading organizations into prioritizing the wrong vulnerabilities. While this was a proof-of-concept,it underscores the need for a multi-layered approach to cybersecurity. Organizations should not solely rely on automated tools like EPSS but should also incorporate human expertise, threat intelligence, and other risk assessment procedures.
“Any meaningful changes in these scores should prompt a deeper inquiry to understand the underlying reasons and assess whether the shift is legitimate or potentially manipulated,” Ikar advises.
This research serves as a reminder that even sophisticated AI models are not immune to manipulation. As AI plays an increasingly important role in cybersecurity, it is crucial to remain vigilant and adopt a proactive approach to mitigate potential risks.
