Tag: generative ai
107 articles
Writer AI Flaw Exposes Session Tokens Across Tenants
A critical flaw in Writer AI, dubbed WriteOut, could let an outsider hijack any account and take over an entire organization with just a single link - no login credentials required. This shocking vulnerability highlights the urgent need for robust security measures in AI-powered platforms.
Pentagon's GenAI.mil Platform Expands with New Models, Higher Classification Levels
The Pentagon's GenAI.mil platform is blowing up, with a whopping 1.7 million users and over 100,000 custom agents created - and it's only getting bigger with new models and higher classification levels on the way. This generative AI marketplace is revolutionizing the Department of Defense's approach to innovation, with top vendors like SpaceX, OpenAI, and Google already on board.
Feds Seek Clear Guidance on AI-Powered Vulnerability Scanning Tool
The US government's adoption of a cutting-edge AI-powered vulnerability scanning tool has sparked a heated debate, with select federal agencies gaining access to Anthropic's powerful Mythos model through the secretive Project Glasswing initiative. But with great power comes great risk, and officials are now seeking clear guidance on the tool's use.
Anthropic Unveils Mythos-Class LLM with Enhanced Cybersecurity Capabilities
Meet Claude Mythos 5 and Claude Fable 5, Anthropic's latest game-changing AI models, boasting the strongest cybersecurity capabilities on the planet. With Mythos 5 leading the charge, these cutting-edge tools are revolutionizing the fight against cyber threats.
Anthropic Unveils Dual AI Models, Fable 5 and Mythos 5, With Enhanced Cyber Safeguards
Meet Claude Fable 5 and Claude Mythos 5, Anthropic's game-changing dual AI models that supercharge cybersecurity, with Mythos 5 touted as the world's strongest cybersecurity model. By splitting its powerful tech into two products, Anthropic is making advanced cyber safeguards more accessible while ensuring top-notch security for vetted users.
OpenAI Bolsters ChatGPT Security With New Controls
OpenAI has introduced Lockdown Mode for ChatGPT, a game-changing security control that limits the model's access to the web and external services, giving users and organizations handling sensitive data an added layer of protection. This new feature is now available to personal and self-serve business accounts, following its initial rollout for enterprise plans in February.
Florida Sues OpenAI, Altman Over Alleged Safety Neglect
Florida's top lawman, Attorney General James Uthmeier, is taking a stand against OpenAI and its CEO Sam Altman, alleging the company prioritized profits over safety, putting users at risk. He's filed a civil suit seeking penalties and holding Altman personally accountable for the harm caused to Floridians.
Bayer Overhauls Security Training to Counter AI-Driven Threats
Bayer is revolutionizing its security training to combat AI-driven threats by ditching traditional checklist-driven advice for a psychology-first approach that outsmarts increasingly realistic social engineering tactics. This bold move aims to empower staff and suppliers to safely harness the power of generative AI.
ChatGPT Exposes Users to Prompt Injection Attacks via Browser Content
Researchers have uncovered a vulnerability in ChatGPT that leaves users open to prompt injection attacks, where malicious content is embedded into web pages and then summarized by the AI system as legitimate information. This loophole could put users at risk of falling prey to spoofed security alerts and other online threats.
US Special Ops Forces Seek AI Edge in Remote Warfare
US Special Ops Forces are leveraging AI to gain a strategic edge in remote warfare, with a focus on harnessing generative AI for tactical operations and resource allocation. They're now pushing to deploy AI capabilities to the tactical edge, enabling faster decision-making in disconnected environments.
Microsoft Unveils AI-Powered Red Teaming Tools to Bolster Software Security
Microsoft is shifting the conversation around AI safety from philosophical debates to hands-on action, empowering developers to build more secure software with innovative tools. With the launch of Rampart, a cutting-edge red-teaming tool, the company is putting AI-powered security into practice, helping developers proactively identify and fix vulnerabilities.
Check Point Targets AI Trust Gap with Deepchecks Acquisition
Check Point is bridging the AI trust gap with its acquisition of Deepchecks, gaining cutting-edge model validation capabilities to help organizations ensure the reliability and accuracy of their AI-driven actions. This strategic move enables businesses to effectively test, evaluate, and monitor machine learning systems and mitigate operational risks associated with generative AI.
Federal Agencies Face AI Infrastructure Hurdles
As federal agencies increasingly integrate AI into their facilities, they're facing a major hurdle: outdated legacy systems that require a fresh, open systems approach to support the technology. This critical upgrade is essential to unlock AI's full potential and drive vital service delivery improvements.
Managing Shadow AI Tools Requires Proactive Security Measures
Employees are quietly embracing AI tools to boost productivity, with 80% using unapproved generative AI applications at work - but only 12% of companies have a formal policy in place to manage this growing trend. This creates a shadow AI gap that leaves organizations vulnerable to security risks.
Generative AI Exposes Software Vulnerabilities at Scale
Generative AI is rapidly advancing and can now efficiently uncover and exploit software vulnerabilities, prompting companies like Anthropic to carefully manage their powerful models. Anthropic's recent decision to limit access to its Claude Mythos Preview model to a select group of companies highlights the potential risks and costs associated with these cutting-edge AI systems.
Enterprises Face AI-Generated Fraud Onslaught
Fraudsters are unleashing an AI-powered assault on enterprises, with synthetic identities skyrocketing 100-fold and deepfake impersonations rising sevenfold in just two years. This alarming surge is catching businesses off guard, with nearly half reporting a significant increase in AI-driven fraud.
AI Tools Facilitate but Fail to Deliver in Water System Hack Attempt
In a recent cyber attack on nine Mexican government entities, hackers surprisingly used AI tools like Claude and Chat GPT to help breach the systems, but ultimately failed to cause significant harm. The attack, which included a January intrusion into a municipal water and sewage utility, revealed that while AI can facilitate malicious activity, it can't guarantee success.
AI Exploits Emerge as New Security Threat
As AI use grows, a hidden risk is emerging: malicious inputs can alter model behavior, bypassing safeguards and putting enterprises at risk. This "prompt injection" tactic is like phishing, targeting the link between user and system to wreak havoc.
Phishing Campaigns Exploit Vercel's AI Tools
Scammers are using Vercel's AI tools to create super-realistic phishing sites that mimic popular brands, making it easier for them to trick victims into handing over sensitive info. This clever tactic allows attackers to quickly recreate malicious pages, even if they're taken down.
AI Adoption Outpaces Security Policies, Heightens Cyber Risk
Most organizations are already using AI tools, with 90% of digital trust professionals confirming employees are leveraging them, yet only 38% have a comprehensive policy in place to manage the risks. This disconnect leaves a staggering 25% of organizations with no AI policy at all, heightening cyber risk.
Phishing Kit Bluekit Incorporates AI to Streamline Attacks
Meet Bluekit, a cutting-edge phishing kit that's revolutionizing the game with an AI Assistant panel, pairing traditional templates with advanced AI models to help cybercriminals quickly draft campaign materials. This innovative tool is streamlining attacks, making it easier for malicious actors to launch sophisticated phishing campaigns.
AI Innovation Push Sparks Rethink on Security Response Times
The pharmaceutical sector is surging ahead with AI innovation, as seen in Merck's multiyear deal with Google Cloud, aiming to revolutionize research, manufacturing, and commercial operations. By embedding generative and agentic AI, companies are speeding up drug development and commercialization, while navigating data governance and regulatory risks.
Breach Exposes Anthropic's AI Model Vulnerability
A shocking security breach has exposed a vulnerability in Anthropic's advanced AI model, Mythos, allowing unauthorized users to gain access by simply changing a model name. This incident raises serious concerns about the safety and reliability of cutting-edge AI technology.
FTC Bolsters AI Efforts to Combat Deepfakes and Voice Scams
The Federal Trade Commission is stepping up its game against AI-powered scams, gearing up to enforce new laws targeting sexual deepfakes and exploring ways to shut down voice clone scams. It's a crucial move in the cat-and-mouse battle to stay ahead of tech-savvy scammers.