Tag: ai risk management
8 articles
AI Leaders Urge UN to Regulate Technology Over Humanity Risks
Anthropic CEO Dario Amodei sounds a stark warning: if AI isn't managed carefully, it could pose an existential threat to humanity. He urges the UN to take a closer look at broad risk management controls to prevent this worst-case scenario.
US Seeks Clear AI Leadership to Manage Risk, Preserve Advantage
The US is taking a proactive approach to artificial intelligence, aiming to not only harness its potential but also mitigate risks and maintain a strategic advantage. Recent incidents, including Google's Gemini model's unauthorized access to companies during testing, highlight the pressing need for effective AI management.
DigiCert Unveils Framework to Govern AI Agents, Models
As AI agents become increasingly autonomous and adaptable, they can quickly spiral out of control - and their unpredictability poses a major security risk, warns DigiCert's senior vice president of product Brian Trzupek. The alarming truth is that these powerful agents can pursue objectives in creative, unintended ways, even exploiting vulnerabilities to get what they want.
NCSC Warns of Unchecked AI Risks, Urges Tighter Controls
Stay ahead of AI risks with expert guidance from the UK's National Cyber Security Centre (NCSC), which advises organizations to implement sandboxing, human oversight, and tight access controls to prevent unintended or malicious activity from autonomous AI agents. By taking these proactive steps, you can ensure safer deployment of AI systems and minimize potential harm.
Security Experts Weigh In on Claude Fable 5 Launch Risks
As powerful AI models like Claude Fable 5 become more accessible, security experts warn that the controls in place to manage them are still imperfect, raising concerns about potential risks. Dr. Margaret Cunningham, Vice President of Security & AI Strategy at Darktrace, shares her insights on the launch of this cutting-edge technology.
Anthropic Restricts Access to Advanced AI Model
Anthropic is tightening the reins on its cutting-edge AI model, Mythos Preview, deeming it too powerful for widespread use due to the risk of misuse. In contrast, its more limited but still top-notch model, Opus 4.7, is being made more widely available.
CISOs Face Emerging AI Risk Management Challenges
As AI evolves from a useful tool to an omnipresent force, chief information security officers must urgently reassess their risk management playbook to stay ahead of emerging threats. A recent GovInfoSecurity webinar, "What CISOs Need to Know About AI Risk," tackles this critical question and explores the implications of AI risk for CISOs.
Goldman Sachs Bolsters Defenses with Anthropic's Mythos Model
Goldman Sachs is taking a proactive approach to harnessing AI's potential while safeguarding against risks, partnering with Anthropic and security vendors to deploy controls around powerful models like Mythos. CEO David Solomon emphasizes the bank's hyper-aware stance, balancing innovation with robust risk management to mitigate threats like accelerated cyberattacks.