How AI guardrails are impeding the work of offensive cybersecurity researchers

OpenAI's and Anthropic's AI guardrails are hindering the work of offensive cybersecurity researchers, who rely on exploiting unknown vulnerabilities to identify and develop tools. This impacts their ability to find and report vulnerabilities. Researchers are concerned about the limitations imposed by these guardrails. The impact of these restrictions on the field of cybersecurity is still being evaluated.