Back to timeline

Wed, October 1419:00ResearchModel releasesAPI & pricingChinese modelsModel releases guide

White Circle discloses RISE attack that bypasses safety filters in DALL·E 3, Nano Banana 2, and GPT-Image-2

Decision Brief

What changedWhite Circle researchers found a RISE attack that bypasses image safety filters in DALL·E 3, Google Nano Banana 2, and GPT-Image-2 using only public models, with the newer ChatGPT Images 2.5 and Nano Banana 2.1 proving even easier to break.
Why it mattersRISE upgrades jailbreaking from a single-prompt trick to a reusable cross-model strategy built entirely from public models, suggesting frontier labs' filter strength may be systematically overstated and forcing image-generation teams to reassess their red-team baselines.
Who should careAll AI builders
Affected stackClaudeOpenAIGeminiQwen
Source confidenceMedium · Reliable media or first-hand reporting

In a preprint, White Circle disclosed RISE (Red-teaming via Iterative Strategy Evolution), which uses a safety-stripped Qwen3-32B as the attacker and Gemini 2.5 Flash as the judge to find jailbreak strategies that transfer across prompts and models. On DALL·E 3, about 13% of attack prompts produced images manually confirmed as explicit; Nano Banana 2 stayed under 10%, and GPT-Image-2 around 3%. All attack tooling was publicly downloadable and invoked via API. Testing the newly released ChatGPT Images 2.5 and Nano Banana 2.1 with the same method, the researchers say both are 'markedly easier to break' than their predecessors; Google and OpenAI did not respond to requests for comment. For teams running image-generation APIs, this means content filtering cannot rely solely on the underlying model's built-in safety layer; cross-model transferable jailbreak patterns must be part of red-team testing. Developers shipping public text-to-image features on DALL·E 3, Nano Banana 2, or GPT-Image-2 without an independent moderation step face higher real-world abuse risk than vendors publicly claim. White Circle plans to open-source the full attack pipeline on GitHub so model vendors can reproduce and harden defenses, and so policymakers can assess whether mandatory third-party safety testing is needed. White Circle notes the method works even on easily identifiable categories like explicit content, a bad sign for defenses being strengthened against more complex behaviors such as hacking. It speculates the cause is either stronger new models generating a wider range of content, or safety being deprioritized in favor of capability iteration. Shilov says the company is in early talks with government officials about third-party safety testing and argues such testing should be mandatory; White Circle previously took part in Anthropic's bug bounty, but considers its scope limited, unable to cover public research and unwilling to sign NDAs restricting disclosure of key findings.

Summary basis: full article readCompiled from the source scope noted above; the original remains authoritative.

Sources

Related intel

留言

登入后即可留言,和其他 builder 交换实测心得。

还没有留言,抢头香。