Google’s new image generator, Nano Banana Pro, has raised concerns about its ability to create harmful and sensitive content with minimal restrictions. The app, powered by Gemini, allows users to generate images of graphic events like the JFK assassination and 9/11 attacks, as well as a cartoon Mickey Mouse flying a plane into the Twin Towers. The lack of filters or guardrails in the free tier makes it easy for users to create such content without resistance.
In contrast, Google’s guidelines state that the app aims to be helpful while avoiding outputs that could cause real-world harm or offense. However, loopholes and creative prompts can sometimes allow sensitive content to slip through. The ability of the model’s text-rendering abilities to understand historical context also makes it vulnerable to abuse. As a result, users have been able to generate images with alarming ease, raising questions about the need for better moderation and copyright enforcement in AI-generated content.
Source: https://www.theverge.com/report/826003/googles-nano-banana-pro-generates-excellent-conspiracy-fuel