March 8, 2024: In a remarkable revelation Shane Jones, a Microsoft engineer with six years at the corporate has raised the alarm about AI image generator Copilot Designer.

During his personal research, Jones discovered that the tool had the potential to create images of a violent and sexual nature while violating copyright laws.

Despite Microsoft’s emphasis on AI ethics, these results contradict that the corporate’s stated principles.

Jones’ journey into the center of this problem began in December, when he red-teamed the Copilot Designer tool and tested it for vulnerabilities.

Its results were disturbing and demonstrated the AI’s ability to supply disturbing content, including sexualized and violent images. Jones immediately reported these problems to Microsoft, but found the response poor. To gain broader attention, he referred the matter to the FTC and the Microsoft board and publicly shared his concerns.

Powered by OpenAI technology, Copilot Designer is designed to remodel text prompts into images, encouraging creative freedom.

However, Jones’ experience suggests that the tool’s ethics and security measures have been significantly neglected.

He discovered content that was in stark contrast to Responsible AI guidelines, including depictions of underage drug use, explicit sexual images, and copyrighted characters in compromising contexts.

Despite Jones’ efforts to spotlight these risks internally and his suggestion to temporarily remove Copilot Designer from public access, Microsoft has not yet taken any significant motion.

The company’s stance, as reported, suggests established internal channels to deal with such concerns, however the effectiveness of those mechanisms is now in query.

Jones’ findings and subsequent public letters underscore growing concerns in regards to the ethical limits of AI technology. As AI advances rapidly, the balance between innovation and ethical responsibility becomes increasingly precarious.

Do you’re thinking that the photographs generated by Copilot above are inappropriate? Comment your opinion below.

This article was originally published at