Google enhances play store safety measures: Users can now report offensive AI content

In a move aimed at fostering a more secure Android ecosystem, Google is set to implement a series of updates to its developer policies, focusing on enhancing app quality, safety, and privacy within the Play Store. Among the notable changes is a policy emphasising the ethical use of generative AI models within apps.

Empowering users: Reporting offensive AI-Generated content made easy

Starting in early 2024, developers utilising AI-generated content within their apps will be required to integrate a reporting feature for offensive material. This proactive measure enables users to offer feedback on potentially harmful content without exiting the app. Google’s initiative ensures a safer, more accountable environment for Android users, aligning with the company’s commitment to responsible AI practices.

Google's updated policy covers a wide array of AI applications, including chatbots, image-generation apps, and those creating voice or video content of real people. However, it excludes apps that merely host AI-generated content or use AI for summarising purposes. Examples of content deemed problematic include nonconsensual deepfakes, recordings designed for scams, false election content, and apps primarily intended for sexually explicit purposes, along with malicious code creation.

Stricter permissions & enhanced privacy protocols

In addition to addressing AI-generated content, Google is implementing changes to the Play Store’s photo and video permissions policy. Recognising the sensitivity of personal media files, Google is limiting app access to users' photos and videos. Apps requiring extensive access must justify their necessity, while others with limited media usage will be directed to use a photo picker. This shift promotes privacy best practices, safeguarding users from potential exploitation.

As technology advances, Google acknowledges the evolving landscape of generative AI applications. Consequently, the company remains open to revisiting its policies to ensure ongoing alignment with ethical standards and user safety. These updates mark a significant stride toward a more secure and trustworthy app environment, reflecting Google’s dedication to user satisfaction and online safety within the Android ecosystem.