- OpenAI launches "Collective Alignment" for AI bias.
- Extends grant program for democratic AI processes.
- Focus on public input, exploring partnerships.
Tyna Eloundou, a research engineer and founding member of the Collective Alignment team, emphasized the importance of giving people the opportunity to provide direct input as AI technologies become increasingly integrated into society. The team's mission is to create democratic processes that can effectively address potential biases and other factors in AI systems.
To ensure that only humans can provide input, OpenAI is exploring potential partnerships, such as with Worldcoin—a cryptocurrency project founded by OpenAI CEO Sam Altman. Worldcoin offers a mechanism to distinguish between humans and AI bots. While concrete plans regarding Worldcoin integration have not been finalized, the team is considering various options to enhance the democratic input process.
OpenAI gained widespread attention with the launch of ChatGPT in late 2022, a generative AI technology that rapidly became one of the fastest-growing applications. However, concerns have been raised about AI's ability to generate "deepfake" content and misinformation, particularly in the context of political campaigns, such as the upcoming 2024 U.S. election.
Critics argue that AI systems, like ChatGPT, may exhibit inherent bias due to the input data used to train them. Instances of racist or sexist outputs from AI software have also been reported by users. The establishment of the
Collective Alignment team at OpenAI reflects the organization's commitment to proactively address these challenges.
The newly formed team, currently consisting of Tyna Eloundou and Teddy Lee, is actively recruiting additional members, including a research engineer and research scientist. The team will collaborate closely with OpenAI's "Human Data" team, which focuses on building infrastructure for collecting human input on the company's AI models, as well as other research teams within OpenAI.
OpenAI's emphasis on democratic processes in AI development signals a dedication to inclusivity, transparency, and the incorporation of diverse perspectives in shaping the future of AI technology. As the field of AI continues to advance, OpenAI's commitment to addressing bias and involving the public in governance decisions reflects a proactive approach to responsible AI development.
[embedpost slug="/imf-report-warns-ai-revolution-targets-40-of-global-jobs/"]
