Earlier this month The U.S. Air Force Chief Scientist’s inter-agency working group sent out a Request for Information (RFI) on unintended Artificial Intelligence (AI) bias. The group is delving into the critical issue of bias within AI and Machine Learning (ML) algorithms, with a primary emphasis on datasets. They are seeking to learn about these biases from academic institutions like minority serving institutions (MSIs) and historically black colleges and universities (HBCUs), alongside industry, the federal government and other academic institutions.
Despite the development of several tools aimed at identifying and addressing bias, such as the Department of Defense (DoD) Responsible AI toolkit, significant challenges persist in combating bias within AI and ML systems.
The group recognizes that as AI technology expands into new domains, unique challenges emerge, each with its own set of application-specific biases that may inadvertently lead to harmful outcomes. Therefore, there is an urgent need for continued research and collaboration across disciplines to develop effective strategies for detecting and mitigating bias at every stage of AI and ML development.
Individuals and groups interested in sharing information about how to better understand AI bias in datasets should submit a response through their portal by May 15.
Responses should include:
- a capabilities statement
- a description of ongoing and future research the institution has performed to combat unintended AI bias
- a description of all the existing partnerships aimed at researching and mitigating AI bias
- a description of the types of unintended AI bias that are being observed (including the data being collected), the domains they are in and the impacts they are having on the institution
- a statement proposing how this work would advance the education and training of students and researchers
To find more information and to submit a response see the full RFI here.
Interested in informing the group on these challenges from an industry perspective? They have also released an RFI, where they hope to hear from commercial and non-profit organizations that use data to develop AI capabilities.
