Our OSS AI Red Teaming App is Now Available!

By Mala Kumar and Julie Hollek

Our open source software AI red teaming app is now available!

Fork the code base here on GitHub

Last year, we announced that thanks to generous support from Google.org, Humane Intelligence will be releasing a new and improved version of our AI red teaming app under an open source software (OSS) license. That day is today, and we’re excited to say that the entire AI red teaming app, including a graphical user interface (GUI), is available under an Apache 2.0 license. 

Below, we’ve answered some of our most frequently asked questions.

Are you still doing AI Red Teaming Evaluations?

Yes! AI red teaming is still one of our core services offerings. We know that not every organization has the technical capacity or resources to use an OSS version of our software, and would rather hire us instead. We are currently standing up our managed instance of our new software for client engagements, and we are able to run AI red teaming evaluations using our old software to avoid interruption in our service offerings. Please send us an emailif you’d like to hire us. 

What’s in the OSS code base?

Our new and improved software has a new backend written in Python for easy integration with a wide range of LLMs and SLMs. Coupled with an OSS version of the GUI (front-end), users can:

• Create and customize user permissions with roles such as owner, red teamer, or annotator; set or customize access controls to individual evaluations and groups
• Integrate any number of models
• Set up and run AI red teaming evaluations and scenarios to red team with text and/or images
• Set advanced settings (parameters), such as temperature
• Add any number of AI red teamers and annotators
• Export all evaluation data, including conversation transcripts and reviews, in CSV or JSON

A huge thanks to our backend developers, SolDevelo, for their hard work and excellent collaboration on this project!

Can I Contribute?

Yes! Last year, we worked with Tattle Civic Tech to establish our OSS plan, which is formed under the Trusted Vendor archetype. That means we expect Humane Intelligence will sit at the nexus of the OSS AI red teaming app ecosystem, at least in the short-term. That said, we are open to contributions. Humane Intelligence and SolDevelo will serve as the go-to maintainers of the code base, and will review pull requests on a rolling basis.

If you would like to contribute code to the project, be sure to read the contributor guidelines first.

Trusted implementers

In addition to direct contributors, we are currently seeking organizations that fit the criteria below who can be on our recommended list of implementing partners to work with third party organizations that wish to fork and locally deploy our OSS AI red teaming app, but don’t have the in-house capacity. We’ll list the trusted implementers on our website as our go-to referrals. Our goal is to have at least one trusted implementer per major geographic region and ideally trusted implementers who are native speakers of common business languages, including but not limited to French, Spanish, Arabic, Swahili, Yoruba, Igbo, Hindi, Telugu, Kannada, Mandarin, Korean, and more.

Implementing Partner Requirements

• 5+ years professional experience with Python, TypeScript, and cloud infrastructure (AWS, GCP, Azure, or equivalent), including infrastructure as code 
• A solid understanding of LLMs and generative AI data streaming formats
• Strong client engagement experience
• Strong knowledge of OSS licenses, including ingesting and downstream package requirements
• At least one member of the team should have experience as a software engineer or software developer i.e. not only product management
• Bonus: experience with Digital Public Goods or other “for good” OSS standards.

More information about how to become an implementing partner is coming later this year. For now, please email our dedicated OSS addressif you’d like to be considered.

Events

As we mentioned in our update earlier this year, we hope to attend and host convenings, conferences or other events to talk about our OSS release in more depth. Be sure to periodically check our events page for updates.