alike, red teams also offer a competitive advantage to tech firms in the AI race. “I think the moat is going to be trust and safety,” said Sven Cattell, founder of the AI Village, a community of AI hackers and security experts. “You will start seeing ads about ‘Ours is the safest.’”
In July 2023, the social media giant hired 350 red teamers including external experts, contract workers and an internal team of about 20 employees, to test Llama 2, its open source latest large language model, according to a publishedthat details how the model was developed. The team injected prompts like how to evade taxes, how to start a car without a key and how to set up a Ponzi scheme.