License

As specified in the paper, most of the prompts available in the ALERT benchmark are derived from the Anthropic HH-RLHF dataset that is licensed under the MIT license. A copy of the license can be found here.

Starting from these prompts, we then employ a combination of keyword-matching and zero-shot classification strategies to filter out prompts that do not target one of our safety risk categories as well as to classify remaining ones. Furthermore, we designed templates to create new, additional prompts and provide sufficient support for each safety risk category in our benchmark. Finally, we adopt adversarial data augmentation methods to create the ALERT_Adv subset of our benchmark. The ALERT benchmark is licensed under the CC BY-NC-SA 4.0 license. The text of the license can be found here.