Skip to main content

BoN

Best-of-N augmentation search with inline judge evaluation.

Adaptive. Searches: it reads the target's replies and refines its prompts, which is why it needs an attacker model.

A stochastic search over augmentations of the goal.

Helper models​

None. This attack drives no model of its own, so roles can be left out.

Parameters​

Settings for the algorithm itself, written under the attack's parameters. Anything left out keeps its default.

FieldTypeDefaultDescription
stepsinteger (>= 1)4Sequential search steps. Each one sends candidates requests.
candidatesinteger (>= 1)5Independently seeded candidates generated per step.
sigmanumber (> 0.0, <= 1.0)0.4Augmentation strength, from untouched (0) to heavily perturbed (1).
word_scramblingbooleantrueShuffle the middle letters of words.
random_capitalizationbooleantrueRandomly change the case of letters.
ascii_perturbationbooleantrueRandomly shift some characters to nearby ASCII characters.

In a campaign file​

attacks:
- name: bon