J A B B Y A I

Loading

Most people here probably remember the Lackera game where you’ve had to get Gendalf to give you a password and the more recent hiring challenge by SplxAI, which interviewed people who could extract a code from the unseen prompt of a model tuned for safety.

There is a simple technique to get a model to do whatever you want that is guaranteed to work on all models unless a guardrail supervises them.

Prompt overflow. Simply have a script send large chunks of text into the chat until you’ve filled about 50-80% of the conversation / prompt size. Due to how the attention mechanism works, it is guaranteed to make the model fully comply with all your subsequent requests regardless of how well it is tuned/aligned for safety.

submitted by /u/UndercoverEcmist
[link] [comments]

Leave a Comment