Installation

There are two ways to install promptbench. If you want to simply use as it is, install via pip. If you want to make any changes and play around, install it from source.

We recommend to build virtual environment via anaconda/miniconda or python virtual environment to better manage your python library.

Install via pip

We provide a Python package promptbench for users who want to start evaluation quickly. Simply run

pip install promptbench

Install via github

First, clone the repo:

git clone git@github.com:microsoft/promptbench.git

Then,

cd promptbench

To install the required packages, you can create a conda environment:

conda create --name promptbench python=3.9

then use pip to install required packages:

pip install -r requirements.txt

Note that this only installed basic python packages. For Prompt Attacks, it requires to install textattacks.