Please run chmod +x run.sh && ./run.sh to reproduce all experiments. This script will do the following:
- create a conda environment with
python=3.11and install all necessary packages - install the LLM weights (
gpt2,Mistral7B,Llama3-8B, andGemma7b) and queries (for datasetswikitextandpenn treebank) and MNL weights and queries (for datasetsMNISTandEuroSAT) from a public Google Drive link - run all adasoftmax experiments and print results