Format Matters: Tables vs. Charts

This is the repository for the paper: [Format Matters: The Robustness of Multimodal LLMs in Reviewing Evidence from Tables and Charts] (AAAI 2026)

Reproduction of Results

• download data.zip
• download outputs.zip

Table 2:

Edit base_path in Line 49 to obtain all results in Table 2.

python3 run_eval.py

Running process

Run the Claim Label Prediction Task for Tables

python3 run_claim_table.py

Run the Claim Label Prediction Task for Charts

python3 run_claim_img.py

Combination

python3 run_claim_combine.py

Evaluation

python3 run_eval.py

The structure of the code in this repository is based on: https://github.com/Alab-NII/SciTabAlign