Skip to content

Any detailed results on LoCoMo evaluation? #3

@TianwenZhou

Description

@TianwenZhou

Congrats to your awesome work! Scoring 92.3% on LoCoMo test set is an amazing result, considering the previous SOTA is around 84-85. Therefore, could the authors provide a more detailed result on the evaluation of LoCoMo, e.g. the model's response to each question. Or, at least, a detailed score of questions from each category (i.e. single-hop, multi-hop, etc.). Great thanks!

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions