Skip to content

In the codes, the positional embedding is SinePE_progress, but in the paper it's rope_progress #9

@splinter21

Description

@splinter21

Why did you use SinePositionalEmbedding_progress in your codes?

class SinePositionalEmbedding_progress(nn.Module):

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions