Comparison against FlexAttention?

[jzhang38]

Thanks for open-sourcing this and congrats!

I was wondering how does this compare against FlexAttention? Is it significantly faster?

[zhengqigao]

Hi guys, I have benchmarked block_sparse_attn against FlexAttention, and can confirm it runs faster.