Replies: 1 comment
-
Would be awesome to support this! attn_output = einsum(attn_weights, v, "b h s t, b h t d -> b s (h d)") |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I mostly use this lib for tensor computing, and I find it really useful. However, I find that I always need to write several lines of code to implement a simple idea. One example is tensor the product (Kronecker product).
wher I compute b as the kronecker product of a:$b= a\otimes a$ , and I feel this is unnecessarily complicated. I think it would be wonderful if rearrange is supported in einsum.
Beta Was this translation helpful? Give feedback.
All reactions