Livoa
Discord
Pricing
English
Sign In
q
k
v
reshape
(b, head, c, h×w)
q
k
v
input
conv2d
(1,1)
conv2d
(3,3)
q
k
v
q
k
T
softmax\n( (qk^T) / sqrt(d_k) )
v
methodology
by dm
Use this design
0
0 uses