Livoa LogoLivoa
q
k
v
reshape
(b, head, c, h×w)
q
k
v
input
conv2d
(1,1)
conv2d
(3,3)
q
k
v
q
kT
softmax\n( (qk^T) / sqrt(d_k) )
v

methodology

by dm

0
0 uses