Livoa LogoLivoa
(a)
Forget gate
Input gate
Output gate
Q-Kernel
Q-Kernel
Q-Kernel
Q-Kernel
σ
σ
tanh
σ
σ
tanh
×
+
×
Ct-1
ht-1
xt
Ct
yt
ht
xt
ht-1
Ct-1
Ct
yt
ht
(b)
U(xi, w)
U(xj, w)
⎡⎤ ⎢⎥ ⎢⎥ ⎢⎥ ⎢⎥ ⎢⎥ ⎢⎥ ⎣⎦
(c)
H
Rz
Rz
⎡⎤ ⎢⎥ ⎢⎥ ⎢⎥ ⎢⎥ ⎢⎥ ⎢⎥ ⎣⎦
⎡⎤ ⎢⎥ ⎢⎥ ⎢⎥ ⎢⎥ ⎢⎥ ⎢⎥ ⎣⎦

2

by sha

0
0 uses