Sequence Models

LSTM

Inspect forget, input and output gates along the cell-state highway.

Speed ×Step 0 / 4

Gate linear combinations z (f,i,g,o) · 1 × 4

f=σ(zf); i=σ(zi); g=tanh(zg); o=σ(zo)f=0.8176, i=0.69, g=0.7616, o=0.6457

cₜ = fₜ cₜ₋₁ + iₜ gₜ; hₜ = oₜ tanh(cₜ)

0.8176 × 0 + 0.69 × 0.7616

Cell state = 0.5255; hidden state = 0.3112

Opening this lab…

No account required. Local images and model files stay in your browser. Educational models demonstrate mechanisms; they are not production predictors.

LSTM

Continue exploring