Neural Turing Machines

E899070

Neural Turing Machines are a class of neural network architectures that augment standard networks with differentiable external memory, enabling them to learn algorithmic and sequence-based tasks in a manner analogous to Turing machines.

All labels observed (3)

Label Occurrences
Neural Turing Machines canonical 8
neural RAM 1
neural Turing machines 1

How this entity was disambiguated

Statements (48)

Predicate Object
instanceOf differentiable computer
memory-augmented neural network
neural network architecture
comparedTo Gated Recurrent Unit
Long Short-Term Memory
linked to: LSTM networks
controllerType recurrent neural network
describedInPaper Neural Turing Machines
developedAt Google DeepMind
linked to: DeepMind
field deep learning
machine learning
neural computation
hasAuthor Alex Graves
Greg Wayne
Ivo Danihelka
hasComponent controller network
read head
write head
hasExternalMemory differentiable memory matrix
hasLimitation difficulty scaling to large problems
training instability
hasMemoryAccessMechanism soft attention over memory locations
hasProperty can generalize to longer sequences than seen during training
can learn algorithms from data
end-to-end differentiable
hasPublicationYear 2014
hasSuccessor Differentiable Neural Computer
isInspiredBy Turing machine
neural networks
memoryAddressingType content-based
hybrid addressing
location-based
optimizationObjective sequence prediction loss
task-specific loss
relatedConcept differentiable memory
memory-augmented neural networks
neural RAM
supportsOperation content-based addressing
differentiable read
differentiable write
location-based addressing
trainedWith backpropagation through time
gradient descent
usedFor algorithmic tasks
associative recall task
copy task
repeat-copy task
sequence-based tasks
sorting task

How these facts were elicited

Referenced by (10)

Full triples — surface form annotated when it differs from this entity's canonical label.

Neural Turing Machines hasTitle Neural Turing Machines
Differentiable Neural Computers extends Neural Turing Machines
Differentiable Neural Computers comparedTo Neural Turing Machines
Omniglot benchmarkFor neural Turing machines
linked to: Neural Turing Machines
Greg Wayne notableWork Neural Turing Machines
Greg Wayne coAuthorOf Neural Turing Machines
Ivo Danihelka notableWork Neural Turing Machines
Ivo Danihelka coAuthorOf Neural Turing Machines
Neural Turing Machines describedInPaper Neural Turing Machines
Neural Turing Machines relatedConcept neural RAM
linked to: Neural Turing Machines