Transformer alternative neural architecture AND its open source (:
muellerberndt/cadence
11 likes · 3 reposts · 743 views
Cadence v0.92 lets builders grow a trained brain with new memory tools and outputs, or graft compatible trained regions into another brain.
Build on what you’ve already taught. Give it room to learn more.
Combining skills still takes teaching.
muellerberndt/cadence
6 likes · 2 reposts · 265 views
From the same author: Cadence, a brain-like learning system that keeps learning while it acts, with local plasticity in place of backpropagation. pip install cadence-net
muellerberndt/cadence
Paper: philpapers.org
Cadence is a settling/equilibrium propagation neural net that learns during life. v0.89 adds multi-head attention: The brain can learn to attend to memories keyed by (also learned) compressed representations of meaning. Find the latest release here:
github.com/muellerberndt/cadence/releases t.co
12 likes · 3 reposts · 741 views
New Cadence release just dropped:
github.com/muellerberndt/cadence/releases/tag/v0.…
Roadmap update: Our strategy is to implement bio-inspired mechanisms for sequence processing, attention and short/long-term memory. These should integrate well with Cadence's local settling dynamics. Symbolic reasoning, language capability and self-reflection are all long-term research goals. A Cadence brain is supposed to be able to form an entire sentence in-brain before saying it.
23 likes · 7 reposts · 935 views
Now on the official Cadence GitHub repo:
muellerberndt/cadence t.co
9 likes · 2 reposts · 379 views
Mentions
Transformer alternative neural architecture AND its open source (: muellerberndt/cadence
Cadence v0.92 lets builders grow a trained brain with new memory tools and outputs, or graft compatible trained regions into another brain. Build on what you’ve already taught. Give it room to learn more. Combining skills still takes teaching. muellerberndt/cadence
From the same author: Cadence, a brain-like learning system that keeps learning while it acts, with local plasticity in place of backpropagation. pip install cadence-net muellerberndt/cadence Paper: philpapers.org
Cadence is a settling/equilibrium propagation neural net that learns during life. v0.89 adds multi-head attention: The brain can learn to attend to memories keyed by (also learned) compressed representations of meaning. Find the latest release here: github.com/muellerberndt/cadence/releases t.co
New Cadence release just dropped: github.com/muellerberndt/cadence/releases/tag/v0.… Roadmap update: Our strategy is to implement bio-inspired mechanisms for sequence processing, attention and short/long-term memory. These should integrate well with Cadence's local settling dynamics. Symbolic reasoning, language capability and self-reflection are all long-term research goals. A Cadence brain is supposed to be able to form an entire sentence in-brain before saying it.
Now on the official Cadence GitHub repo: muellerberndt/cadence t.co