Skip to content
Snippets Groups Projects
Select Git revision
  • rwkv
  • master default protected
2 results

shape-transformer-rwkv

  • Clone with SSH
  • Clone with HTTPS
  • Forked from Gregor Kobsik / Shape Transformer
    23 commits behind the upstream repository.
    Gregor Kobsik's avatar
    Gregor Kobsik authored
    - add API for token_embedding, transformer_module and generative_head to architecture implementation
    - extend composite head to process only last depth layer
    - extend ShapeSampler to accept "recurrent" implementation. TODO: set recurrent sampler for "fast" architecture as default.
    - implemented recurrent sampler + basic/substitution/composite token generator
    578ba724
    History