Skip to content

GitLab

Explore

Sign in

Primary navigation

Project

Shape Transformer RWKV
- Activity
- Members
- Labels
- Terraform modules
- Incidents
- Contributor analytics
- Model experiments

Snippets Groups Projects

467ca569

Commit 467ca569 authored 3 years ago by Gregor Kobsik

Downloads
- Patches
- Plain Diff

Add Fast Transformer and Recurrent version.

Add DO-Transformer as own Pytorch module.

adjust collate function and architecture factory.

parent 6d1b76df

Loading

Changes 5

Show whitespace changes

Inline Side-by-side

Showing

data/collate/data_collate_factory.py 1 addition, 1 deletion

data/collate/data_collate_factory.py
modules/architecture/architecture_factory.py 9 additions, 0 deletions

modules/architecture/architecture_factory.py
modules/architecture/fast_recurrent_transformer.py 114 additions, 0 deletions

modules/architecture/fast_recurrent_transformer.py
modules/architecture/fast_transformer.py 116 additions, 0 deletions

modules/architecture/fast_transformer.py
modules/architecture/pytorch_transformer.py 119 additions, 0 deletions

modules/architecture/pytorch_transformer.py

with 359 additions and 1 deletion

Loading

0% Loading or .

You are about to add 0 people to the discussion. Proceed with caution.

Finish editing this message first!

Please register or sign in to comment