Commits · master · Nicolay Strohschen / Shape Transformer RWKV · GitLab

Snippets Groups Projects

Feb 24, 2022
- revert latent filtering · 2bd5bc1f
  Moritz Ibing authored 3 years ago
  
  2bd5bc1f
Feb 11, 2022
- bugfix in sequence length check · bb587c24
  Moritz Ibing authored 3 years ago
  
  bb587c24
Feb 03, 2022
- additional changes for latent filtering · fa8bbbe1
  Moritz Ibing authored 3 years ago
  
  fa8bbbe1
Nov 25, 2021
- Filter out unused latents · 4db61e52
  Moritz Ibing authored 3 years ago
  
  4db61e52
Nov 22, 2021
- Merge branch 'master' into BlockConvolutionFix · f6d41286
  Moritz Ibing authored 3 years ago
  
  f6d41286
- Deleted old configs · 5bc9874a
  Moritz Ibing authored 3 years ago
  
  5bc9874a
Nov 19, 2021
- small changes to sampling script · 2443de1b
  Moritz Ibing authored 3 years ago
  
  2443de1b
Nov 16, 2021
- fix bug: error when shape is fully sampled before last layer · 9bd90169
  Gregor Kobsik authored 3 years ago
  
  9bd90169
Nov 12, 2021
- fix bug: · 824fa3b1
  Gregor Kobsik authored 3 years ago
  824fa3b1
Nov 11, 2021
- quickfix: added new generator to match generative head 'composite_D' · e50bb344
  Gregor Kobsik authored 3 years ago
  
  e50bb344
- fix bug: adjust composite B, C, D to new API for recurrent sampling · 00007aae
  Gregor Kobsik authored 3 years ago
  
  00007aae
- Simple fix to pass full information to higher layers · d90b6609
  Moritz Ibing authored 3 years ago
  
  d90b6609
Nov 10, 2021
- Added testing option to main · aa25ef26
  Moritz Ibing authored 3 years ago
  
  aa25ef26
Nov 09, 2021
- Rework loading of 'fast-recurrent' sampler. · 8cf95852
  Gregor Kobsik authored 3 years ago
  
  8cf95852
- renamed token generators · e85530c1
  Gregor Kobsik authored 3 years ago
  e85530c1
- added `double_substitution` as a recurrent generator · c1847c76
  Gregor Kobsik authored 3 years ago
  c1847c76
Nov 08, 2021
- Added composite encodings to recurrent_token_generation · bdb223b0
  Moritz Ibing authored 3 years ago
  
  bdb223b0
- removed "autoregressive" from generator names · ebc7dc56
  Gregor Kobsik authored 3 years ago
  
  ebc7dc56
- Merge remote-tracking branch 'origin/master' into Fast-Transformer · 115a80f8
  Gregor Kobsik authored 3 years ago
  
  115a80f8
- refactored indexing in recurrent generators · 74be0df0
  Gregor Kobsik authored 3 years ago
  74be0df0
- implement the fast recurrent sampler to speed up inference · 578ba724
  Gregor Kobsik authored 3 years ago
  578ba724
Nov 04, 2021
- updated check_sequence_length · 82503b4c
  Moritz Ibing authored 3 years ago
  
  82503b4c
- Reworked composite embeddings · 0a90cbf2
  Moritz Ibing authored 3 years ago
  
  0a90cbf2
Nov 03, 2021
- sum fixes in embeddings + head, as well as new composite embedding and loss · 842a635e
  Moritz Ibing authored 3 years ago
  
  842a635e
- incorporate `pytorch` and `fast` architecture into sampling pipeline · 1f7c86a6
  Gregor Kobsik authored 3 years ago
  
  1f7c86a6
- fix masking in 'fast' architecture · 575f0e5b
  Gregor Kobsik authored 3 years ago
  575f0e5b
Nov 02, 2021
- Merge branch 'Fast-Transformer' · 8e5ef48f
  Gregor Kobsik authored 3 years ago
  
  8e5ef48f
- include `pytorch-fast-transformers` as an optional module · 68aed754
  Gregor Kobsik authored 3 years ago
  
  68aed754
- addition to last bugfix · ed2dc7be
  Moritz Ibing authored 3 years ago
  
  ed2dc7be
Oct 29, 2021
- quick fix for positional encoding in linear head, as it requires a different dimension · 15a2ff10
  Moritz Ibing authored 3 years ago
  
  15a2ff10
- updated heads to allow different embedding dimension and variable number of layers · dc1565de
  Moritz Ibing authored 3 years ago
  
  dc1565de
- Add Fast Transformer and Recurrent version. · 467ca569
  Gregor Kobsik authored 3 years ago
  467ca569
- move padding mask creation allways to forward pass. · 6d1b76df
  Gregor Kobsik authored 3 years ago
  6d1b76df
Oct 28, 2021
- mask "padding token" probability before softmax · 1194c4a4
  Gregor Kobsik authored 3 years ago
  
  1194c4a4
- fix substitution heads · 899737db
  Gregor Kobsik authored 3 years ago
  899737db
- small bugfix in CompositeHeadAutoregressiveA · c5b1f60c
  Moritz Ibing authored 3 years ago
  
  c5b1f60c
- Merge remote-tracking branch 'refs/remotes/origin/TransformerHead' into TransformerHead · 3ad55192
  Moritz Ibing authored 3 years ago
  
  3ad55192
- Added autoregressive heads and sampling · 1ab9c9c9
  Moritz Ibing authored 3 years ago
  
  1ab9c9c9
Oct 27, 2021
- remove token clipping handling in sampler · 9398fdc0
  Gregor Kobsik authored 3 years ago
  9398fdc0
- remove unnecessary overlow/clipping handling in Transformer and Head · 8275ad9f
  Gregor Kobsik authored 3 years ago
  
  8275ad9f