-
- Downloads
implement the fast recurrent sampler to speed up inference
- add API for token_embedding, transformer_module and generative_head to architecture implementation - extend composite head to process only last depth layer - extend ShapeSampler to accept "recurrent" implementation. TODO: set recurrent sampler for "fast" architecture as default. - implemented recurrent sampler + basic/substitution/composite token generator
Showing
- modules/architecture/fast_recurrent_transformer.py 42 additions, 8 deletionsmodules/architecture/fast_recurrent_transformer.py
- modules/generative_head/composite_head_A.py 14 additions, 7 deletionsmodules/generative_head/composite_head_A.py
- modules/generative_head/composite_head_C.py 4 additions, 1 deletionmodules/generative_head/composite_head_C.py
- sample/layer_sampler/recurrent_sampler.py 93 additions, 0 deletionssample/layer_sampler/recurrent_sampler.py
- sample/layer_sampler/sampler_factory.py 3 additions, 0 deletionssample/layer_sampler/sampler_factory.py
- sample/shape_sampler.py 15 additions, 4 deletionssample/shape_sampler.py
- sample/token_generator/recurrent/__init__.py 3 additions, 0 deletionssample/token_generator/recurrent/__init__.py
- sample/token_generator/recurrent/recurrent_basic_generator.py 158 additions, 0 deletions...le/token_generator/recurrent/recurrent_basic_generator.py
- sample/token_generator/recurrent/recurrent_composite_generator.py 98 additions, 0 deletions...oken_generator/recurrent/recurrent_composite_generator.py
- sample/token_generator/recurrent/recurrent_substitution_generator.py 98 additions, 0 deletions...n_generator/recurrent/recurrent_substitution_generator.py
- sample/token_generator/recurrent/recurrent_token_generator_factory.py 61 additions, 0 deletions..._generator/recurrent/recurrent_token_generator_factory.py
Loading
Please register or sign in to comment