Skip to content
Snippets Groups Projects
Commit 34f876c3 authored by Gregor Kobsik's avatar Gregor Kobsik
Browse files

define xs and xxs configurations for shapenet

parent 9f66f9b0
No related branches found
No related tags found
No related merge requests found
name: shapenet_xs
dataset: shapenet
# training
epochs: 100
warmup_steps: 0.1
batch_size: 1
accumulate_grad_batches: 1
learning_rate: 0.0003
# architecture
embed_dim: 64
num_heads: 4
num_layers: 16
num_positions: 4096
num_vocab: 3
tree_depth: 6
spatial_dim: 3
gpus: 8
precision: 16
name: shapenet_xxs
dataset: shapenet
# training
epochs: 30
warmup_steps: 0.1
batch_size: 4
accumulate_grad_batches: 1
learning_rate: 0.001
# architecture
embed_dim: 16
num_heads: 2
num_layers: 8
num_positions: 4096
num_vocab: 3
tree_depth: 6
spatial_dim: 3
gpus: 1
precision: 16
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment