mohammadali.sadraei
/
SuperposPrompt_Thesis
Watch 1
Star 0
Fork 0
Code Issues 0 Pull Requests 0 Releases 0 Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
1 Commit
1 Branch
Tree: 6400586fcc
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from '6400586fcc'
${ noResults }
SuperposPrompt_Thesis/09_Cluster/run_hyperparam_effect/config4.yaml

config4.yaml 714B
Raw Blame History

1234567891011121314151617181920212223242526272829303132333435363738 
  1. default: &default

  2.   use_tqdm: true 

  3.   random_seed: 42

  4.   base_save_path: /home/msadraei/trained_final

  5.   model_name: google/t5-base-lm-adapt

  6.   project_name_prefix: hzi_cluster_comp_run

  7.   experiment_name_suffix: null

  8.   train_batch_size: 24

  9.   valid_batch_size: 24

  10.   remove_dropout: true

  11.   learning_rate: 0.01

  12.   weight_decay: 0.01

  13.   num_epochs: 80

  14.   peft_params: null  # no mutation

  15.   hot_modules:

  16.   - sadcl

  17.   - classifier

  18.   best_finder:

  19.     save: True

  20.     metric: valid_mean

  21.     higher_better: true

  22.   tasks:

  23.   - superglue:boolq

  24. 

  25. 

  26. run_configs:

  27. - <<: *default

  28.   peft_params:

  29.     kind: combine

  30.     n_tokens: 10

  31.     n_comb_tokens: 8

  32. 

  33. - <<: *default

  34.   peft_params:

  35.     kind: combine

  36.     n_tokens: 10

  37.     n_comb_tokens: 16