melu by l2l + MetaSGD + second oreder · 0d298f3f31 - Melu_L2L_hyperTunning - DML Git Lab

melu by l2l + MetaSGD + second oreder

master

mohamad maheri 4 years ago

parent

14e32e0afc

commit

0d298f3f31

1 changed files with 1 additions and 1 deletions

Unified View Show Diff Stats

						
							+ 1
							
							- 1
						
learnToLearn.pyView File
								
														# META LEARNING
														
														# META LEARNING
													
														print("META LEARNING PHASE")
														
														print("META LEARNING PHASE")
													
														head = l2l.algorithms.MetaSGD(head, lr=config['local_lr'])
														
														head = l2l.algorithms.MetaSGD(head, lr=config['local_lr'],first_order=True)
													
														head.cuda()
														
														head.cuda()
													
														# Setup optimization
														
														# Setup optimization