Fine-Tuning

English Version pytorch
#1

https://d2l.ai/chapter_computer-vision/fine-tuning.html

#3

I find hotdog is 934 in ImageNet

#4

in Exercises4:
in my opinion, we can copy the hotdog_w into the parameters of fc.
image

when i use xavier_uniform_ only, the training process is
image

when i copy hotdog_w into fc in the begining of training, the loss is smaller than before.
image

3 Likes
#5

Hi @min_xu, I was wondering why we update finetune_net.fc.weight.data[0 : , ] to hotdog_w[0] and not finetune_net.fc.weight.data[1 : , ] to hotdog_w[0]. Shouldn’t the 0th index correspond to label 0 and index 1 correspond to label 1 (which indicates that the image contains a hotdog)

#6

How would we go about implementing fine-tuning for a pretrained model that doesn’t support .fc?
I’ve been using alexnet and that doesn’t support .fc

#7

@Danfriedz Try .classifier instead of .fc if you are fine-tuning torchvision.models.alexnet().

#8

im trying to implement vgg16 to finetune, i have changed the classifer[0] for the linear equation. however i keep getting runtime errors saying CUDA is out of memory, is there any other values to change besides making the batch size smaller