How to calculate the number of parameters of AlexNet?
computer-vision, conv-neural-network
Solution
Your calculations are correct. We came up with the exact same number independently while writing this blog post. I have also added the final table from the post
Problem
i haven't found a calculation of parameters (weights + biases) of AlexNet so I tried to calculate it, but I'm not sure if its correct: conv1: (11*11)*3*96 + 96 = 34944 conv2: (5*5)*96*256 + 256 = 614656 conv3: (3*3)*256*384 + 384 = 885120 conv4: (3*3)*384*384 + 384 = 1327488 conv5: (3*3)*384*256 + 256 = 884992 fc1: (6*6)*256*4096 + 4096 = 37752832 fc2: 4096*4096 + 4096 = 16781312 fc3: 4096*1000 + 1000 = 4097000 this results in a total amount of 62378344 parameters. Is that calculation right?