I'm creating animations and instructional videos about neural networks.
Check out my
Patreon and
YouTube channel!
Convolution
The Basic Algorithm
Watch the companion YouTube video: Fundamental Algorithm of Convolution in Neural Networks.
Padding
Companion video: Convolution Padding - Neural Networks
|
|
No Padding AKA "Valid" |
[1,1,1,1] Padding AKA "Same" |
Stride
Companion video: Stride - Convolution in Neural Networks
Stride 1 | Stride 2 |
|
|
No Padding AKA "Valid"; Stride of 1 |
No Padding AKA "Valid"; Stride of 2 |
|
|
[1,1,1,1] Padding AKA "Same"; Stride of 1 |
[1,1,1,1] Padding AKA "Same"; Stride of 2 |
Groups, Depthwise, and Depthwise-Separable
Watch the companion YouTube video: Groups, Depthwise, and Depthwise-Separable Convolution (Neural Networks).
|
|
1 Group |
2 Groups |
|
|
Depthwise (8 Groups) |
Depthwise-separable (8 Groups followed by pointwise) |
Pixel Shuffle
Watch the companion YouTube video: Pixel Shuffle - Changing Resolution with Style
2x2 Block Size
|
|
2x2 Pixel Shuffle |
2x2 Pixel Unshuffle |
|
2x2 Pixel Shuffle/Unshuffle Loop |
3x3 Block Size
|
|
3x3 Pixel Shuffle |
3x3 Pixel Unshuffle |
|
3x3 Pixel Shuffle/Unshuffle Loop |
Licensed under the
MIT License