Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
piercusΒ 
posted an update 6 days ago
Post
229
The Loss is a field with holes πŸ•³οΈβ›³οΈ

πŸ›ž Batch Size is your wheel size.
🏎️ Learning Rate is your speed.

Batch size is the number of holes, or the number of cars. Learning rate is your wheel size (assuming you have enough torque to make it so having a bigger wheel doesn't decrease your wheel RPM).

Β·

But higher LR makes the path more volatile/unstable ? @nroggendorff