The scaling block represents a simple multiplication of each input by the same user-defined scalar value. One of the possible uses is for it is scaling the residual branch of residual connections.
Scalar factor: the real number used to multiply each input.
Stay in the know by signing up for occasional emails with tips, tricks, deep learning insights, product updates, event news and webinar invitations.
We promise not to spam you or share your email with any third party. You can change your preferences at any time. See our privacy policies.
Please check your email inbox account to confirm, set, or update your communication preferences.