maxout

Blend of maximum +‎ dropout; coined in a 2013 paper by Ian J. Goodfellow et al.

maxout (uncountable)

1. A certain approach to neural networks that attempts to improve on the dropout technique. Its activation function is the maximum of the inputs.
   • 2016, George Saon, Tom Sercu, Steven Rennie, Hong-Kwang J. Kuo, “The IBM 2016 English Conversational Telephone Speech Recognition System”, in arXiv‎:

     On the acoustic side, we use a score fusion of three strong models: recurrent nets with maxout activations, very deep convolutional nets with 3x3 kernels, and bidirectional long-short term memory nets which operate on bottleneck features.

• dropout
• softmax