Recently, I find this word --Inductive bias many times when reading papers. e.g. one of the top answer from stackoverflow writes: pretty much every machine learning model have signifies some inductive bias.
In order to explain what is inductive bias, I need to explain the word- induction,which means experiences or conclusions learned from past. Inductive bias means assumptions sufficient to justify the inference. Take convolution layer for example. we assume that there is local correlation between each cell.They are interactive. For LSTM, we assume correlation in time.
induction a formal entry into an organization or position or office More (Definitions, Synonyms, Translation)
原文:https://www.cnblogs.com/pengzhangzhi/p/14288358.html