Statistical mechanics of an error correcting code using monotonic and nonmonotonic treelike multilayer perceptrons

An error correcting code using a treelike multilayer perceptron is proposed. An original message s⁰ is encoded into a codeword y₀ using a treelike committee machine (committee tree) or a treelike parity machine (parity tree). Based on these architectures, several schemes featuring monotonic or nonmonotonic units are introduced. The codeword y₀ is then transmitted via a binary asymmetric channel where it is corrupted by noise. The analytical performance of these schemes is investigated using the replica method of statistical mechanics. Under some specific conditions, some of the proposed schemes are shown to saturate the Shannon bound at the infinite codeword length limit. The influence of the monotonicity of the units on the performance is also discussed.