One-hot code

One-hot code[1]

Alternative names: One-vs-all (OVA) code, One-against-all (1AA) code, One-vs-rest (OvR) code, \(1\)-in-\(n\) code.

Description

A length-\(n\) binary code whose codewords are those with Hamming weight one. The reverse of this code, where all codewords have Hamming weight \(n-1\) is called a one-cold code.

Realizations

The bi-quinary code, a combination of one-hot 1-in-2 and 1-in-5 one-hot codes to encode decimal digits, was used in several early computers ([2], Ch. 27).Marking the state of a finite automaton [3].Encoding the output of the different classes of a classifier neural network [4]. One-hot codes are the primary codes used in multiclass classification [5–8].

Cousins

Pulse-position modulation (PPM) code— The PPM code is an continuous analogue of the one-hot code.
PPM c-q code— The PPM c-q code is an continuous analogue of the one-hot code designed for transmission through quantum channels.
One-hot quantum code— The one-hot quantum code is the quantum version of the one-hot code.

Member of code lists

Primary Hierarchy

Classical Domain

Binary Kingdom

Binary codeECC

Binary group-orbit codeECC

Linear binary codeLinear \(q\)-ary Linear code over \(\mathbb{Z}_q\) ECC

Cyclic linear binary codeLinear \(q\)-ary Cyclic Constacyclic Skew-cyclic ECC

Parents

Cyclic linear binary code

Constant-weight codeECC

Error-correcting output code (ECOC)ECC

One-hot codes are the primary codes used in multiclass classification [5–8].

One-hot code

References

[1]: Nilsson, Nils J. "Learning machines." (1965).
[2]: Encyclopedia of Computer Science and Technology, Second Edition Volume I (CRC Press, 2017) DOI
[3]: S. Devadas and A. R. Newton, “Decomposition and factorization of sequential finite state machines”, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 8, 1206 (1989) DOI
[4]: Potdar, Kedar, Taher S. Pardawala, and Chinmay D. Pai. "A comparative study of categorical variable encoding techniques for neural network classifiers." International journal of computer applications 175.4 (2017): 7-9.
[5]: L. Rokach, Pattern Classification Using Ensemble Methods (WORLD SCIENTIFIC, 2009) DOI
[6]: G. Anthony, H. Gregg, and M. Tshilidzi, “Image Classification Using SVMs: One-against-One Vs One-against-All”, (2007) arXiv:0711.2914
[7]: K. Potdar, T. S., and C. D., “A Comparative Study of Categorical Variable Encoding Techniques for Neural Network Classifiers”, International Journal of Computer Applications 175, 7 (2017) DOI
[8]: W. Utschick and W. Weichselberger, “Stochastic Organization of Output Codes in Multiclass Learning Problems”, Neural Computation 13, 1065 (2001) DOI

Page edit log

Victor V. Albert (2022-07-14) — most recent

Cite as:

“One-hot code”, The Error Correction Zoo (V. V. Albert & P. Faist, eds.), 2022. https://errorcorrectionzoo.org/c/one_hot

Github: https://github.com/errorcorrectionzoo/eczoo_data/edit/main/codes/classical/bits/easy/one_hot.yml.