Hostname: page-component-76fb5796d-vfjqv Total loading time: 0 Render date: 2024-04-25T07:28:09.824Z Has data issue: false hasContentIssue false
  • English
  • Français

Prototype-based Models for the Supervised Learning of Classification Schemes

Published online by Cambridge University Press:  30 May 2017

Michael Biehl ,
Barbara Hammer  and
Thomas Villmann
Michael Biehl
Affiliation:
Johann Bernoulli Institute for Mathematics and Computer Science, University of Groningen, P.O. Box 407, 9700 AK Groningen, The Netherlands email: m.biehl@rug.nl
Barbara Hammer
Affiliation:
CITEC Center of Excellence, Bielefeld University, Univ.-Str. 21-23, 33594 Bielefeld, Germany email: bhammer@techfak.uni-bielefeld.de
Thomas Villmann
Affiliation:
Computational Intelligence Group, Univ. of Applied Sciences, Technikumplatz 17, 09648 Mittweida, Germany email: villmann@hs-mittweida.de
Rights & Permissions [Opens in a new window]

Abstract

Core share and HTML view are not available for this content. However, as you have access to this content, a full PDF is available via the ‘Save PDF’ action button.

An introduction is given to the use of prototype-based models in supervised machine learning. The main concept of the framework is to represent previously observed data in terms of so-called prototypes, which reflect typical properties of the data. Together with a suitable, discriminative distance or dissimilarity measure, prototypes can be used for the classification of complex, possibly high-dimensional data. We illustrate the framework in terms of the popular Learning Vector Quantization (LVQ). Most frequently, standard Euclidean distance is employed as a distance measure. We discuss how LVQ can be equipped with more general dissimilarites. Moreover, we introduce relevance learning as a tool for the data-driven optimization of parameterized distances.

Keywords

miscellaneousmethods: data analysistechniques: miscellaneous
Type
Contributed Papers
Information
Proceedings of the International Astronomical Union , Volume 12 , Symposium S325: Astroinformatics , October 2016 , pp. 129 - 138
Copyright
Copyright © International Astronomical Union 2017 

References

Hastie, T., Tibshirani, R. & Friedman, J. 2009, The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Berlin: Springer CrossRefGoogle Scholar
Kohonen, T. 1990, Self-Organizing Maps. Berlin: Springer Google Scholar
Martinetz, T., Berkovich, S. & Schulten, K. 1993 IEEE Trans. Neural Networks, 4, 558–569.Google Scholar
Biehl, M., Hammer, B., Verleysen, M., & Villmann, T. (eds.) 2009, Similiarity based clustering. Berlin: Springer, Lecture Notes in Artificial Intelligence 5400Google Scholar
Biehl, M., Hammer, B., & Villmann, T. 2016, Wiley Interdisciplinary Reviews: Cognitive Science, 7 (2), 92–111 Google Scholar
Cover, T. & Hart, P. 1967, IEEE Trans. Information Theory, 13, 21–27 CrossRefGoogle Scholar
Duda, R., Hart, P., & Stork, D. 2001, Pattern Classification. Hoboken, NJ: Wiley Google Scholar
Hart, P. 1968, IEEE Trans. Information Theory, 14, 515–516 Google Scholar
Nova, D. & Estévez, P. A. 2014, Neural Computing and Appl., 25, 11–524 Google Scholar
Robbins, H. & Monro, S. 1951, The Ann. of Math. Statistics, 22, 405 Google Scholar
Kohonen, T. 1990, In: Proc. Int. Joint Conf. on Neural Networks, Vol. 1, 545–550 Google Scholar
Seo, S., Bode, M., & Obermayer, K. 2003, IEEE Trans. Neural Networks, 14, 390–398CrossRefGoogle Scholar
Sato, A. & Yamada, K. 1996, In: Touretzky, D.S. & Hasselmo, M.E. (eds.), Proc. Adv. in Neural Proc. Information Processing Systems 8. Cambridge, MA: MIT Press, 423–429 Google Scholar
Bottou, L. 1998, In: Saad, D. (ed.), Online Learning and Neural Networks. New York: Cambridge Univ. Press, 9–42 Google Scholar
Sra, S., Nowozin, S., & Wright, S. (eds.) 2011, Optimization for Machine Learning. Cambridge, MA: MIT Press CrossRefGoogle Scholar
Hammer, B. & Villmann, T. 2005, In: Verleysen, M. (ed.) Proc. Europ. Symp. on Artificial Neural Networks. Evere: d-side publishing, 303–316 Google Scholar
Biehl, M., Hammer, B. & Villmann, T. 2014 In: Grandinetti, L., Lippert, T. & Petkov, N. (eds.), Proc. BrainComp2013. Berlin: Springer, Lecture Notes in Computer Science 8603, 110–116 Google Scholar
Mahalonobis, P. 1936, In: Proc. of the National Inst. of Sciences of India, 2, 49–55 Google Scholar
Schölkopf, B. 2001, In: Proc. Adv. in neural information processing systems, 301–307.Google Scholar
Biehl, M., Breitling, R., & Li, Y. 2007, In: Yin, H., Tino, P., Corchado, E., Byrne, W. & Yao, X. (eds.), Proc. Intelligent Data Engineering and Automated Learning, IDEAL. Berlin: Springer, Lecture Notes in Computer Science 4881, 880–889.Google Scholar
Golubitsky, O. & Watt, S. 2010, Int. J. on Document Analysis and Recognition (IJDAR), 13, 133–146 CrossRefGoogle Scholar
Shawe-Taylor, J. & Cristianini, N. 2004, Kernel Methods for Pattern Analysis. New York: Cambridge University Press Google Scholar
Schölkopf, B. & Smola, A. 2002, Learning with Kernels. Cambridge, MA: MIT Press Google Scholar
Villmann, T., Kästner, M., Nebel, D., & Riedel, M. 2012, In: Proc. of the International Conference on Machine Learning Applications (ICMLA). New York: IEEE, 7–10 Google Scholar
Cichocki, A., Zdunek, R., Phan, A., & Amari, S. 2009, Nonnegative Matrix and Tensor Factorizations. Hoboken, NJ: Wiley CrossRefGoogle Scholar
Mwebaze, E., Schneider, P., Schleif, F.-M., Aduwo, J., Quinn, J., Haase, S., Villmann, T., & Biehl, M. 2011, Neurocomputing, 74, 1429–1435 Google Scholar
Lange, M. & Villmann, T. 2013, Machine Learning Reports, MLR-03-2013Google Scholar
Hammer, B. & Villmann, T. 2002, Neural Networks, 15 (8), 1059–1068 CrossRefGoogle Scholar
Schneider, P., Biehl, M., & Hammer, B. 2009, Neural Computation, 21, 3532–3561Google Scholar
Schneider, P., Bunte, K., Stiekema, H., Hammer, B., Villmann, T., & Biehl, M. 2010, IEEE Trans. Neural Networks, 21, 831–840 CrossRefGoogle Scholar
Bunte, K., Schneider, P., Hammer, B., Schleif, F.-M., Villmann, T., & Biehl, M. 2012, Neural Networks, 26, 159–173 Google Scholar
Biehl, M., Bunte, K., & Schneider, P. 2013, PLOS ONE, 8, e59401 CrossRefGoogle Scholar
Arlt, W., Biehl, M., Taylor, A., Hahner, S., Libe, R., Hughes, B., Schneider, P., Smith, D., Stiekema, H., Krone, N., Porfiri, E., Opocher, G., Bertherat, J., Mantero, F., Allolio, B., Terzolo, M., Nightingale, P., Shackleton, C., Bertagna, X., Fassnacht, M., & Stewart, P. 2011, J. Clinical Endocrinology and Metabolism, 44, 1892–1902 Google Scholar
Biehl, M., Schneider, P., Smith, D., Stiekema, H., Taylor, A., Hughes, B., Shackleton, C., Stewart, P. & Arlt, W. 2012 In: Verleysen, M. (ed.) Proc. Europ. Symp. on Artificial Neural Networks (ESANN). Evere: d-side publishing, 423–428 Google Scholar
Leo, Y., Adlard, N., Biehl, M., Juarez, M., Samllie, T., Snow, M., Buckley, C. D., Raza, K., Filer, A., & Scheel-Toellner, D. 2016, Ann. of the Rheumatic Disease, 75, 763–771 Google Scholar
Denecke, A., Wersing, H., Steil, J., & Körner, E. 2009, Neurocomputing, 72, 1470–1482 CrossRefGoogle Scholar
Weinberger, K. & Saul, L. 2009, J. of Machine Learning Res., 10, 207–244 Google Scholar
Backhaus, A., Ashok, P., Praveen, B., Dholakia, K., & Seiffert, U. 2012, In: Verleysen, M. (ed.) Proc. Europ. Symp. on Artificial Neural Networks. Evere: d-side publishing, 411–416 Google Scholar
Boareto, M., Cesar, J., Leite, V., & Caticha, N. 2015, IEEE/ACM Trans. Computational Biology and Bioinformatics, 12 (3), 705–711 Google Scholar
Biehl, M., Hammer, B., Schleif, F.-M., Schneider, P., & Villmann, T. 2015, Proc. Int. Joint Conf. Neural Networks. New York: IEEE, 8 pagesGoogle Scholar
Biehl, M. 2014, website: http://www.cs.rug.nl/~biehl/gmlvq Google Scholar
Fisher, R. 1936, Annual Eugenics, 7, 179–188 Google Scholar
Lichman, M. 2013, UCI machine learning repository, website: http://archive.ics.uci.edu/ml.Google Scholar