Statistical Data Analysis and Entropy

This book reconsiders statistical methods from the point of view of entropy, and introduces entropy-based approaches for data analysis. Further, it interprets basic statistical methods, such as the chi-square statistic, t-statistic, F-statistic and the maximum likelihood estimation in the context of entropy. In terms of categorical data analysis, the book discusses the entropy correlation coefficient (ECC) and the entropy coefficient of determination (ECD) for measuring association and/or predictive powers in association models, and generalized linear models (GLMs). Through association and GLM frameworks, it also describes ECC and ECD in correlation and regression analyses for continuous random variables. In multivariate statistical analysis, canonical correlation analysis, T²-statistic, and discriminant analysis are discussed in terms of entropy. Moreover, the book explores the efficiency of test procedures in statistical tests of hypotheses using entropy. Lastly, it presents an entropy-based path analysis for structural GLMs, which is applied in factor analysis and latent structure models. Entropy is an important concept for dealing with the uncertainty of systems of random variables and can be applied in statistical methodologies. This book motivates readers, especially young researchers, to address the challenge of new approaches to statistical data analysis and behavior-metric studies.

Nobuoki Eshima was born in Fukuoka, Japan in 1957. He was received B. Sc. and D. Sc. degrees in Mathematics from Kyushu University, Fukuoka, Japan in 1980 and 1993, respectively. In 1993, he joined Department of Statistics, Faculty of General Education, Nagasaki University as Associate Professor. In 1996, he joined Department of Medical Information Analysis, Faculty of Medicine, Oita Medical University as Professor. Since 2003 he is working as a Professor in Faculty of Medicine, Oita University, where the name of affiliation has changed because of combining with another university. From 2016, he is a professor of Center for Educational Outreach and Admissions, Kyoto University. He is an elected member of International Statistical Institute (ISI) and a reviewer for Mathematical Reviews of the American Mathematical Society (AMS).