5.1. Binomial 139
5.2. The Hypergeometric Probability Distribution 146
5.3. The Poisson Distribution 148
5.4. The Exponential Distribution 154
5.5. The Gamma Distribution 158
5.6. The Uniform Distribution 164
5.7. The Beta Distribution 165
5.8. The Normal Distribution 166
5.9. The Chi-Square Distribution 172
5.10. The Lognormal Distribution 174
5.11. The Cauchy Distribution 174
Chapter 6. Sufficient Statistics and their Distributions 179
6.1. Factorization Theorem for Sufficient Statistics 179
6.2. The Exponential Family of Probability Distributions 182
Chapter 7. Chebyshev Inequality, Weak Law of Large Numbers, and Central
Limit Theorem 189
7.1. Chebyshev Inequality 189
7.2. The Probability Limit and the Law of Large Numbers 192
7.3. Central Limit Theorem 195
Chapter 8. Vector Random Variables 199
8.1. Expected Value, Variances, Covariances 203
8.2. Marginal Probability Laws 210
8.3. Conditional Probability Distribution and Conditional Mean 212
8.4. The Multinomial Distribution 216
8.5. Independent Random Vectors 218
8.6. Conditional Expectation and Variance 221
8.7. Expected Values as Predictors 226
8.8. Transformation of Vector Random Variables 235
Chapter 9. Random Matrices 245
9.1. Linearity of Expected Values 245
9.2. Means and Variances of Quadratic Forms in Random Matrices 249
Chapter 10. The Multivariate Normal Probability Distribution 261
10.1. More About the Univariate Case 261
10.2. Definition of Multivariate Normal 264
10.3. Special Case: Bivariate Normal 265
10.4. Multivariate Standard Normal in Higher Dimensions 284
10.5. Higher Moments of the Multivariate Standard Normal 290
10.6. The General Multivariate Normal 299
Chapter 11. The Regression Fallacy 309
Chapter 12. A Simple Example of Estimation 327
12.1. Sample Mean as Estimator of the Location Parameter 327
12.2. Intuition of the Maximum Likelihood Estimator 330
12.3. Variance Estimation and Degrees of Freedom 335
Chapter 13. Estimation Principles and Classification of Estimators 355
13.1. Asymptotic or Large-Sample Properties of Estimators 355
13.2. Small Sample Properties 359
13.3. Comparison Unbiasedness Consistency 362
13.4. The Cramer-Rao Lower Bound 369
13.5. Best Linear Unbiased Without Distribution Assumptions 386
13.6. Maximum Likelihood Estimation 390
13.7. Method of Moments Estimators 396
13.8. M-Estimators 396
13.9. Sufficient Statistics and Estimation 397
13.10. The Likelihood Principle 405
13.11. Bayesian Inference 406
Chapter 14. Interval Estimation 411
|