# Computational Statistics and Data Analysis

winter term 2023/2024
Lecturer: Bereau
44 participants

Course website: https://mvcomp2-w2324.tristanbereau.com/

## Course description

This lecture will introduce basic methods and approaches in computational statistics and data analysis, of great importance to empirical problems in the natural sciences. An overview of relevant concepts and theorems in probability theorey and statistics will be covered, all the way to more modern approaches, including automatic differentiation and machine learning. Lectures will be accompanied by computational exercises in Python. Students will learn to analyze data sets and interpret the results from a solid, thoeretically grounded statistical perspective; devise statistical and machine learning models of experimental situations; infer the parameters of these models from empirical observations; and test hypotheses.

## Prerequisites

• Linear (Matrix) Algebra
• Basic calculus (derivatives & integrals)
• Basic programming skills in Python

## Tentative course outline

1. Basic concepts in probability theory
2. Random variables; expectations, variances, co-variances, and their properties
3. Discrete & continuous probability distributions
4. Moment-generating functions, central limit theorem, and multivariate distributions
5. Statistical models & inference: parameter estimation
6. Hypothesis tests: tests, confidence intervals, bootstrap method
7. Linear regression: least squares, generalized linear model
8. Regularization: Ridge & LASSO regression, MAP estimation
9. Nonlinear regression: basis expansions, neural networks
10. Classification: k-nearest neighbors, logistic regression, linear discriminant analysis
11. Kernel methods: Mercer kernels, Gaussian processes, support vector machines
12. Model selection: Jeffreys scale, BIC, bias-variance tradeoff
13. Dimensionality reduction: principal component analysis, factor analysis
14. (Information theory)

## Practice groups

Computational Statistics and Data Analysis
winter term 2023/2024
Bereau