Statistical Methods in Particle Physics (MVSpec)

Learning goals and required knowledge

This course introduces basic concepts and statistical methods used in particle physics. It is a natural follow-up to the PEP4 lecture for bachelor students. Master students can attend this lecture in parallel or after the Particle Physics course.

The concepts and techniques discussed here are also applied in fields different from particle physics. 

Learning goals

• Get to know and apply the toolobx of statistical methods used in particle physics.
• Understand error bars and confidence limits as reported in publications.
• Solid understanding of maximum likelihood and least squares fits.
• From measurement to message: Which conclusion can you draw from your data (and which not)?
• Learn to apply machine learning methods.

Required knowledge

• Basic understanding of experimental particle physics (as taught in the bachelor's course)
• Basic knowledge of Python.

Content

1. Basic concepts
2. Probability distributions
3. Uncertainty
4. Monte Carlo and numerical methods
5. Maximum likelihood estimation
6. Method of least squares
7. Goodness-of-fit and hypothesis testing
8. Confidence limits and intervals
9. Machine Learning
10. Unfolding
11. Analysis Walkthrough
12. Selected topics
    1. Kalman Filtering
    2. Symbolic Regression

Practical Information

Lecture

• Lecture will be in presence
• Thursdays: 16:15 - 17:45, KIP HS-2 (INF 227)
• First Lecture: 17. 10. 2024

Tutorials

• Tutorials will be in presence in the PI CIP Pool
• Please register for one of the two groups
• Group 1 (Fr: 9:00 - 11:00)
• Group 2 (Mo: 16:00 - 18:00)
•  First Tutorial: 18/21. 10. 2024
• Used software: Python + jupyter notebooks
• The KIP Jupyter server can be used to work on the exercises from any browser
• You can also install Jupyter notebooks on your own computer

Registration

• Register through HeiCo for the lecture. Then register for one of the two groups.

Exercise Sheets

• will become available online every week after the lecture.
• can be downloaded from ths web page.
• to be handed in by Wednesday 18:00 of the following week (electronically through the Übungsgruppenverwaltung).
• will be handed out as jupyter notebook.
• should be handed in as jupyter notebook as well or as pdf file (scan of handwritten solution).
• At least 60% of the points are required to qualify for the exam.
• You can upload your .pdf & .ipynb files under https://uebungen.physik.uni-heidelberg.de/uebungen/mygroups

Exam

• Date: to be defined
• will be graded. 

ECTS points

• Lecture and Tutorials: 4 ECTS points

Python

• A large fraction (>50%) of the problems consist of the implementation of statistical methods in Python in the framework of jupyter noebooks.
• A basic level of knopwledge in Python is needed. Advanced modules will be used but special knowledge is not needed prior to the lecture.
• There are several good tutorials and courses on the internet which you can use to acquire a basic programming level.
  • Python course of the lab course PAP
  • Python course at the physics department
  • Stanford Python tutorial
• The tutorials start at the end of the first week and the first problem sheet will be handed out on Thursday of the first week. So you might consider the first few days to go through some of these Python courses.

Literature

• G. Cowan: Statistical Data Analysis
• Behnke, Kroeninger, Schott, Schoerner-Sardenius: Data Analysis in High Energy Physics: A Practical Guide to Statistical Methods
• Claude A. Pruneau: Data Analysis for Physics Scientists
• L. Lista: Statistical Methods for Data Analysis in Particle Physics
• R. Barlow: Statistics: A guide to the Use of Statistical Methods in the Physical Sciences
• Bohm, Zech: Introduction to Statistics and Data Analysis for Physicists
• Blobel, Lohrmann: Statistische Methoden der Datenanalyse
• F. James: Statistical Methods in Experimental physics
• W. Metzger: Statstical Methods in Data Analysis

Software

Practical Programming Tips

 - practical tips (ipynb file)

Random Numbers

 - Random numbers from an arbitrary continous distribution (ipynb file)

 - Random numbers from a multivariate gaussian (ipynb file)

Error Propagation

 - Gaussian error propagation with SymPy (uncorrelated variables) (ipynb file)

 - Gaussian error propagation with SymPy (correlated vaiables) (ipynb file)

Error Ellipse

 - Plot error ellipse (ipynb file)

Maximum Likelihood Fit

 - Simple maximum likelihood fit (ipynb file)

 - Basic least squares fit (ipynb file)

 - Total least squares fit with errors in x and y (ipynb file) 

Übungsblätter

• Blatt 01
  
  • SMIPP_2425_01.ipynb
  • SMIPP_2425_01_solution.ipynb
• Blatt 02
  
  • SMIPP_2425_02.ipynb
  • SMIPP_2425_02_solution.ipynb
• Blatt 03
  
  • SMIPP_2425_03.ipynb
  • SMIPP_2425_03_solution.ipynb
• Blatt 04
  
  • SMIPP_2425_04.ipynb
  • SMIPP_2425_04_solution.ipynb
• Blatt 05
  
  • SMIPP_2425_05.ipynb
  • SMIPP_2425_05_solution.ipynb
• Blatt 06
  
  • SMIPP_2425_06.ipynb
  • SMIPP_2425_06_solution.ipynb
• Blatt 07
  
  • SMIPP_2425_07.ipynb
  • SMIPP_2425_07_solution.ipynb
• Blatt 08
  
  • SMIPP_2425_08.ipynb
  • SMIPP_2425_08_solution.ipynb
• Blatt 09
  
  • SMIPP_2425_09.ipynb

Übungsgruppen

• Gruppe 1 (Hans-Christian Schultz-Coulon)
  12 Teilnehmer/innen
  INF 226 CIP Pool 1.305, Fr 09:00 - 11:00
• Gruppe 2 (Falk Bartels)
  15 Teilnehmer/innen
  INF 226 CIP Pool 1.305, Mo 16:00 - 18:00