Statistical Computing - 2023 entry

When we want to fit a statistical model to some data it is almost inevitable that a computer will make this process much easier. Computers can speed up calculations, avoid the tedium or potential for error of doing calculations by hand, and have allowed us to analyse amounts of data and fit new models that were simply impractical without them. Data Science is built on the fitting of statistical models to data. While such models continue to evolve, we must balance what's theoretically and practically possible; otherwise we have data that we can't analyse and models that we can't estimate. We can achieve more by fitting statistical models efficiently.

To efficiently fit statistical models, we often use fundamental mathematical concepts, including some that you will have previously seen, such as matrix decompositions. You will learn a variety of these concepts from the theory behind them to their role in analysing real-life data. You will see some important statistical models that rely on these concepts and how the R programming language can be used for computation, in particular some of its more advanced features for calculations and analysing data. You will gain experience in programming while learning new statistical methods and models, through interesting examples and exercises. After this module you will be able to analyse more complex data with more advanced statistical techniques.

MTH2006 or equivalent is a prerequisite for this module. You may find MTH3041 and MTH3028 helpful and/or of interest.

 

This module aims to help you develop advanced computational and mathematical skills for the statistical analysis of data, which are essential for advanced Data Science. The module will introduce important mathematical concepts and their place in efficiently fitting statistical models or contributing to new statistical models that let us better analyse data. Such skills and models are important for statistical research and for jobs that heavily involve statistical analysis, such as a Data Scientist.

 

On successful completion of this module you should be able to:

 Module Specific Skills and Knowledge:

1. demonstrate an understanding of important mathematical concepts, such as matrix decompositions and optimisation algorithms, and their role in fitting statistical models;

2. apply these concepts to the fitting of various statistical models to data;

3. employ these concepts and fit statistical models to data using the programming language R;

4. demonstrate and compare fitting approaches for computational efficiency;

 Discipline Specific Skills and Knowledge

5. demonstrate an understanding of using computers to fit statistical models to data;

6. progress to study a wider range of computational tools and/or statistical methodology;

 Personal and Key Transferable / Employment Skills and Knowledge:

7. demonstrate an understanding of key computational aspects when fitting statistical models for the advanced study, application and development of statistical and data science.

 

Background in statistical computing: How computers perform calculations, efficiency in computation; computing with programming language R; compiled computer code; debugging, benchmarking and profiling.

Matrix-based computing: Fundamentals of matrices and matrix-based calculations; systems of linear equations; matrix decompositions; statistical applications, e.g. principal components, multivariate normal calculations.

Optimisation: One-dimensional optimisation; multi-dimensional optimisation, including variants of Newton's method; global optimisation; statistical applications, e.g. non-linear model fitting and uncertainty estimation.

Numerical calculus: Numerical and symbolic differentiation; Monte Carlo integration, quadrature, Laplace's method; statistical applications, e.g. the integrated Laplace approximation.

Advanced numerical and statistical methods: E.g. approximate Bayesian computation; discrete and fast Fourier transforms.

*Please refer to reassessment notes for details on deferral vs Referral reassessment 

Deferrals: Reassessment will be by coursework and/or written exam in the deferred element only. For deferred candidates, the module mark will be uncapped. 

Referrals: Reassessment will be by a single exam worth 100% of the module only. As it is a referral, the mark will be capped at 40%.

ELE - http://vle.exeter.ac.uk

Reading list for this module: