Applied Linear Models I

2020/2021

Academic Year

ENG

Instruction in English

6

ECTS credits

Delivered at:

International Laboratory for Applied Network Research

Course type:

Compulsory course

When:

1 year, 1, 2 module

Instructor

Kuskova, Valentina

Course Syllabus

Abstract

The objective of the discipline "Applied Linear Models I" is of the course is to ensure that students understand topics and principles of applied linear models, basic level. The course is strongly related and complementary to other compulsory courses provided in the first year (e.g. Applied Linear Models II, Contemporary Data Analysis) and sets a crucial prerequisite for later courses and research projects as well as for the master thesis.

Learning Objectives

• The course gives students an important foundation to develop and conduct their own research as well as to evaluate research of others.

Expected Learning Outcomes

• To know the theoretical foundation of applied linear modeling, starting with the univariate models
• To know modern extensions to applied regression, including working with “problem data”
• To know the basic principles behind working with all types of data for building regression models
• Be able to explore the advantages and disadvantages of various linear modeling instruments, and demonstrate how they relate to other methods of analysis
• Be able to work with major linear modeling programs, especially SAS, so that they can use them and interpret their output.
• Be able to develop and/or foster critical reviewing skills of published empirical research using applied statistical methods
• Be able to criticize constructively and determine existing issues with applied linear models in published work
• Have an understanding of the basic principles of linear models and lay the foundation for future learning in the area
• Have the skill to meaningfully develop an appropriate model for the research question
• Have the skill to work with statistical software, required to analyze the data

Course Contents

• Introduction to the Framework of Regression Analysis
  The first session will introduce the main concepts of preparation for regression analysis. We will discuss data types and levels, sampling techniques, variable types and transformations, and graphical representation of the data.
• Simple Linear Regression I
  The session sets up the framework for fitting the linear curve. We will discuss both the algebraic and the geometric meaning of linear regression.
• Simple Linear Regression II
  The session provides the theoretical basis and the derivation of the Ordinary Least Squares (OLS) and the Goodness of Fit measures (Pearson’s r and R2). Practical part will include running and interpreting the regression output in R.
• Statistical Inference in a Simple Linear Regression I
  This sessions builds the understanding of model assumptions and properties of the OLS esti-mates, as well as running and interpreting the Analysis of Variance output.
• Statistical Inference in a Simple Linear Regression II
  This session covers the foundation of the hypothesis testing and building confidence intervals for regression coefficients. Also, we will discuss the derivation of confidence intervals for predictors (for a given criterion) and a criterion (for a given predictor).
• Statistical Inference in a Simple Linear Regression II
  This session will continue the derivation of confidence intervals, provide an understanding of prediction intervals, and discuss regression through the origin.
• Model diagnostics in a Simple Linear Regression
  This session will focus on the residual analysis, including evaluation of regression assumptions of homoscedasticity and normality. We will also look at graphical tools to evaluate the residuals.
• Multivariate regression I
  This session will extend the basics of univariate regression to two independent variables, includ-ing specifics of OLS estimates, goodness of fit, and inference.
• Multivariate regression II
  This session will generalize regression to the multivariate case, with OLS estimates, Goodness of Fit, interpretation of adjusted R2, inference, ANOVA, analysis of residuals.
• Model Building I
  This session will focus on variable selection and information measures (Akaike, Schwarz, ad-justed R2). It will also introduce the use of machine learning for variable selection.
• Model Building II
  This session will continue with building appropriate models, with a special focus on influential observations and multicollinearity.
• Model Building III
  This session introduces variable transformation and models with categorical predictors. Special attention will be paid to coding categorical predictors in SAS.

Assessment Elements

• Quizzes (Best 9 of 10, Varied points)
• Final In-Class or Take-home exam (at the discretion of the instructor)
• Homework Assignments (5 x Varied points)
• In-Class Labs (9-10 x Varied points)

Interim Assessment

• Interim assessment (2 module)
  0.5 * Final In-Class or Take-home exam (at the discretion of the instructor) + 0.2 * Homework Assignments (5 x Varied points) + 0.2 * In-Class Labs (9-10 x Varied points) + 0.1 * Quizzes (Best 9 of 10, Varied points)

Bibliography

Recommended Core Bibliography

• Montgomery, D. C., Vining, G. G., & Peck, E. A. (2012). Introduction to Linear Regression Analysis (Vol. 5th ed). Hoboken, NJ: Wiley. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=1021709
• Weisberg, S. (2005). Applied Linear Regression (Vol. 3rd ed). Hoboken, N.J.: Wiley. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=128514
• Yan, X., Su, X., & World Scientific (Firm). (2009). Linear Regression Analysis: Theory And Computing. Singapore: World Scientific. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=305216

Recommended Additional Bibliography

• Elliott, A. C., & Woodward, W. A. (2016). SAS Essentials : Mastering SAS for Data Analytics (Vol. Second edition). Hoboken, New Jersey: Wiley. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=1051725
• Hocking, R. R. (2013). Methods and Applications of Linear Models : Regression and the Analysis of Variance (Vol. Third edition). Hoboken, New Jersey: Wiley. Retrieved from http://search.ebscohost.com/login.aspx?direct=true&site=eds-live&db=edsebk&AN=603362