An Introduction to Linear Regressions Does lake depth affect water column stability? Is the age of a volcanic island related to its distance from a hot spot? Is the soil pH related to the amount of sulfides? Earth scientists can investigate the relationships between these things using linear regressions. Linear regression provides a statistical analysis of the relationship between two variables. A linear change is when one factor changes by a constant amount with respect to a second factor. A line that models this relationship is usually calculated through the least squares method , resulting in the equation `y=mx+b` . If there is a linear relationship, the resulting equation then helps you predict the value of one variable ( `x` or `y` ) based on knowing the value of the other variable. The least squares method is a way to find a line that best fits the data through a calculation to minimize the sum of the squared distance of each point to that line. When Do I Need to Calculate a Linear Regression? Linear regressions are used when you want to determine if there is a linear relationship between two variables . You may need to first plot the data in a scatterplot ( see ' How do I plot points on a graph? ' ) to visually determine if there is a relationship between the two variables, and if that relationship appears linear. The equation of your calculated best-fitting line can then be used to predict values of one variable based on given or known values of the other variable. How Do I Calculate a Linear Regression? Here are the steps to take when using least squares analysis for a linear regression: The active Kilauea Volcano lava flow and cross-section of the Pacific plate near Kilauea, Hawaii (USGS) Provenance: Kilauea Eruption: Anthony Quintano, Creative Commons, via Wikimedia Common. Pacific Plate Cross-section: Joel E. Robinson (US Geological Survey) Reuse: This item is offered under a Creative Commons Attribution-NonCommercial-ShareAlike license http://creativecommons.org/licenses/by-nc-sa/3.0/ You may reuse this item for non-commercial purposes as long as you provide attribution and offer any derivative works under a similar license. We will use a data set with paired variables (where every value for one variable has a corresponding value of the other variable) from the Hawaiian hot spot track to calculate a linear regression. Kilauea is an active volcano forming at the Hawaiian hot spot above a mantle plume. A chain of volcanic islands to the northwest of Kilauea shows the hot spot track over the last 80 million years. The Pacific plate moves northwest over the hot spot, displacing the volcanic islands to the northwest and allowing a new volcanic island to form above the mantle plume. Can we use the distance from the hot spot to determine the age of the older volcanic islands? Data provided are the distance from the hot spot in kilometers (km) and the age of the volcanic islands in millions of years (Ma). How to calculate a linear regression with the least squares method The dependent variable is always plotted on the y-axis (when graphing) and "depends" on the other variable. Rainfall amount could cause a change in hill slope stability, but it isn't possible for hill slope stability to cause a change in rainfall amount. Therefore, rainfall is the independent variable and hill slope is the dependent variable. If you have trouble deciding which are the independent and dependent variables, it may be that one variable does not drive the relationship with the other. This is okay; simply assign one variable as `x` and the other as `y` . Step 1. Decide which variable is the independent variable and which is the dependent variable. For graphing and calculating linear regressions, the independent variable is represented as `x` , and the dependent variable is represented as `y` . Step 2. Calculate `x^2` for every value of `x` , and `y^2` for every value of `y` . For each pair of values, calculate `x xx y` . You can write these values as additional columns in your table to help keep everything organized, like this: Show me how to calculate those values Hide `x^2` `y^2` `x xx y` 0 2 = 0 0.25 2 = 0.0625 0 × 0.25 = 0 300 2 = 90,000 2 2 = 4 300 × 2 = 600 1,800 2 = 3,240,000 20 2 = 400 1,800 × 20 = 36,000 2,600 2 = 6,760,000 28 2 = 784 2,600 × 28 = 72,800 3,500 2 = 12,250,000 42 2 = 1,764 3,500 × 42 = 147,000 4,800 2 = 23,040,000 60 2 = 3,600 4,800 × 60 = 288,000 Step 3 . Now, you will add up some of these values you just calculated. The `Sigma` symbol means "sum of," so in this step, you are adding up all the values for each of these groups. Calculate `Sigmax` , `Sigmay` , `Sigma(x^2)` , `Sigma(y^2)` , and `Sigma(x xx y)` . For example, to calculate `Sigmax` , you will add up all values of `x` , and to calculate `Sigma(y^2)` , you will add up all the values of `y^2` that you calculated in Step 2 . Show me how Hide `Sigmax = 0 + 300 + 1800 + 2600 + 3500 + 4800 = 13000` `Sigmay = 0.25 + 2 + 20 + 28 + 42 + 60 = 152.25` `Sigma(x^2) = 0 + 90000 + 3240000 + 6760000 + 12250000 + 23040000 = 45380000` `Sigma(y^2) = 0.0625+ 4 + 400 + 784 + 1764 + 3600 = 6552.0625` `Sigma(x xx y) = 0 + 600 + 36000 + 72800 + 147000 + 288000 = 544400` You can write these values at the bottom of your table to help keep everything organized, like this: Step 4 . Familiarize yourself with the equation of a line: `y=mx+b` . The `x` and `y` in this equation represent data and will remain as `x` and `y` in the equation. The `m` is the slope of the line, and the `b` is the y-intercept, or where the line crosses the y-axis. Performing linear regression will help you calculate the values for `m` ( Step 5 ) and `b` ( Step 6 ) to replace in the equation. In this example, there are 6 values for `x` and 6 values for `y` , so `n = 6` . Step 5 . Calculate m (slope): `(n(Sigma(x xx y)) – (Sigmax)(Sigmay))/(n(Sigma(x^2)) – (Sigmax)^2)` . This may look complicated, but don't worry! You already calculated the values for each of these components in Step 3 . For this calculation, simply plug in those values that you calculated in Step 3 . Show me how Hide To simplify this calculation, let's start on the top half of the equation (this is called the numerator ): `(n(Sigma(x xx y)) – (Sigmax)(Sigmay))` numerator = `(6(544400) – (13000)(152.25))` numerator = `(3266400 – 1979250)` numerator = `1287150` Now we can calculate the bottom half of the equation (this is called the denominator ): `(n(Sigma(x^2)) – (Sigmax)^2)` denominator = `(6(45380000) – (13000)^2)` denominator = `(272280000 – 169000000)` denominator = `103280000` To finish the calculation, divide the numerator by the denominator: `m = 1287150/103280000 = 0.0125` Here, we have rounded the actual answer from a long decimal string (0.0124627226955848...) to 0.0125 . Step 6 . Calculate b (intercept): `(Sigmay – m(Sigmax))/(n)` numerator = `(152.25 – 0.0125(13000))` numerator = `(152.25 – 162.5)`

numerator = `-10.25` Next, we would calculate the denominator (bottom half of the equation), but this is just `n` ! denominator = `n` denominator = `6` To finish the calculation, divide the numerator by the denominator: `b = -10.25/6 = -1.71` Again, we have rounded the actual answer from a long decimal string (-1.708333333...) to -1.71 . Step 7 . Replace ' b ' and ' m ' in the line equation: `y=mx+b` . From the previous steps, we know: So the final equation of the linear regression is: `y = 0.0125x - 1.71` How to use Excel to calculate a linear regression using the Data Analysis Toolpak Now let's use a statistical analysis tool in Excel to determine a linear regression for the Kilauea volcano data. Step 1. Enter your data into an Excel spreadsheet in two columns. To help visualize the relationship between the variables, create a scatterplot using the Excel graph feature and insert a trendline. A trendline shows you a best fit line for the data on the chart; it is often calculated with a least squares but can be calculated several different ways. Add the trendline: Select the chart area again. Click on "Chart Design" then "Add Chart Element." Select Trendline --> Linear. Step 2. Under the tab "Data," select "Data Analysis." If you do not see "Data Analysis" as an option, you must activate the Data Analysis Toolpak. With a Mac: Tools menu at the top of the screen --> Excel Add-Ins --> Choose from available add-ins --> Check the box for "Analysis Toolpak" and click "Ok." Step 3. Now use the Regression tool on your data. Step 4. Determine the line equation for your data. Write it in the form of `y=mx+b` and look for the `R^2` value. The accompanying correlation coefficient , usually called `R^2` , sometimes `r^2` , measures the strength of the linear relationship between `x` and `y` . The closer the correlation coefficient is to 1.0, the stronger the correlation between `x` and `y` . Values near zero indicate no linear relationship between the variables. The desired value of `R^2` varies depending on the context and field of study. The Summary Output from our volcano data is shown in the figure. `R^2 = 0.994` which indicates a strong correlation, meaning that the ages of the old volcanoes increase as distance from the active volcano increases. Our line equation is `y = 0.0125x - 1.628` . This is because the `y` intercept is negative. Because the slope, `m` , is positive, that indicates a positive linear relationship. A negative slope indicates a negative linear relationship. Step 5. Check to see if this line equation matches what you calculated by hand above. Note that the values of `m` and `b` may differ slightly due to different rounding within the calculations, but they should be close. Do they match? Hurray! You now know how to do a linear regression with two different methods. How Do You Use the Line Equation from the Linear Regression? One of the most important things a scientist does with data is to discover if there is a relationship between two factors. A linear regression shows us if there is a strong positive or negative linear relationship, and that conclusion is often the goal of a study. Another important use of linear regressions is as a tool to solve for an unknown. Once you have a line equation from your linear regression, you can solve for `x` if you have `y` , or solve for `y` if you have `x` . For example, your unknown may be the concentration of a salt or metal in a solution or what the temperature will be at a certain level of carbon dioxide. You are studying an island in the Hawaiian hot spot chain approximately 1000 km from Kilauea. Based on your linear regression, how old are the rocks here? Step 1. Decide which variable is the independent variable and which is the dependent variable. Step 2. Solve for `y` using the line equation you determined for the Hawaiian hot spot in the problem above. Step 3. What does this mean? Show me Hide It tells us that since this island is 1000 km away from Kilauea, its rocks are approximately 10.37 million years old! Where Do You Use Linear Regressions in Earth Science? Determination of the velocity of tectonic plates or seismic waves Determination of the concentration of an unknown solution based on various measurements of standards of known concentrations Relating environmental or ecological responses to a measured factor Determination of the relationship of temperature to gas concentrations or chemical components I am ready to PRACTICE! More Help (Resources for Students) Khan Academy has a review page on linear regression and a chalkboard animation showing a least squares calculation example. This Statistics How To entry includes explanations, examples, and videos. A tutorial on Excel spreadsheets Pages written by Dr. Laura Treible (Savannah State University) and Dr. Melanie Szulczewski (University of Mary Washington).