As we begin to discuss different algorithms in data mining, many students experience fear.\u00a0 They\u2019ve been warned that the class is hard and, for many, it is beyond their comfort zone. Because of this, the first algorithm we discuss is multiple linear regression as it is a natural extension of the prerequisite\u00a0introductory statistics course.\u00a0 It is nonetheless intimidating.<\/p>\n
It turns out that virtually every college-bound American student has already been introduced to the framework necessary to intuitively understand regression.\u00a0 So, when introducing it, I draw x<\/em> and y<\/em> axes on the whiteboard and a line through the axes\u00a0and then ask the most scared looking student \u201cwhat is the formula for a line?\u201d\u00a0 Like clockwork they respond with \u201cy<\/em> = mx<\/em> + b<\/em>\u201d as if it were indelibly written in their mind.\u00a0 I ask what that means and some student will explain how it works (m<\/em> is the slope, b<\/em> is the intercept, plug in x<\/em> and get y<\/em>).\u00a0 I then tell them that I am going to simply re-write the formula to y<\/em> = b0<\/em> + b1x1<\/em>, and explain how all I have done is re-arrange and re-name things.<\/p>\n I then ask them \u201cwhat if we added a third dimension to our x<\/em> and y<\/em> – what do you think the formula for this plane, instead of a line, would be?\u201d\u00a0 This is a harder question but always a student will get it, saying something along the lines of \u201cy<\/em> = b0<\/em> + b1x1<\/em> + b1z<\/em>.\u201d\u00a0 I usually need to clarify things a bit here and explain that b1<\/em> goes with dimension x1<\/em> so our new component is b2x2<\/em>.\u00a0 \u201cWhat if we add yet another dimension?\u201d\u00a0 By now, the students are beginning to get it: each new dimension merely adds its own new beta<\/em> (bn<\/em>) and its own new variable<\/em> (xn<\/em>).\u00a0 I continue on through more dimensions until whoever I call on can give the correct answer.<\/p>\n At this point, I need to tie it back into how we are actually using it in data mining.\u00a0 The \u2018y<\/em>\u2019 is what we are trying to predict and x<\/em>\u2019s are what we are using to predict.\u00a0 So if I have y<\/em> = b0<\/em> + b1x1<\/em> + b2x2<\/em> + b3x3<\/em> + b4x4<\/em>, and I am trying to predict the price of a used Toyota Corolla with certain variables, I can write out my formula as:<\/p>\n corolla_price<\/em> = b0<\/em> + b1<\/em>*mileage<\/em> + b2<\/em>*mpg<\/em> + b3<\/em>*age<\/em> + b4<\/em>*number_of_doors<\/em>.<\/p>\n When we run our regression algorithm, it will give us the beta weights, which just like our old friend, the formula for a line, we only need to plug in the variable values (e.g., mileage<\/em> for this car is 100,000, mpg<\/em> is 27, etc.), multiply them by their weights and finally sum up the products to get a predicted price.\u00a0 So, a complex yet useful algorithm can be rendered a little more tractable by linking it back to students\u2019 eighth\u00a0grade algebra class.\u00a0 Plus, it helps to ease their transition into a world which will eventually give way to logistic regression and neural networks, both of which are linked back to that little old formula they learned so long ago.<\/p>\n <\/p>\n As we begin to discuss different algorithms in data mining, many students experience fear.\u00a0 They\u2019ve been warned that the class is hard and, for many, it is beyond their comfort zone. Because of this, the first algorithm we discuss is multiple linear regression as it is a natural extension of the prerequisite\u00a0introductory statistics course.\u00a0 It … Continue reading
\n<\u00a0Consumer Behavior Example Content<\/a>\u00a0|\u00a0Data Mining Example Content\u00a0| Teaching Philosophy<\/a>\u00a0><\/h6>\n","protected":false},"excerpt":{"rendered":"