ridge regression in R?

是 否 +2 论坛币

k人 参与回答

经管之家送您一份

应届毕业生专属福利!

求职就业群

赵安豆老师微信：zhaoandou666

经管之家联合CDA

送您一个全额奖学金名额~ !

立即领取

感谢您参与论坛问题回答

经管之家送您两个论坛币！

+2 论坛币

Is it possible to penalize coefficients toward a number other than zero in a ridge regression in R?

For example, let's say I have dependent variable Y and independent variables X1,X2,X3, and X4. Because of the multicollinear nature of the ivs, ridge regression is appropriate. But say I'm fairly certain that the coefficient of X1 is near 5, X2 is near 1, X3 is near -1, and X4 is near -5.

Is there a ridge package and method in R where I can implement penalties on the coefficients of the ivs that penalize them toward those numbers instead of 0? I'd love to see an example in R with my example data, if possible. Thank you.

扫码加我 拉你入群

请注明：姓名-公司-职位

以便审核进群资格，未注明则拒绝

分享0 收藏0 回帖

关键词：regression regressio regress Ridge DGE possible Because example package number

A simple way to do this is to subtract the "centering value" of the coefficient times its associated variable from the left-hand side. To go with your example,

Y=β1X1+β2X2+β3X3+β4X4+e
Assume the coefficient values should be centered at (5,1,-1,-5) respectively. Then:

Y−5X1−X2+X3+5X4=(β1−5)X1+(β2−1)X2+(β3+1)X3+(β4+5)X4+e
and, redefining terms, you have:

Y∗=β∗1X1+β∗2X2+β∗3X3+β∗4X4+e
A standard ridge regression would shrink the β∗i towards 0, which is equivalent to shrinking the original βi towards the specified centering values. to see this, consider a fully-shrunk β∗4=0, then β4+5=0 and therefore β4=−5. Shrinkage accomplished!

Ridge regression sets a normal prior centered at zero for each parameter. To penalize coefficients towards different values, just center the priors around your target instead of around 0. I think you can accomplish this using the bayesGLM function of the arm package with the following parameters:

prior.mean : set this to vector containing the values you want to use as the centers for your priors (the values you want to penalize "towards")
prior.df : set this to Inf to get normal priors. Possibly not necessary. There should be a way to control your prior variance, but it's not clear to me how this would be accomplished from looking at the documentation.
http://cran.r-project.org/web/packages/arm/arm.pdf