You ask a relevant question. Perhaps I give you an excessively large answer… but I like this question very much…
When the frailty (neighborhood variance) is close to null and you are studying neighborhood variables, you are not using 500 information units but almost 30000. So… the lower the influence of the neighborhood, the easier you get “significant” neighborhood level association (if there is some contrast of exposure). This is a very common paradox in neighborhood research… that is reinforced by the fact that “significant” neighborhood level associations are positive results easier to publish. In my opinion the first step in ant contextual analysis is to evaluate the relevance of the contextual boundaries by mean of the frailty, the VPC, the ICC or other measures.
Mixed model/multilevel regression analyses were developed to handle structures with very high “frailty” like repeated measurements (level 1) within individuals (level 2). In this case the intra-individual correlation of the information is always very high and we are just interested in quantifying individual level (i.e., level 2) associations. No one questions the human body’s “effects” on repeated measurements. The problem appears when we apply multilevel regression to systems that like the neighborhoods are not as well defined as in the case of individuals. You can find a larger explanation on these ideas elsewhere. [1] [2].
Another relevant aspect is that in epidemiology and similar disciplines we are simultaneously using two conceptually contradictory approaches (probabilistic and mechanistic). This is the reason of your confusion.
In fact, many epidemiologists become confused when we observe a “significant” association between contextual variables and individual health alongside with tiny general contextual influences (e.g., frailty or VPC close to 0%) [3]. While a statistically significant association is always relevant in the probabilistic approach, it may not be in multilevel analyses investigating individual heterogeneity. This apparent paradox can be solved if we realize that the idea of quantifying general contextual influences by using, for instance, the VPC is completely analogous to the concept of discriminatory accuracy developed in other fields of epidemiology like the study of risk factors and biomarkers [4] [5-7]. It is well recognized that many risk factors and novel biomarkers are not so useful because they have a very low discriminatory accuracy even if they are “significantly” associated with diseases [4].
In your case the neighborhood variables are significantly associated but they have a very low (not high!) discriminatory accuracy.
I explain more extensively these ideas in a recent commentary that is accepted for publication in the American Journal of Epidemiology [8]. It will be published in a near future but I can send you a copy for personal use if you like.
Best whishes
Juan Merlo
References
1. Merlo J, Ohlsson H, Lynch KF, Chaix B, Subramanian SV (2009) Individual and collective bodies: using measures of variance and association in contextual epidemiology. J Epidemiol Community Health 63: 1043-1048.
2. Merlo J, Chaix B, Yang M, Lynch J, Rastam L (2005) A brief conceptual tutorial of multilevel analysis in social epidemiology: linking the statistical concept of clustering to the idea of contextual phenomenon. J Epidemiol Community Health 59: 443-449.
3. Merlo J, Viciana-Fernandez FJ, Ramiro-Farinas D, Research Group of Longitudinal Database of Andalusian P (2012) Bringing the individual back to small-area variation studies: a multilevel analysis of all-cause mortality in Andalusia, Spain. Soc Sci Med 75: 1477-1487.
4. Pepe MS, Janes H, Longton G, Leisenring W, Newcomb P (2004) Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker. Am J Epidemiol 159: 882-890.
5. Merlo J, Wagner P (2013) The tyranny of the averages and the indiscriminate use of risk factors in public health: a call for revolution. European Journal of Epidemiology 28: 148.
6. Wagner P, Merlo J (2013) Measures of discriminatory accuracy in multilevel analysis. European Journal of Epidemiology 28: 135.
7. Merlo J, Wagner P, Juarez S, Mulinari S, Hedblad B (2013) Low discriminatory accuracy questions the use of risk factors. The tyranny of the averages and the indiscriminate use of risk factors and population attributable fractions in Public Health: the case of coronary heart disease. Working paper version 2013-09-26. Unit for Social Epidemiology, Department of Clinical Sciences, Faculty of Medicine, Lund University
http://www.med.lu.se/english/kli ... c_working_papers_c.
8. Merlo J (2014) Multilevel analysis of individual heterogeneity: a fundamental critique of the current probabilistic risk factor epidemiology (invited commentary). American Journal of Epidemiology In press.