 Methodology
 Open Access
 Published:
Locally structured correlation (LSC) plots describe inhomogeneity in normally distributed correlated bivariate variables
Archives of Public Health volume 80, Article number: 30 (2022)
Abstract
Background
The association between bivariate variables may not necessarily be homogeneous throughout the whole range of the variables. We present a new technique to describe inhomogeneity in the association of bivariate variables.
Methods
We consider the correlation of two normally distributed random variables. The 45° diagonal through the origin of coordinates represents the line on which all points would lie if the two variables completely agreed. If the two variables do not completely agree, the points will scatter on both sides of the diagonal and form a cloud. In case of a high association between the variables, the band width of this cloud will be narrow, in case of a low association, the band width will be wide. The band width directly relates to the magnitude of the correlation coefficient. We then determine the Euclidean distances between the diagonal and each point of the bivariate correlation, and rotate the coordinate system clockwise by 45°. The standard deviation of all Euclidean distances, named “global standard deviation”, reflects the band width of all points along the former diagonal. Calculating moving averages of the standard deviation along the former diagonal results in “locally structured standard deviations” and reflect patterns of “locally structured correlations (LSC)”. LSC highlight inhomogeneity of bivariate correlations. We exemplify this technique by analyzing the association between body mass index (BMI) and hip circumference (HC) in 6313 healthy East German adults aged 18 to 70 years.
Results
The correlation between BMI and HC in healthy adults is not homogeneous. LSC is able to identify regions where the predictive power of the bivariate correlation between BMI and HC increases or decreases, and highlights in our example that slim people have a higher association between BMI and HC than obese people.
Conclusion
Locally structured correlations (LSC) identify regions of higher or lower than average correlation between two normally distributed variables.
Background
The association between bivariate variables may not necessarily be homogeneous throughout the whole range of the variables so that the independent variable predicts the criterion variable with different predictive power along the abscissa. This is an old problem, relevant for anthropology, public health, and many other disciplines.
We give a public health example: Slim people have both low body mass index (body weight divided by height square, BMI) and narrow hip circumference (HC). Obese people have both high BMI and a much wider HC. Yet, the strength of this correlation varies along the X and the Yaxis. The correlation appears much better in the slim than in the obese people. We say, the correlation is not homogeneous. Yet, approaching this phenomenon statistically is difficult. When we restrict the range of either one of the variables (i.e. when we either look at only the slim, or only the obese) to better focus on either one group, the resulting correlation coefficient within the restricted range will be reduced [1].
We present a new technique to better describe inhomogeneity in the association of bivariate variables.
Sample
We exemplify the new technique by analyzing data on body mass index (BMI) and hip circumference (HC) in 6313 healthy adults aged 18 to 70 years from former East Germany. Information on height, weight, age, sex and several other anthropometric variables e.g. hip and waist circumference, sitting height, etc. are available. Details of these data and available variables were published elsewhere [2]. Height, weight and HC had been measured following standard procedure [3]. BMI was calculated in the usual way (kg/m^{2}). Sexspecific zscores for BMI and HC were calculated:
Methods
Consider X and Y two normally distributed random variables with X~N(0, 1) and Y~N(0, 1), \( \overline{x} \) and \( \overline{y} \) the arithmetic mean and \( {s_x}^2 \) and \( {s_y}^2 \) the corrected sample variance. If variables X and Y do not have standard normal distribution (e.g. this is the case for BMI and HC in our example of 6,313 healthy adults), ztransformation has to be used first for both variables. The Pearson correlation r between X and Y can be written as
If the two variables completely agreed (which is not the case in measures of BMI and HC), all measurements would lie on the 45° diagonal through the origin of the coordinates. If the two variables do not completely agree (as this is the case in measures of BMI and HC), the measurement points scatter on both sides of the diagonal forming a cloud of measurements. In case of a high association between the variables, the band width of this cloud will be narrow, in case of a low association, the band width will be wide. The band width directly relates to the magnitude of the correlation coefficient. We discuss the case that the two variables do not completely agree, i.e. r > 0. The diagonal can be written as \( g:\overrightarrow{x}=\overrightarrow{a}+t\bullet \overrightarrow{b},t\ \epsilon\ \mathbb{R} \) with \( \overrightarrow{a}=\left(\begin{array}{c}0\\ {}0\end{array}\right),\overrightarrow{b}=\left(\begin{array}{c}1\\ {}1\end{array}\right) \). Therefore
We determine the Euclidean distance d between the diagonal g and any point P(x_{i} y_{i}) ϵ ℝ^{2} with x_{i} ϵ X and y_{i} ϵ Y. With Eq. (2) we get
We calculated the mean squared error (MSE) as the sum of the distance d for all random points P(x_{i} y_{i}) ϵ ℝ^{2} with x_{i} ϵ X and y_{i} ϵ Y.
The observed (corrected) dispersion \( {\hat{s}}^2 \), or band width of the cloud of points alongside of the diagonal is equivalent to what is commonly considered the variance. With (4), the observed (corrected) dispersion \( {\hat{s}}^2 \) can be described by
Similar for r < 0 the dispersion \( {\hat{s}}^2 \) can be described using the same arguments as
With (5) and (6) we get for each r ϵ ℝ, r ≠ 0
In summary, the band width of the scattered points along both sides of the 45° diagonal is directly related to the bivariate Pearson correlation coefficient (Fig. 1.1).
The observed dispersion \( {\hat{s}}^2 \) of a sample derived from the Euclidean distances between the diagonal g and each point (Eqs. 3 and 7), also called “global variance” \( {s}_g^2 \) reflects the average scattering of all points along the diagonal of the original correlation plot, i.e. the “global correlation” r_{g} as given by Pearson correlation between X and Y and the “global standard deviation” s_{g}
In order to identify inhomogeneity in the band width of all points along the former diagonal and therefore to describe the magnitude of the association separately for the slim, for the normal, and for the obese, we compute “locally structured standard deviations” \( {\hat{s}}_{lsc} \) by the following two steps. First, we calculate moving averages [5] of standard deviations to better describe the local magnitude of scattering along the new abscissa. In a second step, the moving averages are smoothed e.g. by using LOESS (Locally Estimated Scatterplot Smoothing) technique [6]. Other smoothing techniques e.g. LOWESS (Locally Weighted Scatterplot Smoothing) or GAM (Generalized Additive Modelling) might be applicable as well.
The resulting smoothed moving averages of the standard deviation is now called “locally structured standard deviations” \( {\hat{s}}_{lsc} \). The pattern of “locally structured standard deviations” \( {\hat{s}}_{lsc} \) reflects the “locally structured correlations” \( {\hat{r}}_{lsc} \), written as
“Locally structured correlations” depict the “local” association between BMI and HC within the full range from slim to normal, and to obese persons.
For all analyses the statistical software R [4] was used.
Results
We exemplify this approach. Figure 1.1 and 1.2 depict the correlation plot for BMI zscores (zBMI) and HC zscores (zHC) in 6313 healthy East German adults. The correlation is not homogeneous, though this may not be immediately visible.
For visualization, we rotate the coordinate system clockwise by 45° (Fig. 1.3 and 1.4) and define two new Cartesian axes. The former diagonal line has now turned into the new abscissa described by \( \frac{zBMI+ zHC}{2} \). The new ordinate is given by \( \frac{zBMI zHC}{2} \). The “global standard deviations” s_{g} between zBMI and zHC of slim, normal and obese people combined are presented as horizontal lines in Fig. 1.5. Figure 1.6 illustrates the “locally structured standard deviations” \( {\hat{s}}_{lsc} \) of zBMI and zHC after smoothing the moving averages of the standard deviation (=local pattern of scattering). In our example, the standard technique for scatterplot smoothing LOESS was used. Figure 1.7 magnifies the pattern of \( {\hat{s}}_{lsc} \). Rotating the coordinate system back by 45° (counterclockwise) (Fig. 1.8 and 1.9) shows the locally structured correlations (LSC) plot and highlights the inhomogeneity of the bivariate correlation between BMI and HC. LSCplots identify regions within correlation plots where the predictive power increases or decreases (increasing or decreasing “locally structured standard deviations” \( {\hat{s}}_{lsc} \)). Predictive power is highest around BMI and HC zvalues between 1 and 0 (low locally structured standard deviations \( {\hat{\mathrm{s}}}_{\mathrm{lsc}} \)) and decreases with increasing BMI and/or HC (high locally structured standard deviations \( {\hat{\mathrm{s}}}_{\mathrm{lsc}} \) ).
Figure 2 illustrates the reciprocal dynamics of locally structured \( {\hat{s}}_{lsc} \) and the locally structured correlation \( {\hat{r}}_{lsc} \). Locally structured correlations \( {\hat{r}}_{lsc} \) indicate regions of higher or lower than average (global) correlation between BMI and HC. Correlation is highest for zBMI or zHCvalues of 1. The correlation decreases for zvalues above 0 indicating an increase of variability in zBMI and zHC and thereby demonstrates a weaker association than average between the two variables. I.e. slim people have a higher association between BMI and HC than obese people.
Negative associations of bivariate variables that are also common in public health can be analyzed in analogy.
Discussion
In public health the interaction between bivariate variables is often described by using the Pearson correlation between these variables. The Pearson correlation assumes homogenous linear relationships but this may not necessarily be the case as we have seen in the example of BMI and HC. Localizing particular areas within which the strength of the interaction between two bivariate variables may be greater or smaller, is not trivial, and also estimating the magnitude of this phenomenon is difficult. Restricting the range of one of the variables (e.g. assessing the association between BMI and HC only in the slim or only the obese) is not an appropriate statistical method.
Restrictions of range reduce the power of an experiment, because correlations are attenuated by reduced variability, a problem well known. The problem of restricted ranges in correlation was first exemplified in the classical study by Thorndike in 1949 [7]. Bland and Altman [1] further discussed this issue and defined restricted ranges of variables on the xaxis but state that a detailed analysis of subgroups within a variable is not appropriate and refer to using regression instead of correlation. Several additional methods exist for correcting correlations for range restriction [8]. Wiberg and Sundström [8] tested two approaches for correcting restricted correlations, but concluded that further studies are necessary – a final solution for the problem is still unknown but widely needed for public health.
Figure 2 illustrates the inhomogeneity of the correlation between zBMI and zHC in our example. In slim people the correlation between zBMI and zHC with r close to 0.9, has a high predictive power, indicating that adults with low BMI are very likely to also have a low HC. The pattern of “locally structured correlation” illustrates the magnitude at which the association between BMI and HC depends on the body’s fat depots.
Many variables such as physical activity, child growth, adult height, income, the association of socioeconomic status and risk of infectious diseases etc. are highly interrelated and usually far from being homogenous [9, 10].
Conclusion
In public health, complex interactions between social, economic and anthropological variables are common. Inhomogeneity in the association of these variables may further jeopardize the understanding of these interactions.
We present a new method for studying local variability within correlation plots of bivariate variables by creating locally structured correlations (LSC). LSC identify regions of higher or lower than average association within the correlation of two normally distributed variables. In contrast to existing statistical methods, locally structured correlations are not based on range restriction, but directly analyze local inhomogeneity along the 45° diagonal axis crossing the origin of coordinates. The new method helps to improve the understanding of complex interactions of variables in public health studies.
Availability of data and materials
Not applicable.
Abbreviations
 BMI:

Body mass index
 HC:

Hip circumference
 LSC:

Locally structured correlation
 zBMI:

zscores for BMI
 zHC:

zscores for hip circumference
 SD:

standard deviation
References
Bland JM, Altman DG. Correlation in restricted ranges of data. BMJ. 2011;342:d556.
Der GH. Körperbau im Erwachsenenalter. Dissertation: Medical Faculty, HumboldtUniversity, Berlin; 1988.
Lohman TG, Roche AF, Martorell R, editors. Anthropometric standardization reference manual. Champaign: Human Kinetics Books; 1988.
R Core Team. R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2003. http://www.Rproject.org/
Sachs L. Statistische Methoden 2. Planung und Auswertung. Berlin. Heidelberg: Springer; 1990.
Irizarry RA. Introduction to data science: Data analysis and prediction algorithms with R. Boca Raton: CRC Press; 2020.
Thorndike RL. Personnel selection: test and measurement techniques. New York: Wiley; 1949.
Wiberg M, Sundström A. A comparison of two approaches to correction of restriction of range in correlation analysis. Pract Assess Res Eval. 2009;14(1):5.
Bogin B. Patterns of Human Growth. Cambridge: Cambridge University Press; 2020.
Eveleth PB, Tanner JM. Worldwide variation in human growth. Cambridge: Cambridge University Press; 1991.
Acknowledgements
We acknowledge the support of the Deutsche Forschungsgemeinschaft and Open Access Publishing Fund of University of Potsdam.
Funding
No funding was received. Open Access funding enabled and organized by Projekt DEAL.
Author information
Affiliations
Contributions
RM, CS und MH developed the idea. RM did the statistical analyses. RM, CS and MH interpreted the results and wrote the manuscript. The authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Mumm, R., Scheffler, C. & Hermanussen, M. Locally structured correlation (LSC) plots describe inhomogeneity in normally distributed correlated bivariate variables. Arch Public Health 80, 30 (2022). https://doi.org/10.1186/s13690021007484
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13690021007484
Keywords
 Standard deviation
 Locally structured standard deviation
 Locally structured correlation
 Variance