- Open Access
Self-care behaviors related to air pollution protection questionnaire: a psychometric analysis
Archives of Public Health volume 78, Article number: 19 (2020)
Air pollution is an environmental health issue that has received much attention due to its harmful effects on public health. The aim of this study was to determine the psychometric properties of the self-care behaviors related to air pollution protection. To this mean, questionnaire responses provided by Iranian college students were analyzed and a Health Belief Model (HBM) determined.
The self-care behavior related to air pollution protection was determined from responses from 301 university students using test item characteristics, face validity, reliability (internal consistency) and construct validity. Moreover, we carried out an exploratory factor analysis (EFA) to determine the factorial structure and explained variance.
Based on Eigenvalues of ≥1.00 and factor loadings of ≥0.40, seven factors were extracted. The calculated Kaiser–Meyer–Olkin value was 0.804. Overall, the seven factors explain 66.39% of the variance in the hypothesized model. Cronbach’s alpha for the measured factors: the perceived susceptibility, severity, barriers, benefits, self-efficacy, cues to action and behavior were 0.85, 0.79, 0.86, 0.66, 0.74, 0.83, and 0.75, respectively.
The analysis of the questionnaire’s reliability and validity properties resulted in good values. The questionnaire is a promising instrument to assess self-care behavior related to air pollution protection from the perspective of college students.
Due to the fact that it causes diseases (such as respiratory, cardiovascular and cancers), the exposure to air pollution has been associated with a decrease of life expectancy and quality of life and with an increase in mortality and morbidity [1,2,3,4,5]. The United Nations Environment Program (UNEP) estimated that, worldwide, approximately 1.1 billion people breathe unhealthy air (approximately 80% of the world population [6, 7] and that the urban air pollution annually is responsible for 4.6 million lost years of healthy life . Therefore, designing and developing preventive programs to reduce the exposure to air pollution is of stringent urgency .
The most important task in the development of preventive programs is the identification of effective determinants , various studies focused in evaluating the behavior of individuals at different ecological levels [11,12,13,14]. Given the complexity of human behavior, psychologists and social scientists have recommended the use of theories and models to identify and explain the fine aspects of human behavior . The focus of health psychology studies is on the factors that influence how people adopt and change health behaviors . It was found that the main factors that influence health behaviors are based on cognitive factors such as beliefs, attitudes and processes used when an individual makes decision . One of the most widely used theories to explain the health behaviors of individuals is the Health Belief Model (HBM) . HBM, as a psychological model, predicts health behaviors by focusing on an individual’s cognitive constructs, attitudes, and beliefs. The key determinants of HBM are: perceived susceptibility, severity, benefits, barriers, self-efficacy, and cues to action . The HBM has also been successfully used to predict and develop health intervention strategies [18, 19]. After the cognizance of the behaviors and related cognitive determinants, one of the most important tools needed for health program planners is designing and developing standard questionnaires to evaluate them. Next, the psychometric evaluation, the most important step in standardizing the developed questionnaires to measure the behaviors and related cognitive determinants  is applied. Considering the lack of studies in developing countries, our study focused on development and psychometric properties of the air pollution self-care behavior questionnaire in a sample of Iranian college students.
Materials and methods
This cross-sectional study was conducted in 2017among301 male and female university students in Kermanshah University of Medical Sciences (KUMS) the west of Iran and 12 experts.
For the questionnaire development, a pool of items based on HBM constructs mentioned by Rosenstock et al. (perceived susceptibility, perceived severity, perceived benefit, perceived barrier, perceived self-efficacy, and cues to action) and behaviors  about self-care behavior related to air pollution protection was used in addition with mechanisms from similar studies [18, 19, 21,22,23,24] and in accordance with expert panel comments. The expert panel included two health policymakers, four environmental health specialists, one health services manager, and five health educators and promoters. Items were carefully written to minimize ambiguity and increase comprehension. In total, the item pool was comprised of 29 items. A five-point Likert type scaling was used for responders, ranging from 1 (strongly disagree) to 5 (strongly agree).
Face validity evaluation
Face validity indicates that the measured elements are apparently capable of measuring the concept of the research. In other words, face validity represents to what extent the items are similar to the subject in terms of appearance, rationality, proportionality, attractiveness, logical sequence of items, utility and importance of the instrument, with an emphasis on the target group’s perspective . The face validity of the self-care behavior related to air pollution protection questionnaire was evaluated qualitatively. Thus, face-to-face individual interviews were held up with 12 experts, their comments analyzed and the necessary modification performed.
Content validity evaluation
Content validity can be defined as the ability of selected items to reflect the characteristics of the construct. Content validity is a way of making sure that the items used are capable of measuring the concept . The self-care behavior related to air pollution protection questionnaire content validity was measured by both quantitative and qualitative methods. In this case, similar to the face validity evaluation, 12 experts were interviewed and their comments about the difficulty, relevance, and the ambiguity were examined, and the items modified based on their comments. In addition, in order to measure quantitative content validity, 12 other experts were interviewed to assess whether each item was “essential”, “useful but not essential”, or “not essential”. The expert comments were used to measure the Content Validity Ratio (CVR) and Content Validity Index (CVI). The CVR is used to ensure that the most important and correct content (item necessity) is selected and CVI is used to ensure that the tool items are optimally designed to measure the content. Based on the Lawshe table, the minimum value for acceptable CVI and CVR items were considered 0.79 and 0.62, respectively [27, 28].
Construct validity evaluation
The construct validity indicates how well a test is up to its claims; this type of validity refers to whether the operational definition of a variable actually reflects the true theoretical meaning of a construct . Construct validity was investigated through the use of Classical Item Analysis (CIA) and Exploratory Factor Analysis (EFA). For this purpose, university students in Kermanshah University of Medical Sciences (KUMS) voluntarily agreed to participate in the study. Evidence shows that five or ten subjects per item are required for factor analysis, while some researchers suggest three samples per item of instrument . In the present study, we considered approximately, eleven subjects for every item of instrument.
KUMS has 4742 students in 7 faculties including (a) dentistry, (b) medical, (c) pharmacy, (d) public health, (e) nutrition and food sciences, (f) nursing & midwifery, and (g) allied medical sciences. To select the participants, a three-step sampling technique (cluster sampling, proportional and randomization) was used. First, each school was considered as a cluster and all seven clusters of KUMS were included in the study. Then, the sample size for each school (cluster) was determined based on its population coverage (the number of students studying there). Finally, due to high numbers of students in each school, the participants for the study were selected randomly using Excel randomization. In total, 319 students from all 7 clusters were selected. From this population, 301 (94.3%) voluntarily agreed to participate in the study and signed the consent form. After that, the volunteers received the self-questionnaire. Finally, the data collected was used to evaluate classical item analysis and exploratory factor analysis. Item analysis was evaluated by using the Corrected Item-Total Correlation (CITC), and items with a CITC less than 0.4 were excluded from the final questionnaire; CITC refers to the correlation between each item and a scale score that excludes that item . To perform exploratory factor analysis, the Kaiser-Meyer-Olkin (KMO) test and Bartlett’s test of sphericity were used to evaluate of sampling adequacy.
The KMO specifies that factor analysis is possible on the data stored. It examines the intensity of correlations between variables or questions; it should be noted that the acceptable value of KMO for a factor analysis is 0.7 . One of the main assumptions in factor analysis is there must be a correlation between variables examined through the use of Bartlett Test of Sphericity .
Factor assumptions and analysis is should be as simple as possible; each factor must be based on factor analysis and evaluated using Bartlett Test of Sphericity . Moreover, EFA with VARIMAX rotation (a cutoff point of 0.4 for factor load) was used to determine the main factors of the inventory. VARIMAX rotation is used to simplify the expression of a particular sub-space in terms of just a few major items . The determined factors were approved by using the scree plot. The scree plot selects the appropriate number of factors in EFA from the Eigenvalues and shows the Eigenvalues on the y-axis and the number of factors on the x-axis. In addition, the cut-offs Eigenvalues of ≥1.00 and factor loadings of ≥0.40 were considered for selected factors . Students in the KUMS represent the inclusion criteria, while lack of interest to participate and incomplete questionnaires were considered as excluded criteria.
The internal consistency was measured by using Cronbach’s Coefficient Alpha of the various components of the HBM. All the data analysis was performed using the statistical package for social sciences (IBM SPSS) (Version 16.0).
The research ethics committee at the deputy of research of KUMS approved the study protocol and monitored the research process (KUMS.REC.1396.438). Furthermore, students had been given adequate information about the purpose of the study. The individual personal information was kept confidentially.
The mean age of participants was 22.35 years [95% CI, 22.12, 22.59], ranged from 19 to 30 years. 52.8%of them were female and approximately 54% were BSc students. About 75.4% of participants were living in student dormitory. 29.9 and 29.6% of the respondents reported that their father had high school and academic education, respectively. In addition, 37.9% of the respondents reported that their mother had only primary school education. 52.2% of the students had average economic status. More details of demographic characteristics of the participants are shown in Table 1.
None of the original twenty-nine items were omitted in the content validity process. The feedback from the panel experts was used to make minor editorial changes. There were three items with less than 0.40 CITC, which were omitted (Table 2).
In addition, the twenty-six finalized items were applied for the explanatory and confirmatory factor analysis. The KMO test, which is the efficiency index of the sampling, was measured at 0.804. Bartlett’s Test was also significant (P < 0.001) which indicated the data is appropriate for factorial analysis. Based on Eigen values of ≥1.00 and factor loadings of ≥0.40, seven factors explain 66.39% of the variance. Furthermore, as it can be seen in Table 3, the estimates of the reliability using Cronbach’s coefficient alpha and the reliability coefficient for the all HBM variables suggested that the internal consistency was adequate. More details of exploratory factor analysis are shown in Table 3.It should be noted that the factor loadings of less than 0.4 are not shown in Table 3. Furthermore, the scree plot diagram of factors is shown in Fig. 1, where the slope of the curve becomes emergent at the seventh point.
Our finding indicated that the internal consistency reliability of each component was equal to 0.66 to 0.86, which suggested that the items within each component of the HBM contributed to the precision of measurement. Overall, the current study indicated that the seven factors explained 66.39% of the variance in the hypothesized model. These findings showed that the questionnaire has acceptable validity and reliability and can be used in studies to assess Iranian students’ beliefs about air pollution prevention behavior. Several studies have been conducted to assess the validity and reliability of environmental health related scale whose methodological approach has been similar to our study [32,33,34]. For example, in Australia, Higginbotham et al. examined the validity and reliability of the environmental distress scale and reported that their scale construct (that includes hazard perception, felt impact changes, loss of solace, threat appraisal and environmental action) has strong (0.79–0.96) internal consistency reliability . In line with our result, Berberoglu and Tosunoglu, in their study among 192 Turkish students stated that Environmental Attitude Scale (EAS) is a reliable and valid measure . Deguen et al. carried out research on 2522 subjects in eight French cities with the aim of assessing the psychometric properties of air quality perception scale and indicated that their scale has good validity and reliability and can be used in studies for investigation of community perceptions of air quality . Fernández-Manzanal et al. showed need to increase environmental education among university students . It should also be acknowledged that educational campuses (such as universities) are unique in terms of access to opportunities for social and cultural advancement . Hence, the availability of standard and native scales can be very useful for assessment and design of interventions.
Our findings indicated that the perceived severity, cues to action, perceived benefit, perceived susceptibility, perceived self-efficacy, perceived barrier, and behavior explained 22.17%, 11.14, 9.55, 7.34, 5.86, 5.49, and 4.81% of the variance in the hypothesized model, respectively. The perceived severity refers to individual feelings on the seriousness of getting an illness or engages in an unhealthy behavior . Several studies have reported that perceived severity can play an important role in explaining health-related behaviors. For example, Claeson et al. indicated that perceived health risk perception was the best predictor of environmentally induced annoyance . The results of a systematic review indicated the perceived severity of air pollution is one of the cognitive determinants of adherence to health advice recommendations of air quality warning systems . In addition, cues to action are the stimulus needed to produce the decision-making to uptake a suggested behavior . Cordano et al. focused on Chile and the United States students and noted that the norms determinant had the strongest association with pro-environmental behavior intention . This is similar to the cues to action investigated in the current study. The perceived benefits were introduced as the third determinant, which played a significant role in estimating the variance of the model. These findings are similar to ones reported by previous researches. In this regard, Claeson et al. suggested if an individual believes that exposure to the material is hazardous, it could be a positive motivation to avoid exposure . Radisic et al. indicated that the perceived benefits of healthy air quality had a significant relationship with air pollution exposure behavior [18, 19]. Actually, cognitive determinants as a theoretical framework for desirable behaviors are used for different types of behaviors. Consequently; a greater focus on social-cognitive determinants of the self-care behaviors related to air pollution protection is an effective and convenient strategy to develop successful preventive interventions.
The first important limitation of this study is that it did not assess the external validation of scale with the goal of establishing relationships to similar scales. The second limitation is that the data collection was just among sample of medical university students in the west of Iran; thus, this result cannot be generalized to other population groups. Finally, the current data collection is based on self-reporting, which often faces the risk of recall bias.
This study offers a useful scale to measure self-care behavior related to air pollution protection and help in the development and planning prevention programs for air pollution for Iranian students. The analysis of the scale’s reliability and validity properties resulted in good values. The scale is a promising instrument to assess self-care behaviors related to air pollution protection from the perspective of university students. This scale could be used by health promotion planners to develop and implement air pollution protection promotion programs.
Availability of data and materials
Please contact the corresponding author for data requests.
Bachelor of Science
Classical Item Analysis
Corrected Item-Total Correlation
Content Validity Index
Content Validity Ratio
Environmental Attitude Scale
Exploratory Factor Analysis
Health Belief Model
Kermanshah University of Medical Sciences
Statistical Package for Social Sciences
World Health Organization
Brunekreef B, Holgate ST. Air pollution and health. Lancet. 2002;360(9341):1233–42.
Brook RD, Rajagopalan S, Pope CA III, Brook JR, Bhatnagar A, Diez-Roux AV, Holguin F, Hong Y, Luepker RV, Mittleman MA, Peters A. Particulate matter air pollution and cardiovascular disease: an update to the scientific statement from the American Heart Association. Circulation. 2010;121(21):2331–78.
Crouse DL, Peters PA, Hystad P, Brook JR, van Donkelaar A, Martin RV, Villeneuve PJ, Jerrett M, Goldberg MS, Pope CA III, Brauer M. Ambient PM2. 5, O3, and NO2 exposures and associations with mortality over 16 years of follow-up in the Canadian census health and environment cohort (CanCHEC). Environ Health Perspect. 2015;123(11):1180–6.
Wang Y, Kloog I, Coull BA, Kosheleva A, Zanobetti A, Schwartz JD. Estimating causal effects of long-term PM2. 5 exposure on mortality in New Jersey. Environ Health Perspect. 2016;124(8):1182–8.
Cohen AJ, Brauer M, Burnett R, Anderson HR, Frostad J, Estep K, Balakrishnan K, Brunekreef B, Dandona L, Dandona R, Feigin V. Estimates and 25-year trends of the global burden of disease attributable to ambient air pollution: an analysis of data from the global burden of diseases study 2015. Lancet. 2017;389(10082):1907–18.
Brauer M, Amann M, Burnett RT, Cohen A, Dentener F, Ezzati M, Henderson SB, Krzyzanowski M, Martin RV, Van Dingenen R, Van Donkelaar A. Exposure assessment for estimation of the global burden of disease attributable to outdoor air pollution. Environ Sci Technol. 2012;46(2):652–60.
Zeng XT, Tong YF, Cui L, Kong XM, Sheng YN, Chen L, Li YP. Population-production-pollution nexus based air pollution management model for alleviating the atmospheric crisis in Beijing, China. J Environ Manag. 2017;197:507–21.
Yakubu O. Addressing environmental health problems in Ogoniland through implementation of United Nations environment program recommendations: environmental management strategies. Environments. 2017;4(2):28.
Jhun I, Gaffin JM, Coull BA, Huffaker MF, Petty CR, Sheehan WJ, Baxi SN, Lai PS, Kang CM, Wolfson JM, Gold DR. School environmental intervention to reduce particulate pollutant exposures for children with asthma. J Allergy Clin Immunol Pract. 2017;5(1):154–9.
Kok G, Gottlieb NH, Peters GJ, Mullen PD, Parcel GS, Ruiter RA, Fernández ME, Markham C, Bartholomew LK. A taxonomy of behaviour change methods: an intervention mapping approach. Health Psychol Rev. 2016;10(3):297–312.
Sun C, Kahn ME, Zheng S. Self-protection investment exacerbates air pollution exposure inequality in urban China. Ecol Econ. 2017;131:468–74.
Hadley MB, Vedanthan R, Fuster V. Air pollution and cardiovascular disease: a window of opportunity. Nat Rev Cardiol. 2018;15(4):193.
Janke K. Air pollution, avoidance behaviour and children's respiratory health: evidence from England. J Health Econ. 2014;38:23–42.
Barnes B. Behavioural change, indoor air pollution and child respiratory health in developing countries: a review. Int J Environ Res Public Health. 2014;11(5):4607–18.
Kok G, Peters LW, Ruiter RA. Planning theory-and evidence-based behavior change interventions: a conceptual review of the intervention mapping protocol. Psicologia: Reflexão e Crítica. 2017;30(1):19.
Kok G. A practical guide to effective behavior change: how to apply theory- and evidence-based behavior change methods in an intervention. European Health Psychologist. 2014;16(5):156–70.
Rosenstock IM, Strecher VJ, Becker MH. Social learning theory and the health belief model. Health Educ Q. 1988;15(2):175–83.
Radisic S, Newbold KB, Eyles J, Williams A. Factors influencing health behaviours in response to the air quality health index: a cross-sectional study in Hamilton. Canada Environ Health Rev. 2016;59(1):17–29.
Radisic S, Newbold KB. Factors influencing health care and service providers’ and their respective “at risk” populations’ adoption of the air quality health index (AQHI): a qualitative study. BMC Health Serv Res. 2016;16(1):107.
Mirzaei-Alavijeh M, Jalilian F. A psychometric analysis of the socio-cognitive determinants questionnaire of type 2 diabetes prevention among a group at risk. Iranian J Endocrinology Metab. 2019;20(5):224–34.
Claeson AS, Lidén E, Nordin M, Nordin S. The role of perceived pollution and health risk perception in annoyance and health symptoms: a population-based study of odorous air pollution. Int Arch Occup Environ Health. 2013;86(3):367–74.
D’Antoni D, Smith L, Auyeung V, Weinman J. Psychosocial and demographic predictors of adherence and non-adherence to health advice accompanying air quality warning systems: a systematic review. Environ Health. 2017;16(1):100.
Cordano M, Welcomer S, Scherer RF, Pradenas L, Parada V. A cross-cultural assessment of three theories of pro-environmental behavior: a comparison between business students of Chile and the United States. Environ Behav. 2011;43(5):634–57.
Straub CL, Leahy JE. Application of a modified health belief model to the pro-environmental behavior of private well water testing. JAWRA J Am Water Resources Assoc. 2014;50(6):1515–26.
Zamanzadeh V, Ghahramanian A, Rassouli M, Abbaszadeh A, Alavi-Majd H, Nikanfar AR. Design and implementation content validity study: development of an instrument for measuring patient-centered communication. J Caring Sci. 2015;4(2):165.
Rubio DM, Berg-Weger M, Tebb SS, Lee ES, Rauch S. Objectifying content validity: conducting a content validity study in social work research. Soc Work Res. 2003;27(2):94–104.
Lawshe CH. A quantitative approach to content validity. Pers Psychol. 1975;28(4):563–75.
Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30(4):459–67.
Heale R, Twycross A. Validity and reliability in quantitative studies. Evidence-Based Nursing. 2015 Jul 1;18(3):66–7.
Knapp TR, Brown JK. Ten measurement commandments that often should be broken. Res Nursing Health. 1995;18(5):465–9.
Hayton JC, Allen DG, Scarpello V. Factor retention decisions in exploratory factor analysis: a tutorial on parallel analysis. Organ Res Methods. 2004;7(2):191–205.
Higginbotham N, Connor L, Albrecht G, Freeman S, Agho K. Validation of an environmental distress scale. EcoHealth. 2006;3(4):245–54.
Berberoglu G, Tosunoglu C. Exploratory and confirmatory factor analyses of an environmental attitude scale (EAS) for Turkish university students. J Environ Educ. 1995;26(3):40–3.
Deguen S, Ségala C, Pédrono G, Mesbah M. A new air quality perception scale for global assessment of air pollution health effects. Risk Analysis. Int J. 2012;32(12):2043–54.
Fernández-Manzanal R, Rodríguez-Barreiro L, Carrasquer J. Evaluation of environmental attitudes: analysis and results of a scale applied to university students. Sci Educ. 2007;91(6):988–1009.
Ogunbode CA. The NEP scale: measuring ecological attitudes/worldviews in an African context. Environ Dev Sustain. 2013;15(6):1477–94.
This research project supported by Kermanshah University of Medical Sciences. We would like to thank deputy of research of Kermanshah University of Medical Sciences for financial support. Also, we special thanks are given to all of the students who participated in this study.
This study was supported by Kermanshah University of Medical Sciences, Kermanshah, Iran. The funding organization has no role in the design of the study, collection, analysis, and interpretation of data and in writing the manuscript this was the role of authors.
Ethics approval and consent to participate
The research ethics committee at the deputy of research of the KUMS had approved the study protocol and had monitored the research process (KUMS.REC.1396.438). Furthermore, students had been given adequate information about the purpose of the study. Individual personal information was kept confidentially.
Consent for publication
The authors declare that there they have no conflicts of interest.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Mirzaei-Alavijeh, M., Jalilian, F., Dragoi, EN. et al. Self-care behaviors related to air pollution protection questionnaire: a psychometric analysis. Arch Public Health 78, 19 (2020). https://doi.org/10.1186/s13690-020-00400-7
- Environmental health
- Health education
- Preventive behavior
- Health promotion