Assessing Questionnaire Validity and Reliability on Learning Environment, School-Enterprise Cooperation, Motivation, and Employment Competitiveness
Abstract
Graduate employment outcomes are increasingly regarded as a primary indicator for assessing both the quality and the social value of higher education. With shifting labor market expectations, applied universities in China have placed greater priority on strengthening students’ employability. This research investigates how the learning environment, collaboration between universities and enterprises, and student motivation collectively influence the employment competitiveness of undergraduates at Qingdao Hengxing University. A quantitative strategy rooted in a positivist paradigm was employed, and data were obtained through stratified random sampling with standardized questionnaires tailored to local academic and cultural contexts. A central focus of this study was the validation of the measurement tool. The process involved expert appraisal, exploratory factor analysis (EFA) and assessments of internal consistency using Cronbach’s Alpha. Findings verified the robustness of the 97-item scale, providing strong support for both reliability and construct validity. By offering a validated and contextually relevant instrument, this study advances empirical research on the determinants of employability in applied universities. The results highlight the essential roles of supportive learning environments, university–enterprise partnerships, and student motivation in enhancing employment readiness. This validated framework can guide further investigations and inform practical interventions that align educational practices with labor market demands, thereby improving the competitiveness of graduates in China’s evolving higher education sector.
Downloads
References
Almanasreh, E., Moles, R., & Chen, T. F. (2019). Evaluation of methods used for estimating content validity. Research in social and administrative pharmacy, 15(2), 214-221.
Arranz, N., Arroyabe, M. F., Sena, V., Arranz, C. F., & Fernandez de Arroyabe, J. C. (2022). University-enterprise cooperation for the employability of higher education graduates: a social capital approach. Studies in Higher Education, 47(5), 990-999.
Bartlett, M. S. (1950). Tests of significance in factor analysis. British Journal of Statistical Psychology, 3(2), 77–85. https://doi.org/10.1111/j.2044-8317.1950.tb00285.x
Berk, R. A. (1990). Importance of expert judgment in content-related validity evidence. Western Journal of Nursing Research, 12(5), 659–671. https://doi.org/10.1177/019394599001200510.
Brophy, J. (2004). Motivating students to learn. Routledge.
Chen, X., Chen, Y., Li, D., & Dong, H. (2022). Research on the influence mechanism of university-enterprise collaboration: Evidence From five southern coastal provinces in China. Frontiers in Psychology, 13, 929059.
Chua, Y. P. (2006). Asas statistik penyelidikan [Fundamentals of research statistics]. McGraw-Hill Education.
Chunying, M. (2020). Mediating role of psychological capital in relationships between school-enterprise cooperation and employment of students higher vocational education institutions. Revista de Psicología del Deporte (Journal of Sport Psychology), 29(4), 135-148.
Closs, L., Mahat, M., & Imms, W. (2022). Learning environments’ influence on students’ learning experience in an Australian Faculty of Business and Economics. Learning Environments Research, 25(1), 271–285. https://doi.org/10.1007/s10984-021-09364-7
Creswell, J. W. (2009). Research designs. Qualitative, quantitative, and mixed methods approaches. Sage Publications.
Dacre Pool, L., Qualter, P., & J. Sewell, P. (2014). Exploring the factor structure of the CareerEDGE employability development profile. Education+ training, 56(4), 303-313.
Donald, W. E., Baruch, Y., & Ashleigh, M. (2019). The undergraduate self-perception of employability: Human capital, careers advice, and career ownership. Studies in Higher Education, 44(4), 599–614. https://doi.org/10.1080/03075079.2017.1387107
Drost, E. A. (2011). Validity and reliability in social science research. Education Research and Perspectives, 38(1), 105–123.
El Miedany, Y. (2018). Motivation in Education. In Rheumatology Teaching: The Art and Science of Medical Education (pp. 379-402). Cham: Springer International Publishing.
Fraser, B. J. (2023). The evolution of the field of learning environments research. Education Sciences, 13(3), 257.
Goldman, Z. W., Goodboy, A. K., & Weber, K. (2017). College students’ psychological needs and intrinsic motivation to learn: An examination of self-determination theory. Communication Quarterly, 65(2), 167–191. https://doi.org/10.1080/01463373.2016.1215338
Gottfried, A. E. (1985). Academic intrinsic motivation in elementary and junior high school students. Journal of Educational Psychology, 77(6), 631–645. https://doi.org/10.1037/0022-0663.77.6.631
Griffin, K. (2006). Striving for success: A qualitative exploration of competing theories of high-achieving Black college students' academic motivation. Journal of college student development, 47(4), 384-400.
Hinchliffe, G. W., & Jolly, A. (2011). Graduate identity and employability. British Educational Research Journal, 37(4), 563–584. https://doi.org/10.1080/01411926.2010.482200
Hogan, R., Chamorro-Premuzic, T., & Kaiser, R. B. (2013). Employability and career success: Bridging the gap between theory and reality. Industrial and organizational psychology, 6(1), 3-16.
Izah, S. C., Sylva, L., & Hait, M. (2023). Cronbach's alpha: A cornerstone in ensuring reliability and validity in environmental health assessment. ES Energy & Environment, 23, 1057.
Kaiser, H. F. (1974). An index of factorial simplicity. Psychometrika, 39(1), 31–36. https://doi.org/10.1007/BF02291575
Kassab, S. E., Rathan, R., Taylor, D. C., & Hamdy, H. (2024). The impact of the educational environment on student engagement and academic performance in health professions education. BMC medical education, 24(1), 1278
Kottmann, A., & de Weert, E. (2013). Higher education and the labour market: International policy frameworks for regulating graduate employability. Center for Higher Education Policy Studies (CHEPS).
Krejcie, R. V., & Morgan, D. W. (1970). Determining sample size for research activities. Educational and Psychological Measurement, 30(3), 607–610. https://doi.org/10.1177/001316447003000308
Kuzminov, Y., Sorokin, P., & Froumin, I. (2019). Generic and specific skills as components of human capital: new challenges for education theory and practice. Форсайт, 13(2 (eng)), 19-41.
Lebasi, A., & Talischi, G. (2024). The Impact of Physical Learning Environments on Creativity in Educational Settings: A Systematic Review. Int. J. Archit. Eng. Urban Plan, 34(1).
Lepeley, M. T. (2019). EDUQUALITY: Human Centered Quality Management in Education. A Model for Deployment, Assessment and Sustainability. IAP.
Liang, M., Abdullah, M. K. & Cassy Ompok, C. (2025). Work Concerns and Teacher Effectiveness in China: The Moderating Role of Cultural Norms. Malaysian Journal of Social Sciences and Humanities (MJSSH), 10(3), p. e003277. doi: 10.47405/mjssh.v10i3.3277.
Ligin, N. M., Shin, C., & Ompok, C. C. (2025). Kesahan dan Kebolehpercayaan Instrumen Sokongan Organisasi, Kepuasan Kerja, Ganjaran dan Komitmen Guru. Malaysian Journal of Social Sciences and Humanities (MJSSH), 10(6), e003451-e003451.
Markauskaite, L., Ripley, D., Arthars, N., & Khosronejad, M. (2021). Co-designing for learning across disciplines: Design principles for student-led innovation. In European Association for Research on Learning and Instruction 2021 Online Conference: Book of Abstracts (p. 85). EARLI.
Magnano, P., Craparo, G., & Paolillo, A. (2016). Resilience and emotional intelligence: Which role in achievement motivation. International Journal of Psychological Research, 9(1), 9-20.
McMillan, J. H., & Schumacher, S. (2010). Research in education: Evidence-based inquiry (7th ed.). Pearson Education.
McQuaid, R. W., & Lindsay, C. (2013). The concept of employability. In Employability and local labour markets (pp. 6-28). Routledge.
Monteiro, S., Santos, S., Teixeira, J. N., Torres, L., & Palhares, J. (2025). Determinants of higher education graduates’ employability: a scoping review. Education+ Training, 67(1), 56-74.
Mustafa, N. K., Ibrahim, R., Awang, Z., Aizuddin, A. N., & Junid, S. M. A. S. (2024). Validation of a quantitative instrument measuring critical success factors and acceptance of Casemix system implementation in the total hospital information system in Malaysia. BMJ open, 14(8), e082547.
Nghia, T. L. H., Pham, T., Tomlinson, M., Medica, K., & Thompson, C. (2020). Developing and Utilizing Employability Capitals. Developing and Utilizing Employability Capitals. Routledge.
Okolie, U. C., Nwosu, H. E., & Mlanga, S. (2019). Graduate employability: How the higher education institutions can meet the demand of the labour market. Higher education, skills and work-based learning, 9(4), 620-636.
Qinghua, L. & Ompok, C. S. @ C. C. (2022). The Influence of Social Support on Child-Parent Relationship Among Chinese Mothers of Preschoolers in Penampang, Sabah. Malaysian Journal of Social Sciences and Humanities (MJSSH), 7(11), p. e001880. doi: 10.47405/mjssh.v7i11.1880.
Reinius, H., Korhonen, T., & Hakkarainen, K. (2021). The design of learning spaces matters: Perceived impact of the deskless school on learning and teaching. Learning Environments Research, 24(3), 339-354.
Shaheen, N., Shaheen, A., Ramadan, A., Hefnawy, M. T., Ramadan, A., Ibrahim, I. A., ... & Flouty, O. (2023). Appraising systematic reviews: a comprehensive guide to ensuring validity and reliability. Frontiers in research metrics and analytics, 8, 1268045.
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach's alpha. International journal of medical education, 2, 53.
Tomlinson, M. (2012). Graduate employability: A review of conceptual and empirical themes. Higher education policy, 25(4), 407-431.
Tran, T. T. (2016). Enhancing graduate employability and the need for university-enterprise collaboration. Journal of Teaching and Learning for Graduate Employability, 7(1), 58-71.
Utkirov, A. (2024). Enhancing Alumni Employability: Aligning Higher Education Quality with Workforce Expectations. Available at SSRN 4948534.
Wang, Y., Sangsawang, T., Vipahasna, P. P., Vipahasna, K., & Watkraw, W. (2025). Applying Factor Analysis to Assess Employment Competitiveness Strategies: A Data Science Perspective. Journal of Applied Data Sciences, 6(1), 726-741.
Williams, B., Onsman, A., & Brown, T. (2010). Exploratory factor analysis: A five-step guide for novices. Australasian Journal of Paramedicine, 8(3), 1–13. https://doi.org/10.33151/ajp.8.3.93
Xu, X. (2011). Study on the measurement scale of school–enterprise cooperation behavior [Unpublished master’s thesis].
Yang, Z., Shin, C., & Sharif, S. B. (2025). Classroom engagement in Chinese private colleges: The role of teacher-student interactions and peer relationships. Humanities and Social Sciences Letters, 13(3), 1130–1144. https://doi.org/10.18488/73.v13i3.4390
Yang, Z., & Ompok, C. S. C. C. (2025). “The Relationship Between Peer Relationships and Classroom Engagement Among Undergraduate Private College Students”, Malaysian Journal of Social Sciences and Humanities (MJSSH), 10(4), p. e003271. doi: 10.47405/mjssh.v10i4.3271.
Zhang, Y. C., Zhang, Y., Xiong, X. L., Liu, J. B., & Zhai, R. B. (2022). An empirical study on the improvement of college students’ employability based on university factors. Frontiers in Psychology, 13, 793492.
Zhang, J. (2025). Research on Innovation of Industry-Education Integration Model in Chinese Applied Vocational Universities. Pacific International Journal, 8(3), 110-116.
