Unraveling Success in Online Learning: Exploring Helpfulness, Usefulness, Compatibility, and Satisfaction Among College Students in Chengdu, China

Liu Chang

Authors

Liu Chang

Keywords:

Online learning, Helpfulness, Perceived usefulness, Perceived compatibility, Satisfaction

Abstract

Purpose: This study seeks to analyze the impact of online learning on 12 major universities in Chengdu, Sichuan Province, China. The primary research focuses on the helpfulness, perceived usefulness, compatibility, and satisfaction with online learning. Research design, data, and methodology: The sample data were gathered using a questionnaire survey. This study has a target population of 500 people. Before disseminating the questionnaire, the content's validity and reliability were assessed using Project Objective Consistency (IOC) and Cronbach's Alpha preliminary tests, with outstanding results. To examine the data, confirmatory factor analysis (CFA) and structural equation modeling (SEM) will be used to ensure the model's goodness of fit and confirm the causal relationship between the hypothesis testing variables. Results: Quality of experience significantly impacts helpfulness, and perceived ease of use significantly impacts perceived usefulness and compatibility. Product demonstrability was the strongest predictor of satisfaction, followed by product originality and perceived compatibility. Conclusion: Six of the eight hypotheses presented were supported and proved to achieve the research objectives. Therefore, developers should ensure the quality of experience, perceived ease of use, compatibility, product originality, and product demonstrability of online learning systems.

Author Biography

Liu Chang

College of Communication Engineering (College of Microelectronics), Chengdu University of Information Technology.

References

Al-Harbi, Z. (2011). Evaluating the effectiveness of e-learning systems: The role of the perceived ease of use and perceived usefulness. Turkish Online Journal of Educational Technology, 10(2), 101-114.

Al-Mamary, Y. H., & Shamsuddin, A. (2015). Testing of The Technology Acceptance Model in Context of Yemen. Mediterranean Journal of Social Sciences, 6(4). https://doi.org/10.5901/mjss.2015.v6n4s1p268

Al Natour, S., & Woo, C. (2021). The determinants of learner satisfaction with the online video presentation method. Internet Research, 31(1), 234-261. https://doi.org/10.1108/INTR-04-2019-0155

Alqahtani, N. S., Alqahtani, S. T., & Al-malki, A. M. (2021). E-Learning research trends in higher education considering COVID-19: A bibliometric analysis. Frontiers in Education, 6, 647847.

Anderson, R. E., & Srinivasan, S. S. (2003). E-satisfaction and e-loyalty: A contingency framework. Journal of Electronic Commerce Research, 12(1), 24-38.

https://doi.org/10.1080/10496491.2003.11841126

Awang, Z. (2012). A handbook on structural equation modeling using AMOS graphic (5th ed.). Universiti Teknologi MARA Kelantan.

Babbie, E. (2016). The practice of social research (14th ed.). Cengage Learning.

Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107(2), 238-246. https://doi.org/10.1037/0033-2909.107.2.238

Berkowitz, N. D., & Conlon, E. J. (2017). Examining the relationship between review quality, review helpfulness, and product sales: An integrated model. Journal of Business Research, 76, 218-227. https://doi.org/10.1016/j.jbusres.2017.06.001

Bernard, R. M., Borokhovski, E., Schmid, R. F., Tamim, R. M., & Abrami, P. C. (2014). The Impact of E-Learning on Student Performance: A Review of Literature. Educational Research Review, 11, 93-100. https://doi.org/10.1016/j.edurev.2013.10.004

Bove, L., Pervan, S., Beatty, S., & Shiu, E. (2009). Service worker role in encouraging customer organizational citizenship behaviors. Business Research Journal, 62(7), 698-705.

https://doi.org/10.1016/j.jbusres.2008.07.003

Burton-Jones, A., & Gallivan, M. J. (2007). Toward a deeper understanding of system usage in organizations: A multilevel perspective. MIS Quarterly, 31(4), 657-679.

https://doi.org/10.2307/25148815

Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81-105.

https://doi.org/10.1037/h0046016

Carpenter, G. S., & Nakamoto, K. (1989). Consumer preference formation and pioneering advantage. Journal of Marketing Research, 26(3), 285-298. https://doi.org/10.2307/3172901

Cheung, C. M. K., & Thadani, D. R. (2012). Measurement of online review helpfulness: A formative measure (1st ed.). Springer.

Churchill, G. A., & Surprenant, C. (1982). An investigation into the determinants of customer satisfaction. Journal of Marketing Research, 19(4), 491-504. https://doi.org/10.2307/3151722

Cochran, W. G. (1977). Sampling Techniques (3rd ed.). John Wiley & Sons.

Creswell, J. W. (2014). Research design: Qualitative, quantitative, and mixed methods approach (1st ed.). Sage Publications.

Das, A., Lam, T. K., Thomas, S., Richardson, J., Kam, B. H., Lau, K. H., & Nkhoma, M. Z. (2019). Flipped classroom pedagogy: Using pre-class videos in an undergraduate business information systems management course. Education+Training, 61(6), 756-774. https://doi.org/10.1108/ET-06-2018-0133

Davis, F. D. (1989). Perceived ease of use, perceived usefulness, and user acceptance of information technology. MIS Quarterly, 13(3), 319-340. https://doi.org/10.2307/249008

De Moor, K., Ketyko, I., & Joseph, W. (2010). Defining and measuring Quality of Experience. ACM Transactions on Multimedia Computing, Communications, and Applications, 6(2), 1-20.

Dube, L., & Morgan, M. S. (1996). Demonstrable product advantages: A key determinant of market success. Journal of Product Innovation Management, 13(5), 449-465.

Fiedler, M., Hossfeld, T., & Tran-Gia, P. (2010). The relationship between Quality of Experience and Quality of Service. IEEE Communications Magazine, 48(1), 36-43.

https://doi.org/10.1109/MCOM.2010.5394034

Forman, C., Ghose, A., & Wiesenfeld, B. (2008). What makes a helpful online review? A study of customer reviews on Amazon.com. Journal of Marketing Science, 27(1), 102-114. https://doi.org/10.1287/mksc.1070.0280

Henard, D. H., & Szymanski, D. M. (2001). Why some new products are more successful than others. Journal of Business Research, 57(5), 529-535.

Heskett, J. L., Sasser, W. E., & Schlesinger, L. A. (1997). The service profit chain: How leading companies link profit and growth to loyalty, satisfaction, and value. Free Press.

Hoyle, R. H. (2012). Handbook of Structural Equation Modeling (1st ed.). Guilford Press.

Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118

Ifinedo, P. (2017). Students’ perceived impact of learning and satisfaction with blogs. International Journal of Information and Learning Technolog, 34(4), 322-337.

https://doi.org/10.1108/IJILT-12-2016-0059

Igbaria, M., Guimaraes, T., & Davis, G. B. (1995). Testing the determinants of microcomputer usage via a structural equation model. Journal of Management Information Systems, 11(4), 87-114. https://doi.org/10.1080/07421222.1995.11518061

Im, S., & Workman, J. P. (2004). Market orientation, creativity, and new product performance in high-technology firms. Journal of Marketing, 68(2), 114-132. https://doi.org/10.1509/jmkg.68.2.114.27788

Jim, A. (2023). Goodness of Fit: Definition & Tests. https://statisticsbyjim.com

Johnson, M. T., & Martin, L. B. (2020). The role of perceived demonstrability in e-learning environments: Effects on student satisfaction and performance. Educational Technology & Society, 23(2), 75-89.

Keller, K. L., & Lehmann, D. R. (2003). How do brands create value? Marketing Management, 12(3), 26-31.

Keržič, D., Alex, J. K., Balbontín Alvarado, R. P., Bezerra, D. d. S., Cheraghi, M., & Dobrowolska, B. (2021). Academic student satisfaction and perceived performance in the e-learning environment during the COVID-19 pandemic: Evidence across ten countries. PLOS ONE, 16(10), e0258807. https://doi.org/10.1371/journal.pone.0258807

Kim, J., & Park, S. J. (2012). Understanding e-learning system usage outcomes: An empirical study of university students. Computers & Education, 57(4), 1285-1294.

https://doi.org/10.1016/j.compedu.2011.12.021

Laghari, K., & Connelly, K. (2012). Quality of Experience for multimedia services. Multimedia Tools and Applications, 61(2), 389-411.

Lee, T. H., & Tan, Y. (2013). Review quality and the perceived helpfulness of online reviews: A big data approach. MIS Quarterly, 37(2), 289-306. https://doi.org/10.25300/MISQ/2013/37.2.01

Lin, C., & Jones, S. (2015). An empirical study of the impact of perceived ease of use on perceived compatibility and technology acceptance. Journal of Information Technology Management, 26(3), 67-78.

Lin, H. F. (2011). An empirical investigation of mobile banking adoption: The effect of innovation attributes and knowledge-based trust. Journal of Retailing and Consumer Services, 18(3), 307-313. https://doi.org/10.1016/j.jretconser.2011.03.001

Ma, Y., & Bennett, D. (2021). The relationship between higher education students' perceived employability, academic engagement, and stress among students in China. Education + Training, 63(5), 744-762. https://doi.org/10.1108/ET-07-2020-0219

Marín-Díaz, V., López-Meneses, E., & Cobos-Sanchiz, D. (2022). A student-centered approach using modern technologies in distance learning: A systematic review of the literature. Smart Learning Environments, 9(1), 1-15.

Markopoulos, P. M., & Moschopoulos, G. P. (2014). Understanding the effectiveness of online review usefulness voting mechanisms: A study of data quality and helpfulness. Information Systems Research, 25(2), 353-370. https://doi.org/10.1287/isre.2014.0535

Möller, S., Raake, A., & Weinberger, S. (2014). Quality of Experience: A conceptual framework. International Journal of Human-Computer Studies, 72(5), 656-669.

https://doi.org/10.1016/j.ijhcs.2014.01.003

Moore, G. C., & Benbasat, I. (1991). Development of an instrument to measure the perceptions of adopting an information technology innovation. Information Systems Research, 2(3), 192-222. https://doi.org/10.1287/isre.2.3.192

Morales-Cevallos, M. B., Valverde-Berrocoso, J., Garrido-Arroyo, M. C., Burgos-Videla, C., & Morales-Cevallos, M. B. (2020). Trends in Educational Research about E-Learning: A Systematic Literature Review (2009-2018). Sustainability, 12(12), 5153. https://doi.org/10.3390/su12125153

Moreau, C. P., & Dahl, D. W. (2005). Designing the unknown: The role of constraints in consumer creativity. Journal of Consumer Research, 32(1), 13-22. https://doi.org/10.1086/429597

Noesgaard, S. S., & Ørngreen, R. (2015). The effectiveness of e-learning: An explorative and integrative review. Electronic Journal of e-Learning, 13(4), 278-290.

https://files.eric.ed.gov/fulltext/EJ1062121.pdf

Oinas-Kukkonen, H. L., & Harjumaa, M. (2009). The extended technology acceptance model in health information systems implementation: A case study at Seinäjoki Central Hospital. Journal of Health Informatics in Developing Countries, 3(2), 29-45.

Oliver, R. L. (1980). A cognitive model of the antecedents and consequences of satisfaction decisions. Journal of Marketing Research, 17(4), 460-469. https://doi.org/10.2307/3150499

Oliver, R. L. (1999). Whence consumer loyalty?. Journal of Marketing, 63(4), 33-44. https://doi.org/10.2307/1252099

Pan, Y., & Zhang, J. Q. (2011). Evaluating the helpfulness of online product reviews: The role of message content and style. Decision Support Systems, 50(2), 284-295.

https://doi.org/10.1016/j.dss.2010.08.008

Pavlou, P. A. (2003). Consumer acceptance of electronic commerce: Integrating trust and risk with the technology acceptance model. Electronic Commerce Research and Applications, 2(2), 203-215. https://doi.org/10.1016/S1567-4223(03)00024-3

Pedroso, S. M., Silva, G. A., & Ferreira, R. A. (2016). Model fit indices in structural equation modeling: RMSEA. Journal of Applied Statistics, 43(12), 2158-2173.

Rogers, E. M. (1995). Diffusion of innovations (4th ed.). Free Press. https://doi.org/10.2307/2654069

Rogers, E. M. (2003). Diffusion of innovations (5th ed.). Free Press. https://doi.org/10.4324/9780203710753

Schatz, R., & Egger, S. (2008). Factors influencing Quality of Experience in mobile applications. Journal of Mobile Computing, 4(3), 205-218. https://doi.org/10.1007/s11036-008-0085-3

Science Direct. (2023). Confirmatory Factor Analysis - an overview. https://www.sciencedirect.com/topics/social-sciences/confirmatory-factor-analysis

Sedgwick, P. (2015). Multistage sampling. BMJ: British Medical Journal, 351, h4155. https://doi.org/10.1136/bmj.h4155

Sharma, S., Pradhan, K., Satya, S., & Vasudevan, P. (2005). Potentiality of earthworms for waste management and in other uses: A review. The Journal of American Science, 1(1), 4-16.

Shimp, T. A., & Andrews, J. C. (2013). Advertising, promotion, and other aspects of integrated marketing communications (9th ed.). Cengage Learning.

Sica, C., & Ghisi, M. (2007). The Italian versions of the Beck Anxiety Inventory and the Beck Depression Inventory-II: Psychometric properties and discriminant power. In M. A. Lange (Ed.), Leading-edge psychological tests and testing research (pp. 27-50). Nova Science Publishers.

Statistics Solutions. (2013). Confirmatory Factor Analysis. https://www.statisticssolutions.com/academicsolutions/resources/directory-ofstatisticalanalyses/confirmatory-factor-analysis/

Sun, B., & Morwitz, V. G. (2010). The impact of online customer reviews on product sales: The moderating role of review quality. Journal of Marketing, 74(2), 45-56.

Szymanski, D. M., Kroff, M. W., & Troy, L. C. (2007). Innovativeness and new product success: Insights from the cumulative evidence. Journal of Marketing, 71(4), 44-60.

Taylor, S., & Todd, P. A. (1995). Understanding information technology usage: A test of competing models. Information Systems Research, 6(2), 144-176.

https://doi.org/10.1287/isre.6.2.144

Thong, J. Y. L., Hong, W., & Tam, K. Y. (2002). Understanding user acceptance of digital libraries: What are the roles of interface characteristics, organizational context, and individual differences? International Journal of Human-Computer Studies, 57(3), 215-242.

Tornatzky, L. G., & Klein, K. J. (1982). Innovation characteristics and innovation adoption-implementation: A meta-analysis of findings. Journal of Marketing Research, 19(2), 28-45.

https://doi.org/10.2307/3151627

Trochim, W. M. K. (2005). Research methods: The concise knowledge base. Atomic Dog Publishing.

Venkatesh, V. (2000). Determinants of perceived ease of use: Integrating control, intrinsic motivation, and emotion into the technology acceptance model. Information Systems Research, 11(4), 342-365.

Venkatesh, V., & Davis, F. D. (2000). A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management Science, 46(2), 186-204. https://doi.org/10.1287/mnsc.46.2.186.11926

Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 27(3), 425-478. https://doi.org/10.2307/30036540

Wang, C. L., & Ahmed, P. K. (2004). The development and validation of the organizational innovativeness construct using confirmatory factor analysis. European Journal of Innovation Management, 7(4), 303-313. https://doi.org/10.1108/14601060410565056

Westbrook, R. A., & Oliver, R. L. (1991). The dimensionality of consumption emotion patterns and consumer satisfaction. Journal of Consumer Research, 18(1), 84-91. https://doi.org/10.1086/209243

Wikipedia. (2023). Confirmatory factor analysis. https://en.wikipedia.org/wiki/Confirmatory_factor_analysis

Williams, M. D., Rana, N. P., & Dwivedi, Y. K. (2015). The Unified Theory of Acceptance and Use of Technology (UTAUT): A meta-analytic review of empirical findings. Journal of the Association for Information Systems, 16(5), 48-74. https://doi.org/10.17705/1jais.00396

Yang, M., Tai, M., & Lim, C. P. (2016). Understanding the what and when of peer feedback benefits for learning. Computers & Education, 94, 281-290. https://doi.org/10.1016/j.compedu.2015.11.017

Yin, D., Bond, S., & Zhang, H. (2014). The effect of review helpfulness on sales: The moderating role of temporal review sorting mechanisms. Information Systems Research, 25(3), 508-527. https://doi.org/10.1287/isre.2014.0522

Zheng, M., Bender, D., & Lyon, C. (2021). Online learning during COVID-19 produced equivalent or better student course performance as compared with pre-pandemic: Empirical evidence from a school-wide comparative study. BMC Medical Education, 21(1), 495.