Rate Like An Expert: Bridging The Gap Between Rater’s Knowledge And Ratee’s Self-Efficacy
Abstract
Abstract Views: 292
This paper aims to investigate the role of an expert rater (knowledgeable and experienced) in predicting the ratee’s self-efficacy (SE) through fair procedures (procedural justice). Performance appraisal (PA) research has been of particular interest to researchers, and the role of the rater in determining the positive reactions has been under-researched. The role of the rater-ratee relationship has been the main focus of all rater-centric studies. However, the role of the rater’s expertise, i.e., knowledge and experience, has not been tested regarding ratee reactions. In this regard, we take the perspective of the systems theory and echelon theory to see the role of the rater’s knowledge, experience, and procedural justice (PJ) on the ratee’s SE. A survey questionnaire is used to collect data from 252 respondents from different sectors of the economy. Data were analyzed using SmartPLS-3. Results show that the rater’s knowledge does not directly predict the ratee’s SE. However, the rater’s knowledge predicts ratee’s SE indirectly through PJ and the rater’s experience moderates the indirect relationship between rater’s knowledge and ratee’s SE through PJ. The study provides important insights for policymakers regarding using expert raters who are knowledgeable and experienced to produce positive ratee reactions through fair processes.
Downloads
References
Bandura, A. (1997). Self-Efficacy: The exercise of control. Worth Publishers.
Barbieri, M., Micacchi, L., Vidè, F., & Valotti, G. (2021). The performance of performance appraisal systems: A theoretical framework for public organizations. Review of Public Personnel Administration, e0734371X211043560. https://doi.org/10.1177/0734371X211043560
Baron, R. M., & Kenny, D. A. (1986). The moderator–mediator variable distinction in social psychological research: Conceptual, strategic, and statistical considerations. Journal of Personality Social Psychology, 51(6), 1173-1182.
Batista-Foguet, J. M., Saris, W., Boyatzis, R. E., Serlavos, R., & Velasco Moreno, F. (2018). Multisource assessment for development purposes: Revisiting the methodology of data analysis. Frontiers in Psychology, 9, 1-16. https://doi.org/10.3389/fpsyg.2018.02646
Bradley, J. H., Paul, R., & Seeman, E. (2006). Analyzing the structure of expert knowledge. Information & Management, 43(1), 77-91. https://doi.org/10.1016/j.im.2004.11.009
Çelik, D. A., Yeloğlu, H. O., & Yıldırım, O. B. (2016). The moderating role of self efficacy on the perceptions of justice and turnover intentions. Procedia - Social and Behavioral Sciences, 235, 392-402. https://doi.org/10.1016/j.sbspro.2016.11.049
Chang, S., Witteloostuijn, A., & Eden, L. (2010). From the editors: Common method variance in international research. Journal of International Business Studies, 41, 178-184.
https://doi.org/10.f057/jibs.2009.88
Colquitt. (2001). On the dimensionality of organizational justice: A construct validation of a measure. Journal of Applied Psychology, 86(3), 386-400. https://doi.org/10.1037/0021-9010.86.3.386
Colquitt, & Zipay, K. P. (2015). Justice, fairness, and employee reactions. Annual Review of Organizational Psychology and Organizational Behavior, 2(1), 75-99. https://doi.org/10.1146/annurev-orgpsych-
-111457
Colquitt, J. A., & Rodell, J. B. (2011). Justice, trust, and trustworthiness: A longitudinal analysis integrating three theoretical perspectives. Academy of Management Journal, 54(6), 1183-1206. https://doi.org/10.5465/amj.2007.0572
DeNisi, A. (2003). A cognitive approach to performance appraisal.
Routledge.
DeNisi, A., & Murphy, K. R. (2017). Performance appraisal and performance management: 100 years of progress? Journal of Applied Psychology, 102(3), 421-433. https://doi.org/10.1037/apl0000085
Dong, Y., Bartol, K. M., Zhang, Z.-X., & Li, C. (2017). Enhancing employee creativity via individual skill development and team knowledge sharing: Influences of dual-focused transformational leadership. Journal of Organizational Behavior, 38(3), 439-458. https://doi.org/10.1002/job.2134
Ehrenberg, R. G., Smith, R. S., & Hallock, K. F. (2021). Modern labor economics: Theory and public policy. Routledge.
Ericsson, K. A., Hoffman, R. R., Kozbelt, A., & Williams, A. M. (2018). The cambridge handbook of expertise and expert performance. Cambridge University Press.
Evans, E. M., & Mcshane, S. L. (1988). Employee perceptions of performance appraisal fairness in two organizations. Canadian Journal of Behavioural Science, 20(2), 171-191.
Govaerts, M. J., Schuwirth, L. W., Van der Vleuten, C. P., & Muijtjens, A.
M. (2011). Workplace-based assessment: Effects of rater expertise. Adv Health Sci Educ Theory Pract, 16(2), 151-165. https://doi.org/10.1007/s10459-010-9250-7
Hair, J. F., Hult, G. T. M., Ringle, C. M., & Sarstedt, M. (2017). A primer on partial least squares structural equation modeling (PLS-SEM) (2nd ed.). Sage publications.
Hambrick, D. C., & Mason, P. A. (1984). Upper echelons: The organization as a reflection of its top managers. Academy of Management Review, 9(2), 193-206.
Hayes, A. F. (2009). Beyond baron and kenny: Statistical mediation analysis in the new millennium. Communication Monographs, 76(4), 408-420. https://doi.org/10.1080/03637750903310360
Henseler, J., Hubona, G., & Ray, P. A. (2016). Using PLS path modeling in new technology research: updated guidelines. Industrial Management & Data Systems, 116(1), 2-20. https://doi.org/10.1108/imds-09-2015-
Huber, V. L., Neale, M. A., & Northcraft, G. B. (1987). Decision bias and personnel selection strategies. Organizational Behavior and Human Decision Processes, 40(1), 136-147. https://doi.org/10.1016/0749-
(87)90009-4
Jakobsen, M., & Jensen, R. (2014). Common method bias in public management studies. International Public Management Journal, 18(1), 3-30. https://doi.org/10.1080/10967494.2014.997906
Kalidass, A., & Bahron, A. (2015). The relationship between perceived supervisor support, perceived organizational support, organizational commitment and employee turnover intention. International Journal Of Business Administration, 6(5), 82-89.
https://doi.org/10.5430/ijba.v6n5p82
Katz, D., & Kahn, R. L. (1978). The social psychology of organizations
(Vol. 2). Wiley.
Kim, J. (2016). Impact of performance appraisal justice on the effectiveness of pay-for-performance systems after civil service reform. Public Personnel Management, 45(2), 148-170.
https://doi.org/10.1177/0091026016644625
Kim, J. (2021). Extending upper echelon theory to top managers’ characteristics, management practice, and quality of public service in local government. Local Government Studies, 1-22.
https://doi.org/10.1080/03003930.2021.1882427
Kock, N. (2015). Common method bias in PLS-SEM. International Journal of e-Collaboration, 11(4), 1-10.
https://doi.org/10.4018/ijec.2015100101
Latan, H., Jabbour, C. J. C., & Sousa Jabbour, A. B. L. d. (2017). Ethical awareness, ethical judgment, and whistleblowing: A moderated
mediation analysis. In Partial Least Squares Path Modeling (pp. 311- 337). Springer. https://doi.org/10.1007/s10551-017-3534-2
Levy, M., Poertner, J., & Lieberman, A. (2012). Work attitudes and intention to quit among workers in private child welfare agencies operating under performance-based contracts. Administration in Social Work, 36(2), 175-188. https://doi.org/10.1080/03643107.2011.564723
Levy, P. E., & Williams, J. R. (2004). The social context of performance appraisal: A review and framework for the future. Journal of Management, 30(6), 881-905. https://doi.org/10.1016/j.jm.2004.06.005 Liu, Y., & Bakici, T. (2019). Enterprise social media usage: The motives and the moderating role of public social media experience. Computers
in Human Behavior, 101, 163-172.
https://doi.org/10.1016/j.chb.2019.07.029
Matsuo, M., & Kusumi, T. (2002). Salesperson’s procedural knowledge, experience and performance: an empirical study in Japan. European Journal of Marketing, 36(7/8), 840-854.
https://doi.org/10.1108/03090560210430836
Merkel, S., Chan, H. F., Schmidt, S. L., & Torgler, B. (2020). Optimism and positivity biases in performance appraisal ratings: Empirical evidence from professional soccer. Applied Psychology, 70(3), 1100- 1127. https://doi.org/10.1111/apps.12266
Minbaeva, D. B., & Michailova, S. (2004). Knowledge transfer and expatriation in multinational corporations. Employee Relations, 26(6), 663-679. https://doi.org/10.1108/01425450410562236
Murphy, K. R. (2019). Performance evaluation will not die, but it should.
Human Resource Management Journal, 30(1), 13-31. https://doi.org/10.1111/1748-8583.12259
Murphy, K. R., & Cleveland, J. N. (1995). Understanding performance appraisal: Social, organizational, and goal-based perspectives. Sage.
Ng, K. Y., Koh, C., Ang, S., Kennedy, J. C., & Chan, K. Y. (2011). Rating leniency and halo in multisource feedback ratings: Testing cultural assumptions of power distance and individualism-collectivism. Journal of Applied Psychology, 96(5), 1033-1044.
https://doi.org/10.1037/a0023368
Pichler, S. (2019). Performance appraisal reactions: A review and research agenda. In L. A. Steelman & J .R. Williams (Eds.), Feedback at work. Springer. https://doi.org/10.1007/978-3-030-30915-2_5
Podsakoff, N., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879-903. https://doi.org/10.1037/0021-9010.88.5.879
Puyod, J. V., & Charoensukmongkol, P. (2019). The contribution of cultural intelligence to the interaction involvement and performance of call center agents in cross-cultural communication. Management Research Review, 42(12), 1400-1422. https://doi.org/10.1108/mrr-10-2018-0386 Rigotti, T., Schyns, B., & Mohr, G. (2008). A short version of the occupational self-efficacy scale: structural and construct validity across five countries. Journal of Career Assessment, 16(2), 238-255.
https://doi.org/10.1177/1069072707305763
Ross, K. G., Shafer, J. L., & Klein, G. (2006). Professional judgments and “Naturalistic decision making”. In The Cambridge handbook of expertise and expert performance (pp. 403-420). Cambridge University Press. https://doi.org/10.1017/cbo9780511816796.023
Rucker, D. D., Preacher, K. J., Tormala, Z. L., & Petty, R. E. (2011). Mediation analysis in social psychology: Current practices and new recommendations. Social and Personality Psychology Compass, 5(6), 359-371. https://doi.org/10.1111/j.1751-9004.2011.00355.x
Schleicher, D. J., & Baumann, H. M. (2020). 16 Performance management and the changing nature of work. In The Cambridge handbook of the changing nature of work (pp. 340).
Schleicher, D. J., Baumann, H. M., Sullivan, D. W., Levy, P. E., Hargrove,
D. C., & Barros-Rivera, B. A. (2018). Putting the system into performance management systems: A review and agenda for performance management research. Journal of Management, 44(6), 2209-2245. https://doi.org/10.1177/0149206318755303
Schleicher, D. J., Baumann, H. M., Sullivan, D. W., & Yim, J. (2019). Evaluating the effectiveness of performance management: A 30-year integrative conceptual review. Journal of Applied Psychology, 104(7), 851-887. https://doi.org/10.1037/apl0000368
Shapiro, S. S., & Wilk, M. B. (1965). An analysis of variance test for normality (complete samples). Biometrika, 52(3-4), 591-611.
Spence, J. R., & Keeping, L. M. (2009). The impact of non-performance information on ratings of job performance: A policy-capturing approach. Journal of Organizational Behavior, 31(4), 587-608. https://doi.org/10.1002/job.648
Sunder, S., Kim, K. H., & Yorkston, E. A. (2019). What drives herding behavior in online ratings? The role of rater experience, product portfolio, and diverging opinions. Journal of Marketing, 83(6), 93-112. https://doi.org/10.1177/0022242919875688
Tekleab, A. G., Takeuchi, R., & Taylor, M. S. (2005). Extending the chain of relationships among organizational justice, social exchange, and employee reactions: The role of contract violations. Academy of Management Journal, 48(1), 146-157.
https://doi.org/10.5465/amj.2005.15993162
Vermunt, R., & Steensma, H. (2013). How can justice be used to manage stress in organizations? In Handbook of organizational justice (pp. 383- 410). Psychology Press. https://doi.org/10.3390/bs8120114
Williams, J. R., & Levy, P. E. (2000). Investigating some neglected criteria: The influence of organizational level and perceived system knowledge on appraisal reactions. Journal of Business Psychology, 14(3), 501-513. https://doi.org/10.1023/A:1022988402319
Williams, L. J., Cote, J. A., & Buckley, M. R. (1989). Lack of method variance in self-reported affect and perceptions at work: Reality or artifact? Journal of Applied Psychology, 74(3), 462-468.
https://doi.org/10.1037/0021-9010.74.3.462
Wood, R. E., & Marshall, V. (2008). Accuracy and effectiveness in appraisal outcomes: The influence of self-efficacy, personal factors and organisational variables. Human Resource Management Journal, 18(3), 295-313. https://doi.org/10.1111/j.1748-8583.2008.00067.x
Xiaolan, Z., Zhen, L., & Tiqin, Z. (2018). Orientation on knowledge sharing intention under performance appraisal intervention. Science Research Management, 39(3), 90-100.
Copyright (c) 2022 M. ATIF RAZA
This work is licensed under a Creative Commons Attribution 4.0 International License.
