Industrial/Organizational Psychology: Psychometrics, faking Issues in personnel selection, personality and individual differences, non-cognitive assessments development, machine learning and big data, technology-based assessments (e.g., game-based assessments) in I/O
Dr. Lee earned his Ph.D. degree in Industrial and Organizational Psychology at the University of South Florida. His research interests focus on (1) developments and applications of modern psychometric modeling, (2) application of big data, machine learning, and natural language processing (NLP) techniques to work settings, (3) faking issues in personnel selection, (4) development of noncognitive personnel assessment, and (5) personality and individual differences. In applied settings, Dr. Lee has worked with university faculties and practitioners to develop and improve tests measuring constructs, such as performance, virtue, personality, and cognitive ability. Courses he taught at the university level include industrial/organizational psychology, personnel selection, research method, industrial test and measurement, psychometrics, and multivariate statistics. He currently serves as the assistant editor for Human Resource Development Quarterly, the editorial board of Organizational Research Methods and Personnel Assessment and Decisions. Dr. Lee is interested in admitting a doctoral student. He is most keen on accepting students who want to pursue an academic career path. If you are interested, please feel free to contact him.
Peer Review Publications (* indicates student author)
Zhou, S.* & Lee, P. (in press) Examining gender differences in the use of multidimensional forced-choice (MFC) measures of personality in terms of test-taker reactions and test fairness, Human Resource Development Quaterly.
Lee, P., Joo, S., & Son, M.* (2023). Detecting Careless Respondents in Multidimensional Forced Choice Data: An Application of lz Person-Fit Statistic to the TIRT Model, Journal of Business and Psychology, 1-24. https://link.springer.com/article/10.1007/s10869-023-09911-w
Joo, S., Lee, P., & Stark, S. (2023) Accuracy and Precision of Bayesian Multigroup Estimation for the Generalized Hyperbolic Cosine Ideal Point Item Response Theory Model, Journal of Applied Measurement. 23, 19-36
Fyffe, S.*, Lee, P., & Kaplan, S. (2023) "Transforming" Personality Scale Development: Illustrating the Potential of State-of-the-Art Natural Language Processing. Organizational Research Methods, 1-36. https://doi.org/10.1177/10944281231155771
Joo, S. H., Lee, P., Park, J. Y., & Stark, S. (2023). Assessing Dimensionality of the Ideal Point Item Response Theory Model Using Posterior Predictive Model Checking. Organizational Research Methods, 26(2), 353-382.
Lee, P., Fyffe, S.*, Son, M.*, Jia, Z.*, & Yao, Z. (2023). A Paradigm Shift from “Human Writing” to “Machine Generation” in Personality Test Development: an Application of State-of-the-Art Natural Language Processing. Journal of Business and Psychology, 38(1), 163-190. https://doi.org/10.1007/s10869-022-09864-6 [This paper received an Editor Commendation]
Lee, P., Joo, S., & Jia, Z.* (2023) Cross-Cultural Differences in the Use of the “?” Response Category of the Job Descriptive Index: An Application of the Item Response Tree Model, International Journal of Selection and Assessment, 31, 175-188. https://doi.org/10.1111/ijsa.12414
Joo, S. H., Lee, P., & Stark, S. (2023). Modeling multidimensional forced choice measures with the Zinnes and Griggs pairwise preference item response theory model. Multivariate Behavioral Research, 58(2), 241-261.
Cho, I., Berry, C. M., Payne, S. C., & Lee, P. (2023). Too good to be true? Are supervisor-perspective ratings a valid substitute for actual supervisor ratings? Journal of Applied Psychology, 108(1), 167-178. https://doi.org/10.1037/apl0001018
Joo, S. & Lee, P. (2022) Detecting Differential Item Functioning Using Posterior Predictive Model Checking: Comparison of Discrepancy Statistics, Journal of Educational Measurement, 59(4), 442-469. https://doi.org/10.1111/jedm.12316
Lee, P., Joo, S. H., & Jia, Z.* (2022). Opening the Black Box of the Response Process to Personality Faking: An Application of Item Response Tree Models. Journal of Business and Psychology, 37, 1199-1214.
Zhou, S.* & Lee, P. (2022) Spirituality in the context of teams and organizations, Journal of Management, Spirituality & Religion. https://doi.org/10.51327/AELL2802
Tu, N., Joo, S., Lee, P., & Stark, S. (2022) Comparison of Parameter Estimation Approaches for Multi-Unidimensional Pairwise Preference Tests, Behavior Research Methods. https://doi.org/10.3758/s13428-022-01927-z
Lee, P., Joo, S., Zhou, S.*, & Son, M*. (2022) Investigating the impact of negatively keyed statements on multidimensional forced-choice personality measures: A comparison of partially ipsative and IRT scoring methods, Personality and Individual Differences. Volume 191, June 2022, 111555, https://doi.org/10.1016/j.paid.2022.111555.
Joo, S., Lee, P., & Stark, S. (2022). Bayesian Approaches for Detecting Differential Item Functioning Using the Generalized Graded Unfolding Modell, Applied Psychological Measurement, 1-18. https://doi.org/10.1177/01466216211066606
Lee, P. & Joo, S. (2021). A new investigation of fake-resistance of multidimensional forced-choice measure: An application of differential item/test functioning. Journal of Personnel Assessment and Decisions, 7(1), 31-48.
Lee, P., Joo, S., & Stark, S. (2021). Detecting DIF in multidimensional forced-choice measures using the Thurstonian Item Response Theory model, Organizational Research Methods, 24(4), 739-771.
Joo, S., Lee. P., Park, J., & Stark, S. (2021). Assessing Dimensionality of the Ideal Point Item Response Theory Model using Posterior Predictive Model Checking. Organizational Research Methods. 1-30. https://journals.sagepub.com/doi/pdf/10.1177/10944281211050609
Joo, S., Lee. P., & Stark, S. (2021). The Explanatory Generalized Graded Unfolding Model: Incorporating Collateral Information to Improve the Latent Trait Estimation Accuracy. Applied Psychological Measurement, 1-16
Joo, S., Lee. P., & Stark, S. (2021). Modeling Multidimensional Forced Choice Measures with the Zinnes and Griggs Pairwise Preference Item Response Theory Model. Multivariate Behavioral Research. https://www.tandfonline.com/doi/full/10.1080/00273171.2021.1960142
Li, K., Lee, P., Sheldon, O., Li, C., Zhao, J. (2021). Personality profiles based on the FFM: A systematic review with a person-centered approach. Personality and Individual Differences. 180, https://doi.org/10.1016/j.paid.2021.110996
Ng, V., Lee, P., Ho, M. H. R., Kuykendall, L., Stark, S., & Tay, L. (2021). The development and validation of a multidimensional forced-choice format character measure: Testing the Thurstonian IRT approach. Journal of personality assessment, 103(2), 224-237.
Joo, S., Lee, P., & Stark, S. (2020). Adaptive Testing with the GGUM-RANK Multidimensional Forced Choice Model: Comparison of Pair, Triplet, and Tetrad Scoring, Behavior Research Methods, 52, 761-772
Choi, S., Heo, W., Cho, S., & Lee, P. (2020) The Links between Job Insecurity, Financial Well-Being, and Financial Stress: A Moderated-Mediation Model. International Journal of Consumer Studies. 44, 353-360 https://doi.org/10.1111/ijcs.12571
Heo, W., Cho, S., & Lee, P. (2020) Assessment of Financial Stress: Definition of Financial Stress and a Comprehensive Measurement for Financial Stress, Journal of Financial Therapy, 11(1), 1-28.
Wang, Y., Kim, E., Joo, S. H., Chun, S., Alamri, A., Lee, P., & Stark, S. (2020). Reconsidering Multilevel Latent Class Models: Can Level-2 Latent Classes Affect Item Response Probabilities?. The Journal of Experimental Education, 1-15.
Lee, P., Joo, S. H., & Fyffe, S.* (2019). Investigating faking effects on the construct validity through the Monte Carlo simulation study. Personality and Individual Differences, 150, 109491.
Lee, P., Joo, S., Stark, S., & Chernyshenko, O. (2019). GGUM-RANK statement and person parameter estimation with multidimensional forced choice triplets. Applied Psychological Measurement, 43, 226-240.
Lee, P., Joo, S., & Lee, S. (2019). Examining stability of personality profile solutions between Likert-type and multidimensional forced choice measure. Personality and Individual Differences, 142, 13-20.
Co-Investigator: Zaccaro, S., Zhou, S., & Lee, P (2023-2024). Studying journal publication bias, $25,000, SIOP
Pincipal Investigator: Lee, P. & Kaplan S. (2022) Evaluating Organizational Climate and Turnover, $10,000, Virginia Department of Veterans Services
Pincipal Investigator: Lee, P. & Kaplan S. (2022) Developing machine learning model for personnel selection, $20,000, US Navy (Contract)
Co-Investigator: Lee S., Lee, P., Lee B., Nam G. Ji O., & Kim N. (2017). An in-depth study on organizational safety culture using Korean Occupational Safety and Health Company Survey (Research Report No. 2017-906). Ulsan, Korea: Korean Occupational Safety Health Research Institute.
Ph.D. I/O Psychology, University of South Florida, 2016
(* indicates GMU student authors)
Son, M.*, Lee, P., Cheng, V. W.*, & Lee, H. (2023). Faking profiles of job applicants from overclaiming and social desirability scales [Poster]. Society for Industrial and Organizational Psychology Annual Conference, Boston, MA, United States.
Jia, Z.*, Cheng, V. W.*, Wonders, M. E.*, Lee, P. & Kaplan, S. (2023). Using Text Comments to Predict Turnover: the Incremental Validity of Sentiment Score [Poster]. Society for Industrial and Organizational Psychology Annual Conference, Boston, MA, United States.
Zhou, S.*, Aikin, J.*, & Lee, P. (2022, April) Putting the O*NET to Good Use: A Critical Evaluation of the Use and Misuse of O*NET. [Symposium]. 37th annual meeting of the Society of Industrial-Organizational Psychology, Seattle.
Chen, T*, Lee, P., & Tetric, L. (2022, April). The Relationship Between Work-to-Family Conflict and Climate for Sacrifice Over Time. [Poster session]. 37th annual meeting of the Society of Industrial-Organizational Psychology, Seattle.
Zhou, S.*, Cannon, J. A., McEachern, P. J., Zaccaro, S. J., & Lee, P. (2021, April). A process-pattern model of personality and leader behaviors across gender and level [Poster session]. 36th annual meeting of the Society of Industrial-Organizational Psychology, Online.
Tu, N., Joo, S., Lee, P., & Stark, S. (2021, April). Building better multidimensional forced-choice tests: How statement parameter estimation methods affect scoring accuracy [Oral session], 36th annual meeting of the Society of Industrial-Organizational Psychology, Online.
Joo, S., Lee, P., & Stark, S. (2021, April). Improving scoring by using collateral information: Explanatory GGUM, [Oral session], 36th annual meeting of the Society of Industrial-Organizational Psychology, Online.
Joo, S., Lee, P., & Stark. S. (2020, July) Development of computerized adaptive testing for multidimensional forced choice measurement, Oral presentation conducted at International Meetings of Psychometric Society, 2020, College Park, MD.
Lee, P., Joo, S., & Zhou, S.* (2020, July) Detecting ideal point-based DIF using dominance-based DIF methods, Oral presentation will be conducted at International Meetings of Psychometric Society, 2020, College Park, MD.
Zhou, S.* & Lee, P. (2020, April) 'Not much more than PsyCap?' A new psychometric investigation using bi-factor exploratory SEM, Poster presentation conducted at APA meeting, Washington, DC
Lei, X.*, Lee, P., Zhou, S.*, & Jang, S. (2020, April). What happens to job satisfaction trajectory under normal and intervention conditions? Poster presentation conducted at the 35th annual meeting of the Society of Industrial Organizational Psychology, Austin, TX
Lei, X.*, Lee, P., Fyffe, S.*, Dubovoy, L.*, Zhou, Y.*, & Lam, N*. (2019, November). A new investigation of the stability of job satisfaction: An application of second-order growth mixture modeling. Poster presented at the 2019 Work, Stress, & Health Conference, Boston, MA.
Lee, P., Joo, S, & Lee, S. (2019, April) Examining the effectiveness of MFC personality assessments from diverse perspectives. In Lee. P. (Chairs), Person-Centric Investigation of the Effectiveness of Multidimensional Forced Choice Personality Measure Across Different Test Contexts. Symposium to be presented at the 34th Annual Conference of the Society for Industrial and Organizational Psychology, National Harbor, Maryland.
Joo, S., Lee, P., & Stark, S. (2019, April). Evaluating bayesian DIF detection methods using an ideal point IRT model. Symposium to be presented at National Council on Measurement in Education (NCME), Ontario, Canada.
Wang, Y., Joo, S., Chun, S., Alamri, A., Lee, P., Kim, E. S., & Stark, S. (2019, April). Evaluating latent class models when ignoring and accounting for clustering. Symposium to be presented at National Council on Measurement in Education (NCME), Ontario, Canada.
Stark, S., Lee, P., & Joo, S. (2018, August). Improving resistance to response biases in personality measurement: Advances in forced-choice modeling. Symposium presented at 11th Conference of the International Test Commission (ITC), Montreal, Canada.
Lee, P., Joo. S., & Stark, S. (2018, April). Advances in measurement invariance: Methods and applications to advanced models. In Seybert, J. (Chairs) Testing DIF for MFC measures using Thurstonian Item Response Theory. Symposium conducted at the 33nd annual meeting of the Society of Industrial Organizational Psychology, Chicago, IL
Lee, P., & Lee, S. (2018, April). Discovering the hidden latent profiles of employee drinking motives: An application of integrated variable-centered and person-centered approaches. Paper presented at the 33nd annual meeting of the Society of Industrial Organizational Psychology, Chicago, IL.
Lee, P., Joo, S., & Stark, S. (2017, August). Examining differential item functioning of multidimensioal forced choice measure using Thurstonian IRT Model. Paper presented at the International Meeting of the Psychometric Society (IMPS), Zurich, Switzerland.
Joo, S., Lee, P., & Stark, S. (2017, August). Information functions for the GGUM-RANK multidimensional forced choice Model, Symposium conducted at the International Meeting of the Psychometric Society (IMPS), Zurich, Switzerland.
Lee, P., Mahoney, K., Chon, J., Lee, S., & Orina, N. B., K (2017, May). Investigation of drinking motives with variable centered and person-centered approaches. Paper presented at the 12th International Conference on Occupational Stress and Health, Minneapolis, MN.
Lee, P., Stark, S., & Chernyshenko, S., (2017, July). Comparing four different scoring methods to estimate the multidimensional forced choice noncognitive measure. Symposium conducted at the 13th, International Conference on Psychology and Behavioural Sciences (ICPBS), Lisbon, Portugal.
Lee, P., Mahoney, K., Chun, S., & Lee, S (2017, April). Are ESEM-based models more appropriate for studying personality faking? Paper presented at the 32nd annual meeting of the Society of Industrial Organizational Psychology, Orland, FL.
Stark, S., Joo, S, Lee, P. (2017, April). Novel approaches to noncognitive skills assessment for the workplace. In Kell, H. J. (Chairs), Development of information function index for multidimensional forced choice measure. Symposium conducted at the 32nd annual meeting of the Society of Industrial Organizational Psychology, Orland, FL