Philseok Lee

Philseok Lee

Philseok Lee

Assistant Professor

Industrial/Organizational Psychology: Psychometrics, faking Issues in personnel selection, personality and individual differences, non-cognitive assessments development, machine learning and big data, technology-based assessments (e.g., game-based assessments) in I/O

Dr. Lee earned his Ph.D. degree in Industrial and Organizational Psychology at the University of South Florida. His research interests focus on (1) developments and applications of modern psychometric modeling, (2) application of big data, machine learning, and natural language processing (NLP) techniques to work settings, (3) faking issues in personnel selection, (4) development of noncognitive personnel assessment, and (5) personality and individual differences. In applied settings, Dr. Lee has worked with university faculties and practitioners to develop and improve tests measuring constructs, such as performance, virtue, personality, and cognitive ability. Courses he taught at the university level include industrial/organizational psychology, personnel selection, research method, industrial test and measurement, psychometrics, and multivariate statistics. He currently serves as the assistant editor for Human Resource Development Quarterly, the editorial board of Organizational Research Methods, Journal of Business and Psychology, and Personnel Assessment and Decisions. Dr. Lee is interested in admitting a doctoral student. He is most keen on accepting students who want to pursue an academic career path. If you are interested, please feel free to contact him.

 

Selected Publications

Peer Review Publications (* indicates student author)

Zhou, S.*, Cheng V.*, & Lee, P.  (2024) What are you comparing it to? Investigating order effects in presentation of multidimensional forced choice personality items, Personality and Individual Differences. https://doi.org/10.1016/j.paid.2024.112581

Zhou, S.* & Lee, P. (2024) Examining gender differences in the use of multidimensional forced-choice (MFC) measures of personality in terms of test-taker reactions and test fairness, Human Resource Development Quaterly. https://onlinelibrary.wiley.com/doi/10.1002/hrdq.21521

Lee, P., Joo, S., & Son, M.* (2023). Detecting Careless Respondents in Multidimensional Forced Choice Data: An Application of lz Person-Fit Statistic to the TIRT Model, Journal of Business and Psychology, 1-24. https://link.springer.com/article/10.1007/s10869-023-09911-w

Joo, S., Lee, P., & Stark, S. (2023) Accuracy and Precision of Bayesian Multigroup Estimation for the Generalized Hyperbolic Cosine Ideal Point Item Response Theory Model, Journal of Applied Measurement. 23, 19-36

Fyffe, S.*, Lee, P., & Kaplan, S. (2023) "Transforming" Personality Scale Development: Illustrating the Potential of State-of-the-Art Natural Language Processing. Organizational Research Methods, 1-36. https://doi.org/10.1177/10944281231155771

Joo, S. H., Lee, P., Park, J. Y., & Stark, S. (2023). Assessing Dimensionality of the Ideal Point Item Response Theory Model Using Posterior Predictive Model Checking. Organizational Research Methods, 26(2), 353-382.

Lee, P., Fyffe, S.*, Son, M.*, Jia, Z.*, & Yao, Z. (2023). A Paradigm Shift from “Human Writing” to “Machine Generation” in Personality Test Development: an Application of State-of-the-Art Natural Language Processing. Journal of Business and Psychology, 38(1), 163-190. https://doi.org/10.1007/s10869-022-09864-6 [This paper received an Editor Commendation]

Lee, P., Joo, S., & Jia, Z.* (2023) Cross-Cultural Differences in the Use of the “?” Response Category of the Job Descriptive Index: An Application of the Item Response Tree Model, International Journal of Selection and Assessment, 31, 175-188. https://doi.org/10.1111/ijsa.12414

Joo, S. H., Lee, P., & Stark, S. (2023). Modeling multidimensional forced choice measures with the Zinnes and Griggs pairwise preference item response theory model. Multivariate Behavioral Research, 58(2), 241-261.

Cho, I., Berry, C. M., Payne, S. C., & Lee, P. (2023). Too good to be true? Are supervisor-perspective ratings a valid substitute for actual supervisor ratings? Journal of Applied Psychology, 108(1), 167-178. https://doi.org/10.1037/apl0001018

Joo, S. & Lee, P. (2022) Detecting Differential Item Functioning Using Posterior Predictive Model Checking: Comparison of Discrepancy Statistics, Journal of Educational Measurement, 59(4), 442-469. https://doi.org/10.1111/jedm.12316

Lee, P., Joo, S. H., & Jia, Z.* (2022). Opening the Black Box of the Response Process to Personality Faking: An Application of Item Response Tree Models. Journal of Business and Psychology, 37, 1199-1214.

Zhou, S.* & Lee, P. (2022) Spirituality in the context of teams and organizations, Journal of Management, Spirituality & Religion. https://doi.org/10.51327/AELL2802

Tu, N., Joo, S., Lee, P., & Stark, S. (2022) Comparison of Parameter Estimation Approaches for Multi-Unidimensional Pairwise Preference Tests, Behavior Research Methods. https://doi.org/10.3758/s13428-022-01927-z

Lee, P., Joo, S., Zhou, S.*, & Son, M*. (2022) Investigating the impact of negatively keyed statements on multidimensional forced-choice personality measures: A comparison of partially ipsative and IRT scoring methods, Personality and Individual Differences. Volume 191, June 2022, 111555, https://doi.org/10.1016/j.paid.2022.111555.

Joo, S., Lee, P., & Stark, S. (2022). Bayesian Approaches for Detecting Differential Item Functioning Using the Generalized Graded Unfolding Modell, Applied Psychological Measurement, 1-18. https://doi.org/10.1177/01466216211066606

Lee, P. & Joo, S. (2021). A new investigation of fake-resistance of multidimensional forced-choice measure: An application of differential item/test functioning. Journal of Personnel Assessment and Decisions, 7(1), 31-48.

Lee, P., Joo, S., & Stark, S. (2021). Detecting DIF in multidimensional forced-choice measures using the Thurstonian Item Response Theory model, Organizational Research Methods, 24(4), 739-771.

Joo, S., Lee. P., Park, J., & Stark, S. (2021). Assessing Dimensionality of the Ideal Point Item Response Theory Model using Posterior Predictive Model Checking. Organizational Research Methods. 1-30. https://journals.sagepub.com/doi/pdf/10.1177/10944281211050609

Joo, S., Lee. P., & Stark, S. (2021). The Explanatory Generalized Graded Unfolding Model: Incorporating Collateral Information to Improve the Latent Trait Estimation Accuracy. Applied Psychological Measurement, 1-16

Joo, S., Lee. P., & Stark, S. (2021). Modeling Multidimensional Forced Choice Measures with the Zinnes and Griggs Pairwise Preference Item Response Theory Model. Multivariate Behavioral Research. https://www.tandfonline.com/doi/full/10.1080/00273171.2021.1960142

Li, K., Lee, P., Sheldon, O., Li, C., Zhao, J. (2021). Personality profiles based on the FFM: A systematic review with a person-centered approach. Personality and Individual Differences. 180, https://doi.org/10.1016/j.paid.2021.110996

Ng, V., Lee, P., Ho, M. H. R., Kuykendall, L., Stark, S., & Tay, L. (2021). The development and validation of a multidimensional forced-choice format character measure: Testing the Thurstonian IRT approach. Journal of personality assessment103(2), 224-237.

Joo, S., Lee, P., & Stark, S. (2020). Adaptive Testing with the GGUM-RANK Multidimensional Forced Choice Model: Comparison of Pair, Triplet, and Tetrad Scoring, Behavior Research Methods, 52, 761-772

Choi, S., Heo, W., Cho, S., & Lee, P. (2020) The Links between Job Insecurity, Financial Well-Being, and Financial Stress: A Moderated-Mediation Model. International Journal of Consumer  Studies. 44, 353-360 https://doi.org/10.1111/ijcs.12571

Heo, W., Cho, S., & Lee, P. (2020) Assessment of Financial Stress: Definition of Financial Stress and a Comprehensive Measurement for Financial Stress, Journal of Financial Therapy, 11(1), 1-28.

Wang, Y., Kim, E., Joo, S. H., Chun, S., Alamri, A., Lee, P., & Stark, S. (2020). Reconsidering Multilevel Latent Class Models: Can Level-2 Latent Classes Affect Item Response Probabilities?. The Journal of Experimental Education, 1-15.

Lee, P., Joo, S. H., & Fyffe, S.* (2019). Investigating faking effects on the construct validity through the Monte Carlo simulation study. Personality and Individual Differences150, 109491.

Lee, P., Joo, S., Stark, S., & Chernyshenko, O. (2019). GGUM-RANK statement and person parameter estimation with multidimensional forced choice triplets. Applied Psychological Measurement, 43, 226-240.

Lee, P., Joo, S., & Lee, S. (2019). Examining stability of personality profile solutions between Likert-type and multidimensional forced choice measure. Personality and Individual Differences, 142, 13-20.

Expanded Publication List

Joo, S. H., Lee, P., & Stark, S. (2019). Adaptive testing with the GGUM-RANK multidimensional forced choice model: Comparison of pair, triplet, and tetrad scoring. Behavior research methods, 1-12.

Lee, P., Lee, S., & Stark, S. (2018) Examining validity evidence for multidimensional forced choice measures with different scoring approaches. Personality and Individual Differences, 123, 229-235.

Lee, P., & Lee, S. (2018). Discovering the hidden profiles of employee drinking motives: An application of integrated variable-and person-centered latent profile analysis. Substance use & misuse, 53, 2299-2309.

Joo, S., Lee. P., & Stark, S. (2018) Development of Information Functions and Indices for the GGUM-RANK Multidimensional Forced Choice IRT Model, Journal of Educational Measurement, 55, 357-372

Lee S., Ji, O. Y., & Lee., P. (2018) Effects of alcohol drinking of employee on job engagement and interpersonal conflict at work: A test of self-control strength theory using diary study, The Korean Journal of Industrial and Organizational Psychology, 31, 303-325.

Cho, S. H., Beach, L., & Lee, P. (2018). Association between Personality and Financial Well-being: Strategies for More Effective Financial Education, Counseling and Advising. Consumer Interests Annual, 64, 1-5.

Lee. P., Mahoney, K., & Lee, S. (2017). An Application of the exploratory structural equation modeling framework to the study of personality faking. Personality and Individual Difference, 119, 220-226.

Lee, P., Joo, S. & Stark, S. (2017). Linking methods for the Zinnes-Griggs pairwise preference IRT model, Applied Psychological Measurement, 41, 130-144.

Joo, S., Lee, P., & Stark, S. (2017). Evaluating anchor-item designs for concurrent calibration with the GGUM, Applied Psychological Measurement, 41, 83-96

Lee, S., Lee, P., & Im, S. (2017). Drinking and absence of college students: A daily examination of the alcohol use vigor-absence model, Journal of Institute for Social Sciences, 28, 123-137.

Wang, W., Lee, P., Joo, S. H., Stark, S., & Louden, R. (2016). MCMC ZG: An IRT Computer program for forced-choice noncognitive measurement. Applied Psychological Measurement, 40, 551-553.

Kim, E. S., Joo, S. H., Lee, P., Wang, Y., & Stark, S. (2016). Measurement invariance testing across between-level latent classes using multilevel factor mixture modeling. Structural Equation Modeling: A Multidisciplinary Journal23, 870-887.

Lee, P., Stark, S., Chernyshenko, O. (2014). Detecting aberrant responding on unidimensional pairwise preference tests: an application of lz based on the Zinnes and Griggs ideal point IRT Model, Applied Psychological Measurement, 38, 391-403.

Lee, P., Chun, S., & Lee, S. (2014). Differential use of middle category “?” in job descriptive index between Korean and American samples using mixed-model IRT, Korean Journal of Psychology: General, 33, 647-672.

Grants and Fellowships

Co-Investigator: Zaccaro, S., Zhou, S., & Lee, P (2023-2024). Studying journal publication bias, $25,000, SIOP

Pincipal Investigator: Lee, P. & Kaplan S. (2022) Evaluating Organizational Climate and Turnover, $10,000, Virginia Department of Veterans Services 

Pincipal Investigator: Lee, P. & Kaplan S. (2022) Developing machine learning model for personnel selection, $20,000, US Navy (Contract)

Co-Investigator: Lee S., Lee, P., Lee B., Nam G. Ji O., & Kim N. (2017). An in-depth study on organizational safety culture using Korean Occupational Safety and Health Company Survey (Research Report No. 2017-906). Ulsan, Korea: Korean Occupational Safety Health Research Institute.

Education

Ph.D. I/O Psychology, University of South Florida, 2016

Recent Presentations

(* indicates GMU student authors)

Ponce, L. P.*, Son, M.*, Moon, N.A., Kaplan, S. A., & Lee, P. (2024, April). Navigating the Office Arena: Developing a Multidimensional Measure for Political Will [Poster session]. Society for Industrial and Organizational Psychology Annual Conference, Chicago, IL, United States. 

Cheng, V.*, Fyffe, S.*, & Lee, P. (2024, April). Test-Taker Reactions to Dark and Bright Personalities in Likert and MFC Formats [Poster session]. Society for Industrial and Organizational Psychology Annual Conference, Chicago, IL, United States. 

Cheng, V.*, Zhou, S.*, & Lee, P. (2024, April). Investigating Order Effects in Presentation of MFC Personality Items [Poster session]. Society for Industrial and Organizational Psychology Annual Conference, Chicago, IL, United States. 

Jia, Z.,* & Lee, P. (2024, April). A New Text-Selection Approach to Process the Long Sequence Data in Transformers: Applications of Artificial Intelligence to Selection and Job Analysis Contexts [Symposium session]. Society for Industrial and Organizational Psychology Annual Conference, Chicago, IL, United States. 

Son, M.*, Lee, P., Cheng, V. W.*, & Lee, H. (2023). Faking profiles of job applicants from overclaiming and social desirability scales [Poster]. Society for Industrial and Organizational Psychology Annual Conference, Boston, MA, United States.

Jia, Z.*, Cheng, V. W.*, Wonders, M. E.*, Lee, P. & Kaplan, S. (2023). Using Text Comments to Predict Turnover: the Incremental Validity of Sentiment Score [Poster]. Society for Industrial and Organizational Psychology Annual Conference, Boston, MA, United States.

Zhou, S.*, Aikin, J.*, & Lee, P. (2022, April) Putting the O*NET to Good Use: A Critical Evaluation of the Use and Misuse of O*NET. [Symposium]. 37th annual meeting of the Society of Industrial-Organizational Psychology, Seattle.

Chen, T*, Lee, P., & Tetric, L. (2022, April). The Relationship Between Work-to-Family Conflict and Climate for Sacrifice Over Time. [Poster session]. 37th annual meeting of the Society of Industrial-Organizational Psychology, Seattle.

Zhou, S.*, Cannon, J. A., McEachern, P. J., Zaccaro, S. J., & Lee, P. (2021, April). A process-pattern model of personality and leader behaviors across gender and level [Poster session]. 36th annual meeting of the Society of Industrial-Organizational Psychology, Online.

Tu, N., Joo, S., Lee, P., & Stark, S. (2021, April). Building better multidimensional forced-choice tests: How statement parameter estimation methods affect scoring accuracy [Oral session], 36th annual meeting of the Society of Industrial-Organizational Psychology, Online.

Joo, S., Lee, P., & Stark, S. (2021, April). Improving scoring by using collateral information: Explanatory GGUM, [Oral session], 36th annual meeting of the Society of Industrial-Organizational Psychology, Online.

Joo, S., Lee, P., & Stark. S. (2020, July) Development of computerized adaptive testing for multidimensional forced choice measurement, Oral presentation conducted at International Meetings of Psychometric Society, 2020, College Park, MD.

Lee, P., Joo, S., & Zhou, S.* (2020, July) Detecting ideal point-based DIF using dominance-based DIF methods, Oral presentation will be conducted at International Meetings of Psychometric Society, 2020, College Park, MD.

Zhou, S.* & Lee, P. (2020, April) 'Not much more than PsyCap?' A new psychometric investigation using bi-factor exploratory SEM, Poster presentation conducted at APA meeting, Washington, DC

Lei, X.*, Lee, P., Zhou, S.*, & Jang, S. (2020, April). What happens to job satisfaction trajectory under normal and intervention conditions? Poster presentation conducted at the 35th annual meeting of the Society of Industrial Organizational Psychology, Austin, TX

Lei, X.*, Lee, P., Fyffe, S.*, Dubovoy, L.*, Zhou, Y.*, & Lam, N*. (2019, November). A new investigation of the stability of job satisfaction: An application of second-order growth mixture modeling. Poster presented at the 2019 Work, Stress, & Health Conference, Boston, MA.

Lee, P., Joo, S, & Lee, S. (2019, April) Examining the effectiveness of MFC personality assessments from diverse perspectives. In Lee. P. (Chairs), Person-Centric Investigation of the Effectiveness of Multidimensional Forced Choice Personality Measure Across Different Test ContextsSymposium to be presented at the 34th Annual Conference of the Society for Industrial and Organizational Psychology, National Harbor, Maryland.

Joo, S., Lee, P., & Stark, S. (2019, April). Evaluating bayesian DIF detection methods using an ideal point IRT model. Symposium to be presented at National Council on Measurement in Education (NCME), Ontario, Canada. 

Wang, Y., Joo, S., Chun, S., Alamri, A., Lee, P., Kim, E. S., & Stark, S. (2019, April). Evaluating latent class models when ignoring and accounting for clustering. Symposium to be presented at National Council on Measurement in Education (NCME), Ontario, Canada. 

Stark, S., Lee, P., & Joo, S. (2018, August). Improving resistance to response biases in personality measurement: Advances in forced-choice modeling. Symposium presented at 11th Conference of the International Test Commission (ITC), Montreal, Canada.

Lee, P., Joo. S., & Stark, S. (2018, April). Advances in measurement invariance: Methods and applications to advanced models. In Seybert, J. (Chairs) Testing DIF for MFC measures using Thurstonian Item Response Theory. Symposium conducted at the 33nd annual meeting of the Society of Industrial Organizational Psychology, Chicago, IL

Lee, P., & Lee, S. (2018, April). Discovering the hidden latent profiles of employee drinking motives: An application of integrated variable-centered and person-centered approaches. Paper presented at the 33nd annual meeting of the Society of Industrial Organizational Psychology, Chicago, IL.

Lee, P., Joo, S., & Stark, S. (2017, August). Examining differential item functioning of multidimensioal forced choice measure using Thurstonian IRT Model. Paper presented at the International Meeting of the Psychometric Society (IMPS), Zurich, Switzerland.

Joo, S., Lee, P., & Stark, S. (2017, August). Information functions for the GGUM-RANK multidimensional forced choice Model, Symposium conducted at the International Meeting of the Psychometric Society (IMPS), Zurich, Switzerland.

Lee, P., Mahoney, K., Chon, J., Lee, S., & Orina, N. B., K (2017, May). Investigation of drinking motives with variable centered and person-centered approaches. Paper presented at the 12th International Conference on Occupational Stress and Health, Minneapolis, MN.

Lee, P., Stark, S., & Chernyshenko, S., (2017, July). Comparing four different scoring methods to estimate the multidimensional forced choice noncognitive measure. Symposium conducted at the 13th, International Conference on Psychology and Behavioural Sciences (ICPBS), Lisbon, Portugal.

Lee, P., Mahoney, K., Chun, S., & Lee, S (2017, April). Are ESEM-based models more appropriate for studying personality faking? Paper presented at the 32nd annual meeting of the Society of Industrial Organizational Psychology, Orland, FL.

Stark, S., Joo, S, Lee, P. (2017, April). Novel approaches to noncognitive skills assessment for the workplace. In Kell, H. J. (Chairs), Development of information function index for multidimensional forced choice measure. Symposium conducted at the 32nd annual meeting of the Society of Industrial Organizational Psychology, Orland, FL