Further insights into the structure of cognitive abilities and their role in predicting performance

Jeffrey Cucina, Philip Walmsley, Kevin Byle, Sharron Peyton, Wendy Su, and Henry Busciglio

U.S. Bureau of Customs and Border Protection (CBP).

• Food included on-site.
• NEW: Email questions for the presenter to vp.ptcmw@gmail.com by 12pm ET the day before.
  

• Crystal City Shops, 2010 Crystal Dr, Arlington, VA 22202 (map)
  
• Metro Access and Parking Available

Abstract: In this presentation we will give a high-level summary of recent research that we have been conducting on cognitive ability testing. We will cover five research questions in our presentation. First, is general mental ability (g) best viewed as a higher-order construct (Answer: No, bifactor models fit better.) Second, how much variance in job and training performance is explained by g? (Answer: More than is often reported in the literature). Third, is it possible to develop an alternative test that would replace cognitive ability tests? (Answer: Unfortunately, no; cognitive ability tests will always add incremental validity). Fourth, what are the predictors of high school grades? (Answer: grades correlate with g and Conscientiousness, but not substantially with specific abilities) Fifth, do meaningful memory tests add incremental validity over g for training performance? (Answer: Yes).

Jeffrey M. Cucina, Ph.D., is a Personnel Research Psychologist at U.S. Customs and Border Protection (CBP), Department of Homeland Security (DHS) where he works on the development and validation of entry-level assessments (e.g., structured interviews, logical reasoning, biographical data, video-based tests).  He also is serving as the Historian for the Society for Industrial and Organizational Psychology (SIOP) and is the 2015 recipient of SIOP’s Distinguished Early Career Contributions Award. His current research interests include mental abilities testing, research methodology (especially the definition of theory in I/O psychology compared to other fields), the application of psychometric theory to organizational surveys, and personality testing. Dr. Cucina received a Ph.D. in Industrial/Organizational Psychology from the George Washington University.

Philip T. Walmsley, Ph.D., is a Personnel Research Psychologist in the Personnel Research and Assessment Development division of U.S. Customs and Border Protection (CBP). Prior to joining CBP, he worked in the Assessment and Evaluation branch of the U.S. Office of Personnel Management (OPM). Phil conducts job analyses, develops and validates the use of a variety of pre-employment assessments, develops and administers leadership assessments, conducts testing- and assessment-related trainings, and conducts large-scale data analyses. Phil also conducts research on those topics and presents scholarly and professional work at conferences and in published outlets. Phil received a Ph.D. in Industrial and Organizational Psychology from the University of Minnesota, Twin-Cities.

Kevin A. Byle, Ph.D., is a Personnel Research Psychologist at U.S. Customs and Border Protection (CBP), Department of Homeland Security (DHS). Prior to working at CBP, Kevin worked in personnel selection at GEICO. Dr. Byle has extensive experience in several areas of Industrial/Organizational Psychology, including the development and validation of a broad range of tests and assessments (e.g., in-baskets, role plays, cognitive ability tests, multitasking simulations, biodata inventories, structured interviews), large scale job analyses, and organizational surveys.  His current research interests include integrity testing, mental abilities testing, and the use of organizational surveys. His research has been published in Leadership Quarterly, Intelligence, and the Journal of Business and Psychology. Dr. Byle received a Masters in Clinical Psychology from Ball State University and a Ph.D. in Industrial/Organizational Psychology from Northern Illinois University.

Sharron T. Peyton is a Personnel Research Psychologist in the Office of Human Resources Management (HRM) at U.S. Customs and Border Protection (CBP), Department of Homeland Security (DHS) where she works on the development of entry-level and promotions assessments (e.g., structured interviews, assessment centers, in-baskets, video-based tests, and logical reasoning). She has had the honor to receive various awards for her performance at CBP, like the 2014 CBP Commissioner’s Best Practices, Efficiency, and Innovation Team Award and the 2013 HRM Assistant Commissioner’s Quiet Leadership Award. Mrs. Peyton attended the University of Baltimore to receive a Master’s in Industrial Organizational Psychology.

Chihwei (Wendy) Su, M.S., is a Personnel Research Psychologist at U.S. Customs and Border Protection (CBP), Department of Homeland Security (DHS) where she works on developing and validating entry-level assessments (e.g., structured interviews, logical reasoning/arithmetic, video-based tests) and maintaining the testing programs. She received a M.S. in Industrial/Organizational Psychology from the University of Baltimore.

Henry H. Busciglio, Ph.D. is a Senior Research Psychologist with the Personnel Research and Assessment Division, Office of Human Resources Management, U.S. Bureau of Customs and Border Protection (CBP). His primary duties are to assist in the development and implementation of written and other assessments for selection and promotion into CBP’s mission-critical occupations. Dr. Busciglio received his M.A. and Ph.D. degrees in Industrial and Organizational Psychology from the University of South Florida. Since then he has been employed in one private-sector firm and three U.S. Government agencies. At the National Assessment Institute in Clearwater, Florida, Dr. Busciglio was mainly involved in the development, administration, and statistical analysis of licensing and certification assessments for various state, county, and local jurisdictions. Dr. Busciglio began his Federal service at the U.S. Army Research Institute, where he participated in many research and development projects, most notably Project A, Building the Career Force, Expanding the Concept of Quality in Personnel, and NCO 21. At the U.S. Office of Personnel Management, he was a major contributor to the Administrative Law Judge and Presidential Management Intern projects. His many research efforts at CBP include entry-level tests for officers and agents, as well as various job analysis and test validation projects.