[{"content":" PhD 2020 - 2026 PhD in Psychology at University of Oregon I received my PhD from University of Oregon in 2026, where I worked in the Personality Is Everywhere (PIE) lab with Dr. Sara Weston and Dr. David Condon. My dissertation explored the advantages of item-level personality assessment (as opposed to using multi-item scales) across research questions in personality psychology. You can read my dissertation here. Master of Science 2020 - 2021 Psychology at University of Oregon Master's degree in Psychology from University of Oregon. Bachelor of Arts 2016 - 2020 Business Administration and Psychology at University of Miami I graduated from University of Miami in 2020 with a BA in Business Administration and a second major in Psychology. ","externalUrl":null,"permalink":"/education/","section":"","summary":"","title":"Education","type":"page"},{"content":"Welcome to my portfolio! I am a quantitative researcher whose work has primarily focused on personality measurement and the development of personality assessment tools. One of the things I enjoy most about the psychometric focus of my research is that it has allowed me to explore a wide range of topics in psychology, including creativity, spatial ability, and cross-cultural personality assessment. I have also had opportunities to work with many different types of data, and use large, complex, and culturally diverse datasets to address research questions about personality.\nI recently received my PhD in psychology and I\u0026rsquo;m currently on the job market. View my CV here if you\u0026rsquo;re interested, and feel free to get in touch!\n","externalUrl":null,"permalink":"/","section":"","summary":"","title":"","type":"page"},{"content":"","externalUrl":null,"permalink":"/authors/","section":"Authors","summary":"","title":"Authors","type":"authors"},{"content":"","externalUrl":null,"permalink":"/categories/","section":"Categories","summary":"","title":"Categories","type":"categories"},{"content":"","externalUrl":null,"permalink":"/tags/creativity/","section":"Tags","summary":"","title":"Creativity","type":"tags"},{"content":"","externalUrl":null,"permalink":"/tags/culture/","section":"Tags","summary":"","title":"Culture","type":"tags"},{"content":" Project overview # kmather3/Big-Two null 0 0 The \u0026ldquo;Big Two\u0026rdquo; model of personality has stronger evidence for cross-cultural replicability than any other lexically-based model of personality. Many individual lexical studies across languages and cultural contexts have reproduced this Big Two structure, which captures (a) Communion/Social Self-regulation (the internalization versus resistance to the normative code\u0026rsquo;s of one\u0026rsquo;s society\u0026ndash;with components of warmth, morality, respect, and industriousness), and (b) Agency/Dynamism (which reflects approach versus avoidant tendencies, with components of competence, confidence, fearlessness, positive mood, and sociability). The present work further developed the theoretical model of the Big Two and established the validity of a Big Two personality assessment instrument.\nMethod # The initial pool of 55 items (collected from or developed based on 11 global lexical studies) was first reduced to a subset of 45 items that were most consistently understood across English-speaking contexts. All items begin with the stem \u0026ldquo;I tend to be\u0026hellip;\u0026rdquo; and are followed by a trait-descriptive adjective like \u0026ldquo;lively\u0026rdquo; or \u0026ldquo;polite\u0026rdquo;, and participants respond with an answer option from 1 (very inaccurate) to 6 (very accurate).\nItems retained in the subset of 45 were selected based on\u0026hellip;\nThe frequency of use of the trait-descriptive adjective in World English corpora\nFamiliarity ratings and exploratory factor analysis results among Africa Long Life Study participants (N = 2,958 18 year old participants from Namibia, Kenya, and South Africa)\nDistribution test statistics, exploratory factor analysis results, and test–retest reliability in SAPA project data from 13 diverse English-speaking countries (N = 61,760).\nNext, we examined the validity of the 45-item Cross-Cultural Big Two Inventory (CCBTI) by\u0026hellip;\nExploring relationships with external criteria in the Africa Long Life Study samples\nComparing the CCBTI and other Two-Factor models across sub-fields of psychology (e.g., measures of Stability and Plasticity) and exploring relationships with other personality traits and demographic characteristics in the SAPA project sample.\nResults # Here, I focus on findings I contributed to this project from the SAPA project dataset, which tell us about the dimensionality, reliability, and construct validity of the CCBTI scales. If you\u0026rsquo;re interested in reading more about the earlier steps in the validation process, we discuss all details in the published manuscript, and you can read more about the Africa Long Life Study (ALLS) lead by Dr. Amber Gayle Thalmayer and colleagues here.\nThe SAPA project sample included 61,760 participants who ranged in age from 18 to 90 years old (M = 25.8, SD = 9.0) from 13 geographically and culturally diverse nations. Sample characteristics for each nation included are shown in the table below.\nSAPA Project Sample Characteristics Psychometric Properties # Overall, findings indicate that the Agency and Communion sub-scales demonstrate strong psychmetric properties.Internal consistency among items was strong for both Communion/SSR (α = .87) and Agency/Dynamism (α = .91), and Omega Hierarchical values indicated moderate unidimensionality for both scales (ωh Communion/SSR = .63; ωh Agency/Dynamism = .57).\nThis suggests that the CCBTI measures two cohesive, and relatively unidimensional psychological constructs.\nConstruct Validity # Next, the construct validity of the CCBTI subscales was examined to determine whether they measure the individual differences they were designed to assess. This involved exploring relationships with previous measures of the \u0026ldquo;Big Two\u0026rdquo; (or similar measures), and with personality constructs from other frameworks such as the Big Five traits and the 27 traits from SAPA Personality Inventory.\nWith the Big Five, correlations were largely as expected with Communion/SSR moderately positively associated with Agreeableness and Conscientiousness and Agency/Dynamism with Extraversion, Openness, and (negatively) Neuroticism. The SPI-27 scales that associated most strongly with Communion/SSR were Compassion, Honesty, and Authoritarianism versus Irritability and Impulsivity. The strongest associations with Agency/Dynamism were for Charisma, Well-Being, Humor, and Sociability versus Anxiety.\nRelationships with other personality scales: The only substantial zero-order associations of the CCB2I scales with sociodemographic and behavioral variables were for Agency/Dynamism with health and exercise frequency; these were also positive but low for Communion/SSR. In all other cases correlations were in the expected direction but small in magnitude, with the exception of Twitter usage, which had a small negative correlation with Agency/Dynamism. Agency/Dynamism had a slightly higher correlation with many health variables than did Communion/SSR.\nRelationships with behavioral and demographic outcomes: Findings also revealed which occupations were most differentially associated with Communion/SSR and Dynamism/Agency.\nOccupations with the highest Communion to Agency percentile difference\nThe occupations distinguished more by high Communion relative to Agency levels included Executive Secretary/Administrative Assistant, Registered Nurse, Administrative Services Manager, and Medical Assistant. Many of these could be considered \u0026ldquo;service\u0026rdquo; or \u0026ldquo;helping\u0026rdquo; professions, which generally demand more of a focus on the physical or mental well being of others (i.e., higher levels of Communion).\nHowever, several occupations here––such as Auditor, Computer Software Engineer, accountant, computer programmer––appear to rank highly on the Communion to Agency percentile due to lower average levels of both. Entrance into and success in these occupations likely depend more on interests and specific cognitive skills (e.g., mathematical or spatial ability) than on the temperament-related behaviors and skills assessed by the CCBTI.\nOccupations with the highest Agency to Communion percentile difference\nAlternatively, occupations distinguished by high Agency relative to Communion levels included Marketing Manager, Human Resources Manager, Lawyer, Community/Social Service Specialist, Manager, and Food Server. Entrance into and success in many of these occupations (e.g., Lawyer, Managerial roles) likely demand higher levels of sociability, confidence, and boldness.\nHowever, similar to findings for occupations with higher relative Communion levels, some of those with higher relative Agency levels may not demand higher levels of either Big Two construct (e.g., pharmacist, financial specialist). Instead, they might require strengths captured by other individual differences, such as cognitive skills, specific knowledge and expertise, or strong interest.\nConclusions and impact # This work established an initial personality assessment built using a more culturally inclusive development process. It provides researchers with a foundation for investigating personality across diverse populations while helping address the risk of treating culturally specific assumptions as universal psychological patterns.\n","externalUrl":null,"permalink":"/projects/cross-cultural-personality-assessment/","section":"Research Interests and Experience","summary":"Why the big five model is holding cross-cultural personality research back and the two-factor model to use instead.","title":"Developing a more generalizable model of personality across cultures","type":"projects"},{"content":"","externalUrl":null,"permalink":"/tags/factor-analysis/","section":"Tags","summary":"","title":"Factor Analysis","type":"tags"},{"content":"","externalUrl":null,"permalink":"/tags/item-response-theory/","section":"Tags","summary":"","title":"Item Response Theory","type":"tags"},{"content":"","externalUrl":null,"permalink":"/tags/measurement/","section":"Tags","summary":"","title":"Measurement","type":"tags"},{"content":" kmather3/2D-Rotation-Task null 0 0 Project overview # Spatial reasoning-—the ability to mentally manipulate and rotate visual information—-is needed for daily tasks such as map-reading and navigation and is particularly important in some occupations across STEM fields. However, researchers have relatively few freely available tools for measuring specific spatial abilities––especially for assessing two-dimensional (2D) rotation ability, as most available instruments assess 3D rotation. I developed and evaluated an algorithmically generated, public domain measure of 2D rotation ability using data from the Synthetic Aperture Personality Assessment (SAPA) Project.\nSome of our specific research questions were\u0026hellip;\nDoes responding across 2D rotation ability items appear to be influenced by a single ability (i.e., spatial reasoning), or do different item types require different mental processes?\nHow does 2D rotation ability relate to other cognitive abilities and personality traits?\nHow do 2D rotation ability and 3D rotation ability compare across college majors and occupations?\nThis is an example item from the complete pool of 70. Each item presents participants with a large square containing 16 small shapes in a 4 × 4 array. To the right of this square, the same square was shown rotated 0–3 times by 90 degrees, with one of the corner pieces missing from the frame. To solve the problem, participants must select the answer that completes the figure from a set of multiple-choice options. Six of the eight multiple-choice options show a puzzle piece with 1 of the 16 small shapes, and the remaining two allowed participants to indicate that they did not know the answer or that the correct answer was not included among the answer options. Each item requirea either rotation of the large square, rotation of the answer option, rotation of both the large square and answer option, or rotation of neither (i.e., simple pattern matching).\nThis item requires rotation of both the large square and the answer option to arrive at the correct answer (\u0026ldquo;G\u0026rdquo;).\nMethod # Using SAPA project data (N = 1,558,035), I evaluated the assessment\u0026rsquo;s psychometric properties, including its factor structure and internal consistency, and used item response theory to estimate participants\u0026rsquo; spatial ability.\nTo examine the items\u0026rsquo; construct validity, I explored relationships with other cognitive abilities and personality traits, and compared performance across college majors and occupations. In addition, I identified the job characteristics from the O*NET content model that were most strongly associated with spatial reasoning by applying the BISCUIT (Best Items Scales that are Cross Validated, Unit Weighted, Informative, and Transpatent) Technique. This is a statistical learning approach designed to identify informative predictors while accounting for the complexity of large, incomplete datasets (See Elleman et al. (2021) for more information).\nResults # Overall, findings indicated that the items demonstrate strong psychometric properties and hypothesized relationships with other constructs.\nPsychometric Properties # Evaluation of the factor structure of the 70-item scale suggested the presence of four lower-order factors, which reflected differences in the items\u0026rsquo; mental rotation demands (i.e., whether they demanded rotation of the larger square and/or the answer option). Thus, unidimensionality was poor (ωh = 0.47), but improved when accounting for the specific variance associated with these lower-order factors (ωh = 0.66).\nBecause this task was developed primarily as a measure of 2D rotation ability, the 12 items that do not require any rotation were removed to improve the unidimensionality of the scale (although these items could still be useful for assessing other spatial skills, such as pattern detection). The removal of these items resulted in sufficient unidimensionality of the scale with the remaining 58 items (ωh = 0.77).\nOne additional item was removed from the scale before generating IRT scores due to its interference with generating accurate overall test scores. This item had unusually high difficulty and discrimination parameters, and appeared to have a challenging distractor response option, which deviates from other items included in the scale.\nFindings from the IRT analyses indicated that the items demonstrated a broad range of difficulty (from −0.79 to 1.96; M = 0.34; SD = 0.68)\u0026ndash;indicating that the items are suitable for administration in samples across levels of expected spatial ability. In addition, item discrimination ranged from 0.91 to 3.21 (M = 1.76; SD = 0.53).\nItem Characteristic Curves from IRT analyses This figure shows the Item Characteristic Curves for the final set of 57 items (with latent ability level on the x axis and the probability of a correct response on the y axis). The difficulty level of an item is the latent ability level at which the probability of a correct response is .5.\nConstruct Validity # The 2D rotation items also demonstrated the hypothesized relationships to various other cognitive abilities and personality traits.\nAmong the cognitive abilities assessed, 2D rotation ability showed slightly larger relationships to other spatial and visual tasks (e.g., 3D rotation, matrix reasoning) than tasks that draw more on verbal skills (e.g., Verbal reasoning, Compound Remote Associates), though relationships were very similar across all ability measures.\nIn line with past findings, relationships with personality traits (i.e., the Big Five traits and the 27 SAPA Personality Inventory traits) were very modest. 2D rotation ability showed the strongest relationships with emotional stability (+), intellect (+), anxiety (-), and irritability (-) from the SAPA Personality Inventory.\nAs anticipated, job characteristics from the O*NET content model showing the strongest positive associations with 2D rotation ability were related to STEM knowledge and skills. Most job characteristics showing the strongest negative associations with 2D rotation ability were related to interpersonal skills and frequent interaction with others. Other characteristics that showed negative associations with 2D rotation ability were related to physical labor.\nThe relationship between 2D rotation ability and STEM-related tasks and activities was also supported by the associations between occupations and performance with the 2D rotation items. The occupations with the highest correlations were almost exclusively STEM-related. There was also strong overlap between the occupations that scored highest on 2D rotation ability and the occupations that scored the highest on 3D rotation ability. However, there were enough differences among the lists of majors and occupations scoring higherst on 2D and 3D rotation ability to support the discriminant validity of these measures.\nHighest scoring majors (arranged in order of 2D rotation ability percentile)\nHighest scoring occupations (arranged in order of 2D rotation ability percentile)\nConclusions and impact # This project established an openly available assessment with strong psychometric properties and support for validity that researchers can use to investigate spatial reasoning without relying on proprietary testing tools. You can find the items and information regarding psychometric properties and scoring under the Measures tab, and all code and data for this project on the github repository linked at the top of this page.\n","externalUrl":null,"permalink":"/projects/measuring-spatial-ability/","section":"Research Interests and Experience","summary":"A project designed to develop and validate a measure of spatial ability","title":"Measuring Spatial Ability","type":"projects"},{"content":" kmather3/Compound-Remote-Associates-Task PostScript 0 0 Project overview # How can researchers measure creative problem-solving reliably across large populations?\nCreativity research often relies on open-ended tasks that require participants to generate their own answers. Although useful, these tasks can be difficult to score consistently and challenging to administer at scale. I developed and validated a multiple-choice version of the Compound Remote Associates (CRA) task, which measures the ability to connect seemingly unrelated concepts.\nFor example, a participant might be asked to find a word that connects three different cue words such as \u0026ldquo;safety\u0026rdquo;, \u0026ldquo;cushion\u0026rdquo;, and \u0026ldquo;point\u0026rdquo;:\n(answer: \"pin\", or \"p\" in the multiple-choice version). Method # Using multiple large datasets, we evaluated the measure\u0026rsquo;s reliability, underlying structure, and relationships with other individual differences.\nStudy 1: Exploring factor structure, internal consistency, and construct validity\nDataset: SAPA project data (N = 1,323,480 participants) Goals: Explore the internal consistency and factor structure of the CRA items (i.e., is the measure unidimensional?), and examine relationships with other constructs. Analyses used: exploratory factor analysis, item response theory (IRT) modeling, pearson correlations, and the BISCUIT statistical learning technique. Study 2: Comparing the multiple-choice and short-answer response modes\nDataset: Undergraduate sample (N = 685 participants) Goals: Compare the multiple-choice and short-answer response modes, establish further evidence for construct validity based on GPA and standardized test scores. Analyses used: Logistic regression, pearson correlations Study 3: Examining test-retest reliability\nDataset: Prolific sample (N = 357 participants) Goals: Examine the test-retest reliability of the items over a two week period, establish further evidence for construct validity using the Cognitive Reflection Task. Analyses used: Pearson correlations Results # Psychometric properties # Overall, psychometric findings indicated that one underlying ability (creative cognition) explains responding across items, that the items show strong reliability, and that the complete item bank includes CRA items that are suitable for those across levels of creative thinking.\nFindings from the SAPA project sample (N = 1,323,480) revealed that the multiple-choice CRA items demonstrated strong psychometric properties including high internal consistency (α = .97, ω total = .97) and unidimensionality based on exploratory factor analysis findings. In addition, Item Response Theory analysis (using a 2 parameter logistic model) suggested that the multiple-choice CRA items are strong in their ability to distinguish participants at one ability level from another (i.e., they demonstrate strong item discrimination), and that the set of items collectively cover a wide range of item difficulty (i.e., there are items in the pool that are suitable for administration to participants from lower levels of ability to those with high levels of associative ability).\nItem difficulty and discrimination curves:\nTest-retest reliability:\nIn addition, findings from the prolific sample (N = 357 participants) found good stability for the items over a time period of two weeks (test–retest correlation = .74).\nConstruct validity # Findings across studies also provided evidence that the multiple-choice CRA items measure the construct they were developed to assess––creative thinking.\nComparison of new item set and multiple-choice response mode with existing remote associates task and open ended response mode:\nFirst, a mixed effects logistic regression model (used in study 2, with N = 685 undergraduates) that participants were more likely to give a correct response to problems using the multiple-choice response mode (OR = 1.89, 95% CI [1.78, 2.01]), and that the older set of items (from the Remote Associates Test or \u0026ldquo;RAT\u0026rdquo;) were easier to solve than the newer set of items (OR = 0.41, 95% CI [0.39, 0.44]).\nAn interaction term between response mode and problem set was then added to the model, which was also found to be significant (OR = 1.75, 95% CI [1.55, 1.97]). The interaction, depicted in the figure below, shows that the multiple-choice response mode had a stronger effect on the difficulty of the newer \u0026ldquo;CRA\u0026rdquo; items (i.e., making them easier to solve) than the difficulty of the older \u0026ldquo;CRAT\u0026rdquo; items. When administered using the multiple-choice response mode, the difficulty (on average) of the CRA items appears similar to the difficulty on average of the open CRAT items (i.e., the item set and mode of administration that has been used in previous work).\nPerformance on the CRA items across all item sets (newer, older), and response modes (multiple-choice, open-ended) were also moderately correlated with measures of academic achievement such as ACT scores and GPA.\nCorrelations for the newly developed items using a multiple-choice format with other constructs:\nWhen examining relationships with other individual differences, findings from the prolific sample indicated that CRA performance was positively correlated with the Cognitive Reflection Test (r = .44), which assesses individuals\u0026rsquo; ability to suppress an intuitive but incorrect answer in favor of a correct answer that requires more reflection to arrive at.\nRelationships with the Four Factor Imagination Scale indicated that CRA performance was negatively related to how directed and purposeful one\u0026rsquo;s imagination is (r = -.21)––which aligns with previous findings that more creative individuals tend toward uninhibited “mind-wandering” more than intentional brainstorming. However, we did not find the expected positive relationships for CRA performance with other dimensions of imagination, such as how frequently participants engage in imaginative thinking (non-significant correlation), and the complexity of their imagination (how detailed and intricate it is; r = -.12).\nFindings from the SAPA project sample revealed that the new, multiple-choice CRA items showed the strongest correlations with various cognitive abilities (e.g., propositional reasoning, verbal reasoning). Consistent with past findings, they also showed positive relationships with personality traits such as Openness to Experience and Intellect, and negative relationships with traits like anxiety and neuroticism.\nHowever, performance on the CRA items showed unexpectly strong positive relationships with prosocial traits such as Agreeableness and Honesty––even after controlling for cognitive ability. These results were surprising given past findings which most often suggest that creativity shows no relationship with these traits, or sometimes even that creative people have a tendency toward interpersonal antagonism and dishonesty (e.g., Feist, 1998). However, some findings deviate from this pattern and are more in line with the present findings. Because few studies have examined how CRA items relate to temperament, it is unclear whether the relationship creativity shows with the traits of honesty and agreeableness varies across measures (e.g., CRA items, measures of divergent thinking). The relationship between creativity and agreeableness could also vary depending on how creativity is conceptually defined.\nFindings from the SAPA project sample also suggested that those who performed the highest on the CRA items chose more creative majors and occupations––particularly those demanding strong verbal skills (relative to math or spatial skills).\nUsing the BISCUIT statistical learning technique, we also examined the relationships for CRA performance with the 200+ job characteristics described in the O*NET content model––which capture the various abilities, skills, work styles, knowledge bases, and tasks demanded by a given role.\nJob characteristics most strongly associated with CRA performance are shown in descending order in the table below, along with information regarding how many times the job characteristic appeared in the optimal model (N), mean correlation (mean r), and the standard devation of correlations across bootstrap iterations.\nThese findings, which revealed job characteristics such as writing and reading comprehension as being most strongly related to CRA performance, further emphasized the importance of verbal skills for solving these problems. Job characteristics relating to creativity—such as originality, thinking creatively, and innovation—were also, to a lesser extent, among the top characteristics.\nConclusions and impact # This work produced a scalable, validated tool for studying creative problem-solving. By making the task easier to administer and analyze in large surveys, the project helps researchers investigate creativity across diverse populations and examine how associative ability relates to cognitive skills, personality, and occupational outcomes.\nPresentation slides from the European Association of Personality Psychology Conference\u0026ndash;2022 ","externalUrl":null,"permalink":"/projects/measuring-creativity/","section":"Research Interests and Experience","summary":"A project designed to develop and validate a measure of verbal creativity using new and existing Compound Remote Association (CRA) Task items","title":"Measuring Verbal Creativity","type":"projects"},{"content":"","externalUrl":null,"permalink":"/tags/personality/","section":"Tags","summary":"","title":"Personality","type":"tags"},{"content":"All items and information regarding the personality assessment materials I\u0026rsquo;ve developed can be found on this page!\nCompound Remote Associates (CRA) Items # Download all CRA items (including newly developed items and items from the Remote Associates Test developed by Mednick \u0026amp; Halpern (1962)) as a csv file here or as an xlsx file here.\nAdministration Guidelines:\nCRA items assess the ability to find a connection among seeminly unrelated words. They offer a strong method for measuring creative thinking, and can be administered using either an open-ended or multiple-choice response format (shown below).\n(answer: \"pin\", or \"p\"). Together, the complete set of 96 items included in the file cover a wide range of difficulty, making them suitable for administration in samples across levels of creativity. To help those interested in administering CRA items, information on the difficulty of each item is included in the following files (the \u0026ldquo;difficulty\u0026rdquo; column refers to the IRT item difficulty parameter and the \u0026ldquo;mean\u0026rdquo; column refers to the proportion of participants in the SAPA project sample who responded correctly).\nScoring:\nI recommend selecting a subset of CRA items that cover the full range of item difficulty (i.e., some easier items, some more difficult items, but mostly items somewhere in the middle range). Item difficulty is reflected in both the difficulty IRT parameter and the proportion of correct responses. While sum scoring the CRA items is an option, IRT scoring will provide more accurate scores based on known item difficulty levels.\nColumn included in the file:\nSAPA Item label: The label given to the item in the SAPA project dataset. This could be useful for those looking for more information on a particular item in the supplemental file, dataset, or results (e.g., factor loading). Stimuli 1: First stimuli word in the CRA item (e.g., \u0026ldquo;safety\u0026rdquo;) Stimuli 2: Second stimuli word in the CRA item (e.g., \u0026ldquo;cushion\u0026rdquo;) Stimuli 3: Third stimuli word in the CRA item (e.g., \u0026ldquo;point\u0026rdquo;) Solution: The word that connects the three words (e.g., \u0026ldquo;pin\u0026rdquo;) discrimination: IRT discrimination parameter (i.e., how well does this item distinguish those at one ability level from another?) difficulty: IRT difficulty parameter (i.e., at what ability level do participants have a 50% chance of answering correctly? Higher values indicate that the item is harder to solve) mean: The proportion of participants who responded correctly from the SAPA project sample used to validate the items se: Standard error n: Number of responses for this item in the SAPA dataset Reference:\nMather, K. A., Weston, S. J., \u0026amp; Condon, D. M. (2024). Scaling a common assessment of associative ability: Development and validation of a multiple-choice compound remote associates task. Behavior Research Methods, 56(7), 1-29. https://doi.org/10.3758/s13428-024-02422-3\nTwo-dimensional Rotation Items # Download a zip file with all 2D rotation items here, the answer key here:(as csv)/(as xlsx), and information on the psychometric properties for the validated set of items here: (as csv)/(as xlsx).\nAdministration Guidelines:\nEach of these spatial ability items presents a large square containing 16 small shapes in a 4 × 4 array. To the right of this square, the same square is shown rotated 0–3 times by 90 degrees, with one of the corner pieces missing from the frame. Participants should select the answer that completes the figure from a set of multiple-choice options. Six of the eight multiple-choice options show a puzzle piece with 1 of the 16 small shapes, and the remaining two allow participants to indicate that they do not know the answer or that the correct answer is not included among the answer options.\nEach item requires either rotation of the large square, rotation of the answer option, rotation of both the large square and answer option, or rotation of neither (i.e., simple pattern matching). The example item below requires rotation of both the larger square and the answer option to arrive at the correct answer (\u0026ldquo;C\u0026rdquo;).\nScoring:\nI recommend selecting a subset of these 2D rotation items that cover the full range of item difficulty (i.e., some easier items, some more difficult items, but mostly items somewhere in the middle range). Item difficulty is reflected in both the difficulty IRT parameter and the proportion of correct responses. While sum scoring the 2D rotation scale is an option, IRT scoring will provide more accurate scores based on known item difficulty levels.\nColumns included in file with information on validated set of items:\nitem: The label given to the item in the SAPA project dataset (which correspond to the item numbers for the items included in the zip file) mean: The proportion of participants who responded correctly from the SAPA project sample used to validate the items sd: Standard deviation N: Number of responses for this item in the SAPA dataset discrimination: IRT discrimination parameter (i.e., how well does this item distinguish those at one ability level from another?) difficulty: IRT difficulty parameter (i.e., at what ability level do participants have a 50% chance of answering correctly? Higher values indicate that the item is harder to solve) Reference:\nMather, K. A., \u0026amp; Condon, D. M. (2023). Development of a Public-Domain Measure of Two-Dimensional Rotation Ability and Preliminary Evidence for Discriminant Validity among Occupations. Journal of Intelligence, 11(10), 191. https://doi.org/10.3390/jintelligence11100191\nCross-cultural Big Two Inventory (CCBTI) # The CCBTI measures the \u0026ldquo;Big Two\u0026rdquo; traits of Communion/Social Self-regulation (the internalization versus resistance to the normative code\u0026rsquo;s of one\u0026rsquo;s society\u0026ndash;with components of warmth, morality, respect, and industriousness), and Dynamism (which reflects approach versus avoidant tendencies, with components of competence, confidence, fearlessness, positive mood, and sociability).\nDownload all CCBTI items as a csv file here or as an xlsx file here.\nAdministration Guidelines:\nThis file includes all CCBTI items, the Big Two subscale they measure, and information regarding their factor loadings when using raw and ipsatized data. Note that the file contains the complete pool of 55 items for transparency purposes, but only 45 items were retained in the final validated scale. You can filter spreadsheet to see only these 45 items using the \u0026ldquo;Final_Scale\u0026rdquo; column and removing rows with the value \u0026ldquo;No\u0026rdquo;.\nAll items begin with the stem \u0026ldquo;I tend to be\u0026hellip;\u0026rdquo; (e.g., I tend to be shy, I tend to be energetic). The response format used for the validated measure was a 6-point scale with options:\n(1) strongly inaccurate (2) somewhat inaccurate (3) slightly inaccurate (4) slightly accurate (5) somewhat accurate (6) strongly accurate\nColumns included in the file:\nThis file is a factor loading table for the CCBTI items arranged by ipsatized data factor loadings (i.e., you\u0026rsquo;ll see all items with primary loadings onto the \u0026ldquo;Agency\u0026rdquo; factor first, arranged in descending order of factor loading, and then all items with primary loadings on to the \u0026ldquo;Communion\u0026rdquo; factor, arranged in descending order of factor loading). Here is the information included in the file:\nitem: Item label in the SAPA dataset content: Item phrasing Reverse_Score: Whether to reverse score the item (if so, the value will be \u0026ldquo;Yes\u0026rdquo;) subscale: Big Two subscale (Agency or Communion) Final_Scale: Whether or not the item was included in the final scale Primary Ips: Primary construct loading when using ipsatized data (Agency or Communion) Agency Ips: Loading onto the Agency factor for ipsatized data Communion Ips: Loading onto the Communion factor for ipsatized data Loading ratio Ips: Primary:Secondary factor loading ratio for ipsatized data Primary raw: Primary construct loading when using raw data (Agency or Communion) Agency raw: Loading onto the Agency factor for raw data Communion raw: Loading onto the Communion factor for raw data Loading ratio: Primary:Secondary factor loading ratio for raw data Scoring:\nThere are a few options for generating CCBTI scale scores for Agency and Communion. We used mean scoring (taking the mean response of items answered), but sum scoring can also be used is missing data is not an issue. Remember to filter out items that were not included in the final scale (i.e., those with a value of \u0026ldquo;No\u0026rdquo; under the \u0026ldquo;Final_Scale\u0026rdquo; column) and to reverse score items with the value \u0026ldquo;Yes\u0026rdquo; in the \u0026ldquo;Reverse_Score\u0026rdquo; column.\nReference:\nThalmayer, A. G., Mather, K. A., Saucier, G., Naudé, L., Florence, M., Adonis, T. A., \u0026hellip; \u0026amp; Condon, D. M. (2025). The cross-cultural big two: A culturally decentered theoretical and measurement model for personality traits. Journal of Personality and Social Psychology, 128(5), 1181. https://doi.org/10.1037/pspp0000528\n","externalUrl":null,"permalink":"/measures/","section":"","summary":"","title":"Personality Assessment Materials","type":"page"},{"content":" Conference Posters # Mather, K., Weston, S., \u0026amp; Condon, D. (July, 2023). An Item-Level Method for Evaluating Measurement Invariance Presented at the Association for Research in Personality Conference. poster, slides\nMather, K., Weston, S., \u0026amp; Condon, D. (July, 2022). Development and validation of a Two-Dimensional Rotation Ability Scale Presented at the International Society for Intelligence Research conference. poster\nMather, K., Weston, S., \u0026amp; Condon, D. (July, 2022). Development and validation of a Two-Dimensional Rotation Ability Scale Presented at the European Conference of Psychology. poster\nMather, K., Weston, S., \u0026amp; Condon, D. (February, 2022). Do Compound Remote Associates Items Provide a Valid Assessment of Creativity? Presented at the Society for Personality and Social Psychology conference.poster\nMather, K., Weston, S., \u0026amp; Condon, D. (July, 2021). Evaluating the Validity of Compound Remote Associates Items. Presented at the Association for Research in Personality Conference. presentation, poster\nConference Talks # Mather, K. \u0026amp; Condon, D. (August, 2024). An Item-level Method for Evaluating Measurement Invariance. Presentation given at the European Conference of Psychology. slides\nMather, K., Weston, S., \u0026amp; Condon, D. (July, 2022). Evaluating the Validity of Compound Remote Associates Items. Presentation given at the European Conference of Psychology. slides\nMather, K., Condon, D., Rotzinger, J., Saucier, G., \u0026amp; Thalmayer, A., G. (July, 2022). The CrossCultural Big Two: Assessment of a Culturally De-Centered Inventory in 27 Nations. Presentation given at the International Association for Cross Cultural Psychology. presentation, slides\nPresentation slides from my dissertation defense\u0026ndash;2026\n","externalUrl":null,"permalink":"/presentations/","section":"","summary":"","title":"Presentations","type":"page"},{"content":"","externalUrl":null,"permalink":"/tags/r/","section":"Tags","summary":"","title":"R","type":"tags"},{"content":" Why personality psychology? # I\u0026rsquo;ve been interested in personality since well before I had frameworks for describing it! I\u0026rsquo;ve always enjoyed learning about how other people think and view the world, and studying personality psychology is one way to do that more systematically. I\u0026rsquo;m very driven by the idea that a lot of conflict and misunderstanding among people can be explained by the assumptions we make about those who behave differently than us. I think learning about personality can turn differences we might initially view with distrust or frustration into a stronger understanding of each other.\nI was also drawn to personality research because of how applicable it is to so many topics we care about. Personality psychology offers a very useful lens for understanding behavior as it relates to anything from people\u0026rsquo;s life outcomes (e.g., regarding health, well-being, education), to broader policy or business-related decisions. It also connects easily to other fields across the social sciences and subfields within psychology, which can make for some very interesting interdisciplinary work.\nHow do measurement-related decisions shape the conclusions we draw from our data? # This question has been the throughline of my research, which focuses on how we measure a variety of personality differences. The measurement strategy we choose can influence every step of the research process—-from how we conceptualize a psychological variable to the conclusions we draw about its relationship with outcomes of interest.\nMy projects have focused on developing public-domain personality assessment tools, exploring the limitations of measurement-related norms and assumptions (e.g., the use of multi-item scales and latent variable modeling approaches), and identifying alternative measurement and data analysis strategies.\nYou can read more about my previous work below!\n","externalUrl":null,"permalink":"/projects/","section":"Research Interests and Experience","summary":"","title":"Research Interests and Experience","type":"projects"},{"content":"","externalUrl":null,"permalink":"/series/","section":"Series","summary":"","title":"Series","type":"series"},{"content":"","externalUrl":null,"permalink":"/tags/statistical-learning/","section":"Tags","summary":"","title":"Statistical Learning","type":"tags"},{"content":"","externalUrl":null,"permalink":"/tags/","section":"Tags","summary":"","title":"Tags","type":"tags"},{"content":" kmather3/Item-level null 0 0 This page discusses the work I completed for my dissertation. You can read it online here if you\u0026rsquo;re interested in learning more!\nBackground # The Big Five is one of the most widely used frameworks for measuring personality. It organizes personality into five broad traits: Extraversion, Agreeableness, Conscientiousness, Neuroticism, and Openness to Experience. One reason for its popularity is that it reaches a useful balance between comprehensiveness and parsimony: it captures many important components of personality without requiring researchers to measure an overwhelming number of variables.\nHowever, the Big Five isn\u0026rsquo;t necessarily the best framework for every research question. Some studies require more specific measures of personality, while others benefit from broader descriptions of individual differences. These different approaches occupy different levels of the personality trait hierarchy, which organizes traits according to how broadly or narrowly they are defined.\nFor example, the item \u0026ldquo;I start conversations\u0026rdquo; captures a specific behavior associated with Gregariousness, a facet of Extraversion, which falls under the broader meta trait of Plasticity. Each level offers a different perspective on personality, and the most useful level of analysis depends on the research question.\nDespite the value of these different approaches, researchers often default to the Big Five, even when other models may be more appropriate. Cross-cultural research, for example, increasingly suggests that broader frameworks like the Big Two (Social Self-Regulation and Dynamism) generalize more consistently across cultural contexts. Yet the Big Five remains widely used, partly because of longstanding assumptions that its five traits represent universal, biologically grounded dimensions of personality.\nAnother reason for the dominance of the Big Five is the influence of Classical Test Theory, which shaped traditional approaches to psychological measurement. These approaches emphasize using multiple items to measure broad, underlying traits and treating the unique variance associated with individual items largely as measurement error. This perspective helped establish many of the measurement practices that are used today, and often leads researchers to measure personality traits using a latent variable modeling approach––which is very useful for differentiating trait-relevant variance from measurement error.\nHowever, advances in statistical methods and computing have made it possible to reconsider some of these assumptions. Research increasingly shows that individual personality items possess many of the characteristics we associate with personality traits, including stability over time, agreement across observers, and heritability (Mõttus et al., 2014, 2017, 2019). More importantly, specific personality characteristics can sometimes predict real-world outcomes even after accounting for the broader traits they are typically used to measure (Mõttus et al., 2022; Seeboth \u0026amp; Mõttus, 2018).\nThis raises an important question: Are we overlooking meaningful personality information by treating the unique variance in individual items as measurement error?\nRather than automatically assuming that personality items are interchangeable indicators of broader traits, we might consider whether their individual contributions are meaningful in their own right. For example, Extraversion could be understood not simply as an underlying trait reflected in a collection of interchangeable behaviors, but as a system of distinct, interconnected characteristics.\nOne strategy for navigating model selection could be to focus on individual personality items as units of analysis first rather than aggregating them into broader scales from the beginning. This has already been proposed by some researchers focusing on test-validity, who recommend examining causal relationships between items, and item response processes before exploring evidence for the construct validity of a multi-item scale (e.g., test-retest reliability, internal consistency, relationships with other scales; Rhemtulla et al., 2021).\nThe Case for Item-Level Assessment in Cross-Cultural Research # Cross-cultural personality research is one area where item-level assessment may be particularly valuable. Identifying personality frameworks that generalize across different cultural contexts has long been a challenge. Existing evidence suggests that broader models, such as the Big Two and Big Three, often demonstrate stronger cross-cultural generalizability than more specific frameworks like the Big Five.\nBut what if we\u0026rsquo;re interested in more specific personality differences?\nConsider emotional expressivity. A broad trait like Dynamism captures several characteristics, including assertiveness, sociability, adaptability, and emotional expressivity. Even if Dynamism can be measured consistently across cultures, it may not tell us much about the specific ways people express their emotions.\nAt the same time, using an existing emotional expressivity scale presents its own challenges. Cultural norms influence which emotions people feel comfortable expressing, how openly they communicate their feelings, and how they interact with others. As a result, a scale developed in one cultural context may not capture the same experiences in another.\nAn item-level approach offers another possibility: rather than relying on a single broad scale, researchers can examine individual questions that capture different aspects of emotional expressivity. These might include how freely people express emotions like sadness or anger, how much they reveal about themselves to others, and how naturally or comfortably they express their feelings.\nBy examining these specific characteristics individually, we may be able to identify meaningful cross-cultural similarities and differences that broader personality models would otherwise overlook.\nComparing groups at the item-level: Beyond t-tests and F-tests # Another expanation for the lack of item-focused research could be the limited statistical options for addressing research questions at the item-level. Some options––such as Differential Item Functioning (DIF) analysis from the Item Response Theory framework––sound like they would be item-centered, but still mostly tell us about how items relate to their broader scales. Alternative options include comparing group means and variances throught the use of t-tests and F-tests, respectively. A key limitation of these tests is that they only detect differences in one aspect of the distribution, and it\u0026rsquo;s possible that two groups show differences in their distributions that maybe one or both of these tests together wouldn\u0026rsquo;t be able to detect. The Dowd Test Statistic # Instead it would be preferable to detect whether the entire distributions for two groups differ using a single test, which can be done by comparing their empirical cumulative distribution functions or \u0026ldquo;ECDF\u0026quot;s.\nThere are several existing tests for comparing group ECDFs. For this work, I used the Dowd Test Statistic (DTS), which combines the strengths of several of these previously developed tests: The Wasserstein Statistic and the Anderson-Darling Statistic. The DTS test takes the variance weighted integral of the area between the ECDFs––which improves upon the statistical power of previous tests by assigning more weight to stable areas of the distribution with lower variance than those with higher variance that are more likely to be affected by sampling variability.\nThe formula for the statistic is:\nTo give a quick example, let\u0026rsquo;s say we compare the Philippines and the United States on the item \u0026ldquo;I am quiet around strangers\u0026rdquo; with response options from 1 (strongly disagree) to 6 (strongly agree)\u0026hellip;\nIf D(3) = .9, this means the model is fairly confident that the response of 3, or “slightly disagree” came from the Philippines If D(3) is .1, the model is confident that the response of 3 came from the United States If D(3) is around .5, the model is unsure which sample the response came from When the classifier is more confident about which sample each response option likely came from, the denominator is smaller, which leads to a larger DTS effect size. When the classifier is more uncertain (near 0.5 across response options), the denominator is larger, which leads to a smaller DTS effect size.\nApplying DTS # Comparisons across SAPA Personality Inventory (SPI) Items # In this work, I used a dataset from the SAPA project (N = 25,598) to compare responding in a set of culturally diverse nations on each of the 135 SAPA Personality Inventory items using the DTS test. Nations included in analyses were selected based on global representation and whether they met a minimum threshold of 100 pairwise administrations per item pair (as the SAPA project uses a planned missingness design). This left 12 nations: the United States, Canada, the United Kingdom, Australia, Sweden, India, Germany, the Netherlands, China, Singapore, the Philippines, and Norway.\nThis results in a total of 10,530 DTS tests across combinations of the 135 items and 78 nation pairs (of the 12 nations). Here are two example DTS test results for an item with a fairly large significant effect size (\u0026ldquo;I am full of ideas\u0026rdquo;) and an item with a non-significant effect (\u0026ldquo;I do not like art\u0026rdquo;). Response options from 1-6 are shown on the x-axis of each figure, and the percentile of responses at or below a given response option is shown on the y-axis of each figure.\nAcross all DTS tests, 36% were statistically significant.\nItems with the fewest differences in responding across nations (with broader SPI construct/Big Five construct in parentheses) were:\n“Believe that others have good intentions” (SPI Trust/Big Five Agreeableness) “Am not bothered by disorder” (SPI Order/Big Five Conscientiousness) “Adjust easily” (SPI Adaptability/Big Five Openness) “Am open about my feelings” (SPI Emotional expressiveness/Big Five Neuroticism) “Let things proceed at their own pace” (SPI Easygoingness/Big Five Conscientiousness) “Tell the truth” (SPI Honesty/Big Five Agreeableness) “Jump into things without thinking” (SPI Impulsivity/Big Five Conscientiousness) Items with the most differences in responding across nations (with broader SPI construct/Big Five construct in parentheses) were:\n“Like to stand during the national anthem” (SPI Conservatism/Big Five Openness) “Learn things slowly” (SPI Intellect/Big Five Openness) “See myself as an average person” (SPI Conformity/Big Five Agreeableness) “Believe in one true religion” (SPI Conservatism/Big Five Openness) “Lack the talent for influencing people” (SPI Charisma/Big Five Extraversion) “Fear for the worst” (SPI Anxiety/Big Five Neuroticism) “Don’t consider myself religious” (SPI Conservatism/Big Five Openness) While there are a few trends here (such as the higher number of conservatism items with many cross-national differences), it is notable that there were items from a variety of SPI and Big Five scales represented on both of these lists. It suggests that even more precise, fine grained constructs such as the SPI traits might sometimes obscure cultural differences that exist at the item level.\nEffect Sizes for all significant DTS tests across item x nation pair combinations\nTo better understand patterns in repsonding across the SPI items and nation pairs, it can be useful to look at them visually. Effect sizes for all statistically significant (p \u0026lt; .05) DTS tests are shown in the figure below. Nation pairs are represented by their ISO 3 codes and on the x axis (e.g., The \u0026ldquo;AUS_CAN\u0026rdquo; label indicates tests between Australia and Canada), and SPI items are shown on the y axis (grouped and color-coded by SPI trait). In order on the y axis, these SPI constructs include: irritability, industry, humor, authoritarianism, impulsivity, art appreciation, perfectionism, attention seeking, well being, adaptability, charisma, compassion, honesty, trust, emotional stability, easygoingness, anxiety, sensation seeking, conservatism, intellect, emotional expressiveness, sociability, self-control, conformity, order, introspection, and creativity.\nThere are a few items (and broader constructs) where the larger effect sizes appear to cluster, such as those included among items with the highest number of differences (\u0026ldquo;I tend to vote for conservative political candidates\u0026rdquo;, \u0026ldquo;I like to stand for the national anthem\u0026rdquo;, \u0026ldquo;I believe in one true religion\u0026rdquo;, and \u0026ldquo;I don\u0026rsquo;t consider myself religious\u0026rdquo;). Some of these findings are likely driven by the varied relevance of the item across nations (e.g., regarding standing for the national anthem), and others reflect known differences in religiosity across cultures.\nA few other items that stand out in this figure include:\n\u0026ldquo;I am full of ideas\u0026rdquo; \u0026ldquo;I think of others first\u0026rdquo; \u0026ldquo;I think quickly\u0026rdquo; Comparisons across 2,623 International Personality Item Project Items # Using nearly 1.03 million participants from the Synthetic Aperture Personality Assessment (SAPA) Project, we compared the ECDFs for 2,623 personality items from the International Personality Item Project (IPIP; https://ipip.ori.org/) across 13 countries. This resulted in a total of 204,594 DTS tests across all item x nation pair combinations.\nOverall, 56% of DTS tests were statistically significant\nThe following image shows the distribution of the proportion of significant tests per item across the 204,594 DTS comparisons. This distribution appears fairly normally distributed, though some items showed a notably high proportion of significant DTS tests.\nFor the following 37 of the 2,623 IPIP items, 100% of cross-national comparisons were statistically significant:\nAm able to come up with new and different ideas Am full of ideas. Am not bothered by disorder. Am skilled in handling social situations. Believe in one true religion. Believe that people are basically moral. Dislike myself. Don\u0026rsquo;t consider myself religious. Feel comfortable with myself. Get angry easily. Have a natural talent for influencing people. Have a slow pace to my life. Jump into things without thinking. Let things proceed at their own pace. Like order. Like to be thought of as a normal kind of person. Like to stand during the national anthem. Like to take it easy. Love dangerous situations. Never spend more than I can afford. Never splurge. Often forget to put things back in their proper place. Often make decisions on the spur of the moment. Panic easily. Prefer variety to routine. Put on a show to impress people. Rarely get irritated. Rarely overindulge. Seek danger. Start tasks right away. Take risks. Tend to vote for conservative political candidates. Think quickly. Think that my moods don\u0026rsquo;t change more than most people\u0026rsquo;s do. Trust people to mainly tell the truth. Trust what people say. Use others for my own ends. Many items were related to impulsivity or sensation-seeking (items like “I seek danger” or “I take risks”). A few were related to influencing others in various ways or attention-seeking, like “I have a natural talent for influencing people”, or “I put on a show to impress people”. Some items were conscientiousness related, like “I am not bothered by disorder” or “I start tasks right away”. Others, as expected, were openness-related items (so items like “I prefer variety to routine”, “I believe in one true religion”, “Like to be thought of as a normal kind of person”)\nWhen looking at items that had more than 90% significant comparisons across nation pairs, there were many additional openness items:\nSpend time reflecting on things Love to reflect on things Tend to vote for liberal political candidates Seek adventure Learn things slowly Enjoy examining myself and my life Don’t like the idea of change Do not like poetry Believe in the importance of art Am quick to understand things Can handle a lot of information Try to understand myself Am quick to understand things Can handle a lot of information Try to understand myself Love to think up new ways of doing things Have read the great literary classics Have a vivid imagination Catch on to things quickly Am an original thinker Do not enjoy going to art museums Would hate to be considered odd or strange These findings align with the field\u0026rsquo;s understanding of Openness to Experience as a diffcult trait to measure across cultures, as it appears to lack relevance in some non-Western contexts (cite). Previous work has suggested that Openness lacks the universality of other broad constructs, like Agreeableness and Extraversion.\nHowever, most work exploring the generalizability of personality models has focused solely on broad constructs, and findings at the item-level tell a different story. Openness-related items were not only overrepresented among those with the most cross-national differences in responding, but also in the set of items with the fewest cross-national differences in responding.\nFor example, these are the IPIP items that showed the fewest differences in responding across nations (less than 20%), with Openness items shown in bold:\nBelieve that there are many sides to most issues Want to understand things Enjoy the beauty of nature Know how to fly a helicopter Have little patience for slackers Am committed to principles of justice and equality Am able to see how other peoples’ emotions can affect their behaviors Don’t have a soft side Have lived in all 50 states in the U.S.A. Love to chat Look at the facts Think a lot before complaining in a restaurant if my meal is not well-prepared Want to know the reasons why Additional Openness items for which fewer than 30% of cross-national comparisons were significant included\u0026hellip;\nEnjoy games of strategy Try to identify the reasons for my actions Go my own way Love to learn new things Don’t like to travel Get excited when I learn new things Like to visit new places Love to read challenging material Love to travel to places that I have never been before Understand things quickly Want to increase my knowledge Come up with alternatives Am good at thinking of solutions that no one else thinks of Prefer to analyze problems rather than just describe them See beauty in things others might not notice Have new ideas for improving things Look at myself through others’ eyes Love to hear about other countries and cultures Tend to think about something for hours Am a true life-long learner Can see different points of view Can sense how things will turn out Care about justice Notice contradictions Try to do difficult things Does Openness to Experience have a \u0026ldquo;universal core\u0026rdquo;? # Findings regarding these Openness items highlight the value of evaluating differences at more granular levels––particularly the item level. On one hand, they’re consistent with the many findings suggesting that Openness to Experience lacks generalizability across cultures. However, they also build on more recent work suggesting that Openness might have a more “universal core” that generalizes well across cultures and focuses more on how reflective and knowledgeable people are rather than how much they stand out from others and stray from norms and traditions. Thalmayer and Schwaba (2025) propose the following differences in the structure of Openness for Western cultures and Majority-world cultures:\nWhen looking for themes among the openness items showing the most and fewest differences in responding across cultural contexts, the present work supports this claim:\nOpenness items with the most differences in responding across nations included those related to\u0026hellip;\nIdea generation without a specific purpose: \u0026ldquo;I am able to come up with new and different ideas\u0026rdquo;, \u0026ldquo;I have a vivid imagination\u0026rdquo;, \u0026ldquo;I am full of ideas\u0026rdquo;, \u0026ldquo;I love to think up new ways of doing things\u0026rdquo; \u0026ldquo;Quickness\u0026rdquo;: \u0026ldquo;I think quickly\u0026rdquo;, \u0026ldquo;I learn things slowly\u0026rdquo;, \u0026ldquo;I am quick to understand things\u0026rdquo;, \u0026ldquo;I catch on to things quickly\u0026rdquo; Standing out from others: \u0026ldquo;I like to be thought of as a normal kind of person\u0026rdquo;, \u0026ldquo;I would hate to be considered odd or strange\u0026rdquo;, \u0026ldquo;I am an original thinker\u0026rdquo; Art, politics, and religion: \u0026ldquo;I believe in the importance of art\u0026rdquo;, \u0026ldquo;I do not enjoy going to art museums\u0026rdquo;, \u0026ldquo;I believe in one true religion\u0026rdquo;, \u0026ldquo;I tend to vote for liberal political candidates\u0026rdquo; Openness items with the fewest differences in responding across nations included those related to\u0026hellip;\nComing up with solutions or strategies: \u0026ldquo;I have new ideas for improving things\u0026rdquo;, \u0026ldquo;I come up with alternatives\u0026rdquo;, \u0026ldquo;I am good at thinking of solutions that no one else thinks of\u0026rdquo;, \u0026ldquo;I enjoy games of strategy\u0026rdquo; Enjoyment of learning, challenging oneself: \u0026ldquo;I am a true life-long learner\u0026rdquo;, \u0026ldquo;I love to learn new things\u0026rdquo;, \u0026ldquo;I love to read challenging material\u0026rdquo;, \u0026ldquo;I try to do difficult things\u0026rdquo;, \u0026ldquo;I want to increase my knowledge\u0026rdquo;, \u0026ldquo;I want to understand things\u0026rdquo; Perspective-taking: \u0026ldquo;I can see different points of view\u0026rdquo;, \u0026ldquo;I look at myself through others’ eyes\u0026rdquo;, \u0026ldquo;I believe there are many sides to most issues\u0026rdquo; Cultural exploration: \u0026ldquo;I love to hear about other countries and cultures\u0026rdquo;, \u0026ldquo;I like to visit new places\u0026rdquo;, \u0026ldquo;I don\u0026rsquo;t like to travel\u0026rdquo; While these items are grouped into broader themes for ease of interpretation, these results likely wouldn\u0026rsquo;t have been found at the facet level as an alternative to the item level. There are items on each of these lists that are highly similar, and that researchers (myself included) might include in the same scale based on the assumption that they are assessing the same individual difference. For example, it would be very reasonable to inlcude the items \u0026ldquo;I love to think up new ways of doing things\u0026rdquo; and \u0026ldquo;I have new ideas for improving things\u0026rdquo; in the same scale, and maybe even view them as redundant and ultimately remove one of them. However, these items differ greatly in whether they reveal cultural differences.\nThis could be due to the phrasing of the items. But another possibility is that it reveals something about the value that different cultures place on novelty and idea generation as an end itself (not only in the service of some kind of personal or societal improvement). In some places, this might be seen as a generally positive thing\u0026ndash;something associated with creative greatness and innovation. In others, it might be seen more as wasting time.\nConclusions and impact # The work demonstrates that item-level constructs offer several advantages across areas of personality research. Focusing on the item-level is useful for both broader scale development purposes and for detecting differences in more narrowly defined individual differences, which would otherwise be missed when aggreating item responses into broader scale scores. This is especially important to consider when comparing personality across cultures.\nThis work also demonstrated the use of a more item-centric statistical approach for approaching research questions at the item level: the DTS test. One explanation for the relative lack of item-focused research could be the strong norms in the field regarding personality measurement and the statistical approaches that are considered more rigorous––which center multi-item scales that measure broadly defined personality traits. Findings from the present work suggest that it would be beneficial to identify or develop additional statistical approaches for exploring research questions at the item-level.\nWhile broad trait models like the Big Five will remain highly useful in personality research, many research questions would benefit from a stronger focus on the item-level or on other levels of the trait hierarchy. Personality research would likely benefit the most from viewing these levels of the trait hierarchy as complementary approaches, and from reporting findings at multiple levels.\nPosters and talks on item-level analysis:\nPoster presented at the Association for Research in Personality Conference\u0026ndash;2023\nPresentation slides from my dissertation defense\u0026ndash;2026\n","externalUrl":null,"permalink":"/projects/item-level-assessment/","section":"Research Interests and Experience","summary":"Conventional scale development wisdom might not always be the best approach","title":"The case for using individual personality items","type":"projects"}]