SciELO - Scientific Electronic Library Online

 
vol.17 issue1Attitudes towards Sexual Behaviour: an Ex ploratory Analysis of a Comprehensive ModelVoluntary Ethanol Intake and Anxiety Behavior in Wistar-Uis Rats author indexsubject indexarticles search
Home Pagealphabetic serial listing  

Services on Demand

Journal

Article

Indicators

Related links

  • On index processCited by Google
  • Have no similar articlesSimilars in SciELO
  • On index processSimilars in Google

Share


International Journal of Psychological Research

Print version ISSN 2011-2084

int.j.psychol.res. vol.17 no.1 Medellín Jan./June 2024  Epub June 12, 2024

https://doi.org/10.21500/20112084.6106 

Research Article

Validity and Internal Consistency of a Spanish Version of the Cognitive Flexibil ity Scale (CFS)

Validez y consistencia interna de la versión en español de Cognitive Flexibility Scale (CFS)

Mariana Beatriz López*  1  2 
http://orcid.org/0000-0002-6061-7710

Vanessa Arán Filippetti1  2 
http://orcid.org/0000-0002-0753-5089

Gabriela Liliana Krumm1  2 
http://orcid.org/0000-0002-2765-9062

1Consejo Nacional de Investigaciones Científicas y Técnicas (CONICET), Buenos AiresC1425FQB, República Argentina

2Centro Interdisciplinario de Investigación en Ciencias de la Salud y del Compor tamiento (CIICSAC) de la Universidad Adventista del Plata (UAP), Libertador San Martin, E3103XAF, Entre Ríos, República Argentina.


Abstract:

Objective:

This study presents a Spanish version of the Cognitive Flexi bility Scale (CFS), a subjective and brief instrument to measure Cognitive Flexibility (CF), and analyzes its psychometric characteristics.

Method:

The items of the scale’s original version were adapted to Spanish. An interview containing the adapted version of the CFS, the Adult Executive Functioning Inventory (ADEXI), the Interpersonal Reactivity Index (IRI), and sociodemographic data, was administered to an intentional sample of 369 Argentine adults, aged between 18 and 60, through an online platform.

Results:

The CFS’s internal consistency was high (a = .813). A two-factor model, Strengths and Difficulties in CF, showed the best fit for the data. The CFS shows a negative correlation with the executive deficit and a positive correlations with empathy dimensions.

Discussion:

The Spanish-adapted version of the CFS shows satisfactory psychometric properties in the Argentine adult population.

Keywords: Cognitive Flexibility; Adaptation; Reliability; Validity.

Resumen:

Objetivo:

Este estudio presenta una versión en español de la Cognitive Flexibility Scale (CFS), un instrumento subjetivo y breve para medir la Flexibilidad Cognitiva (FC), y analiza sus características psicométricas.

Método:

Los ítems de la versión original de la escala fueron adaptados al español. Se administró una entrevista estructurada conteniendo la versión adaptada de la CFS, el Adult Executive Functioning Inventory (ADEXI), el Interpersonal Reactivity Index (IRI) y datos sociodemográficos, a una muestra intencional de 369 adultos argentinos de entre 18 y 60 años, a través de una plataforma en línea.

Resultados:

La consistencia interna de la CFS fue alta (a = .813). Un modelo de dos factores, Fortalezas y Dificultades en la CF, mostró el mejor ajuste a los datos. La CFS mostró una correlación negativa con el déficit ejecutivo y una correlación positiva con diferentes dimensiones de la empatía.

Discusión:

La versión adaptada al español de la CFS mues tra propiedades psicométricas satisfactorias en población adulta argentina.

Palabras Clave: Flexibilidad cognitiva; adaptación; confiabilidad; validez

1. Introduction

Cognitive Flexibility (CF) is the ability to alternate be tween different approaches or perspectives when analyz ing a problem or situation. This ability is based on the basic understanding that such alternatives exist, which means that it is possible to link the same set of aspects in different ways. In general, it has been conceived as a dimension within the broader concept of executive func tions, a construct that refers to a set of cognitive processes that allow to regulate the individual’s own behavior, in cluding emotions and thoughts, and orient it towards the goals (Luria, 1966; Stuss & Benson, 1986). However, sev eral authors have proposed that it is, actually, an epiphe nomenon of more basic executive functions, the Work ing Memory (WM) and the Inhibition (INH) (Arán Filippetti & Krumm, 2020; Carroll et al., 2016; Dajani & Uddin, 2015). In this direction, the decline in the amount of information that can be held (hold) and processed in WM has been linked to the decline in CF (Hartman et al., 2001). WM also conditions the ability to maintain a cer tain rule, organization or perspective, when the environ ment does not require alternation. Meanwhile, inhibition allows to deactivate irrelevant stimuli when considering alternatives or behavioral changes (Miyake et al., 2000).

Allowing flexible adaptation in diverse contexts and situations, CF is linked to important aspects of social functioning such as communication and empathy. Re garding communication, adaptation of the individual’s own behavior in a communicational interaction concern ing contextual keys requires, firstly, acknowledging these keys and, secondly, acknowledging action options. As for empathy, understanding others implies defocusing on one’s own experience, to be able to consider differ ent experiences, ideas, perceptions, and feelings (López et al., 2014). In fact, subjective measures of CF assess ment include items intended to assess these specific skills and dispositions. For example, items of the Cognitive Flexibility Inventory evaluate the willingness to “think about things from another person’s point of view” or the ability to “putting oneself in others’ shoes” (Dennis & Vander Wal, 2010, p. 252); and the Cognitive Flexibility Scale explores the ability to “. . . communicate an idea in many different ways” and the motivation to “[. . . ] lis ten and consider alternatives for handling a problem” (Martin & Rubin, 1995, p. 624).

The relevance of CF as a basic process to understand both individual functioning and social performance in different contexts has driven its study. On this back ground, different measures have been developed for its evaluation, both objective (i.e., performance-based mea sures) and subjective (i.e., self-ratings). The objective measures are numerous. Among the best known and used globally are the Wisconsin Card Sorting Test (Hea ton et al., 1993), and the Trail Making Test (TMT, Reitan & Wolfson, 1993) as measures of reactive cognitive flexibility, and the verbal fluency test FAS (FAS animals and verbs; Benton & Hamsher, 1989) and nonverbal flu ency test Five Point Test (FPT; Regard et al., 1982), as measurements of spontaneous cognitive flexibility. Be ing performance measurements, this type of evaluation instruments is less sensitive to conscious attempts to manipulate the results. However, it has been criticized due to its lack of ecological validity (i.e., its poor rela tionship with performance in everyday contexts) and its sensitivity to practical effects (Barkley & Fischer, 2011; Barkley & Murphy, 2011). In addition, it requires inter action with a qualified administrator, and its adminis tration and interpretation are time-consuming (Dennis & Vander Wal, 2010; López et al., 2021).

Subjective measurements of CF, shorter and easier to administer and score, are, in contrast, scarce. Among those measures, are the Cognitive Flexibility Inventory (Dennis & Vandel Wal, 2010), the Bilgin Cognitive Flex ibility Scale (Bilgin, 2009), and the Martin and Rubin Cognitive Flexibility Scale (Martin & Rubin, 1995).

Focused on clinical research, the Cognitive Flexibility Inventory (CFI) was created as a brief, 20-item instru ment, to assess the cognitive flexibility needed to suc cessfully defy and modify irrational or maladaptive ideas or thoughts. Depressed people are characterized by hav ing extremely rigid thoughts. The CFI was developed to measure the aspects of CF that allow people to think in a more adaptive way in the face of stressful events, and to scrutinize their ideas, a cognitive intervention strategy in different types of mental disorders. Three aspects of the CF construct were considered necessary by the authors of this inventory for these tasks: a) the tendency to per ceive difficult situations as controllable, (b) the ability to identify multiple alternative explanations for vital events and human behavior, and c) the ability to generate multi ple alternative solutions in the face of difficult situations. The CFI assesses these dimensions of the CF through a 7-point Likert scale. Recently, a Spanish adaptation of this instrument for the Colombian population has been published (Navarro et al., 2022).

The Bilgin Cognitive Flexibility Scale (Bilgin, 2009) was developed as a brief, 19-item instrument, with the aim of assessing cognitive flexibility in the adolescent population. More specifically, it is aimed at assessing how flexible adolescents are about themselves, concern ing others and concerning their environment. Another peculiarity of this instrument is that, as a measuring in strument, it uses semantic differentials, considering its three dimensions (Osgood et al., 1957).

The Martin and Rubin Cognitive Flexibility Scale (CFS; Martin & Rubin, 1995) is an even shorter instru ment than the instruments described above. It contains 12 items, which are answered through a 6-point Likert scale that goes from Strongly Disagree (1) to Strongly Agree (6). This instrument is not designed for a spe cific population, as is the case of the Bilgin scale, nor is it created for specific use in the clinical field, as the CFI. It assesses the CF in a more general way, as a ba sic function that modulates the intrapsychic and inter personal response in the face of difficult situations, and the individual performance in different social situations. Therefore, it is useful to evaluate CF for different pur poses and in different contexts, such as the evaluation of educational strengths and needs in school and academic contexts, or management and selection of personnel in the workplace. Also, given its simplicity, brevity, and availability, it is attractive for use in basic research.

According to Martin and Rubin (1995), CF is a pre requisite for behavioral flexibility in complex situations and contexts. Being flexible in these contexts requires, first, acknowledging alternatives. Two additional cogni tive components which condition flexible behavior are motivation to adapt and confidence concerning the indi vidual’s own abilities to achieve it. Any adaptation or change requires, besides acknowledging alternatives, a reason or motive that promotes it. Besides, a person’s flexible adaptation could be prevented due to the lack of self-efficacy, which means the lack of confidence concern ing the individual’s own ability to perform a specific ac tion, even when the person has acknowledged that there are alternative behavioral options. For this reason, mo tivation and self-efficacy to be flexible have been con ceptualized as components or aspects that integrate the concept of CF (Martin & Rubin, 1995).

The CFS (Martin & Rubin, 1995) has been widely used internationally, as a brief instrument to assess CF, including therefore: a) the awareness that, in a given sit uation, there are options or behavioral alternatives, (b) the willingness to be flexible or adapt to different sit uations, and (c) feelings of self-efficacy concerning the individual’s own ability to be flexible. Although the CFI contains some items that assess self-efficacy, it focuses exclusively on self-efficacy in solving difficult problems. In addition, while the CFI only assesses attitudes, the CFS includes items to assess both attitudes (e.g., “I am willing to listen and consider alternatives for handling a problem”) and behaviors (e.g., “I avoid new and un usual situations”), exploring a more comprehensive per spective of the assessed person’s functioning.

Even though the CFS was developed to measure the three aspects of CF described above, it is unclear if this scale was designed to have a multifactorial struc ture. The authors of the CFS have reported evidence of adequate internal consistency in different studies (a = .76-.77; Martin & Rubin, 1995; .72; Martin & Anderson, 1995), while test-retest reliability is high (.83; Martin & Rubin, 1995). Some others studies have shown high internal consistency (a = .85) and good predictive and convergent validity (Johnco et al., 2014). Previous stud ies have failed to support a multifactorial structure for the English version of this scale (Dennis, 2007).

The self-report CFS is particularly popular for use with English speakers; however, some linguistic adapta tions have been presented during the last decade. For ex ample, the Japanese (Oshiro et al., 2016) and the Turk ish (Qelikkaleli, 2014) versions of the scale, which have shown adequate internal consistency (a = .85; a = .74), and adjust for a one-factor structure model (Qelikkaleli, 2014; Oshiro et al., 2016). Currently, no Spanish CFS version is available.

Considering the importance of the CF, the scarce de velopment of subjective evaluation measurements, and the lack of availability of Spanish version of non-clinic CF measurements, in the present study we aimed to: 1) present an adaptation to Spanish of the Cognitive Flex ibility Scale (Martin & Rubin, 1995); 2) analyze the internal consistency of the adapted version of the CFS, considering the contribution of the independent items; 3) analyze the factorial structure of the Spanish version of the CFS; and 4) analyze the convergent and divergent validity of this assessment instrument when compared to empathy and executive functioning measurements.

2. Method

An instrumental, cross-sectional descriptive study was carried out (Montero & León, 2007).

2.1 Participants

An intentional sample of 369 adults aged 18 to 60 years was interviewed (M = 31.2; SD = 9.7). The inclusion/exclusion criteria were: 1) to be able to consent; 2) not hav ing a diagnosis of neurodevelopmental disorders: and 3) not having a diagnosis of learning disorders. Sixty five percent of the participants were women. The educa tional level of the sample was high, considering that 46% were studying a university career, 26.8% had completed university studies, and 18.4% had completed postgrad uate studies.

2.2 Instruments

2.2.1 Spanish Adaptation of Cognitive Flexibility Scales (CFS)

The CFS (Martin & Rubin, 1995) was cultural and lin guistic adapted to Spanish considering the international test commission guidelines for test translation and adap tation (Hernández et al., 2020). First, Matthew M. Martin was contacted through a professional social net work, and permission for Spanish adaptation was re ceived. Then, the adaptation process followed 3 steps. 1) The items from the original version of the scale were adapted to Spanish by study researchers. 2) Based on a brief theoretical description of the CF construct and the aspects of the construct contemplated by the scale, two experts in the field and one official English trans lator were asked to evaluate the clarity and adequacy of the adapted items. The experts in the field were also asked to judge if the adapted items clearly repre sented an aspect of CF describe by Martin and Rubin (i.e. ability to recognize alternatives, wish to be flexible and self-efficacy regarding flexibility). All the adapted items were judged as clear and adequate to assess the different aspects of CF by the judges summoned. 3) Pi lot study: the translated inventory was administered to a pilot sample of 20 adults aged 30 to 50 years. Par ticipants were asked to provide feedback regarding the clarity of the items or any problems with interpretation (see the Spanish adaptation in Table 1).

Subsequently, a structured interview was designed containing:

  1. 1) An informed consent. The informed consent included data concerning the study, such as its aims and the institutional framework. Besides, it was specified that the information obtained would be treated confi dentially and exclusively for research purposes. Finally, contact data of the researcher in charge of the study were included.

  2. 2) A sociodemographic data questionnaire de signed ad-hoc. It included questions on socio-demo graphic data and on clinical personal and family his tory regarding specific learning disabilities (i.e., dyslexia, dyscalculia, etc.) and neurodevelopment disorders (i.e., specific learning disorders, autism spectrum disorders, ADHD, Intellectual Disability and Mental Retardation or Disruptive, Impulse-Control, and Conduct Disorders).

  3. 3) The adapted to Spanish version of the Cog nitive Flexibility Scale (CFS; Martin & Rubin, 1995). The CFS is a 12-items self-report scale that measures cognitive flexibility, understood as the ability to recog nize alternatives and options in any given situation, the wish to be flexible and to adapt to different contexts, and the feelings of self-efficacy regarding the ability to be flexible, through a 6-point Likert scale (strongly disagree to strongly agree). It was developed in a student sam ple, showing high internal consistency (α = .76 −− .77), good concurrent and construct validity with measures of interaction and communication flexibility, and high testretest reliability (r = .83) over two weeks (Martin & Rubin, 1995).

  4. 4) The Spanish version of the Interpersonal Reactivity Index (IRI; Mestre Escrivá et al., 2004). The IRI is a 28-items self-report measurement of empa thy that evaluates four dimensions including emotional and cognitive aspects of the construct: Fantasy and Per spective Taking (Cognitive Aspects) and Empathic Con cern and Personal Distress (Emotional Aspects), through a 5-points Likert scale. Its Spanish version has shown validity to evaluate these different components of the empathy construct, and adequate internal consistency, with values ranging between 0.56 for the Perspective Taking (PT) scale and .70 for the Fantasy (FS).

  5. 5) The Spanish version of ADEXI (Holst & Thorell, 2018; López et al., 2021). The ADEXI is a brief in ventory (14 items) to assess Executive Functioning consid ering two dimensions: Inhibition and Working Memory. Its Spanish adaptation has shown construct validity, ad justing to a two-factor model as the original version, and high internal consistency (α = .87) (López et al., 2014).

2.3 Procedure

Following the Declaration of Helsinki, participation in the study was voluntary and all participants were re quired to provide informed consent to participate. As previously described and in accordance with the afore mentioned standard, the document had relevant infor mation on the objectives and methods of the study, ben efits and harms that participation could entail, personal data and institutional affiliations of the researchers, etc. Participants were invited to participate in the study through social and institutional networks (internal net works of public and privately managed universities). In terviews were performed through an online platform. Before starting the interview, participants had to dig itally provide their informed consent by clicking on a button that indicated “I agree to participate”.

2.4 Data Analysis

To analyze the internal consistency of the adapted instru ment, the Cronbach α index was calculated, and the Cronbach α index if each element was removed. Also, the Mc Donald’s w was calculated (Hayes & Coutts, 2020). To analyze the factorial structure of the Spanish version of the CFS, firstly, Exploratory Factor Analysis (EFA) was performed, using the Unweighted Least Squares as the ex traction method, and extracting eigenvalues greater than 1 (maximum number of iterations: 25). The Oblimin rotation type was used, since it is the most adequate for instru ments with a Likert-type scale. Subsequently, Confirma tory Factor Analysis (CFA) was used through AMOS 16.0 program (Arbuckle, 2007) to compare a one-dimensional model of the scale, with a two-factor model based on the EFA. In the bifactorial model, items were grouped accord ing to whether they represented strengths or difficulties in CF. The level of the models’ Goodness-of-fit was estimated through the x 2 , and the Bentler-Bonett’s Normed Fit In dex (NFI); Bollen’s Relative Fit Index (RFI); Bollen’s In cremental Fit Index (IFI); Tucker-Lewis Coefficient (TLI), also known as the Bentler-Bonett’s Non-Normed Fit In dex (NNFI); and Comparative Fit Index (CFI; Bentler & Bonett, 1980; Bentler, 1990; Bollen, 1989). The val ues of these indices can range between 0 and 1, becom ing indicators of a good adjustment in the values above .9. The Akaike Information Criterion (Akaike, 1973); Akaike, (1987) was also calculated. In addition, the Root Mean Square Error of Approximation (RMSEA) for each model was calculated. The acceptable value of this index is .08 or lower (Hu & Bentler, 1995, 1999). Finally, to study the convergent and divergent construct validity, the correla tion (Pearson’s r) of the adapted scale with the IRI and ADEXI scores was analyzed.

Table 1 Internal Consistency of the Cognitive Flexibility Scale’s Adapted to Spanish Version 

Items Alpha without elementα
1. I can communicate an idea in many...1 Puedo comunicar una idea de muchas maneras diferentes. .789
2. I avoid new and usual... Evito las situaciones nuevas y poco habituales. .818
3. I feel like I never get to... Siento que nunca consigo tomar decisiones. .803
4. I can find workable solutions... Puedo encontrar soluciones viables para problemas que parecían imposibles .786
5. I seldom have choices when deciding... Me cuesta pensar alternativas para decidir cómo enfrentar una situación. .805
6. I am willing to work at creative... Me gusta trabajar para encontrar soluciones creativas a los problemas. .794
7. In any given situation, I am able to... Puedo actuar de modo apropiado en distintos tipos de situaciones. .799
8. My behavior is a result of conscious... Mi comportamiento es el resultado de decisiones que tomo conscientemente. .793
9. I have many possible ways of behaving... Frente a una situación dada, analizo maneras diferentes de comportarme. .802
10. I have difficulties using may knowledge on... Tengo dificultades para usar mi conocimiento sobre un tema en situaciones de la vida real. .813
11. I am willing to listen and consider alternatives... Me gusta escuchar y considerar alternativas para decidir cómo manejar un problema. .808
12. I have the self-confidence necessary to try... Tengo la autoconfianza necesaria para probar diferentes alternativas al enfrentar una situación difícil. .782

Note. Cronbach’s a of the total scale (12 elements): .813 / McDonald’s w of the total scale: .817. αCronbac’s α if the element is eliminated.

1To access the full original items, please refer to the work of Martin and Rubin (1995).

3. Results

3.1 Internal Consistency

The internal consistency of the adapted version of the CFS was high (α = .813). The contribution of the partic ular items to the internal consistency of the instrument was significant in all cases. Table 1 presents the full data. The McDonald’s Omega was also high (w = .817).

3.2 Analysis of the Factorial Structure

3.2.1 Exploratory Factor Analysis (EFA)

The Kaiser-Meyer-Olkin measure of sampling adequacy was .853, indicating that the matrix is factorizable. Bart lett’s Sphericity Test was significant (x 2 = 1214.605; df = 66; p < .001).

Two self-values above 1 were extracted, which ex plained in total 39.15% of the variance. In Table 2, the items weights by factor are presented, ordered by size.

3.2.2 Confirmatory Factor Analysis: Model Comparison

Firstly, a one-dimensional model of the scale was evaluated. In this model, the correlations between the particular items and the overall factor ranged from .22 to .71. Subsequently, from the EFA and the study of the correlations between the items and between the measurement errors of the unifacto rial model, an alternative bifactorial model was evaluated, grouping the items according to whether they represented Strengths (S) or Difficulties (D) in CF. For this model, the correlations of items with the S factor ranged from .44 to .69, while the correlations between items with the D factor ranged from .48 to .69. Table 3 shows the adjustment in dices of each model. As can be seen, the model that showed a better fit to the data was the one with two factors (see Figure 1). This model obtained values of x 2 /df < 5, higher values of NFI, RFI, IFI, TLI and CFI, lower error values, and a lower value in the AIC index.

3.2.3 Convergent and Divergent Construct Validity

The CF assessed with the adapted version of the CFS correlated negatively with the executive deficit evalu ated with ADEXI (r = -.38). The correlation was strong er with the Working Memory dimension (r = -.44) than with the Inhibition dimension of the ADEXI (r = -.20). In addition, the score in the CFS showed positive correlations with the dimensions Perspective Taking (r = .40) and Empathic Concern (r = .22) of the IRI, and negative with the Personal Distress dimension (r = -.40). The full data is presented in Table 4.

Figure 1 Confirmatory Factor Analysis: Difficulties and Strengths in CF 

Table 2 Exploratory Factor Analysis of the CFS in Spanish 

Factors
Items 1 2
Puedo actuar de modo apropiado en distintos tipos de situaciones .693
Puedo encontrar soluciones viables para problemas que parecían imposibles de resolver .619
Mi comportamiento es el resultado de decisiones que tomo conscientemente .617
Puedo comunicar una idea de muchas maneras diferentes .616
Me gusta trabajar para encontrar soluciones creativas a los problemas .601
Me gusta escuchar y considerar alternativas para decidir cómo manejar un problema .571
Frente a una situación dada, analizo maneras diferentes de comportarme .564
Tengo la autoconfianza necesaria para probar diferentes alternativas al enfrentar una situación difícil .555 .304
Siento que nunca consigo tomar decisiones .701
Me cuesta pensar alternativas para decidir cómo enfrentar una situación .649
Evito las situaciones nuevas y poco habituales .550
Tengo dificultades para usar mi conocimiento sobre un tema en situaciones de la vida real .408

Table 3 Model Comparison 

Models X 2/df NFI RFI IFI TLI CFI AIC RMSEA
1 5.862 .743 .686 .777 .724 .775 388.571 .115
2 2.834 .880 .848 .919 .896 .918 237.302 .075

Note. 1Model 1: 1 factor, CF; Model 2: 2 factors; S and W. 2CFI and IFI values above .90, low AIC values, and RMSEA values below .08 are indicators of a good fit.

4. Discussion

The aims of the present study were to present a Span ish adaptation of the CFS (Martin & Rubin, 1995) and to analyze its psychometric characteristics. Specifically, the internal consistency of the adapted instrument, its factorial structure, and its convergent and divergent va lidity were studied.

The internal consistency of the adapted instrument was high, somewhat higher than the one reported by the authors of the original instrument = .81 and w = .82 vs. α = .76, .77 and .72; Martin & Rubin, 1995; Mar tin & Anderson, 1998), similar to that reported for the Japanese’s version (a = .85 and w = .87; Oshiro et al., 2016), and more recently for the English version (α = .85; Johnco et al., 2014). This state the stability of the responses concerning the psychological domain mea sured, that is, that the items of the scale correspond to the same latent construct. In principle, this high in ternal consistency score does not suggest a multidimen sional structure. However, unlike what was suggested in an analysis of the English version (Dennis, 2007), the EFA suggested a two-factor structure, which in the model comparison through CFA showed a better fit than the one-dimensional model.

In the two-factor model, items were grouped according to whether they represented Strengths (S) or Difficulties (D) in CF. Therefore, in the Strengths dimension, items such as “Puedo comunicar una idea de muchas maneras diferentes” (I can communicate an idea in many different ways), “Puedo encontrar soluciones viables para prob lemas que parecían imposibles de resolver” (I can find viable solutions to problems that seemed impossible to solve), o “Puedo actuar de modo apropiado en distintos tipos de situaciones” (I can act in a proper way in different types of situations), were included, while the Difficulties di mension included items such as “Siento que nunca consigo tomar decisiones” (I feel like I can never get to make deci sions), “Me cuesta pensar alternativas para decidir cómo enfrentar una situación” (It is not easy to think of alter natives to decide how to deal with a situation), o “Tengo dificultades para usar mi conocimiento sobre un tema en situaciones de la vida real” (I find it difficult to use my knowledge concerning a topic in real-life situations).

All items on the scale weighed heavily (with load ings greater than .4), in one or another factor, alter nately. The only item that could be considered as com plex because it had a greater loading than .3 in the secondary factor, was item number 12: “Tengo la auto-confianza necesaria para probar diferentes alternativas al enfrentar una situación difícil” (I have the necessary self-confidence to try different alternatives when facing a difficult situation). Although the load was clearly higher in factor 1 (.555 vs. .304), its weight in factor two (i.e., Difficulties) is striking. When conducting the CFA, a re lationship was also observed between the measurement errors of this item (number 12) and the item number 3: “Siento que nunca consigo tomar decisiones” (I feel I can never get to make decisions). These results suggest that the need to “try alternatives” to face difficult situations appears as linked in the answers of the participants with the difficulty to “make decisions”, and, therefore, entails a certain negative connotation. Despite this complexity of the item, its strong load on factor 1 and its contribu tion to the internal consistency of the instrument make its conservation on the scale valuable.

When assessing convergent and divergent construct validity, a positive relationship was observed between the scores in the CFS and the scores of the dimensions Perspective Taking and Empathic Concern of the IRI. As we mentioned before, CF is linked to empathy be cause being empathetic requires the ability to defocus from the individual’s own experience to consider the ideas, perceptions, and feelings of others. Therefore, it requires the ability to acknowledge alternatives to the person’s own experience, as well as the willingness to ad just to them, and the feelings of self-efficacy to achieve it. The strongest relationship was observed with Per spective Taking, a cognitive dimension of empathy that refers to the ability to temporarily adopt others’ per spective (.40), while a smaller relationship was found with Empathic Concern (.22), the emotional dimension of empathy that refers to the ability to experience emo tions in tune with those of others. Although the emo tional aspects of empathy are, at their base, automatic processes, they are informed or regulated by cognitive processes that modulate them.

A negative relationship was observed between the CFS scores and the IRI Personal Distress dimension scores (r = -.40). The Personal Distress dimension of the IRI is an emotional dimension, which refers to the experience of strong distress in the face of other people’s suffering. This experience has its origins in the difficulty to establish a cognitive distance from the other, imply ing a certain level of cognitive dysregulation. In this sense, it is a dimension that is usually negatively linked to executive functioning (López et al., 2021), and its negative relationship with CFS scores is proof of the instrument’s construct validity.

In the same direction, the CFS scores were negatively linked to the ADEXI scores, which assesses executive dys function. The relationship was higher with the WM di mension (-.44) than with the INH dimension (-.20), high lighting the importance of the ability to retain and manip ulate information in the memory to recognize and analyze alternative ideas, perspectives, and behaviors. As we have mentioned before, CF has been considered as a dimension of EF (Luria, 1966; Stuss & Benson, 1986), or an ex ecutive function more advanced than others more basic such as INH and WM (Arán Filippetti & Krumm, 2020), and its particular relationship with WM (Hartman et al., 2001) has been described. Therefore, the negative corre lation of CFS with ADEXI constitutes further evidence of construct validity.

Table 4 Pearson correlations between the scores of the Cognitive Flexibility Scale’s Spanish-adapted version, the Adult Executive Functioning Inventory, and the Interpersonal Reactivity Index 

ADEXα ADEXI Working Memory ADEXI Inhibition Perspective Taking Fantasy Empathic Concern Personal Distress
Cognitive Flexibility Scale (adapted version) -.383** -.445** -.196** .396** .013 .219** -.405**
ADEXI 1 .933** .849** .165** -.164** .089 -.348**
ADEXI Working Memory 1 .603** .161** -.151** .048 -.398**
ADEXI Inhibition 1 .130* - .141** .128* -.188**
Perspective Taking 1 .265** .454** -.067
Fantasy 1 .388** .307**
Empathic Concern 1 .083

Note. **The correlation is significant at level .01 (2 tails). *The correlation is significant at level .05 (2 tails). αHigher value represents higher executive dysfunction.

Finally, we highlight some limitations of this research. Firstly, this study was conducted with adults who did not have a clinical diagnosis, therefore, the utility of the Spanish version of the CFS to assess CF in the clinical population should be evaluated in future studies. Stud ies with clinical population could be useful as additional evidence of the instrument’s construct validity. Future studies on convergent validity of the Spanish version of the CFS in this population could benefit from the use of the CFI, whose adaptation has recently been published (Navarro et al., 2022), and which has been specifically designed for use in the clinical field. Furthermore, also in relation with the study sample, it had a wide age rage and was characterized by a relatively high level of educa tion. Therefore, caution should be exercised when gen eralizing these results, particularly to populations with lower and lower-middle levels of education. Secondly, this study only assesses one aspect of the reliability of the instrument, the internal consistency. Although ad equate test-retest reliability has been reported for the original version of the scale (Martin & Rubin, 1995), it is suggested for further studies to study the temporary stability of the Spanish-adapted version of the CFS. Fi nally, limitations linked to the sampling strategy (eval uation through an online platform) can be considered. This type of sampling excludes people without access to technology, who, in the context of the present study, could constitute a significant percentage of the adult population. For this reason, it is suggested to report va lidity and reliability data when using this instrument in future studies that use alternative sampling strategies.

5. Conclusions

Despite these limitations, our results confirm that the Spanish-adapted version of the CFS shows satisfactory psychometric properties. Specifically, the scale shows good internal consistency and construct validity, and reasonable convergent and divergent validity, as a mea sure of CF in non-clinical adult population.

Considering the relevance of the CF construct to un derstand both individual performance and complex so cial processes such as communication and empathy, and in view of the scarce development of subjective evalua tion measures of CF for the Spanish population, this in strument constitutes a relevant contribution that could be extremely useful in different evaluation contexts (i.e., educational, clinical, forensic) as well as for basic re search in cognitive processes.

References

Akaike, H. (1973). Information theory and an extension of the maximum likelihood principle. In B. N. Pet rov & F. Caski (Eds.), Proceedings of the Second International Symposium on Informa tion Theory (pp. 267-281). Akademiai Kiado. [ Links ]

Akaike, H. (1987). Factor analysis and AIC. Psychometrika, 52, 317-332. [ Links ]

Arán Filippetti, V., & Krumm, G. (2020). A hierarchi cal model of cognitive flexibility in children: Ex tending the relationship between flexibility, cre ativity, and academic achievement. Child Neu ropsychology, 26(6), 770-800. https://doi.org/10.1080/09297049.2019.1711034Links ]

Arbuckle, J. L. (2007). Amos 16.0 user’s guide. Amos Development Corporation. [ Links ]

Barkley, R. A., & Fischer, M. (2011). Predicting impair ment in major life activities and occupational functioning in hyperactive children as adults: Selfreported executive function (EF) deficits ver sus EF tests. Developmental Neuropsychology, 36(2), 137-161. https://doi.org/10.1080/87565641.2010.549877Links ]

Barkley, R. A., & Murphy, K. R. (2011). The nature of executive function (EF) deficits in daily life activities in adults with ADHD and their rela tionship to performance on EF tests. Journal of Psychopathology and Behavioral Assessment, 33, 137-158. [ Links ]

Bentler, P. M. (1990). Comparative fit indexes in struc tural models. Psychological Bulletin, 107(2), 238. https://doi.org/10.1037/0033-2909.107.2.238Links ]

Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588. https://doi.org/10.1037/0033-2909.88.3.588Links ]

Benton, A. L., & Hamsher, K. (1989). Multilingual Apha sia Examination manual. AJA Associates. [ Links ]

Bilgin, M. (2009). Developing a cognitive flexibility scale: Validity and reliability studies. Social Behav ior and Personality: an international journal, 37(3), 343-353. https://doi.org/10.2224/sbp.2009.37.3.343Links ]

Bollen, K. A. (1989). A new incremental fit index for general structural equation models. Sociological methods & research, 17(3), 303-316. https://doi.org/10.1177/0049124189017003004Links ]

Carroll, D. J., Blakey, E., & FitzGibbon, L. (2016). Cog nitive flexibility in young children: Beyond per severation. Child Development Perspectives, 10(4), 211-215. [ Links ]

Qelikkaleli, O. (2014). The Validity and Reliability of the Cognitive Flexibility Scale. Education & Science/Egitim ve Bilim, 39(176). https://doi.org/10.15390/EB.2014.3466Links ]

Dajani, D. R., & Uddin, L. Q. (2015). Demystifying cog nitive flexibility: Implications for clinical and developmental neuroscience. Trends in neuro sciences, 38(9), 571-578. [ Links ]

Dennis, J. P. (2007). The Relationship Between Life Event Stress, Cognitive Flexibility, Coping, and De pression: A Longitudinal Study [Doctoral disser tation]. Saint Louis University. [ Links ]

Dennis, J. P., & Vander Wal, J. S. (2010). The Cogni tive Flexibility Inventory: Instrument Develop ment and Estimates of Reliability and Validity. Cognitive Therapy and Research, 34, 241-253. https://doi.org/10.1007/s10608-009-9276-4Links ]

Hartman, M., Bolton, E., & Fehnel, S. E. (2001). Ac counting for age differences on the Wisconsin Card Sorting Test: decreased working memory, not in flexibility. Psychology and aging, 16(3), 385. [ Links ]

Hayes, A. F., & Coutts, J. J. (2020). Use omega rather than Cronbach’s alpha for estimating reliability. But... Communication Methods and Measures, 14(1), 1-24. https://doi.org/10.1080/19312458.2020.1718629Links ]

Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, G. G., & Curtiss, G. (1993). Wisconsin Card Sort ing Test manual. Psychological Assessment Re sources. [ Links ]

Hernández, A., Hidalgo, M. D., Hambleton, R. K., & Gómez Benito, J. (2020). International test commission guidelines for test adaptation: A crite rion checklist. Psicothema, 32(3), 390-398. https://doi.org/10.7334/psicothema2019.306Links ]

Holst, Y., & Thorell, L. B. (2018). Adult executive func tioning inventory (ADEXI): Validity, reliability, and relations to ADHD. International Journal of Methods in Psychiatric Research, 27, 1567. https://doi.org/10.1002/mpr.1567Links ]

Hu, L., & Bentler, P. M. (1995). Evaluating model fit. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 76-99). SAGE. [ Links ]

Hu, L., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conven tional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Jour nal, 6, 1-55. https://doi.org/10.1080/10705519909540118Links ]

Johnco, C., Wuthrich, V. M., & Rapee, R. M. (2014). Re liability and validity of two self-report measures of cognitive flexibility. Psychological assessment, 26(4), 1381. [ Links ]

López, M. B., Arán Filippetti, V., & Richaud, M. C. (2014). Empatía: Desde la percepción automáti ca hasta los procesos controlados. Avances en Psicología Latinoamericana, 32(1), 37-51. https://doi.org/10.12804/apl32.1.2014.03Links ]

López, M. B., Arán Filippetti, V., & Richaud, M. C. (2021). Adult Executive Functioning Inventory (ADEXI): Factor structure, convergent validity, and reliability of a Spanish adaptation. Applied Neuropsychology: Adult, 1-7. https://doi.org/10.1080/23279095.2021.1880408Links ]

Luria, A. R. (1966). Higher cortical functions in man. Basic Books. [ Links ]

Martin, M. M., & Anderson, C. M. (1998). The cognitive flexibility scale: Three validity studies. Commu nication Reports, 11(1), 1-9. https://doi.org/10.1080/08934219809367680Links ]

Martin, M. M., & Rubin, R. B. (1995). A new measure of cognitive flexibility. Psychological reports, 76(2), 623-626. https://doi.org/10.2466/pr0.1995.76.2.623Links ]

Mestre Escrivá, V., Frías Navarro, M. D., & Samper Gar cía, P. (2004). La medida de empatía: análisis del Interpersonal Reactivity Index. Psicothema, 255-260. [ Links ]

Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: a latent variable analysis. Cognitive psy chology, 41(1), 49-100. [ Links ]

Montero, I., & León, O. G. (2007). A guide for naming research studies in Psychology. International Journal of clinical and Health psychology, 7(3), 847-862. [ Links ]

Navarro, M. C., Quiroz Molinares, N., & Mebarak, M. (2022). Psychometric Study of the Cognitive Flex ibility Inventory in a Colombian Sample. In ternational Journal of Psychological Research, 15(1), 42-54. [ Links ]

Osgood, C., Suci, G., & Tannenbaum, P. (1957). The measurement of meaning. University of Illinois Press. [ Links ]

Oshiro, K., Nagaoka, S., & Shimizu, E. (2016). Develop ment and validation of the japanese version of cognitive flexibility scale. BMC research notes, 9, 1-8. https://doi.org/10.1186/s13104-016-2070-yLinks ]

Regard, M., Strauss, E., & Knapp, P. (1982). Children’s production on verbal and non-verbal fluency tasks. Perceptual and motor skills, 55(3), 839-844. [ Links ]

Reitan, R. M., & Wolfson, D. (1993). The Halstead- Reitan Neuropsychological Test Battery: Theory and Clinical Interpretation. 2nd edn. Neuropsy chology Press, Tuscon, AZ. [ Links ]

Stuss, D. T., & Benson, D. F. (1986). The frontal lobes. Raven Press. [ Links ]

Declaration of data availability: All relevant data are within the article, as well as the information support files.

Conflict of interests: The authors have declared that there is no conflict of interest.

Received: September 16, 2022; Revised: December 15, 2023; Accepted: April 02, 2024

* Corresponding author: Mariana Beatriz López. mb.lopez@conicet.gov.ar

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License