SciELO - Scientific Electronic Library Online

 
vol.20 issue1Psychometric Study of the Depression, Anxiety and family Dysfunction Scales in Students at Universidad Industrial de SantanderSelf-efficacy and academic experiences with university students author indexsubject indexarticles search
Home Pagealphabetic serial listing  

Services on Demand

Journal

Article

Indicators

Related links

  • On index processCited by Google
  • Have no similar articlesSimilars in SciELO
  • On index processSimilars in Google

Share


Acta Colombiana de Psicología

Print version ISSN 0123-9155

Act.Colom.Psicol. vol.20 no.1 Bogotá Jan./June 2017

https://doi.org/10.14718/ACP.2017.20.1.12 

Artículos

Attitudes Scale Towards Potential Targets of Bullying: Elaboration and Evidence of Validity and Reliability

Escala de atitudes frente a alvos potenciais de bullying: elaboração e evidências de validade e precisão

Mardelides da Silva Lima1 

Rildésia Silva Veloso Gouveia2 

Ana Karla Silva Soares(3 

Rafaella de Carvalho Rodrigues Araújo4 

Maria Gabriela Costa Ribeiro4 

Tátila Rayane de Sampaio Brito4 

Valdiney Veloso Gouveia4 

1 Instituto Federal de Educação, Ciência e Tecnologia de Mato Grosso, Brasil

2 Centro Universitário de João Pessoa, Brasil

3 Universidade Federal do Mato Grosso do Sul, Brasil

4 Universidade Federal da Paraíba, Brasil.


Abstract

The present article aimed at describing the elaboration of a measurement of attitudes towards potential targets of bullying, gathering evidence of its factorial validity and internal consistency. Two studies were performed with 800 secondary school students whose mean age was 15 years old. who answered the Attitudes Scale towards Potential Targets of Bullying (ASTPB) and some demographic questions. In Study 1 (n = 230) the discriminant power of the scale items was verified, and after performing an exploratory factor analysis two components were identified (appearance and gender issues and social exposure). with Cronbach's alpha (α) of 0.81 and 0.70, respectively. In Study 2 (n = 570) a confirmatory factor analysis was performed (Maximum Likelihood), confirming the two-factor structure of the scale (αfactor I = 0.80 and αfactor II = 0.65; CR = 0.80 and 0.64. respectively). Moreover. evidence was also gathered of factorial invariance of this measure in groups of women and men. In conclusion this is a parsimonious measurement with evidences of validity and reliability. suggesting its adequacy for use when the goal is to evaluate attitudes towards potential targets of bullying.

Key words: Bullying; scale; validity; reliability

Resumo

O presente artigo objetivou descrever a elaboração de uma medida de atitudes frente a potenciais alvos de bullying, reunindo evidências de sua validade fatorial e consistência interna. Realizaram-se dois estudos com estudantes secundaristas que tinham idade média de 15 anos, os quais responderam a Escala de Atitudes frente a Alvos Potenciais de Bullying (EAAPB) e perguntas demográficas. No Estudo 1 (n = 230) foi verificado o poder discriminativo dos itens desta medida e feita uma análise fatorial exploratória, emergindo dois componentes: aparência e questões de gênero e exposição social, cujos alfas de Cronbach (α) foram de 0,81 e 0,70, respectivamente. No Estudo 2 (n = 570) foi realizada uma análise fatorial confirmatória (Máxima Verossimilhança), que corroborou a estrutura bifatorial (αfator I = 0,80 e αfator II = 0,65; CC = 0,80 e 0,64, respectivamente). Ademais, reuniram-se evidências acerca da invariância fatorial desta escala entre mulheres e homens. Conclui-se que esta é uma medida parcimoniosa, apresentando evidências de validade e precisão que sugerem seu emprego quando o propósito for conhecer atitudes frente a alvos potenciais de bullying.

Palavras-chave: Bullying; escala; validade; precisão

Resumen

El presente artículo tuvo como objetivo describir la elaboración de una medida de actitudes hacia potenciales víctimas de bullying, reuniendo evidencias de validez factorial y consistencia interna de la Escala de Atitudes frente a Alvos Potenciais de Bullying (EAAPB) (Escala de actitudes hacia potenciales víctimas de bullying). Se realizaron dos estudios con 800 estudiantes de enseñanza secundaria, con edad promedio de 15 años, los cuales contestaron a preguntas demográficas y la EAAPB. En el Estudio 1 (n = 230) se comprobó el poder discriminativo de los ítems de la escala y se realizó un análisis factorial exploratorio en el que se identificaron dos componentes: apariencia y temas de género (α = .81) y exposición social (α = .70). En el Estudio 2 (n = 570) se realizó un análisis factorial confirmatorio (máxima verosimilitud), en el que se comprobó la estructura bifactorial de la escala: el primer factor con α = .80 y CR = .80; y el segundo con α = .65 y CR =.64. Se reunieron evidencias sobre la invariancia factorial de la escala en grupos de mujeres y hombres. Se concluye que la EAFPB es una medida parsimoniosa que presenta evidencias de validez y confiabilidad, por lo que se sugiere su uso para evaluar las actitudes hacia potenciales víctimas de bullying.

Palabras clave: Bullying; escala; validez; fiabilidad

INTRODUCTION

Bullying may be understood as a set of aggressive. intentional, and repetitive attitudes without evident motivation. within a relationship of unequal power. that are adopted by one individual or more against another to intimidate them. In consequence, it will cause pain, anguish, suffering and feelings of vulnerability. shame. and/or low self-esteem (Middelton-Moz & Zawadski. 2007). According to Vanderbilt and Augustyn (2010). bullying is typically related to the bully's attempts for power affirmation via repeated and intentional aggression towards individuals whom s/he considers to be weaker (victims). Therefore. it does not consist in a mere fight between two individuals who are equal in physical and psychological strength. but in a quarrel based on power imbalance and repetition of behaviour (Viscente. 2010).

Bullying comprises several types of behaviours that may be motivated. for instance. by ethnic. religious. sexual. or gender-related issues. According to Olweus (1991). bullying may be classified as: (1) indirect, characterised by situations of subtle intimidation. such as social isolation. exclusion. defamation. and provocations related to some disability-related. racial. or sexual particularity in the victim. causing pain and suffering; or (2) direct. manifested by physical or verbal aggression. such as kicking. pushing. mocking. and the attribution of pejorative nicknames. This categorisation shows that bullying has several forms of expression. including physical (e.g.. hitting. pinching. spitting). verbal (e.g.. insults. threats). and relational (e.g.. gossip. social exclusion) aggression. In addition. the continuous advance of technology has made it possible to detect a new modality. known as cyberbullying. which consists in the distribution of malicious messages via electronic means (Slonje. Smith. & Frisen. 2013).

Four types of social actors related to bullying are described: victims, perpetrators, victim-perpetrators, and the non-involved (witnesses or spectators) (Cunha, 2009; Olweus, 1993). The victims are the target of bullying, and are characteristically sensitive, insecure, and unhappy individuals who exhibit low self-esteem, social inhibition, passivity, submissiveness and feelings of vulnerability, fear or excessive shyness; these characteristics enhance the spread of victimisation (Middelton-Moz & Zawadski, 2007). Victims also exhibit some others enhance the spread of victimisation".physical, social, economic, or sexual orientation-related particularities, such as short height, homosexual relatives, a physical disability, learning problems, obesity, or some ethnic or religious aspect that is divergent from their social environment (Antunes & Zuin, 2008; Tognetta, 2010).

Perpetrators, also known as bullies, are individuals who resort to physical strength and psychological influence to terrify others. With their skills, arrogance and leadership demeanour, they seek to keep others under their control (Fante & Pedra, 2008). Bullies characteristically lack self-control (Pontzer, 2010), and are prone to high attention deficit and hyperactivity levels (Cho, Henderickson, & Mock, 2009). In turn, victim-perpetrators are individuals who both intimidate and are intimidated. This group is also known by several other names, such as provoking victims, ineffective perpetrators, and aggressive victims (Pellegrini, 2001). Witnesses (or spectators, non-involved actors) typically prefer to stay out of conflict and develop friendship bonds with individuals outside this group.

Bullying has been increasingly more discussed in recent decades, perhaps due to the increase of school violence (Bacchini, Esposito, & Affuso, 2009). Some studies, such as the one by Weinstock and Krehbiel (2009), point to some physical characteristics, such as obesity, as factors that make individuals more likely to be bullied. Olweus (1993) describes several characteristics that are detected in most bullied children. For instance. they are sensitive. quiet. retiring. timid. and physically weak. However. studies tend to focus more on the consequences of bullying. and therefore. nothing can be said about victims' aspects (individual or situational) that may potentiate positive or negative attitudes towards this phenomenon. The concerns with the measurement of bullying are typically channelled through two axes: victimisation, i.e.. measures that aim at establishing whether an individual is a victim of some form of bullying (physical. verbal. or psychological). and behavioural. which analyzes the bully's aggressive behaviours. Furthermore. no scales that assess the attitudes of individuals towards potential targets of bullying could be located. even though accurate knowledge of such attitudes is relevant to predicting behaviour.

Hamburger. Basile. and Vivolo (2011) compile a compendium with 33 tools that assess bullying in both victims and perpetrators. in addition to bystanders' experience of this antisocial behaviour. with most measures centred on the victimisation-perpetration axis. Measures of this type include the Olweus Bully/Victim Questionnaire (OBVQ). which evaluates the two aforementioned aspects (bullying and victimisation) through questions that assess the frequency. types. place of occurrence. and perpetrators of bullying; the California Bullying Victimisation Scale (CBVS; Felix. Sharkey. Green. Furlong. & Tanigawa. 2011). which measures the frequency with which respondents experience a series of actions that turn them into victims of bullying; and finally, the Bullying Behavior Scale (Austin & Joseph. 1996). which assesses verbal and physical actions that are characteristic of the perpetration of bullying in the respondents. i.e.. actions performed by bullies.

Considering these conceptual definitions of the subject as a theoretical perspective that's substantiate this study. an instrument that assesses the attitudes towards individuals who present characteristics that are common to targets of bullying is important. For this reason. a search was performed in the Google Scholar (2016) database for studies published over the past five years that use the keywords "targets of bullying". "attitudes towards targets". and "scale of attitudes towards targets of bullying". Eleven studies describing the characteristics of. or the situations in which individuals may become targets of bullying were identified, including the profile of bullying targets at the workplace, and situations in which teachers are targets of bullying by their students (e.g., Hoffmann, 2013). A search performed in the PsycINFO (2016) database using the search term "targets of bullying" enabled 240 studies to be located. with the main studies investigating the psychological aspects (e.g., personality) of bullying victims in organisations, with no mention of any specific assessment tool. In addition, the same keywords enabled 91 studies to be located in the Medline (2016) database, and once again, most studies reported situations of bullying in organisations or defined its process. The use of the search term "scale of attitudes towards targets of bullying" in the Google Scholar (2016), PsycINFO (2016), and Medline (2016) databases did not lead to the identification of any study published over the past five years.

Whereas the measures identified in the literature evaluate conceptual (presence or absence) and typological aspects (victims and bullies), the measure developed in this study differs from others by assessing attitudinal aspects of people considered targets of bullying. Thus, the development of an instrument that embraces the dimension discussed, including analyses of its validity and precision, is important. Therefore, three studies were performed to (1) develop such instrument and analyse its psychometric properties, (2) investigate and confirm its factor structure and internal consistency, and (3) evaluate its factorial invariance. These empirical studies are described next.

STUDY 1 ELABORATION OF THE ATTITUDES TOWARDS POTENTIAL TARGETS OF BULLYING SCALE

The aims of this study were to develop the Attitudes towards Potential Targets of Bullying Scale (APTBS) and gather evidence regarding its factor validity and internal consistency. Firstly, the items that compose the APTBS were developed, and then their discriminant power was investigated through the assessment of the scale's underlying factor structure and internal consistency.

METHOD

Participants

A total of 230 students from João Pessoa - Paraíba (PB), and Cáceres - Mato Grosso do Sul (MT), Brazil, with mean age of 15 years old [(SD) = 1.71; varying from 11 to 20] participated in Study 1. The gender distribution of the sample was even, and the largest proportion corresponded to students who attended the first high school year (38%). Most participants claimed to be catholic (64%) with a religiosity ranking above the mid-point of the response scale [M = 2.8, SD = 1.12; varying from 0 = not religious at all to 4 = very religious]. The participants were recruited by convenience (non-probabilistic) sampling. and all of the invited students who agreed to participate were included.

Instruments

The participants were given a booklet containing questions on demographic variables (gender. age. religion. and religiosity) and the Attitudes towards Potential Targets of Bullying Scale (APTBS). The APTBS was developed by the authors based on a literature review. being composed by 25 items that assess the beliefs. feelings. or behaviours (attitudes) towards individuals who exhibit characteristics or particularities that may turn them into potential victims of bullying (e.g., "A man who does not enter into a fight at least once in his life is odd"; "A person with an ugly voice or face is horrible"). These items are answered on a six-point scale ranging from 1 (totally disagree) to 6 (totally agree). Then. the semantic validity of the experimental version was checked with a sample of15 sixth-year students to establish whether they could understand the items and whether the proposed response scale was adequate.

Procedure

For the development of the APTBS. two psychology specialists performed a literature research to establish which characteristics or situations give rise to or initiate bullying. Several items were then elaborated based on the results of this research. An expert panel composed by five investigators (judges) was requested to indicate which items truly related to the construct under assessment (potential targets of bullying) and whether they were clear enough. Finally. these authors compared the results and performed the due adjustments (exclusion of items without a concordance rate higher than 80%), which was followed by semantic validation with a group of children aged from 7 to 9 years old (an age range lower than the one of the target population). The final version, i.e., the object of the present study. was then established.

Next, administrators of educational institutions were contacted to obtain permission to conduct the study. On this occasion. they were informed about the study objectives and were asked to sign an informed consent form. Authorisation was also requested from the children and adolescents' parents. Once the best time for data collection in the classroom was set. it was performed by two properly trained collaborators who instructed the participants to answer the scale individually. and assured them about the voluntary nature of their participation, anonymity, and confidentiality of the responses. The study was approved by the Human Research Ethics Committee (ruling no. 88.166/2012) and complied with the stipulations in the Brazilian National

Health Council (Conselho Nacional de Saúde - CNS) Resolution no. 466/12. The average duration for completing the participation was 15 minutes.

Data Analysis

The PASW software (version 18) was used to calculate descriptive statistics (distribution of frequencies, measures of central tendency and dispersion) and to perform Student's t-tests (investigation of the discriminant power of items) in addition to exploratory factor analysis and internal consistency, in order to provide evidence of the adequacy of the scale.

Ethical Considerations

The study was approved by the Ethics Committee on Human Research of the Medical Sciences Faculty of the Universidade Federal da Paraíba (n. 88.166) in accordance with the Brazilian National Health Council (Resolution n. 466/12). The students were informed of the objectives and were guaranteed anonymity and confidentiality with respect to the study.

RESULTS

The discriminant power of the items of the APTBS was calculated first to establish whether they distinguished between the participants with close values for a given trait. The respondents were divided into an upper and a lower group, using the empirical median (Md = 61) as basis (half of the total score above and half below the median), forming two criteria groups. For each item, MANOVA was used to compare the means of the participants from the two groups, for all items. Results indicated that there were differences between the groups [Wilks' Lambda = .23; F (25, 188) = 24.46, p < .001, η²= .76]. More specifically, it was determined that all the items discriminated between the two groups in a satisfactory way (F > 41.78,p < .001), and the item 5 was the most discriminative (η² = .16) while item 23 was the less discriminative (η² = .34).

Once the discriminant power of the items was established, the factor structure of the scale was analysed. First, the factorability of the correlation matrix between items was investigated, and the results showed acceptable indexes [Kaiser-Meyer-Olkin (KMO) = .89 and Bartlett's sphericity test, χ² (300) = 1,818.47, p < .001]. A principal component analysis (PCA) was then performed without any previous restriction regarding the number of components or rotation. The results indicated an initial structure that comprised seven components with an eigenvalue greater than or equal to 1 (Kaiser's Criterion): 7.39, 1.85, 1.46, 1.22, 1.05, 1.02, and 1.01, which explained 60.1% of the total variance. However. the scree plot test (Cattell's Criterion) indicated a structure with a single component. Considering the fragility of these two criteria (Hayton. Allen. & Scarpello. 2004). a parallel analysis (Horn's Criterion) was performed based on the database parameters (230 participants and 25 items) with 1.000 simulations. A comparison of the eigenvalues found in the PCA with the simulated values showed that the third empirical eigenvalue (1.46) was lower than the simulated value (1.47). which suggested the adoption of a two-component structure.

Given these findings, a second PCA was performed with direct oblimin rotation to extract two components. These two components explained 29.6% and 7.4% of the total variance. respectively. and were mutually correlated (r = .45. p < .01). The results are described in Table 1.

Table 1 Factor structure of the Attitudes towards Potential Targets of Bullying Scale (APTBS) 

Notas. *Factor loading commonly accepted for interpretation of the factor (λ ≥ |.40| on a single factor).

The first component, named appearance and gender issues. consists of 8 items. which presented a saturation greater than .40. varying from .59 (e.g.. Item 12. Going to the mall or the beach with a fat person is not a good idea) to .67 (Item 19. Ugly people should not have ever been born). The internal consistency (Cronbach's alpha) of the scale was .81. and its homogeneity (mean inter-item correlation. rm,i) was .34. varying from .22 (items 10 and 12) to .49 (items 12 and 13).

The second component. named social exposition, consists of 5 items. which presented a saturation greater than .40. varying from . 57 (Item 1. The best people to give nicknames to are fat people) to .73 (Item 3. I do not trust men with bangs and earrings). The internal consistency (Cronbach's alpha) of the scale was .70. and its homogeneity (mean inter-item correlation. rm.i) was .31. varying from .21 (items 1 and 24) to .41 (items 3 and 4). Based on these results. It is considered that the Attitudes Towards Potential Targets of Bullying Scale is composed by a two-factor structure.

DISCUSSION

The aims of Study 1 were to develop a measure of the attitudes towards potential targets of bulling and to gather evi dence of its factor validity and precision. The results obtained make it possible to indicate that these aims were accomplis hed. More specifically, all of the items were discriminant, succeeding in identifying the participants with close values for a given trait (Pasquali. 2003). The structure composed by two factors able to assess the attitudes towards potential targets of bullying, more specifically Factor 1 (appearance and gender issues). refers to the attitudes towards these individuals due to the presence of elements that physically characterize them (e.g. Item 12. Going to the mall or the each with a fat person is not a good idea) or due to gender issues (e.g., item 21. A wimpy guy is the worst friend and boyfriend). Meanwhile, Factor 2 (social exposition) embraces attitudes towards situations where these individuals socially expose themselves. The values of the internal consistency indicators (Cronbach's alpha and homogeneity) were superior to those recommended by the literature (Clark & Watson, 1995; Tabachnick & Fidell, 2013). Nevertheless, the analyses performed were prominently exploratory, reason why the study described next was performed.

STUDY 2 CONFIRMATION OF THE FACTOR STRUCTURE AND FACTORIAL INVARIANCE OF THE APTBS ACROSS GENDER

Study 2 sought to confirm APTBS's two-factor structure and internal consistency. Besides that, it seemed appropriate to investigate how much the theorised structure is invariant in relation to a preponderant variable in the explanation of this construct: gender (Bandeira & Hutz, 2012; Silva, Pereira, Mendonça, Nunes, & Oliveira, 2013; Wang, Iannotti, & Nansel, 2009). That is, when compared to girls, boys are more often both perpetrators and victims of bullying.

METHOD

Participants

An amount of 570 students from João Pessoa (PB) (52.3%) and Cáceres (MT) (47.7%), with a mean age of 15 years old (SD = 1.66; varying from 11 to 20 years) participated in Study 2. Most participants were female (53.7%), catholic (65.5%), and with mean levels of religiosity ranking above the mid-point of the response scale (M = 2.75, SD = 1.14). Similar to Study 1, participants were recruited by means of convenience (non-probabilistic) sampling: all of the invited students who agreed to voluntarily collaborate with the study were included.

Instruments

The participants received a booklet containing the APTBS and demographic questions (gender, age, religion, and religiosity), described in Study 1.

Procedure

The same procedures for data collection and ethical parameters from Study 1 were reapplied. Participation in the study had an average duration of 15 minutes.

Data Analysis

PASW (version 18) was used to calculate descriptive statistics and the internal consistency of the scale. The confirmatory factor analysis (CFA) and analysis of factorial invariance across gender were performed on AMOS (version 18). and multiple indicators of adjustment were taken into account, such as: χ² (chi-square), ratio to the model's degrees of freedom (χ²/df), GFI (Goodness of Fit Index), AGFI (Adjusted Goodness of Fit Index). CFI (Comparative Fit Index). TLI (Tucker-Lewis Index). RMSEA (Root Mean Square Error of Approximation) and its 90% confidence interval (90% CI), SRMR (Standardized Root Mean Square Residual), ΔCFI and ΔRMSEA (factorial invariance) (Byrne, 2010; Cheung & Rensvold. 2002; Hooper. Coughlan. & Mullen. 2008; Tabachnick & Fidell. 2013). In addition. a specific calculator was used in order to investigate the composite reliability (CR) (Gouveia & Soares. 2015). which is recommended to be higher than .70 (Fornell & Larcker. 1981). even though scores of .60 are also accepted (Škerlavaj & Dimovski. 2009).

Ethical Considerations

In accordance with the Brazilian National Health Council (Resolution n. 466/12). the students were informed of the objectives, were guaranteed anonymity and confidentiality with respect to the study. The participant could withdraw from the study at any time without being penalized. The information regarding this study's approval had been presented beforehand.

RESULTS

The discriminative power of the items was evaluated once again, using multivariate analysis of variance (MANOVA). It was demonstrated that the group-criterion variables (lower and upper) satisfactorily discriminated the set of items [Wilks' lambda = .28. F (25. 214) = 21.99. p < .001. η² = .72], which prevented the exclusion of any items at this step. These items did not exhibit a univariate or multivariate normal distribution. The most extreme skewness and kurtosis were exhibited by items 24 (-.40 and -.86. respectively) and 19 (1.71 and 16.73. respectively). and the critical ratio for multivariate normality was 44.43. Even though the distribution was not normal. given the sample size (n > 200). nevertheless. the analysis was performed.

Figure 1 Graphic representation of eigenvalues 

In order to identify the most appropriate factor structure for the APTBS. analyses were performed to test the two models presented in this study. Model 1 is composed by thirteen items. which saturate in the same factor. and Model 2 presents a solution of two factors. each one of them corresponding to the components of appearance and gender issues, and social exposition. As it can be seen in Table 2, the model with two factors (M2) showed more plausible adjustments when compared to the model with a single factor (e.g. lower CAIC and ECVI). A more robust evidence of this difference is noted when comparing the respective degrees of freedom, where M2 was statistically lower than M1 (Δχ2, p < .05).

Table 2 Comparison models the APTBS 

Notas. M1 = unifactorial e M2 = bifactorial. * p < .001.

The results confirmed the two-factor structure of the APTBS [χ 2 (64) = 169.57 (p < .01), χ2/df = 2.65, GFI = .96, TLI = .92, AGFI = .94, CFI = .93, RMSEA = .054 (90% CI = .044-.064; Pclose = .26), and SRMR = .04]. All of the items presented saturations (lambda) different from zero (λ ≠ 0; z > 1.96, p < .001), with values varying from .37 [Item 24. Men should not dress as women] to .70 [Item 13. Fat women serve only to have fun with and laugh a bit]. These results suggest that the theoretical model fits the data. A summary of the findings is shown in Figure 2.

Figure 2 Confirmatory Factor Analysis of the APTBS 

To test the scale's internal consistency, we checked its Cronbach's alpha (α factor1 = .80; α factor2 = .65) and homogeneity (mean inter-item correlation, F1rm.i = .26; F2rm.i = .33). The Composite Reliability was calculated in order to confirm the parameter of internal consistency, being observed coefficients of CR1 = .80 and CR2 = .64, which were considered adequate.

After testing the two-factor structure of the adapted version of the APTBS, it was intended to verify its invariance considering the gender of participants. Firstly, the mean of the total scale scores obtained by the sample was compared by gender. The results pointed out to a significant difference (ttotal = 5.01, p < .001; tfactor1 = 3.59, p < .001; tfactor2 = 5.21, p <.001), with males having higher mean scores (Mtotal = 2.5, SDtotal = .71; Mfactor1 = 2.2, SDfactor1 = .83; Mfactor2 = 3.2, SDfactor2 = .89) than females (Mtotal = 2.2, SDtotal = .69; Mfactor1 = 1.9, SDfactor1 = .77; Mfactor2 = 2.7, SDfactor2 = .87). Then, it was sought to establish whether the hypothesis of factorial invariance was tenable. The results are described in Table 3.

Table 3 Indicators of APTBS factor invariance 

After that, the tow-factor model was tested for male (αfactor1 = .80; α factor2 = .61) and female (α factor1 = .79; α factor2 = .64), separately. Overall, the indicators of goodness of fit were satisfactory (e.g., χ 2/df < 3). Next, the initial model without restrictions was tested as baseline for the investigation of configural invariance. Subsequently, loading restriction (saturation), covariance, and residuals (errors underlying the items) were tested. Even though the ACFI values were not entirely satisfactory, a comparison between the model without restrictions and all others indicated satisfactory results regarding ΔRMSEA (≤ .01), suggesting that the structure of the analysed scale is invariant across gender.

DISCUSSION

Study 2 sought to gather evidence of factorial structure and internal consistency, and to investigate the factorial invariance of the APTBS across gender. The results confirmed the adequacy of the two-factor structure, with indicators following the recommended levels of adequacy (e.g., CFI, TLI, GFI < .90) (Byrne, 2010; Garson, 2003; Tabachnick & Fidell, 2013). Regarding the factorial invariance, results indicated configural (without restriction; the model exhibited the same factor structure across groups), metric (the factor loadings were equivalent across groups), structural (covariance), and residual (error variance) invariance.

GENERAL DISCUSSION

The objective of this study was to develop the Attitudes Towards Potential Targets of Bullying Scale and to gather evidence of its factor validity and internal consistency, ensuring its metric quality and demonstrating its factorial invariance across gender. These aims are likely to have been attained because the gathered evidence demonstrates that the psychometric adequacy of the scale supports its use with Brazilians in order to investigate the attitudes towards potential targets of bullying.

However, as in any scientific study, some potential limitations might be pointed out. For instance, the partici pants were recruited in a convenience (non-probabilistic) sample, which may restrict the generalisation of the results beyond the scope of the present study. A second possible limitation derives from the use of self-report instruments, of the "paper-and-pencil" type, which allows respondents to give false answers (Kohlsdorf & Costa Junior, 2009) or to answer in a socially acceptable manner (Gouveia, Athayde, Mendes, & Freire, 2012). However, this type of limitation is not exclusive to the APTBS, given that it is inherent to most instruments used in psychology, and has motivated the development of alternative procedures, such as implicit measures (Gouveia et al., 2012).

Regarding the main findings of the present work, Study 1 gathered evidences of the psychometric adequacy of the instrument, in accordance with the recommendations of the literature (Pasquali, 2003). The items of the APTBS were discriminant, a structure with two components clearly emerged, and the internal consistency - assessed through Cronbach's alpha and the homogeneity of the full set of items - clearly met the requirements described in the literature (Clark & Watson, 1995). These findings confirmed the adequacy of the APTBS to measure attitudes towards potential targets of bullying.

The scope of Study 2 went beyond the previous study, providing evidences of the adequacy of the theorised structure through a more robust statistical model (structural equation modelling). The results were adequate for the two-dimensional structure, being consistent with previous studies (Study 1). The coefficients of internal consistency were coherent to the ones found in Study 1, with Factor 2 presenting lower indices than Factor 1, but still demonstrating values recommended by the literature (α > .60) (Hair et al., 2009). This value might be justified by the fact that, as Pasquali (2003) explains, when the number of items that composes the factor is small (Factor 2 = 5 items), this value is relative. Furthermore, in agreement with the factorial invariance, Study 2 showed that bullying-related issues seem to be more present around males than females (Bandeira & Hutz, 2012; Silva et al., 2013). Nevertheless, this gender-based difference did not affect the scale's structure, with the set of analysed indicators suggesting that it is invariant.

Finally, the need to conduct future studies on attitudes of individuals towards potential targets of bullying is emphasised, such as replicating the studies previously described with samples of different ranges of age (the inclusion of children under nine years old), different tools (the development of implicit measures), and, consequently, different educational levels, to establish whether the respondents' scores are predictors of bullying behaviours, as either perpetrators or victims, or of related variables, such as antisocial and delinquent behaviours. The degree of association between the APTBS scores and the constructs that describe individuals (personality traits), or the principles that guide their lives (human values), remains to be established. It is further expected that the APTBS will contribute to the formulation of bullying prevention policies, because once the attitudes of individuals in this regard are known, it will be possible to make decisions about educational campaigns and/or control actions aiming at repressing them.

REFERENCES

Antunes, D. C., & Zuin, A. A. (2008). Do bullying ao preconceito: os desafios da barbárie à educação. Psicologia & Sociedade, 20, 33-42. [ Links ]

Austin, S., & Joseph, S. (1996). Assessment of bully/victim problems in 8 to 11 year-olds. British Journal of Educational Psychology, 66, 447-456. [ Links ]

Bacchini, D., Esposito, G., & Affuso, G. (2009). Social experience and school bullying. Journal of Community & Applied Social Psychology, 19, 17-32. [ Links ]

Bandeira, C., & Hutz, C. S. (2012). Bullying: Prevalência, implicações e diferenças entre os gêneros. Psicologia Escolar e Educacional, 16, 35-44. [ Links ]

Byrne, B. M. (2010). Structural equation modeling with Amos: Basic concepts, applications, and programmim g. New York: Routledge. [ Links ]

Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255. [ Links ]

Cho, J. I., Hendrickson, J. M., & Mock, D. R. (2009). Bullying status and behavior patterns of preadolescents and adolescents with behavioral disorders. Education and Treatment of Children, 32, 655-671. [ Links ]

Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. Psychological Assessment, 7, 309-319. [ Links ]

Cunha, J. M. (2009). Violência interpessoal em escolas no Brasil: Características e Correlatos. Dissertação de Mestrado. Universidade Federal do Paraná, Curitiba, PR. [ Links ]

Fante, C., & Pedra, J. A. (2008). Bullying escolar: Perguntas e respostas. Porto Alegre, RS: Artmed. [ Links ]

Felix, E. D., Sharkey, J. D., Green, J. G., Furlong, M. J., & Tanigawa, D. (2011). Getting precise and pragmatic about the assessment of bullying: the development of the California Bullying Victimization Scale. Aggressive Behavior, 37, 234-247. [ Links ]

Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39-50. [ Links ]

Gouveia, V. V., Athayde, R. A. A., Mendes, L. A. C., & Freire, S. E. A. (2012). Introdução às medidas implícitas: Conceitos, técnicas e contribuições. Revista da Sociedade de Psicologia do Rio Grande do Sul, 12, 80-92. [ Links ]

Gouveia, V. V., & Soares, A. K. S. (2015). Calculadoras de validade de construto (CVC). João Pessoa, PB: BNCS/ Universidade Federal da Paraíba. Recuperado de http://akssoares.com/psicometria/calculadora-vme-e-cc. [ Links ]

Hamburger, M. E., Basile, K. C., & Vivolo, A. M. (Eds.). (2011). Measuring bullying victimization, perpetration, and bystander experiences: A compendium of assessment tools. Centers for Disease Control and Prevention, National Center for Injury Prevention and Control, Division of Violence Prevention. [ Links ]

Hayton, J. C., Allen, D. G., & Scarpello, V. (2004). Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods, 7, 191-205. [ Links ]

Hair, J. F., Black, W. C., Babin, B. J., Anderson, R. E., & Tatham, R. L. (2009). Análise multivariada de dados. Porto Alegre, RS: Artmed [ Links ]

Hooper, D., Coughlan, J., & Mullen, M. R. (2008). Structural equation modelling: Guidelines for determining model fit. The Electronic Journal of Business Research Methods, 6, 53-60. [ Links ]

Hoffmann, C. T. (2013). The nature and extent of teachers as targets of bullying by their learners in a high school. Doctoral dissertation. School of Education, Faculty of Humanities, University of the Witwatersrand. [ Links ]

Kohlsdorf, M., & Costa Junior, A. L. (2009). O autorrelato na pesquisa em psicologia da saúde: Desafios metodológicos. Psicologia Argumento, 27, 131-139. [ Links ]

Middelton-Moz, J., & Zawadski, M. (2007). Bullying - Estraté gias de sobrevivência para crianças e adultos (R. C. Costa, Trad.). Porto Alegre, RS: Artmed . [ Links ]

Olweus, D. (1991). Bully/victim problems among schoolchildren: basic facts and effects of a school based intervention program. En D. Pepler. & K. H. Rubin (Eds), The development and treatment of childhood aggression (pp. 411-448). Hillsdale: Lawrence Erlbaum. [ Links ]

Olweus, D. (1993). Bullying at school. What we know and what we can do. Oxford, UK: Blackwell. [ Links ]

Pasquali, L. (2003). Psicometria: Teoria dos testes na psicologia e na educação. Vozes. [ Links ]

Pellegrini, D. (2001). Aprenda com eles e ensine melhor. Revis ta Nova Escola, 16, 19-25. [ Links ]

Pontzer, D. (2010). A theoretical test of bullying behavior: Parenting, personality, and the bully/victim relationship. Journal of Family Violence, 25, 259-273. [ Links ]

Silva, M. A. J., Pereira, B., Mendonça, D., Nunes, B., & Oliveira, W A. (2013). The involvements of girls and boys with bullying: An analysis of gender differences. International Journal of Environmental Research and Public Health, 10, 6820-6831. [ Links ]

Skerlavaj, M., & Dimovski, V. (2009). Organizational learning and performance in two national cultures: A multi-group structural equation modeling approach. En W. R. King (Ed.), Knowledge management and organizational learning (Vol. 4, pp. 321-366). Nueva York, NY: Springer. [ Links ]

Slonje, R., Smith, P. K., & Frisén, A. (2013). The nature of cyberbullying, and strategies for prevention. Computers in Human Behavior, 29, 26-32. [ Links ]

Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (6a ed.). Boston, MA: Allyn and Bacon. [ Links ]

2Referencia: Da Silva Lima, M., Veloso Gouveia, R., Silva Soares, A.K., Rodrigues Araújo, R., Costa Ribeiro, M.G., de Sampaio Brito, T.R. & Veloso Gouveia, V. (2017). Attitudes towards potential targets of bullying scale: Elaboration and evidence of validity and reliability. Acta Colombiana de Psicología, 20(1), 242-253. DOI: 10.14718/ACP.2017.20.1.12

1Universidade Federal do Mato Grosso do Sul, Centro de Ciências Humanas e Sociais (CCHS), Curso de Psicologia, Caixa Postal 549. CEP 79070-900, Campo Grande-MS. Teléfono: (55) 67 99845-0046. karla.soares@ufms.br

Received: August 11, 2016; Revised: September 27, 2016; Accepted: November 28, 2016

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License