You are seeing this message because your Web browser does not support basic Web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.


ABOUT ARCHIVES
Advanced Search

Welcome   | My Account | E-mail Alerts | Access Rights | Sign In


  Vol. 160 No. 6, June 2006 TABLE OF CONTENTS
  Archives
  •  Online Features
  Article
 This Article
 •Abstract
 •PDF
 •Send to a friend
 • Save in My Folder
 •Save to citation manager
 •Permissions
 Citing Articles
 •Citation map
 •Citing articles on ISI (2)
 •Contact me when this article is cited
 Related Content
 •Similar articles in this journal
 Topic Collections
 •Pediatrics, Other
 •Violence and Human Rights
 •Bioterrorism
 •Alert me on articles by topic

Effects of Antibullying School Program on Bullying and Health Complaints

Minne Fekkes, MSc, PhD; Frans I. M. Pijpers, MD, PhD; S. Pauline Verloove-Vanhorick, MD, PhD

Arch Pediatr Adolesc Med. 2006;160:638-644.

ABSTRACT

Objective  To evaluate the effects of an antibullying school intervention in elementary schools.

Design  Two-year follow-up randomized intervention group–control group.

Setting  Forty-seven elementary schools in the Netherlands.

Participants  Three thousand eight hundred sixteen children aged 9 to 12 years.

Intervention  During the first study year, an antibullying school program was implemented in the schools in the intervention group.

Main Outcome Measures  A questionnaire measuring bullying behavior, depression, psychosomatic complaints, delinquent behavior, and satisfaction with school life and peer relationships was filled out by the students at 3 times to obtain the following data: a baseline measurement, a first-effect measurement at the end of the first year, and a second-effect measurement at the end of the second year.

Results  The number of bullied children decreased by 25% in the intervention group compared with the control group (relative risk, 0.75; 95% confidence interval, 0.57-0.98). The intervention group also showed a decline in the scale scores of victimization (–1.06 vs 0.28; P<.01) and active bullying behaviors (–0.47 vs 0.12, P<.05). Self-reported peer relationships also improved in the intervention schools (0.48 vs 0.11; P<.05), and there was a trend for a decrease in reported depression in the intervention schools (–0.33 vs –0.10; P<.10). At follow-up, there were no differences between the intervention and control groups for the outcome measures. Schools had also lowered their antibullying activities during the second study year.

Conclusions  An antibullying school policy can reduce bullying behavior. To keep bullying at a consistently low level, schools must continue antibullying measures every year. Continued counseling may help schools in their efforts to establish a lasting antibullying policy.



INTRODUCTION
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

Bullying is a form of aggressive behavior that is widespread among schoolchildren and is often characterized by repetition and an imbalance of power.1 Bullying can take many forms, such as hitting, kicking, and name-calling, as well as more indirect forms such as exclusion and gossiping. One of the first large-scale studies on bullying behavior in Norway indicated that 1 of every 7 children was bullied regularly.2-3 Subsequent studies in several countries have also shown that a substantial number of children are bullied.4-7

Several studies also show that children who are being bullied, and to a lesser degree the bullies, have higher incidences of health complaints and depression.4, 8-18 Other studies have found an association between bullying and suicidal thoughts.10, 19

Since the 1980s, antibullying interventions have been implemented in schools in many countries.20 A first large-scale intervention campaign was carried out in Norway and was evaluated by Olweus.21 Results showed that schools implementing an antibullying policy had significant and lasting decreases in bullying behavior.2, 21 As a result, antibullying interventions were implemented in other countries.20, 22-25

In the Netherlands, several antibullying measures have been developed to help schools prevent and diminish bullying. In 1995, school, teacher, and parent organizations joined in a collaborative effort to develop national standard antibullying guidelines for schools. This resulted in a protocol for schools to adopt antibullying measures that mirror many of the principles of the Olweus program.26 Adoption of these antibullying measures was voluntary. Many schools adopted the guidelines and instituted an antibullying school policy, but a substantial number of schools did not develop a specific antibullying policy or implement antibullying activities.

The purpose of our study was to evaluate the effects of this antibullying school program in elementary schools. We studied effects on bullying behavior and on related outcome measures such as depression and health complaints. To evaluate the effects, we used a randomized intervention group–control group design. We hypothesized that bullying and related health complaints in schools that participated in the antibullying intervention would decrease compared with schools that did not participate in the intervention.


METHODS
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

PARTICIPATING SCHOOLS

To study the effect of an antibullying school program, the design included an intervention group and a control group (control group 1). For both groups, a baseline measurement (T0) and 2 follow-up measurements (T1 and T2) were obtained. In addition, another control group was added to the design (control group 2). This group was included in case the schools in control group 1 would start an antibullying school policy on their own during the first year as a result of the baseline measurement. However, this second control group did not contain any baseline measurement data and consequently was less than ideal for analysis. Therefore, control group 2 was included in the analyses only if schools in control group 1 started their own antibullying policy and had their staff trained.

Two hundred Dutch elementary schools were approached to participate in the study. Schools were eligible for participation if they did not have an antibullying school policy and their school staff was not recently trained in antibullying activities. Fifty schools agreed to participate. For logistic reasons, only 15 schools could participate in the intervention group. Schools were randomly assigned to either the intervention group or to 1 of the 2 control groups until each of the 3 groups contained 15 schools; the remaining schools were divided among the 2 control groups.

Children from the 3 highest grades (age, 9-12 years) participated by completing a questionnaire. The questionnaires were completed in classrooms under examinationlike conditions 3 times during the study: the first and second measurements were obtained during the school year, in November 1999 and May 2000, respectively, and the third measurement was obtained at the end of the follow-up school year in May 2001.

The design of the study was approved by the local medical ethics committee. All parental advisory boards of the participating schools were informed about the study and gave written informed consent for participation.

BULLYING BEHAVIOR

Two questions were asked about general bullying behavior: How often did other children bully you in recent months? How often did you bully other children in recent months? Questions were based on the Dutch version of the Olweus Bully/Victim Questionnaire with somewhat modified answer categories.27-28 Children could answer both questions on a 6-point scale: "not bullied at all," "1 or 2 times," "a few times a month," "once a week," "2 or 3 times a week," and "almost every day." Items were dichotomized into bullied ("a few times a month" or more often) and not bullied ("1 or 2 times" or less often). In addition, active and experienced bullying behavior was measured with items addressing 6 types of victimization: name-calling, exclusion, hitting or kicking, having things stolen or hidden, being rumored or gossiped about, and being teased.29 Children were asked if they experienced or performed any of these behaviors during the last 4 weeks. Items were summed for both scales of active and experienced bullying behavior.

PSYCHOSOMATIC COMPLAINTS

Students were asked about a series of health symptoms (eg, headache, sleeping problems, or abdominal pain) and for each symptom were asked to report whether in the last 4 weeks they had experienced the symptom never, sometimes, or often. Items were summed into a scale.

DEPRESSION

Depression was evaluated with the Short Depression Inventory for Children.30 This questionnaire contains 9 items, for example, "The last weeks I felt down." For each item, respondents answered whether this was true or not true. All items answered as true were summed.

DELINQUENT BEHAVIOR

Delinquent behavior was measured with a 7-item scale.29 Each item addressed a different form of delinquent behavior, such as "Have you stolen something at school?" All items that were answered positively were summed.

SCHOOL SATISFACTION

Experience of school life was measured with 3 scales from the Dutch School Experience Questionnaire31: "satisfaction with contact with other students" (8 items, eg, "I would rather be in a classroom with other children"), general satisfaction with school life (10 items), and satisfaction with contact with teachers (15 items). For each item, answer options were always, often, sometimes, or never. Items were summed, with higher scores indicating more satisfaction.

ANTIBULLYING ACTIVITIES

Compliance with the components of the intervention was measured by teacher reports. A questionnaire with questions regarding antibullying activities performed during the school year was distributed among teachers in the participating classes at the end of the second and third years (T1 and T2).

STATISTICAL ANALYSES

Multilevel logistic and linear regression analyses (MLwiN; Multilevel Models Project, Institute of Education, London, England)32 were used to calculate effects of the intervention at the end of the first and second years of the study. Three levels were included in the analyses: school, classroom, and individual. Outcomes were measured at the individual level, corrected for influences from a higher level, that is, classroom and school. Baseline levels of the outcome measure and grade, sex, and school size were included as covariates in the regression model. Odds ratios obtained from logistic regression were converted to relative risk by using the method described by Zhang and Yu.33 P values were 2-tailed. Significance levels for an effect were P<.05, and for a trend were P<.10.

ANTIBULLYING PROGRAM

The antibullying program was developed in the Netherlands and mirrors many principles that also underlie antibullying programs in other countries, such as the Olweus program. The program aims to include teachers, bullied children, bullies, noninvolved children, and parents in the efforts to lower the bullying behavior.

An important part of the program is that teachers undergo training. Another important component is the development of a written antibullying school policy describing the activities that a school plans to perform during the course of the school year and how to deal with bullying incidents. Training of teachers and assistance for the schools was given by the KPC group, an organization that specializes in training school staff and assisting schools with the implementation of new curricula and guidelines. Schools in the intervention group were assisted with the development of an antibullying school policy during the first year of the study.

At the beginning of the school year there was a meeting for school board supervisors to explain the program and create support. There was a 2-day training session for teachers to create awareness of bullying behavior, to assist them in applying antibullying measures, and to instruct them on how to deal with bullying incidents among children. During the intervention year, teachers could consult the training staff with questions about their antibullying activities.

Schools were supplied with the booklet Bullying in School: How to Deal With It,26 which describes how a school can develop an antibullying policy and undertake various measures. They were also supplied with the Bullying Test,26 a computerized questionnaire that children can complete anonymously in the classroom and that gives the teacher an insight into the bullying behavior of the students.

Schools were asked to develop a written antibullying school policy and to include in their activities the core program as described by Olweus3: set clear rules against bullying, have regular measurements of bullying behavior by means of a questionnaire, have a curriculum of lessons on bullying behavior and social skills, have good supervision during recess, and inform parents about and involve them in the antibullying policy of the school.


RESULTS
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

The main criterion for including schools in the intervention group was that their teachers participate in the 2-day training. One school was originally part of the intervention group but indicated having no time for the training and, consequently, was excluded from the intervention group and the study.

ANTIBULLYING ACTIVITIES DURING THE FIRST YEAR

The participating schools included 156 classes participating in the study during the first year. A questionnaire regarding the antibullying activities during the first year was returned for 107 classes (response rate, 69%). Results are given in Table 1. Most teachers in the intervention group participated in the training. None of the control schools had a substantial part of their staff trained in antibullying measures during the study. The results indicate further that intervention schools performed more antibullying activities, although not for all components of the intervention. Specifically, the use of an antibullying survey in the classrooms and the creation of antibullying rules were done significantly more often in the intervention group. At the end of the first year, 6 of the 14 schools in the intervention group had a written antibullying policy. One of the 18 schools in control group 1 had a written policy, and no school in control group 2 had a written antibullying policy.


View this table:
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Table 1. Activities During First Year for Intervention and Control Schools


ANTIBULLYING ACTIVITIES DURING THE SECOND YEAR

The participating schools included 113 classes participating in the study during the second year. A questionnaire regarding the antibullying activities during this second year was returned for 105 classes (response rate, 93%). Results are given in Table 2. There was no significant difference in activities between the intervention group and the control groups. The main reasons why schools in the intervention group discontinued activities during the second year of the study were that they considered the antibullying activities to be a 1-year project, the school decided that another issue should get priority during the following year, or simply that there was no time to perform the activities every year. Schools with a written antibullying policy performed more antibullying activities during the follow-up year than those without a written policy.


View this table:
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Table 2. Activities During Second Year for Intervention and Control Schools


EFFECTS OF ANTIBULLYING POLICY

A total of 3816 children participated in the study: 1214 students in the intervention group (at T0), 1552 students in control group 1 (at T0), and 1050 students in control group 2 (at T1) (Figure). Because most of the schools in both control groups did not have their staff trained and did not have a written antibullying school policy during the first year, control group 1 was used in the main effect analysis as the comparison group because this group also included a baseline measurement (T0).


Figure 501351
View larger version (82K):
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Figure. Flowchart shows school participation and follow-up data for students and schools. T1 & T2 are follow-up measurements obtained at the end of the second and third study years.


NONRESPONSE

The intervention group and control group 1 included 2848 students in the upper 3 grades; 2766 (97%) participated in the baseline measurement (T0), and 2224 (78%) participated in the first-effect measurement (T1). During the following school year children in the lower 2 grades of the initial sample, who were still in elementary school, participated in the second-effect measurement (T2), and 1591 children (58% of the initial total sample, 82% of the initial lower 2 grades) filled out the questionnaire (Figure).

For the nonresponders of the first-effect measurement (T1), there were no differences in outcome variables of the initial measurement between nonresponders from the intervention group and those from the control group. Nonresponders of the second-effect measurement (T2) differed only on the baseline scores of psychosomatic complaints (0.97 vs 1.21; t = 2.71; P = .007).

INITIAL SAMPLE

Mean (SD) age of students at the baseline measurement was 10.1 (1.1) years. Fifty percent of the sample were girls. Table 3 gives data on general bullying behavior in intervention schools and control schools.


View this table:
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Table 3. General Bullying Behavior*


EFFECTS AFTER THE FIRST YEAR

At the end of the first year, the number of bullied children decreased significantly in the intervention schools compared with the control schools. In the intervention schools, the number of bullied children decreased from 17.7% to 15.5%, while the number of bullied children in the control group increased from 14.6% to 17.3%. Multilevel regression analyses indicated that children in the intervention group were at a relative risk of 0.75 (95% confidence interval, 0.57-0.98) of being bullied at the end of the first school year compared with the control group (Table 4). Thus, the number of bullied children decreased by 25% in the intervention group compared with the control group.


View this table:
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Table 4. Relative Risk for General Bullying Behavior at End of Intervention Year*


Scale scores on specific bullying behavior also indicated that children in the intervention schools experienced significantly less bullying behavior (Table 5). Children also indicated less active bullying behavior. Furthermore, there was a trend for fewer depressive symptoms in the intervention schools compared with the control schools at the end of the first year. Children in the intervention group also indicated higher satisfaction with contact with other students.


View this table:
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Table 5. Changes in Bullying Behavior and Health Complaints at End of Intervention Year*


EFFECTS AFTER THE SECOND YEAR

At the end of the follow-up year there were no significant differences in bullying behavior between schools in the intervention group and the control group (Table 6). There were also no differences between the groups in other outcome measures such as depression, psychosomatic complaints, and satisfaction with school life (Table 7).


View this table:
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Table 6. Relative Risk for General Bullying Behavior at End of Second Study Year*



View this table:
[in this window]
[in a new window]
[as a PowerPoint slide]
 
Table 7. Changes in Bullying Behavior and Health Complaints at End of Second Study Year*



COMMENT
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

The results of this randomized control study indicate that schools can reduce the number of children being bullied. The number of bullied children decreased by 25% in the intervention group compared with the control group at the end of the first year. Self-reported peer relationships improved at the intervention schools, and there was a trend toward a decrease in reported depressive complaints in the intervention schools in comparison with the control schools.

Compliance in the intervention group was high for attending the 2-day training for teachers, using the bullying questionnaire to establish levels of bullying behavior, and setting clear rules against bullying in the classroom. Compliance was low for some components of the intervention. For example, schools did not often involve the parents in their antibullying efforts. Awareness is considered important in combating bullying through a school-based intervention program.3 It may well be that attending the training sessions and frequent use of the Bullying Test raised awareness of the bullying problem and made teachers more vigilant during the first year.

In the longer term, at the end of the second study year, there were no significant differences in outcome variables between the intervention and control schools. One explanation might be the decline of antibullying measures in the intervention schools during the second year. Although schools were asked to continue their activities, no training or counseling was given in the second year. This absence of ongoing support may have been an important reason for discontinuation of the activities in the second year. Another explanation is that not all schools in the intervention group developed a written antibullying school policy. Schools with a written policy did continue more of their antibullying measures. Furthermore, several schools indicated that they considered the antibullying activities part of a 1-year project and wanted to give their extra time and attention each year to a different health subject that needed special attention.

Other studies have found mixed results on antibullying school measures. Olweus21 evaluated a nationally implemented antibullying intervention in Norway and found substantial (up to 50%) reductions in bullying victimization. However, other authors34-35 evaluated the same program and found no overall effects. This difference in results is explained by the higher level of counseling given to schools in the Olweus study. Evaluation of similar programs in England and Belgium reported positive effects, although smaller than those reported in Norway.23-25 A recent study in Finland found substantial reductions in bullying behavior, especially among schools with high levels of implementation of antibullying activities.36

Some strengths of our study are the randomized controlled design and the use of multilevel analysis, which controls for clustering effects at the group level. Effect analyses included baseline levels of bullying behavior to correct for initial differences between the groups. An adverse factor in the design was that schools in the control group performed several antibullying activities. All schools were expected to be involved in some antibullying activities. However, these control schools can still be considered part of the control group because their staff did not undergo any antibullying training and most control schools did not develop a written antibullying policy.

Future implementation of the antibullying intervention in elementary schools should be more focused on developing a written antibullying policy and include regular follow-up counseling. A follow-up project is under way to investigate how schools can implement more antibullying activities and continue their activities each year with the help of ongoing consultation.

We conclude that an antibullying school intervention can reduce bullying victimization. However, to keep bullying behavior at a consistently low level, schools must continue antibullying measures every year. Regular follow-up counseling could help schools to continue their antibullying school policy.


AUTHOR INFORMATION
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

Correspondence: Minne Fekkes, MSc, PhD, Youth Department, TNO (Netherlands Organization of Applied Scientific Research) Prevention and Health, PO Box 2215, 2301 CE Leiden, the Netherlands (m.fekkes{at}pg.tno.nl).

Accepted for Publication: November 23, 2005.

Author Contributions: Dr Fekkes had full access to all data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis.

Funding/Support: This study was supported by grant 22000061 from ZorgOnderzoek Nederland, The Hague, which had no role in the design or conduct of the study or in the preparation, review, or approval of the manuscript.

Author Affiliations: Youth Department, TNO (Netherlands Organization of Applied Scientific Research) Prevention and Health, Leiden (Drs Fekkes and Verloove-Vanhorick), Geneeskundige en GezondheidsDienst Amsterdam (Dr Pijpers), Department of Pediatrics and Child Health, Leiden University Medical Center (Dr Verloove-Vanhorick), the Netherlands.


REFERENCES
 Jump to Section
 •Top
 •Introduction
 •Methods
 •Results
 •Comment
 •Author information
 •References

1. Olweus D. Sweden. In: Smith PK, Morita Y, Junger-Tas J, Olweus D, Catalano RF, Slee P, eds. The Nature of School Bullying: A Cross-National Perspective. New York, NY: Routledge; 1999:7-27.
2. Olweus D. Bully/victim problems among schoolchildren: basic facts and effects of a school based intervention program. In: Pepler DJ, Rubin KH, eds. The Development and Treatment of Childhood Aggression. Hillsdale, NY: Lawrence A Erlbaum Associates; 1991:411-448.
3. Olweus D. Bullying at School: What We Know and What We Can Do. Oxford, England: Blackwell Publishers Inc; 1993.
4. Kumpulainen K, Rasanen E, Henttonen I. Children involved in bullying: psychological disturbance and the persistence of the involvement. Child Abuse Negl. 1999;23:1253-1262. FULL TEXT | ISI | PUBMED
5. Nansel TR, Overpeck M, Pilla RS, Ruan WJ, Simons-Morton B, Scheidt P. Bullying behaviors among US youth: prevalence and association with psychosocial adjustment. JAMA. 2001;285:2094-2100. FREE FULL TEXT
6. Rigby K, Slee PT. Bullying among Australian school children: reported behavior and attitudes toward victims. J Soc Psychol. 1991;131:615-627. ISI | PUBMED
7. Wolke D, Woods S, Stanford K, Schulz H. Bullying and victimization of primary school children in England and Germany: prevalence and school factors. Br J Psychol. 2001;92:673-696. FULL TEXT | ISI | PUBMED
8. Nishina A, Juvonen J, Witkow MR. Sticks and stones may break my bones, but names will make me feel sick: the psychosocial, somatic, and scholastic consequences of peer harassment. J Clin Child Adolesc Psychol. 2005;34:37-48. FULL TEXT | ISI | PUBMED
9. Due P, Holstein BE, Lynch J, et al. Health behaviour in school-aged children bullying working group. Bullying and symptoms among school-aged children: international comparative cross sectional study in 28 countries. Eur J Public Health. 2005;15:128-132. FREE FULL TEXT
10. Kaltiala-Heino R, Rimpela M, Marttunen M, Rimpela A, Rantanen P. Bullying, depression, and suicidal ideation in Finnish adolescents: school survey. BMJ. 1999;319:348-351. FREE FULL TEXT
11. Forero R, McLellan L, Rissel C, Bauman A. Bullying behavior and psychosocial health among school students in New South Wales, Australia: cross sectional survey. BMJ. 1999;319:344-348. FREE FULL TEXT
12. Kumpulainen K, Rasanen E, Henttonen I, et al. Bullying and psychiatric symptoms among elementary school-age children. Child Abuse Negl. 1998;22:705-717. FULL TEXT | ISI | PUBMED
13. Rigby K. The relationship between reported health and involvement in bully/victim problems among male and female secondary school children. J Health Psychol. 1998;3:465-476. ABSTRACT
14. Salmon G, James A, Smith DM. Bullying in schools: self reported anxiety, depression, and self esteem in secondary school children. BMJ. 1998;317:924-925. FREE FULL TEXT
15. Slee PT. Situational and interpersonal correlates of anxiety associated with peer victimisation. Child Psychiatry Hum Dev. 1994;25:97-107. FULL TEXT | ISI | PUBMED
16. Williams K, Chambers M, Logan S, Robinson D. Association of common health symptoms with bullying in primary school children. BMJ. 1996;313:17-19. FREE FULL TEXT
17. Wolke D, Woods S, Bloomfield L, Karstadt L. Bullying involvement in primary school and common health problems. Arch Dis Child. 2001;85:197-201. FREE FULL TEXT
18. Bond L, Carlin JB, Thomas L, Rubin K, Patton G. Does bullying cause emotional problems? a prospective study of young teenagers. BMJ. 2001;323:480-484. FREE FULL TEXT
19. Cleary SD. Adolescent victimization and associated suicidal and violent behaviors. Adolescence. 2000;35:671-682. ISI | PUBMED
20. Smith PK, Ananiadou K, Cowie H. Interventions to reduce school bullying. Can J Psychiatry. 2003;48:591-599. PUBMED
21. Olweus D. Bullying at school: basic facts and effects of a school based intervention program. J Child Psychol Psychiatry. 1994;35:1171-1190. ISI | PUBMED
22. Pepler DJ, Craig WM, Ziegler S, Charach A. An evaluation of an anti-bullying intervention in Toronto schools. Can J Community Mental Health. 1994;13:95-110.
23. Smith PK, Sharp S. School Bullying: Insights and Perspectives. London, England: Routledge; 1994.
24. Smith PK. Bullying in schools: the UK experience and the Sheffield anti-bullying project. Ir J Psychol. 1997;18:191-201.
25. Stevens V, De Bourdeaudhuij I, Van Oost P. Bullying in Flemish schools: an evaluation of anti-bullying intervention in primary and secondary schools. Br J Educ Psychol. 2000;70:195-210. FULL TEXT | ISI | PUBMED
26. Limper R. Cooperation between parents, teachers, and school boards to prevent bullying in education: an overview of work done in the Netherlands. Aggress Behav. 2000;26:125-134. FULL TEXT
27. Solberg M, Olweus D. Prevalence estimation of school bullying with the Olweus Bully/Victim Questionnaire. Aggress Behav. 2003;29:239-268. FULL TEXT | ISI
28. Liebrand J, Van IJzerdoorn H, Van Lieshout C. KRVL Klasgenoten Relatie Vragenlijst Junior. Nijmegen, the Netherlands: Vakgroep Ontwikkelingspsychologie, Katholieke Universiteit Nijmegen; 1991.
29. Junger-Tas J, Van Kesteren JN. Bullying and Delinquency in a Dutch School Population. The Hague, the Netherlands: Kugler Publications; 1999.
30. Kroesbergen HT, De Wit CA, Stijnen TH. Detection of depressive complaints in children. Eur J Public Health. 1996;6:29-34. FREE FULL TEXT
31. Knuver JWM. De Relatie tussen Klas: en Schoolkenmerken en het Affectief Functioneren van Leerlingen [The Relation Between Class and School Characteristics, and the Affective Functioning of Students]. Groningen, the Netherlands: RION; 1993.
32. Rasbash J, Browne W, Goldstein H, et al. A User's Guide to MLwiN. London, England: Multilevel Models Project, Institute of Education; 2000.
33. Zhang J, Yu KF. What's the relative risk? a method of correcting the odds ratio in cohort studies of common outcomes. JAMA. 1998;280:1690-1691. FREE FULL TEXT
34. Roland E, Munthe E. The 1996 Norwegian Program for preventing and managing bullying in schools. Ir J Psychol. 1997;18:233-247.
35. Roland E. Bullying in school: three national innovations in Norwegian schools in 15 years. Aggress Behav. 2000;26:135-143. FULL TEXT
36. Salmivalli C, Kaukiainen A, Voeten M. Anti-bullying intervention: implementation and outcome. Br J Educ Psychol. 2005;75:465-487. FULL TEXT | ISI | PUBMED






HOME | CURRENT ISSUE | PAST ISSUES | TOPIC COLLECTIONS | SUBMIT | SUBSCRIBE | HELP
CONDITIONS OF USE | PRIVACY POLICY | CONTACT US | SITE MAP
 
© 2006 American Medical Association. All Rights Reserved.