Abstract

As part of the Spanish Multicenter Normative Studies (NEURONORMA project), we provide age- and education-adjusted norms for the Boston naming test and Token test. The sample consists of 340 and 348 participants, respectively, who are cognitively normal, community-dwelling, and ranging in age from 50 to 94 years. Tables are provided to convert raw scores to age-adjusted scaled scores. These were further converted into education-adjusted scaled scores by applying regression-based adjustments. Age and education affected the score of the both tests, but sex was found to be unrelated to naming and verbal comprehension efficiency. Our norms should provide clinically useful data for evaluating elderly Spaniards. The normative data presented here were obtained from the same study sample as all the other NEURONORMA norms and the same statistical procedures for data analyses were applied. These co-normed data allow clinicians to compare scores from one test with all tests.

Introduction

The Spanish Multicenter Normative Studies (NEURONORMA project; Peña-Casanova et al., 2009) attempts to provide useful norms for people aged over 49 years for commonly used neuropsychological tests. In this paper, we provide normative data for the second edition of the Boston naming test (BNT) and the Token test (TT).

Boston Naming Test

The BNT is a widely used neuropsychological instrument that was developed to assess visual naming ability (Kaplan, Goodglass, & Weintraub, 1983). It is often employed as one of many tests to evaluate cognitive impairment in cases with suspected dementia and possible anomia (Tallberg, 2005). It has undergone several modifications over the years (seeMitrushina, Boone, Razani, & D'Elia, 2005, for a review). In 2001, a second edition was published (Kaplan, Goodglass, & Weintraub, 2001) that included a multiple choice form. In the BNT, patients are presented with 60 line drawings of different objects. Items pertain to three groups representing objects of high (easy to name), medium, and low (hard to name) frequency of occurrence. The maximum score is 60.

Demographic effects such as age, education, and sex have been frequently associated with the BNT scores. Age effects have been shown by a series of studies in which a lower performance on the BNT in older people was a general and consistent conclusion (e.g., Au et al., 1995; Farmer, 1990; Fastenau, Denburg, & Maurer, 1998; Feyereisen, 1997; Goulet, Ska, & Kahn, 1994; Kimbarrow, Vangel, & Lichtenberg, 1996; LaBarge, Edwards, & Knesevich, 1986; Lansing, Ivnik, Cullum, & Randolph, 1999; MacKay, Connor, Albert, & Obler, 2002; Marien, Mampaey, Vervaet, Saerens, & De Deyn, 1998; Neils et al., 1995; Nicholas, Brookshire, MacLennan, Schumacher, & Porrazzo, 1989; Randolph, Lansing, Ivnik, Cullum, & Hermann, 1999; Ross et al., 1998; Saxton et al., 2000; Tallberg, 2005; Van Gorp, Satz, Kiersch, & Henry, 1986; Worrall, Yiu, Hickson, & Barnett, 1995). Education effects were reported by most of these studies, and high education levels were frequently associated with higher scores on the BNT (Borod, Goodglass, & Kaplan, 1980; Ivnik, Malec, Smith, Tangalos, & Petersen, 1996; Lansing et al., 1999; Lucas et al., 2005; Neils et al., 1995; Randolph et al., 1999; Tombaugh & Hubley, 1997; Welch, Doineau, Johnson, & King, 1996; Worrall et al., 1995). However, other reports concluded that education had less influence than an IQ rating (Steinberg, Bieliauskas, Smith, Langellotti, & Ivnik, 2005). A recent study by Zec, Burkett, Markwell, and Larsen, (2007a, 2007b) found “significantly poorer mean BNT scores and increasing variability with successively older age groups and decreasing educational levels, indicating the need for demographically normative data when determining an individual's degree of impairment” (Zec et al., 2007b, p. 617).

Conversely, sex has been shown in several studies to be unrelated to naming efficiency in normal samples (Cruice, Worrall, & Hickson, 2000; Fastenau et al., 1998; Henderson, Frank, Pigatt, Abramson, & Houston, 1998; Ivnik et al., 1996; LaBarge et al., 1986), although some studies (Ivnik et al., 1996; Lansing et al., 1999; Tombaugh & Hubley, 1997; Welch et al., 1996) found a slight, but insignificant, male advantage on the BNT. Contradictory results about the impact of ethnicity and culture on BNT performance have been provided. Although a large group of cross-cultural studies emphasized socio-economic status, ethnicity, and cultural factors as important variables for performance on the BNT (Boone, Victor, Wen, Razani, & Pontón, 2007; Kimbarrow et al., 1996; Lucas et al., 2005), others did not find notable differences in naming ability among elderly people of different ethnicity (Henderson et al., 1998; Manly, Jacobs, Touradji, Small, & Stern, 2002). Finally, some studies reported data from English–Spanish bilinguals (Acevedo & Loewenstein, 2007; Gollan, Fennema-Notestine, Montoya, & Jernigan, 2007; Kohnert, Hernández, & Bates, 1998).

There are a number of studies that provide normative data for the different languages that the BNT has been adapted to (Lezak, Howieson, & Loring, 2004; Mitrushina et al., 2005; Strauss, Sherman, & Spreen, 2006). Zec and colleagues (2007b) have recently published normative data for the BNT from a large group for older people. Several long-form versions exist in Spanish (Allegri et al., 1997; Ardila, Rosselli, & Puente, 1994). Allegri and colleagues (1997) reported normative data for the BNT which were collected from 200 residents of Buenos Aires across an adult age span. Recently, Quiñones-Úbeda, Peña-Casanova, Bohm, Gramunt-Fombuena, and Comas (2004) published an adaptation of the second edition of the BNT, but only normative data for young people were reported. In a more recent study, Rami and colleagues (2008) reported normative data for the BNT on 121 Spanish-speaking elderly people. The mean score was 49.6 (SD = 5.6) and was influenced by sex and the level of education.

Short forms of the BNT were developed in order to reduce the test time for patients (for a review see Kent & Luszcs, 2002; Mitrushina et al., 2005; Strauss et al., 2006). The second edition of the test (Kaplan et al., 2001) includes one of the 15-item short versions developed by Mack, Freed, Williams, and Henderson (1992). With regard to Spanish short forms, a 30-item form was developed for Spanish-speaking people in the USA (Pontón et al., 1996; Pontón, González, Hernández, Herrera, & Higareda, 2000). A 12-item version was developed by Serrano and colleagues (2001) and was used in the diagnosis of Alzheimer's disease. Finally, Calero, Arnedo, Navarro, Ruiz-Pedrosa, and Carnero (2002) presented a 12-item reduced version for assessing patients who required shorter testing methods.

Token Test

The TT was originally developed by De Renzi and Vignolo (1962; the so-called long form) and has been the object of multiple versions and modifications (seeMcNeil & Prescott, 1978, for an early review). Modifications of the original test include short forms (Benton, Hamsher, & Sivan, 1994 [multilingual aphasia examination, MAE]; De Renzi & Faglioni, 1975, 1978; Emery, 1986; Smith, Mann, & Shankweiler, 1986; Spellacy & Spreen, 1969; Van Harskamp & Van Dongen, 1977). The MAE version was included in the MOANS project (Ivnik et al., 1996; Lucas et al., 2005; Steinberg et al., 2005). Another version of the TT was that included in the Neurosensory Center Comprehensive Examination for Aphasia (NCCEA) by Spreen and Benton (1969, 1977).

There are a number of studies that provide normative data for the TT (Lezak et al., 2004; Strauss et al., 2006) including Spanish (Ardila et al., 1994; Rey, Sivan, & Benton, 1998 [MAE version, 3rd ed.]), Danish (Nielsen, Lolk, & Kragh-Sorensen, 1995), Portuguese (Fontanari, 1989), and French (Giroux, Salamé, Bédard, & Bellavance, 1992).

Demographic effects on the TT, mainly age and education, were shown to be minor. In fact, performance improves in childhood, reaching adult scores about age 11 (Strauss et al., 2006). Age-related effects were reported as few in a series of papers (De Renzi & Faglioni, 1978; Ivnik et al., 1996; Swisher & Sarno, 1969); however, Emery (1986), using the NCCEA, found an age-related decline in individuals aged 30–93 years, with lower scores in elderly (75–93) healthy subjects.

Concerning education, scores were found to be modestly associated with an adult's level of education (Orgass & Poeck, 1966), but De Renzi and Faglioni (1978) recommended a correction for education [+2.36 − (.30 × years of formal schooling)] for an item-by-item scoring.

The TT encapsulates a series of cognitive processes in addition to auditory comprehension, including working memory (Emery, 1986; Kitson, 1985; Lesser, 1976; Smith et al., 1986), analysis of the whole into a series of items, or the ability to adequately ignore automatically evoked, distracting stimuli (Strauss et al., 2006). There is also a general cognitive ability influence on the TT, with a high correlation with the MMSE (r = .74; Swihart, Panisett, & Becker, 1989), and a lower correlation (r = .35) with the Raven progressive matrices for brain-damaged subjects (Coupar, 1976). TT performance is mainly dependent on parietotemporal metabolism (Karbe, Herholz, Szelies, Pawlik, Wienhard, & Heiss, 1989). It shows a high correlation with other measures of receptive ability, such as the Peabody picture vocabulary test (r = .71; Lass & Golden, 1975), the Porch index of communicative abilities, and the Boston diagnostic aphasia examination (Morley, Lundgren, & Haxby, 1979). The TT also correlates with the measures of language production (Gutbrod, Meger, Meter, & Cohen, 1985).

Materials and Methods

Research Participants

Socio-demographic and participant characteristics of the entire NEURONORMA sample have been reported in a previous paper (Peña-Casanova et al., 2009). Ethical approval for the study was granted by the Research Ethics Committee of the Municipal Institute of Medical Care of Barcelona, Spain, and from the different participating centers. The study was conducted in accordance with the Declaration of Helsinki (World Medical Association, 1977) and its subsequent amendments, and the European Union regulations concerning medical research.

Recruitment procedures, sample characteristics, and other aspects of the NEURONORMA research program have been previously reported and will not be reiterated here (Peña-Casanova et al., 2009). Study participants were identified as normal based on criteria established for the NEURONORMA research. Following the MOANS model (Ivnik et al., 1992, 1996; Lucas et al., 2005), volunteers did not need to be completely medically healthy to participate. Demographic information concerning the BNT and the TT is presented in Table 1.

Table 1.

Sample size by demographics and test

Boston Naming Test
Token Test
CountPercentage of TotalCountPercentage of Total
Age group
 50–567522.067621.84
 57–595115.005114.66
 60–62339.71349.77
 63–65185.29185.17
 66–68257.35267.47
 69–714914.414914.08
 72–74319.12339.48
 75–77298.53308.62
 78–80195.59205.75
 >80102.94113.16
Education (years)
 ≤56920.297320.98
 6–7216.18257.18
 8–96719.716719.25
 10–113811.184011.49
 12–133610.593510.06
 14–15339.71339.48
 ≥167622.357521.55
Gender
 Men13840.5913939.94
 Woman20259.4120960.06
Total sample (n)340348
Boston Naming Test
Token Test
CountPercentage of TotalCountPercentage of Total
Age group
 50–567522.067621.84
 57–595115.005114.66
 60–62339.71349.77
 63–65185.29185.17
 66–68257.35267.47
 69–714914.414914.08
 72–74319.12339.48
 75–77298.53308.62
 78–80195.59205.75
 >80102.94113.16
Education (years)
 ≤56920.297320.98
 6–7216.18257.18
 8–96719.716719.25
 10–113811.184011.49
 12–133610.593510.06
 14–15339.71339.48
 ≥167622.357521.55
Gender
 Men13840.5913939.94
 Woman20259.4120960.06
Total sample (n)340348
Table 1.

Sample size by demographics and test

Boston Naming Test
Token Test
CountPercentage of TotalCountPercentage of Total
Age group
 50–567522.067621.84
 57–595115.005114.66
 60–62339.71349.77
 63–65185.29185.17
 66–68257.35267.47
 69–714914.414914.08
 72–74319.12339.48
 75–77298.53308.62
 78–80195.59205.75
 >80102.94113.16
Education (years)
 ≤56920.297320.98
 6–7216.18257.18
 8–96719.716719.25
 10–113811.184011.49
 12–133610.593510.06
 14–15339.71339.48
 ≥167622.357521.55
Gender
 Men13840.5913939.94
 Woman20259.4120960.06
Total sample (n)340348
Boston Naming Test
Token Test
CountPercentage of TotalCountPercentage of Total
Age group
 50–567522.067621.84
 57–595115.005114.66
 60–62339.71349.77
 63–65185.29185.17
 66–68257.35267.47
 69–714914.414914.08
 72–74319.12339.48
 75–77298.53308.62
 78–80195.59205.75
 >80102.94113.16
Education (years)
 ≤56920.297320.98
 6–7216.18257.18
 8–96719.716719.25
 10–113811.184011.49
 12–133610.593510.06
 14–15339.71339.48
 ≥167622.357521.55
Gender
 Men13840.5913939.94
 Woman20259.4120960.06
Total sample (n)340348

Neuropsychological Measures

The neuropsychological measures were administered as part of a larger test battery, the NEURONORMA battery (Peña-Casanova et al., 2009). Tests were administered and scored by neuropsychologists specifically trained for this project.

Boston naming test

In order to adapt the test to Spain, an extra item was added: “magdalena” (a cupcake or fairy cake made in a small paper cup container [muffin]), as an alternative to “pretzel’ (Quiñones-Úbeda et al., 2004). A multiple choice form was developed following a three-step process. First, three translations into Spanish were prepared by researchers (JP-C, Peter Bohm, NG-F). Second, the three translations were reconciled into one version, and words checked in the official dictionary of the Royal Academy of Spanish Language (2001). Finally, this version was tested empirically for clarity and acceptability of wording with four individuals who were native in Spanish. Standard instructions indicate beginning with Item 30 and proceeding forward unless an error is made prior to achieving eight consecutive correct responses. Instead of standard instructions, as this was a normative study, the test was administered entirely from Item 1 to Item 60. The reason for this method was that in order to develop future short forms, we wanted to know the specific contribution of each item on the final score. We also avoided the problem of rigorous or lenient interpretation of the discontinuation rule as discussed by Lucas and colleagues (2005).

Following the BNT instructions, participants were allowed up to 20 s to name each item. A stimulus cue was provided when no response was given after 20 s, the participant stated that he/she did not know the name, or the item was incorrectly perceived. As an example of the latter, if a participant misperceived the item “harmonica” as a “train”, he/she would be given the semantic stimulus cue (sem-C) that the item was a picture of a musical instrument. The participant was again allowed up to 20 s to name the picture after being provided with the sem-C. If the participant still did not recognize the picture after receiving the sem-C, or misnamed the picture, the examiner proceeded to phonemic cueing (phon-C). In those cases in which the participant named the semantic class, or superordinate (“musical instrument” for “harp”), he/she was prompted to give the specific name. Finally, after the test was completed, the examiner returned to each item incorrectly named after a phon-C and presented the card with that item and four printed name choices. The examiner read each word and asked the participant to indicate the correct name. The total score (TS) on the test was the number of correct responses produced spontaneously (SR) and with the aid of sem-C (TS = SR + sem-C).

Token test

The TT version included in this project was De Renzi and Faglioni's (1978) short form. It was administered according to the standard procedures of the original publication. This version consists of 36 items in six parts. It uses 20 plastic tokens in five colors, two sizes, and two shapes. In the first five parts, should the participant fail or not to respond for 5 s, the examiner returns the misplaced tokens to their original positions and repeats the command. Success on the second try earns half a credit. In the last part, just one attempt to carry out the command correctly is permitted. The maximum TS is 36.

Statistical Analysis

Considering that the ability to compare all co-normed test scores directly with each other facilitates clinical interpretation of neuropsychological test profiles, a uniform normative procedure was applied to all measures in this research project. Briefly, the procedure was the following: (a) The overlapping interval strategy (Pauker, 1988) was adopted to maximize the number of subjects contributing to the normative distribution at each midpoint age interval. Each midpoint age group provides norms for individuals of that age, plus or minus 1 year; (b) Determination of age, sex, and education effects on raw sub-test scores. Coefficients of correlation (r) and determination (r2) of raw scores with age, years of education, and sex were determined for the BNT; (c) Creation of age-adjusted normative tables. To ensure a normal distribution, the frequency distribution of the raw scores (i.e. TS) was converted into age-adjusted scaled scores, NSSA (NEURONORMA scaled score age-adjusted). For each age range, a cumulative frequency distribution of the raw scores was generated. Raw scores were assigned percentile ranks in function of their place within a distribution. Subsequently, percentile ranks were converted to scaled scores (from 2 to 18) based on percentile ranges. This transformation of raw scores to NSSA produced a normalized distribution (mean = 10; SD = 3) on which linear regressions could be applied; (d) Education adjustments. Years of education were modeled using the following equation: NSSA = k + (β × Educ). The regression coefficient (β) from this analysis was used as the basis for education adjustments. A linear regression was employed to derive age- and education-adjusted scaled scores. The following formula outlined by Mungas, Marshall, Weldon, Haan, and Reed (1996) was employed: NSSA&E = NSSA − (β × [Educ − 12]). The obtained value was truncated to the next lower integer (e.g., 10.75 would be truncated to 10).

Results

Age distribution of the sample made it possible to calculate norms for the following 10 midpoint age groups: 54–56, 57–59, 60–62, 63–65, 66–68, 69–71, 72–74, 75–77, 78–80, >80. Sample sizes resulting from midpoint age intervals are presented in every normative table.

Correlations (Pearson's, r) and shared variance (determination coefficient, r2) of BNT and TT scores with age (years), education (years), and sex are presented in Table 2. Age and education accounted significantly for the raw-score variance of both measures (age: 7% and education: 29% for BNT; age: 16% and education: 25% for TT). Sex differences were not observed, indicating no need to control this demographic variable.

Table 2.

Correlations (r) and shared variance (r2) of raw scores with age, years of education, and sex

Age (years)
Education (years)
Sex
rr2rr2rr2
Boston naming test−0.27870.07770.54670.2989−0.09340.0087
Token test−0.40910.16740.50330.2533−0.00090.0000
Age (years)
Education (years)
Sex
rr2rr2rr2
Boston naming test−0.27870.07770.54670.2989−0.09340.0087
Token test−0.40910.16740.50330.2533−0.00090.0000
Table 2.

Correlations (r) and shared variance (r2) of raw scores with age, years of education, and sex

Age (years)
Education (years)
Sex
rr2rr2rr2
Boston naming test−0.27870.07770.54670.2989−0.09340.0087
Token test−0.40910.16740.50330.2533−0.00090.0000
Age (years)
Education (years)
Sex
rr2rr2rr2
Boston naming test−0.27870.07770.54670.2989−0.09340.0087
Token test−0.40910.16740.50330.2533−0.00090.0000

Age-adjusted NEURONORMA scaled scores (NSSA) for the BNT and TT are presented in Tables 3 and 4 and include percentile ranks, ranges of ages contributing to each normative sub-sample, and the number of participants contributing to each test's normative estimates. Owing to the less number of correct responses in naming the item “pretzel”, we decided not to include this item in the statistical analysis (3.6% of the participants named it spontaneously compared with 77.3% correct answers obtained from the item “magdalena”). To use the table, select the appropriate column corresponding to the patient's age, find the patient's raw score, and subsequently refer to the corresponding NSSA and percentile rank (left part of the tables).

Table 3.

Age-adjusted NEURONORMA scores (NSSA) for the BNT

Scaled ScorePercentile RangeAge Range (years)
50–5657–5960–6263–6566–6869–7172–7475–7778–8081+
2<1≤34≤31≤31≤30≤30≤30≤30≤29≤29≤29
3131313030
4235–3732–3332–33313230
53–53834–3634–3632–3532–3633–3631–3531–3231
66–1039–4137–3937–3836–3837–3837–3936–3734–3532–3531–32
711–1842–4440–4239–4239–4239–4140–4238–4036–403633–34
819–284543–4543–4443–4442–444341–4341–4237–4135–37
929–4046–4946–4845–4745–4645–4644–4644–4543–4442–4338–43
1041–5950–5249–5148–5147–5147–5147–4946–4845–4844–4644–45
1160–7153–5452–5352–535252–5350–5249–5049–5047–4846–47
1272–815554–555453–545453–5451–5251–5249–5148–51
1382–8956565555555553–5453–545252
1490–94575656565655–5655–565353
1595–9757575757–5857–5857575454–55
169858–59585858–59585556
179959595959595856
18>996060606060606059–6057–6057–60
Age range50–6053–6356–6659–6962–7265–7568–7871–8174–8477+ (77–90)
Sample size136132123105118124123976238
Scaled ScorePercentile RangeAge Range (years)
50–5657–5960–6263–6566–6869–7172–7475–7778–8081+
2<1≤34≤31≤31≤30≤30≤30≤30≤29≤29≤29
3131313030
4235–3732–3332–33313230
53–53834–3634–3632–3532–3633–3631–3531–3231
66–1039–4137–3937–3836–3837–3837–3936–3734–3532–3531–32
711–1842–4440–4239–4239–4239–4140–4238–4036–403633–34
819–284543–4543–4443–4442–444341–4341–4237–4135–37
929–4046–4946–4845–4745–4645–4644–4644–4543–4442–4338–43
1041–5950–5249–5148–5147–5147–5147–4946–4845–4844–4644–45
1160–7153–5452–5352–535252–5350–5249–5049–5047–4846–47
1272–815554–555453–545453–5451–5251–5249–5148–51
1382–8956565555555553–5453–545252
1490–94575656565655–5655–565353
1595–9757575757–5857–5857575454–55
169858–59585858–59585556
179959595959595856
18>996060606060606059–6057–6057–60
Age range50–6053–6356–6659–6962–7265–7568–7871–8174–8477+ (77–90)
Sample size136132123105118124123976238
Table 3.

Age-adjusted NEURONORMA scores (NSSA) for the BNT

Scaled ScorePercentile RangeAge Range (years)
50–5657–5960–6263–6566–6869–7172–7475–7778–8081+
2<1≤34≤31≤31≤30≤30≤30≤30≤29≤29≤29
3131313030
4235–3732–3332–33313230
53–53834–3634–3632–3532–3633–3631–3531–3231
66–1039–4137–3937–3836–3837–3837–3936–3734–3532–3531–32
711–1842–4440–4239–4239–4239–4140–4238–4036–403633–34
819–284543–4543–4443–4442–444341–4341–4237–4135–37
929–4046–4946–4845–4745–4645–4644–4644–4543–4442–4338–43
1041–5950–5249–5148–5147–5147–5147–4946–4845–4844–4644–45
1160–7153–5452–5352–535252–5350–5249–5049–5047–4846–47
1272–815554–555453–545453–5451–5251–5249–5148–51
1382–8956565555555553–5453–545252
1490–94575656565655–5655–565353
1595–9757575757–5857–5857575454–55
169858–59585858–59585556
179959595959595856
18>996060606060606059–6057–6057–60
Age range50–6053–6356–6659–6962–7265–7568–7871–8174–8477+ (77–90)
Sample size136132123105118124123976238
Scaled ScorePercentile RangeAge Range (years)
50–5657–5960–6263–6566–6869–7172–7475–7778–8081+
2<1≤34≤31≤31≤30≤30≤30≤30≤29≤29≤29
3131313030
4235–3732–3332–33313230
53–53834–3634–3632–3532–3633–3631–3531–3231
66–1039–4137–3937–3836–3837–3837–3936–3734–3532–3531–32
711–1842–4440–4239–4239–4239–4140–4238–4036–403633–34
819–284543–4543–4443–4442–444341–4341–4237–4135–37
929–4046–4946–4845–4745–4645–4644–4644–4543–4442–4338–43
1041–5950–5249–5148–5147–5147–5147–4946–4845–4844–4644–45
1160–7153–5452–5352–535252–5350–5249–5049–5047–4846–47
1272–815554–555453–545453–5451–5251–5249–5148–51
1382–8956565555555553–5453–545252
1490–94575656565655–5655–565353
1595–9757575757–5857–5857575454–55
169858–59585858–59585556
179959595959595856
18>996060606060606059–6057–6057–60
Age range50–6053–6356–6659–6962–7265–7568–7871–8174–8477+ (77–90)
Sample size136132123105118124123976238
Table 4.

Age-adjusted NEURONORMA scores (NSSA) for Token test

Scaled ScorePercentile RangeAge Range (years)
50–5657–5960–6263–6566–6869–7172–7475–7778–8081+
2<1<25≤25≤24.5≤21.5≤21.5≤21.5≤23.5≤23.5
3125.5–2825.5–262522–24.522–24.522–23.524–2524
4228.5–29.525.5–262524–24.525.5–2624.5–25≤23.5≤21.5
53–530–30.526.5–2926.5–2825.5–2725–28.525–2626.5–2725.5–2624–25
66–1031–31.529.5–31.528.5–30.527.5–3029–29.526.5–2927.5–28.526.5–27.525.5–2622–24
711–1831–31.530.5–3130–30.529.5–3029–29.528–29.526.5–2824.5–27.5
819–2832–3332–32.532–32.531.5–3231–3230.5–3130–3130–30.528.5–3028–29
929–4033.533–33.53332.532.531.5–32.531.531–31.530.5–3129.5–30.5
1041–5934–34.534–34.533.5–34.533–33.533–33.533–33.532–32.532–32.531.5–3231–31.5
1160–713434–34.533–33.533–33.532.532
1272–8135–35.535–35.534–34.53332.5–33
1382–8935–35.534.5–35.53534–34.534.34.5
1490–9435.53533.5–3433.5–35
1595–973535–35.534.5–3535.5
169835.5
1799
18>99363636363635.5–3635.5–36363636
Age range50–6053–6356–6659–6962–7265–7568–7871–8174–8477+ (77–90)
Sample size1371331241071221281271016440
Scaled ScorePercentile RangeAge Range (years)
50–5657–5960–6263–6566–6869–7172–7475–7778–8081+
2<1<25≤25≤24.5≤21.5≤21.5≤21.5≤23.5≤23.5
3125.5–2825.5–262522–24.522–24.522–23.524–2524
4228.5–29.525.5–262524–24.525.5–2624.5–25≤23.5≤21.5
53–530–30.526.5–2926.5–2825.5–2725–28.525–2626.5–2725.5–2624–25
66–1031–31.529.5–31.528.5–30.527.5–3029–29.526.5–2927.5–28.526.5–27.525.5–2622–24
711–1831–31.530.5–3130–30.529.5–3029–29.528–29.526.5–2824.5–27.5
819–2832–3332–32.532–32.531.5–3231–3230.5–3130–3130–30.528.5–3028–29
929–4033.533–33.53332.532.531.5–32.531.531–31.530.5–3129.5–30.5
1041–5934–34.534–34.533.5–34.533–33.533–33.533–33.532–32.532–32.531.5–3231–31.5
1160–713434–34.533–33.533–33.532.532
1272–8135–35.535–35.534–34.53332.5–33
1382–8935–35.534.5–35.53534–34.534.34.5
1490–9435.53533.5–3433.5–35
1595–973535–35.534.5–3535.5
169835.5
1799
18>99363636363635.5–3635.5–36363636
Age range50–6053–6356–6659–6962–7265–7568–7871–8174–8477+ (77–90)
Sample size1371331241071221281271016440
Table 4.

Age-adjusted NEURONORMA scores (NSSA) for Token test

Scaled ScorePercentile RangeAge Range (years)
50–5657–5960–6263–6566–6869–7172–7475–7778–8081+
2<1<25≤25≤24.5≤21.5≤21.5≤21.5≤23.5≤23.5
3125.5–2825.5–262522–24.522–24.522–23.524–2524
4228.5–29.525.5–262524–24.525.5–2624.5–25≤23.5≤21.5
53–530–30.526.5–2926.5–2825.5–2725–28.525–2626.5–2725.5–2624–25
66–1031–31.529.5–31.528.5–30.527.5–3029–29.526.5–2927.5–28.526.5–27.525.5–2622–24
711–1831–31.530.5–3130–30.529.5–3029–29.528–29.526.5–2824.5–27.5
819–2832–3332–32.532–32.531.5–3231–3230.5–3130–3130–30.528.5–3028–29
929–4033.533–33.53332.532.531.5–32.531.531–31.530.5–3129.5–30.5
1041–5934–34.534–34.533.5–34.533–33.533–33.533–33.532–32.532–32.531.5–3231–31.5
1160–713434–34.533–33.533–33.532.532
1272–8135–35.535–35.534–34.53332.5–33
1382–8935–35.534.5–35.53534–34.534.34.5
1490–9435.53533.5–3433.5–35
1595–973535–35.534.5–3535.5
169835.5
1799
18>99363636363635.5–3635.5–36363636
Age range50–6053–6356–6659–6962–7265–7568–7871–8174–8477+ (77–90)
Sample size1371331241071221281271016440
Scaled ScorePercentile RangeAge Range (years)
50–5657–5960–6263–6566–6869–7172–7475–7778–8081+
2<1<25≤25≤24.5≤21.5≤21.5≤21.5≤23.5≤23.5
3125.5–2825.5–262522–24.522–24.522–23.524–2524
4228.5–29.525.5–262524–24.525.5–2624.5–25≤23.5≤21.5
53–530–30.526.5–2926.5–2825.5–2725–28.525–2626.5–2725.5–2624–25
66–1031–31.529.5–31.528.5–30.527.5–3029–29.526.5–2927.5–28.526.5–27.525.5–2622–24
711–1831–31.530.5–3130–30.529.5–3029–29.528–29.526.5–2824.5–27.5
819–2832–3332–32.532–32.531.5–3231–3230.5–3130–3130–30.528.5–3028–29
929–4033.533–33.53332.532.531.5–32.531.531–31.530.5–3129.5–30.5
1041–5934–34.534–34.533.5–34.533–33.533–33.533–33.532–32.532–32.531.5–3231–31.5
1160–713434–34.533–33.533–33.532.532
1272–8135–35.535–35.534–34.53332.5–33
1382–8935–35.534.5–35.53534–34.534.34.5
1490–9435.53533.5–3433.5–35
1595–973535–35.534.5–3535.5
169835.5
1799
18>99363636363635.5–3635.5–36363636
Age range50–6053–6356–6659–6962–7265–7568–7871–8174–8477+ (77–90)
Sample size1371331241071221281271016440

As expected, the normative adjustments reduce shared variance of age to virtually <1% in both tests (r = 0.057; r2 = 0.003 for BNT and r = 0.13735; r2 = 0.01887 for TT). Education, however, continues to account significantly for age-adjusted test-score variance in both cases: for up to 27.5% for BNT (r = 0.525; r2 = 0.275) and for up to 20.7% for TT (r = 0.45561; r2 = 0.207).

The transformation of raw scores to NSSA produced a normalized distribution on which linear regressions could be applied. Regression coefficients from this analysis were used as the basis for education corrections. The resulting computational formulae were used to calculate NSSA&E (β = 0.27746 for BNT and β = 0.29451 for TT). From these data, we have constructed adjustment tables (Tables 5 and 6) to help the clinician make the necessary changes. To use the tables, select the appropriate column corresponding to the patient's years of education, find the patient's NSSA, and subsequently refer to the corresponding NSSA&E. When these formulae are applied to the normative sample, the shared variances between demographically adjusted NEURONORMA scaled scores and years of education are irrelevant (r = −0.02; r2 = 0.0004 for BNT and r = −0.0005; r2 = 0.00003 for TT).

Table 5.

Boston naming test

SSSAEducation (years)
01234567891011121314151617181920
255444333322221110000−1
3665554444333322211110
4776665555444433322221
5887776666555544433332
6998887777666655544443
710109998888777766655554
811111010109999888877766665
9121211111110101010999988877776
101313121212111111111010101099988887
111414131313121212121111111110101099998
1215151414141313131312121212111111101010109
13161615151514141414131313131212121111111110
14171716161615151515141414141313131212121211
15181817171716161616151515151414141313131312
16191918181817171717161616161515151414141413
17202019191918181818171717171616161515151514
18212120202019191919181818181717171616161615
SSSAEducation (years)
01234567891011121314151617181920
255444333322221110000−1
3665554444333322211110
4776665555444433322221
5887776666555544433332
6998887777666655544443
710109998888777766655554
811111010109999888877766665
9121211111110101010999988877776
101313121212111111111010101099988887
111414131313121212121111111110101099998
1215151414141313131312121212111111101010109
13161615151514141414131313131212121111111110
14171716161615151515141414141313131212121211
15181817171716161616151515151414141313131312
16191918181817171717161616161515151414141413
17202019191918181818171717171616161515151514
18212120202019191919181818181717171616161615

Education adjustment applying the following formula: NSSA&E = NSSA − (β*(Education(years) − 12)), where β = 0.27746.

Table 5.

Boston naming test

SSSAEducation (years)
01234567891011121314151617181920
255444333322221110000−1
3665554444333322211110
4776665555444433322221
5887776666555544433332
6998887777666655544443
710109998888777766655554
811111010109999888877766665
9121211111110101010999988877776
101313121212111111111010101099988887
111414131313121212121111111110101099998
1215151414141313131312121212111111101010109
13161615151514141414131313131212121111111110
14171716161615151515141414141313131212121211
15181817171716161616151515151414141313131312
16191918181817171717161616161515151414141413
17202019191918181818171717171616161515151514
18212120202019191919181818181717171616161615
SSSAEducation (years)
01234567891011121314151617181920
255444333322221110000−1
3665554444333322211110
4776665555444433322221
5887776666555544433332
6998887777666655544443
710109998888777766655554
811111010109999888877766665
9121211111110101010999988877776
101313121212111111111010101099988887
111414131313121212121111111110101099998
1215151414141313131312121212111111101010109
13161615151514141414131313131212121111111110
14171716161615151515141414141313131212121211
15181817171716161616151515151414141313131312
16191918181817171717161616161515151414141413
17202019191918181818171717171616161515151514
18212120202019191919181818181717171616161615

Education adjustment applying the following formula: NSSA&E = NSSA − (β*(Education(years) − 12)), where β = 0.27746.

Table 6.

Token test

SSSAEducation (years)
01234567891011121314151617181920
25544443332222111000−1−1
3665555444333322211100
4776666555444433322211
5887777666555544433322
6998888777666655544433
710109999888777766655544
8111110101010999888877766655
9121211111111101010999988877766
101313121212121111111010101099988877
111414131313131212121111111110101099988
121515141414141313131212121211111110101099
13161615151515141414131313131212121111111010
14171716161616151515141414141313131212121111
15181817171717161616151515151414141313131212
16191918181818171717161616161515151414141313
17202019191919181818171717171616161515151414
18212120202020191919181818181717171616161515
SSSAEducation (years)
01234567891011121314151617181920
25544443332222111000−1−1
3665555444333322211100
4776666555444433322211
5887777666555544433322
6998888777666655544433
710109999888777766655544
8111110101010999888877766655
9121211111111101010999988877766
101313121212121111111010101099988877
111414131313131212121111111110101099988
121515141414141313131212121211111110101099
13161615151515141414131313131212121111111010
14171716161616151515141414141313131212121111
15181817171717161616151515151414141313131212
16191918181818171717161616161515151414141313
17202019191919181818171717171616161515151414
18212120202020191919181818181717171616161515

Education adjustment applying the following formula: NSSA&E = NSSA − (β*(Education(years) − 12)), where β = 0.29451.

Table 6.

Token test

SSSAEducation (years)
01234567891011121314151617181920
25544443332222111000−1−1
3665555444333322211100
4776666555444433322211
5887777666555544433322
6998888777666655544433
710109999888777766655544
8111110101010999888877766655
9121211111111101010999988877766
101313121212121111111010101099988877
111414131313131212121111111110101099988
121515141414141313131212121211111110101099
13161615151515141414131313131212121111111010
14171716161616151515141414141313131212121111
15181817171717161616151515151414141313131212
16191918181818171717161616161515151414141313
17202019191919181818171717171616161515151414
18212120202020191919181818181717171616161515
SSSAEducation (years)
01234567891011121314151617181920
25544443332222111000−1−1
3665555444333322211100
4776666555444433322211
5887777666555544433322
6998888777666655544433
710109999888777766655544
8111110101010999888877766655
9121211111111101010999988877766
101313121212121111111010101099988877
111414131313131212121111111110101099988
121515141414141313131212121211111110101099
13161615151515141414131313131212121111111010
14171716161616151515141414141313131212121111
15181817171717161616151515151414141313131212
16191918181818171717161616161515151414141313
17202019191919181818171717171616161515151414
18212120202020191919181818181717171616161515

Education adjustment applying the following formula: NSSA&E = NSSA − (β*(Education(years) − 12)), where β = 0.29451.

Discussion

The purpose of this report was to provide normative comprehensive data from older Spaniards for the BNT and the TT. Age-adjusted normative data and regression-based adjustments for education are presented.

Boston Naming Test

Demographic variables, age, and education affected the score of the BNT, whereas sex was found to be unrelated to naming efficiency in this normal sample. Concerning sex, our data confirm some previous studies in the sense that it is unrelated to naming efficiency in normal samples (Cruice et al., 2000; Fastenau et al., 1998; Henderson et al., 1998; Ivnik et al., 1996; LaBarge et al., 1986; Lansing et al., 1999; Marien et al., 1998; Randolph et al., 1999; Saxton et al., 2000; Welch et al., 1996; Zec et al., 2007a, 2007b).

This study also confirms that there is a decline in BNT performance with advancing age as was reported, for example, by Albert, Heller, and Milberg (1988) and Tsang and Lee (2003) who added that decline in naming in the elderly may be multifactorial. Furthermore, Vandenberghe (2004) reported that greater variation in performance in naming tasks was found in the higher-age groups and concluded that naming abilities slightly decline only in very elderly adults.

As stated previously, education was also found to be related to the BNT scores. In this aspect, our study is of particular interest because it includes a wide range of educational levels. The education effect that we found is in agreement with several studies in different cultural groups and languages including Spanish (Allegri et al., 1997; Borod et al., 1980; Deloche et al., 1996; Hawkins & Bender, 2002; Hawkins et al., 1993; Heaton, Avitable, Grant, & Matthews, 1999; Henderson et al., 1998; Kimbarrow et al., 1996; Lansing et al., 1999; Le Dorze & Durocher, 1992; Marien et al., 1998; Neils et al., 1995; Nicholas, Obler, Albert, & Goodglass, 1985; Pontón et al., 1996; Quiñones-Úbeda et al., 2004; Rami et al., 2008; Randolph et al., 1999; Ross, Lichtenberg, & Christensen, 1995; Saxton et al. 2000; Thompson & Heaton, 1989; Welch et al., 1996; Worrall et al., 1995).

According to this study, a combined effect of age and education should be taken into consideration (Heaton et al., 1999; Zec et al., 2007a). To help clinicians, NSSA were adjusted to NSSA&E using a table resulting from the application of computational formulae. In this table, figures were rounded to an integer. In the case of very extreme scores (e.g., a person with 1 year of education and a NSSA of 18, or a person of 20 years of education and an NSSA of 2), the resulting adjustment may be placed beyond the defined scaled score ranges (e.g., 21 or −1). In these extreme cases, the final score should be 18 or 2, respectively.

Our study shows an extremely low frequency of correct responses in the naming of “pretzel” in a sample of Spanish healthy controls. The higher performance on naming the item “magdalena” justifies our recommendation to use “magdalena” as an alternative to “pretzel” in the Spanish population. These results are comparable to those obtained in previous Spanish norms in young people (Quiñones-Úbeda et al., 2004).

The presented norms for the BNT are only comparable in part to previous Spanish studies due to the fact that in this study, the original items were maintained. Even though other Spanish versions suggest adapting some items from the original test (e.g., Serrano et al., 2001), we believe that more studies about the suitability of each item for assessment of naming ability in Spanish would be necessary.

Token Test

Although age and education affected the score of the TT, sex was found to be unrelated to the TT scores in this normal sample. This study confirms that age-related effects are few, with lower scores in elderly subjects (De Renzi & Faglioni, 1978; Emery, 1986; Ivnik et al., 1996; Swisher & Sarno, 1969). In addition to the figures observed, Table 4 shows that an NSSA of 10 decreased from 34–34.5 points, at 50–56 years, to 31–31.5 points, at age 81+.

Education has a more important role than age in our sample. We confirm early studies from Orgass and Poeck (1966) and De Renzi and Faglioni (1978). The education adjustment table of NSSA (Table 6) will help the clinician to obtain the expected score considering the number of years of formal education (NSSA&E). In this table, figures were rounded to an integer. As in the case of the BNT, the resulting adjustment may be placed beyond the defined scaled score ranges (e.g., 20 or 0). In these extreme cases, the final score should be 18 or 2, respectively. In fact, the proposed adjustments are minor, as were the raw-score adjustments for education proposed by De Renzi and Faglioni (1978).

Owing to significant differences in samples, it is difficult to compare our data with other Spanish language studies; nevertheless, we are able to confirm the need of adjustments for age and education (Ardila et al., 1994).

Final Conclusions

As in all normative studies, the validity of these norms is clearly dependent upon the similarity between the characteristics of the studied subject and the demographic features of the NEURONORMA samples. The present data should provide a useful resource for clinical and research studies and may reduce the risk of misdiagnosis of cognitive impairment in normal individuals in the Spanish population.

As concluded in other similar studies, it would not be accurate to apply these computational formulae to younger individuals due to the different impact of the demographic variables on the cognitive performance across the life span (e.g. Lucas et al., 2005).

Despite its limitations, this study reflects the largest normative study to date for neuropsychological performance of Spanish older subjects on the BNT and TT. The normative data presented here were obtained from the same study sample as all other NEURONORMA norms. In addition, the same statistical procedures for data analyses were applied. These co-normed data allow clinicians to compare scores from one test with all tests included in the project.

Funding

This study was mainly supported by a grant from the Pfizer Foundation and by the Medical Department of Pfizer, SA, Spain. It was also supported by the Behavioral Neurology Group of the Program of Neuropsychopharmacology of the Institut Municipal d'Investigació Mèdica, Barcelona, Spain. JP-C has received an intensification research grant from the CIBERNED (Centro de Investigación Biomédica en Red sobre Enfermedades Neurodegenerativas), Instituto Carlos III (Ministry of Health & Consumer Affairs of Spain).

Conflict of Interest

None declared.

Appendix

Members of the NEURONORMA.ES Study Team

Steering Committee: JP-C, Hospital del Mar, Barcelona, Spain; RB, Hospital de la Santa Creu i Sant Pau, Barcelona, Spain; MA, Hospital Mútua de Terrassa, Terrassa, Spain.

Principal Investigators: JP-C, Hospital de Mar, Barcelona, Spain; RB, Hospital de la Santa Creu i Sant Pau, Barcelona, Spain; MA, Hospital Mútua de Terrassa, Terrassa, Spain; JLM, Hospital Clínic, Barcelona, Spain; AR, Hospital Clínico Universitario, Santiago de Compostela, Spain; MSB, Hospital Clínico San Carlos, Madrid, Spain; CA, Hospital Virgen Arrixaca, Murcia, Spain; CM-P, Hospital Virgen Macarena, Sevilla, Spain; AF-G, Hospital Universitario La Paz, Madrid, Spain; MF, Hospital de Cruces, Bilbao, Spain.

Genetics Sub-study: Rafael Oliva, Service of Genetics, Hospital Clínic, Barcelona, Spain.

Neuroimaging Sub-study: Beatriz Gómez-Ansón, Radiology Department and IDIBAPS, Hospital Clínic, Barcelona, Spain. Research Fellows: Gemma Monte, Elena Alayrach, Aitor Sainz, and Claudia Caprile, Fundació Clinic, Hospital Clinic, Barcelona, Spain; Gonzalo Sánchez, Behavioral Neurology Group, Institut Municipal d'Investigació Mèdica, Barcelona, Spain.

Clinicians, Psychologists, and Neuropsychologists: NG-F (Coordinator), Peter Böhm, Sonia González, Yolanda Buriel, María Quintana, SQ-U, Gonzalo Sánchez, Rosa M. Manero, and Gracia Cucurella, Institut Municipal d'Investigació Mèdica, Barcelona, Spain; Eva Ruiz, Mónica Serradell, and Laura Torner, Hospital Clínic, Barcelona, Spain; Dolors Badenes, LC, Noemí Cerulla, Silvia Ramos, and Loli Cabello, Hospital Mútua de Terrassa, Terrassa, Spain; DR, Clinical Psychology and Psychobiology Department, University of Santiago de Compostela, Spain; María Payno, and Clara Villanueva, Hospital Clínico San Carlos, Madrid, Spain; Rafael Carles, Judit Jiménez, Martirio Antequera, Hospital Virgen Arixaca, Murcia, Spain; Jose Manuel Gata, Pablo Duque, and Laura Jiménez, Hospital Virgen Macarena, Sevilla, Spain; Azucena Sanz and María Dolores Aguilar, Hospital Universitario La Paz, Madrid, Spain; AM, Maitena Lasa, Hospital de Cruces, Bilbao, Spain.

Data Management and Biometrics: Veronica Alfonso, JMS, Francisco Hernández, Irune Quevedo, Anna Salvà, European Biometrics Institute, Barcelona, Spain.

Administrative Management: Carme Pla (†) and Romina Ribas, Department of Psychiatry and Forensic Medicine, Universitat Autònoma de Barcelona, and Behavioral Neurology Group, Institut Municipal d'Investigació Mèdica, Barcelona, Spain.

English Edition: Stephanie Lonsdale, Program of Neuropsychopharmacology, Institut Municipal d'Investigació Mèdica, Barcelona, Spain.

References

Acevedo
A.
Loewenstein
D. A.
Performance on the Boston naming test in English–Spanish bilingual older adults: Some considerations
Journal of the International Neuropsychological Society
2007
, vol. 
13
 (pg. 
212
-
214
)
Albert
M. L.
Heller
H. S.
Milberg
W.
Changes in naming ability with age
Psychology and Aging
1988
, vol. 
3
 (pg. 
173
-
178
)
Allegri
R.
Mangone
C.
Fernández Villavicencio
A.
Rymberg
S.
Taragano
F.
Barman
D.
Spanish Boston naming test norms
The Clinical Neuropsychologist
1997
, vol. 
11
 (pg. 
416
-
420
)
Ardila
A.
Rosselli
M.
Puente
M.
Neuropsychological evaluation of the Spanish Speaker
1994
New York
Plenum Press
Au
R.
Joung
P. C.
Nicholas
M.
Obler
L. K.
Kass
R.
Albert
M. L.
Naming ability across the adult life span
Aging and Cognition
1995
, vol. 
2
 (pg. 
300
-
311
)
Benton
A.
Hamsher
K.
Sivan
A. B.
Multilingual aphasia examination.
1994
Iowa City
AJA Associates
Boone
K. B.
Victor
T. L.
Wen
J.
Razani
J.
Pontón
M.
The association between neuropsychological scores and ethnicity, language, and acculturation variables in a large patient population
Archives of Clinical Neuropsychology
2007
, vol. 
22
 (pg. 
355
-
365
)
Borod
J. C.
Goodglass
H.
Kaplan
E.
Normative data on the Boston diagnostic aphasia examination, parietal lobe battery, and the Boston naming test
Journal of Clinical Neuropsychology
1980
, vol. 
2
 (pg. 
209
-
215
)
Calero
M. D.
Arnedo
M. L.
Navarro
E.
Ruiz-Pedrosa
M.
Carnero
C.
Usefulness of a 15-item version of the Boston naming test in neuropsychological assessment of low-educational elders with dementia
The Journals of Gerontology. Series B, Psychological Sciences and Social Sciences
2002
, vol. 
57
 (pg. 
187
-
191
)
Coupar
M.
Detection of mild aphasia: A study using the Token test
British Journal of Medical Psychology
1976
, vol. 
49
 (pg. 
141
-
144
)
Cruice
M. N.
Worrall
L. E.
Hickson
L. M. H.
Boston naming test results for healthy older Australians: A longitudinal and cross-sectional study
Aphasiology
2000
, vol. 
14
 (pg. 
143
-
155
)
De Renzi
E.
Faglioni
P.
L'esame dei disturbi afasici di comprensione orale mediante una versione abbreviata del test dei gettoni
Revista di Patología Nervosa e Mentale
1975
, vol. 
96
 (pg. 
252
-
269
)
De Renzi
E.
Faglioni
P.
Development of a shortened version of the Token test
Cortex
1978
, vol. 
14
 (pg. 
41
-
49
)
De Renzi
E.
Vignolo
L.
The Token test: A sensitive test to detect receptive disturbances in aphasia
Brain
1962
, vol. 
85
 (pg. 
665
-
678
)
Deloche
G.
Hannequin
D.
Dordain
M.
Perrier
D.
Pichard
B.
Quint
S.
, et al. 
Picture confrontation oral naming performance differences between aphasics and normals
Brain and Language
1996
, vol. 
53
 (pg. 
105
-
120
)
Emery
O. B.
Linguistic decrement in normal aging
Language and Communication
1986
, vol. 
6
 (pg. 
47
-
64
)
Farmer
A.
Performance of normal males on the Boston naming test and the word test
Aphasiology
1990
, vol. 
4
 (pg. 
293
-
296
)
Fastenau
P. S.
Denburg
N. L.
Maurer
B. A.
Parallel short forms of the Boston naming test: Psychometric properties and norms for older adults
Journal of Clinical and Experimental Neuropsychology
1998
, vol. 
20
 (pg. 
828
-
834
)
Feyereisen
P.
A meta-analytic procedure shows an age-related decline in picture naming. Comments on Goulet, Ska, and Khan (1994)
Journal of Speech, Language, and Hearing Research
1997
, vol. 
40
 (pg. 
1328
-
1333
)
Fontanari
J. L.
O ‘Token Test’: elegância e concisao na avaliaçao da compreeçao do afásico. Validaçao da verçao reduzida de De Renzi para o portugués [The ‘Token test’: Elegance and conciseness in the evaluation of comprehension in aplasia patients: Validation of the reduced version of De Renzi to the Portuguese]
Neurobiologia
1989
, vol. 
52
 (pg. 
177
-
218
)
Giroux
L.
Salamé
R.
Bédard
M.
Bellavance
A.
Neuropsychological performance of healthy older adults as a function of age, education and occupation
Revue Québécoise de Psychologie
1992
, vol. 
13
 (pg. 
3
-
27
)
Gollan
T. H.
Fennema-Notestine
C.
Montoya
R. I.
Jernigan
T. L.
The bilingual effect on Boston naming test performance
Journal of the International Neuropsychological Society
2007
, vol. 
13
 (pg. 
197
-
208
)
Goulet
P.
Ska
B.
Kahn
H. J.
Is there a decline in picture naming with advancing age?
Journal of Speech and Hearing Research
1994
, vol. 
37
 (pg. 
629
-
644
)
Gutbrod
K.
Meger
B.
Meter
E.
Cohen
R.
Cognitive processing of tokens and their description in aphasia
Brain and Language
1985
, vol. 
25
 (pg. 
37
-
51
)
Hawkins
K. A.
Bender
S.
Norms and the relationship of Boston naming test performance to vocabulary and education: A review
Aphasiology
2002
, vol. 
16
 (pg. 
1143
-
1153
)
Hawkins
K. A.
Sledge
W. H.
Orleans
J. F.
Quinlan
D. M.
Rakfeldt
J.
Huffman
R. E.
Normative implications of the relationship between reading vocabulary and Boston naming test performance
Archives of Clinical Neuropsychology
1993
, vol. 
8
 (pg. 
525
-
537
)
Heaton
R. K.
Avitable
N.
Grant
I.
Matthews
C. G.
Further crossvalidation of regression-based neuropsychological norms with an update for the Boston naming test
Journal of Clinical and Experimental Neuropsychology
1999
, vol. 
21
 (pg. 
571
-
582
)
Henderson
L. W.
Frank
E. W.
Pigatt
T.
Abramson
R. K.
Houston
M.
Race, gender and educational level effects on Boston naming test scores
Aphasiology
1998
, vol. 
12
 (pg. 
901
-
911
)
Ivnik
R. J.
Malec
J. F.
Smith
G. E.
Tangalos
E. G.
Petersen
R. C.
Neuropsychological tests norms above age 55: COWAT, BNT, MAE Token, WRAT-R, Reading, AMNART, Stroop, TMT, and JLO
The Clinical Neuropsychologist
1996
, vol. 
10
 (pg. 
262
-
278
)
Ivnik
R. J.
Malec
J. F.
Smith
G. E.
Tangalos
E. G.
Petersen
R. C.
Kokmen
E.
, et al. 
Mayo's Older Americans Normative Studies: WAIS-R norms for ages 56 to 97
The Clinical Neuropsychologist
1992
, vol. 
6
 
Suppl.
(pg. 
1
-
30
)
Kaplan
E. F.
Goodglass
H.
Weintraub
S.
The Boston naming test
1983
Philadelphia
Lippincott Williams & Wilkins
Kaplan
E. F.
Goodglass
H.
Weintraub
S.
The Boston naming test
2001
2nd ed.
Philadelphia
Lippincott Williams & Wilkins
Karbe
H.
Herholz
K.
Szelies
B.
Pawlik
G.
Wienhard
K. K.
Heiss
W. D.
Regional metabolic correlates of Token test results in cortical and sub-cortical left hemisphere infarction
Neurology
1989
, vol. 
39
 (pg. 
1083
-
1088
)
Kent
P. S.
Luszcz
M. A.
Review of the Boston naming test and multiple-occasion normative data for older adults on 15-item versions
The Clinical Neuropsychologist
2002
, vol. 
16
 (pg. 
555
-
574
)
Kimbarrow
M. L.
Vangel
S. J.
Jr.
Lichtenberg
P. A.
The influence of demographic variables on normal elderly subjects’ performance on the Boston naming test
Clinical Aphasiology Conference
1996
, vol. 
24
 (pg. 
135
-
144
)
Kitson
D. L.
Comparison of the Token test of language development and the WISC-R
Perceptual and Motor Skills
1985
, vol. 
61
 (pg. 
532
-
534
)
Kohnert
K. J.
Hernández
A. E.
Bates
E.
Bilingual performance on the Boston naming test. Preliminary norms in Spanish and English
Brain and Language
1998
, vol. 
65
 (pg. 
422
-
440
)
LaBarge
E.
Edwards
D.
Knesevich
J. W.
Performance of normal elderly on the Boston naming test
Brain and Language
1986
, vol. 
27
 (pg. 
380
-
384
)
Lansing
A. E.
Ivnik
R. J.
Cullum
C. M.
Randolph
C.
An empirically derived short form of the Boston naming test
Archives of Clinical Neuropsychology
1999
, vol. 
14
 (pg. 
481
-
487
)
Lass
N. J.
Golden
S. S.
A comparative study of children's performance on three tests for receptive language abilities
Journal of Auditory Research
1975
, vol. 
15
 (pg. 
177
-
182
)
Le Dorze
G.
Durocher
J.
The effects of age, educational level, and stimulus length on naming in normal subjects
Journal of Speech-Language Pathology and Audiology
1992
, vol. 
16
 (pg. 
21
-
29
)
Lesser
R.
Verbal and non-verbal memory components in the Token test
Neuropsychologia
1976
, vol. 
14
 (pg. 
79
-
85
)
Lezak
M. D.
Howieson
D. B.
Loring
D. W.
Neuropsychological assessment
2004
4th ed.
New York
Oxford University Press
Lucas
J. A.
Ivnik
R. J.
Smith
G. E.
Ferman
T. J.
Willis
F. B.
Petersen
R. C.
, et al. 
Mayo's Older African Americans Normative Studies: Norms for the Boston naming test, controlled oral word association, category fluency, animal naming, token test, WRAT-3 reading, trail making test, stroop test, and judgement of line orientation
The Clinical Neuropsychologist
2005
, vol. 
19
 (pg. 
243
-
269
)
Mack
W. J.
Freed
D. M.
Williams
B. W.
Henderson
V. W.
Boston naming test: Shortened version for the use in Alzheimer's disease
Journal of Gerontology
1992
, vol. 
47
 (pg. 
164
-
168
)
MacKay
A. J.
Connor
L. T.
Albert
M. L.
Obler
L. K.
Noun and verb retrieval in healthy aging
Journal of the International Neuropsychological Society
2002
, vol. 
8
 (pg. 
764
-
770
)
Manly
J. J.
Jacobs
D. M.
Touradji
P.
Small
S. A.
Stern
Y.
Reading level attenuates differences in neuropsychological test performance between African American and White elders
Journal of the International Neuropsychological Society
2002
, vol. 
8
 (pg. 
341
-
348
)
Marien
P.
Mampaey
E.
Vervaet
A.
Saerens
J.
De Deyn
P. P.
Normative data for the Boston naming test in native Dutch-speaking Belgian elderly
Brain and Language
1998
, vol. 
65
 (pg. 
447
-
467
)
McNeil
M. R.
Prescott
T. E.
Revised Token test.
1978
Austin, TX
Pro-Ed
Mitrushina
M.
Boone
K. B.
Razani
J.
D'Elia
L. F.
Handbook of normative data for neuropsychological assessment
2005
2nd ed.
New York
Oxford University Press
Morley
G. K.
Lundgren
S.
Haxby
J.
Comparison and clinical applicability of auditory comprehension scores on the behavioral neurology deficit evaluation, Boston diagnostic aphasia examination, porch index of communicative ability, and Token tests
Journal of Clinical Neuropsychology
1979
, vol. 
1
 (pg. 
249
-
258
)
Mungas
D.
Marshall
S. C.
Weldon
M.
Haan
M.
Reed
B. R.
Age and education correction of Mini-Mental State Examination for English and Spanish-speaking elderly
Neurology
1996
, vol. 
46
 (pg. 
700
-
706
)
Neils
J.
Baris
J. M.
Carter
C.
Dell'aira
A. L.
Nordloh
S. J.
Weiler
E.
, et al. 
Effects of age, education, and living environment on Boston naming test performance
Journal of Speech and Hearing Research
1995
, vol. 
38
 (pg. 
1143
-
1149
)
Nicholas
M.
Brookshire
R. H.
MacLennan
D. L.
Schumacher
J. G.
Porrazzo
S. A.
Revised administration and scoring procedures for the Boston naming test and norms for non-brain damaged adults
Aphasiology
1989
, vol. 
5
 (pg. 
569
-
580
)
Nicholas
M.
Obler
L.
Albert
M.
Goodglass
H.
Lexical retrieval in healthy aging
Cortex
1985
, vol. 
21
 (pg. 
595
-
606
)
Nielsen
H.
Lolk
A.
Kragh-Sorensen
P.
Normative data for eight neuropsychological tests, gathered from a random sample of Danes aged 64 to 83 years
Nordisk Psykologi
1995
, vol. 
47
 (pg. 
241
-
225
)
Orgass
B.
Poeck
K.
Clinical validation of a new test for aphasia: An experimental study of the Token test
Cortex
1966
, vol. 
2
 (pg. 
222
-
243
)
Pauker
J.
Constructing overlapping cell tables to maximize the clinical usefulness of normative test data: Rationale and an example from neuropsychology
Journal of Clinical Psychology
1988
, vol. 
44
 (pg. 
930
-
933
)
Peña-Casanova
J.
Blesa
R.
Aguilar
M.
Gramunt-Fombuena
N.
Gómez-Ansón
B.
Oliva
R.
, et al. 
for The NEURONORMA Study Team.
Spanish Older Adult Normative Studies: Methods and sample characteristics
Archives of Clinical Neuropsychology
2009
, vol. 
24
 (pg. 
307
-
319
)
Pontón
M. O.
González
J. J.
Hernández
I.
Herrera
L.
Higareda
I.
Factor analysis of the Neuropsychological Screening Battery for Hispanics (NeSBHIS)
Applied Neuropsychology
2000
, vol. 
7
 (pg. 
32
-
39
)
Pontón
M. O.
Satz
P.
Herrera
L.
Ortiz
F.
Urrutia
C. P.
Young
R.
, et al. 
Normative data stratified by age and education for the Neuropsychological Screening Battery for Hispanics (NeSBHIS): Initial report
Journal of the International Neuropsychological Society
1996
, vol. 
2
 (pg. 
96
-
104
)
Quiñones-Úbeda
S.
Peña-Casanova
J.
Bohm
P.
Gramunt-Fombuena
N.
Comas
L.
Preliminary normative data for the second edition of the Boston naming test for young Spanish adults. [Estudio normativo piloto de la segunda edición del Boston Naming Test en una muestra española de adultos jóvenes (20 a 49 anos)]
Neurología
2004
, vol. 
19
 (pg. 
248
-
253
)
Rami
L.
Serradell
M.
Bosch
B.
Caprile
C.
Sekler
A.
Villar
A.
, et al. 
Normative data for the Boston naming test and the pyramids and palm trees test in the elderly Spanish population
Journal of Clinical and Experimental Neuropsychology
2008
, vol. 
30
 (pg. 
1
-
6
)
Randolph
C.
Lansing
A.
Ivnik
R. J.
Cullum
C. M.
Hermann
B. P.
Determinants of confrontation naming performance
Archives of Clinical Neuropsychology
1999
, vol. 
14
 (pg. 
489
-
496
)
Rey
G.
Sivan
A. B.
Benton
A. L.
Multilingual Aphasia examination. Spanish version
1994
3rd ed.
Lutz, FL
PAR, Inc
Ross
T. P.
Lichtenberg
P. A.
Expanded normative data for the Boston naming test for use with urban, elderly medical patients
The Clinical Neuropsychologist
1998
, vol. 
12
 (pg. 
475
-
481
)
Ross
T. P.
Lichtenberg
P. A.
Christensen
B. K.
Normative data on the Boston naming test for elderly adults in a demographically diverse medical sample
The Clinical Neuropsychologist
1995
, vol. 
9
 (pg. 
321
-
325
)
Royal Academy of Spanish Language [Real Academia Española (RAE)].
Diccionario de la Lengua Española.
2001
22nd ed.
Madrid
Espasa Calpe
Saxton
J.
Ratcliff
G.
Munro
C. A.
Coffey
C. E.
Becker
J. E.
Fried
L.
, et al. 
Normative data on the Boston naming test and two equivalent 30-item short-forms
The Clinical Neuropsychologist
2000
, vol. 
14
 (pg. 
526
-
534
)
Serrano
C.
Allegri
R. F.
Drake
M.
Butman
J.
Harris
P.
Nagle
C.
, et al. 
A shortened form of the Spanish Boston naming test: A useful tool for the diagnosis of Alzheimer's disease. [Versión abreviada en español del test de denominación de Boston: su utilidad en el diagnóstico diferencial de la enfermedad de Alzheimer]
Revista de Neurología
2001
, vol. 
33
 (pg. 
624
-
627
)
Smith
S. T.
Mann
V. A.
Shankweiler
D.
Spoken sentence comprehension by good and poor readers: A study with the Token test
Cortex
1986
, vol. 
22
 (pg. 
627
-
632
)
Spellacy
F.
Spreen
O.
A short form of the Token test
Cortex
1969
, vol. 
5
 (pg. 
390
-
397
)
Spreen
O.
Benton
A. L.
The Neurosensory Center Comprehensive Examination for Aphasia
1969
Victoria, BC, Canada
Neuropsychology Laboratory, University of Victoria
Steinberg
B. A.
Bieliauskas
L. A.
Smith
G. E.
Langellotti
C.
Ivnik
R. J.
Mayo's Older Americans Normative Studies: Age- and IQ-adjusted norms for the Boston naming test, the MAE Token test, and the judgment of line orientation test
The Clinical Neuropsychologist
2005
, vol. 
19
 (pg. 
280
-
328
)
Strauss
E.
Sherman
E. M. S.
Spreen
O.
A compendium of neuropsychological tests. Administration, norms, and commentary.
2006
New York
Oxford University Press
Swihart
A. A.
Panisett
M.
Becker
J. T.
The Token test. Validity and diagnostic power in Alzheimer's disease
Developmental Neuropsychology
1989
, vol. 
5
 (pg. 
69
-
78
)
Swisher
L. P.
Sarno
M. T.
Token test scores on three matched patient groups: Left brain-damaged with aphasia; right brain-damaged without aphasia; non brain-damaged
Cortex
1969
, vol. 
5
 (pg. 
264
-
273
)
Tallberg
I. M.
The Boston naming test in Swedish: Normative data
Brain and Language
2005
, vol. 
94
 (pg. 
19
-
31
)
Thompson
L. L.
Heaton
R. K.
Comparison of different versions of the Boston naming test
The Clinical Neuropsychologist
1989
, vol. 
3
 (pg. 
184
-
192
)
Tombaugh
T. N.
Hubley
A. M.
The 60-item Boston naming test: Norms for cognitively intact adults aged 25 to 88 years
Journal of Clinical and Experimental Neuropsychology
1997
, vol. 
19
 (pg. 
922
-
932
)
Tsang
H. L.
Lee
T. M. C.
The effect of ageing on confrontational naming ability
Archives of Clinical Neuropsychology
2003
, vol. 
18
 (pg. 
81
-
89
)
Van Gorp
W. G.
Satz
P.
Kiersch
M. E.
Henry
R.
Normative data on the Boston naming test for a group of normal older adults
Journal of Clinical and Experimental Neuropsychology
1986
, vol. 
8
 (pg. 
702
-
705
)
Van Harskamp
F.
Van Dongen
H. R.
Construction and validation of different short forms of the Token test
Neuropsychologia
1977
, vol. 
15
 (pg. 
467
-
470
)
Vandenberghe
R.
Language, ageing and neurodegenerative disease
Bulletin and mémoires de l'Académie royale de Médecine de Belgique
2004
, vol. 
159
 (pg. 
161
-
166
)
Welch
L. W.
Doineau
D.
Johnson
S.
King
D.
Educational and gender normative data for the Boston naming test in a group of older adults
Brain and Language
1996
, vol. 
53
 (pg. 
260
-
266
)
World Medical Association.
Declaration of Helsinki. Recommendations guiding physicians in biomedical research involving human subjects
Journal of the American Medical Association
1997
, vol. 
277
 (pg. 
925
-
926
)
Worrall
L. E.
Yiu
E. M. L.
Hickson
L. M. H.
Barnett
H. M.
Normative data for the Boston naming test for Australian elderly
Aphasiology
1995
, vol. 
9
 (pg. 
541
-
551
)
Zec
R. F.
Burkett
N. R.
Markwell
S. J.
Larsen
D. L.
A cross-sectional study of the effects of age, education, and gender on the Boston naming test
The Clinical Neuropsychologist
2007
, vol. 
a 21
 (pg. 
587
-
616
)
Zec
R. F.
Burkett
N. R.
Markwell
S. J.
Larsen
D. L.
Normative data stratified for age education and gender on the Boston naming test
The Clinical Neuropsychologist
2007
, vol. 
b 21
 (pg. 
617
-
637
)

Author notes

Deceased.

The members of the NEURONORMA.ES Study Team are listed in the Appendix.