This editorial refers to ‘SCORE performance in Central and Eastern Europe and former Soviet Union: MONICA and HAPIEE results’, by O. Vikhireva et al., on page 571

‘Prediction is very difficult, especially about the future’

(attributed to Niels Bohr)

‘I told you I was ill’

(Spike Milligan's epitaph)

The paper by Vikhireva and colleagues1 is a timely reminder that one size does not fit all when estimating the risk of cardiovascular death. The authors examined the performance of the European Society of Cardiology (ESC) cardiovascular disease (CVD) risk estimation system SCORE in the Czech Republic, Poland, Lithuania, and Russia, using data from the mid 1980s (MONICA) and early 2000s (HAPIEE). Given acknowledged methodological limitations, the high-risk version of the SCORE chart estimated risk fairly well in the older cohorts, apart from underestimating it substantially in Russia. In the more recent cohorts, SCORE overestimated risk apart from in Russia. It was concluded that the low-risk version of SCORE might now be more appropriate for the Czech Republic and Poland. The fact that re-calibrated versions exist for these two countries was not discussed because it was felt that there was insufficient information on the methods used; it is not clear whether this information was sought.

The estimation of CVD risk is not an exact science. The frequently used Cox's proportional hazard model uses regression coefficients to estimate risks relative to an absolute baseline risk. The coefficients are assumed to remain constant over time and in the context of different combinations of other risk factors. Explanatory variables are considered to act multiplicatively on the hazard function. At best, these assumptions may be regarded as usable approximations to ‘truth’. For example, different combinations of risk factors may interact in complex ways that are difficult to model. We have recently shown that beta coefficients are by no means constant as a person ages.2

Cardiovascular disease mortality is less stable than one might imagine. It can change rapidly over time as countries undergo the epidemiological transition of eating and smoking because they can afford to, until they appear to reach a sort of saturation point beyond which risk tends to decline. Figure1 demonstrates the changes in age-standardized coronary heart disease (CHD) mortality rates from 1970 to 2006 in men from the countries studied by Vikhireva et al. and average rates in Scandinavian, Southern and Eastern European countries for comparison, calculated from the World Health Association (WHO) mortality statistics.3 These time trends, given fluctuations in the Russian data, may explain most if not all of the findings of Vikhireva et al. They generally relate rather more to changes in lifestyle than to improvements in treatments.4–8

Figure 1

Age-standardized coronary heart disease mortality rates in men aged under 65 years in the countries studied and European regions, from the World Health Organization mortality statistics. South European countries, average of France, Greece, Italy, and Spain; Eastern European countries, average of Poland, Hungary, Romania, and Bulgaria; Scandinavian countries, average of Denmark, Finland, Norway, Sweden, and Iceland.

Figure 1

Age-standardized coronary heart disease mortality rates in men aged under 65 years in the countries studied and European regions, from the World Health Organization mortality statistics. South European countries, average of France, Greece, Italy, and Spain; Eastern European countries, average of Poland, Hungary, Romania, and Bulgaria; Scandinavian countries, average of Denmark, Finland, Norway, Sweden, and Iceland.

Some persons announce that they are at high risk of cardiovascular events by virtue of having overt CVD, diabetes, or renal impairment, or an extremely high single risk factor. However, for most seemingly healthy people, risk is the product of several factors. Risk estimation systems attempt to estimate the combined effects of several risk factors. These considerations are summarized in Table 1, which shows the risk categories defined by the European Guidelines on CVD prevention.9 As noted, such systems are not capable of analysing interaction effects in any detail so the estimates will necessarily be approximate.

Table 1

Risk categories defined by the European guidelines on cardiovascular disease prevention9

graphic 
graphic 

After a risk estimation system is derived, it is inevitable that it will overestimate risk in countries in which CVD mortality has declined and underestimate it if mortality has increased.10,11 As noted above, this is likely to explain a substantive part of the findings of Vikhireva and colleagues.

So what are the options in trying to improve risk estimation? The least likely to be effective is to hope to find a new mega-risk factor—the literature is littered with failed attempts, not least our own work on homocysteine and risk.12,13 It is improbable that any other factor will fulfil the criteria for causality as well as do hyperlipidaemia, smoking, and hypertension. As for that hoped-for portfolio of polymorphism that would solve all, dream on….9

The challenge is to use the tools that we have appropriately rather than to expect major refinements in an inexact science.14,15 Nevertheless, use of different risk calculators may result in substantial variations in risk estimates.16 Jackson et al.17 have pointed out two possible reasons for this—the use of different CVD outcomes, and failure to recalibrate the risk system to the population to which it is applied.

Are risk estimation systems such as Framingham18 or SCORE19 widely applicable? When deciding what is best for one's own country, there are several options.

If the country is recognizably similar to the population from which the risk chart has been derived in terms of baseline CVD mortality and risk factor prevalences, it may well be appropriate to use the chart as it is. The current ESC Guidelines on CVD prevention offer guidance on this.9

Secondly, the risk chart may be re-calibrated to allow for secular changes in mortality and risk factor prevalences. This process appears to perform fairly well20–22 and, with regard to SCORE, has been undertaken for 10 European countries.

Thirdly, the country may have its own cohort data permitting a risk estimation system that is likely to be directly applicable to that population to be derived.18,23–25 Even then, within-population heterogeneity, for example in the USA, may limit its universal applicability.26

More sophisticated approaches may be feasible in countries with appropriate data systems. In the UK, QRISK uses general practitioner records of millions of patients to update the risk estimates.27 Issues regarding representativeness and missing data may recede as data accumulate. In New Zealand, the PREDICT web-based decision support system generates individualized risk estimates and personalized treatment recommendations.28

Finally, the use of risk age may circumvent some of these problems. Specialists in prevention and public health generally prefer absolute to relative risk in advising on risk management, and this is sensible—a large relative risk of, say, 10 is not very important if the absolute risk is 0.0001%. Yet it can help in advising young persons with a low absolute risk that this will rise over time if the relative risk is high. Risk age is a way of expressing relative risk that may be meaningful to patients. For example, a 40 year old with a risk of 3% because of multiple risk factors has the same risk as a 60 year old with no risk factors, indicating a risk age of 60. Importantly, and not well recognized, risk age appears to be independent of baseline risk or changes in baseline risk over time,29,30 and so retains its clinical utility without requiring re-calibration.

The vulnerability of the performance of any risk estimation system to secular trends in CVD mortality poses a challenge to Guideline writers and to all trying to make prevention accessible and easy to understand. In the 2012 European Guidelines on CVD prevention,9 25 countries were classified as low risk, compared with eight in the 2007 Guidelines.31 One tries to balance accuracy with the need to avoid confusion caused by too many changes in advice. One can conceive of a system of continuous electronic re-calibration of risk estimates, but this is beyond the capability of current data systems.

Some of the methodological issues in the work of Vikhireva et al.1 may be worthy of further discussion in another forum. The authors calculated the C-statistic for the discrimination of SCORE when dichotomized using a cut-off point of 5% 10-year risk of fatal CVD. It is likely that if the discrimination of SCORE as a continuous variable for estimating risk of future CVD was examined the C-statistic would have been considerably higher. This may be more appropriate since risk is a continuum, as acknowledged in the guidelines.9,31 Further, some of the the results, such as poor calibration in some of the more recent cohorts, are not unexpected. It would be impossible for a system to predict risk well in two cohorts from the same country but two decades apart when CVD mortality rates have changed substantially over the time frame.

In conclusion, the study of Vikhireva and colleagues is helpful in confirming that risk estimation systems must be used judiciously in countries where baseline risk is substantially different from that of the SCORE cohorts. We have outlined approaches to this problem. Resources permitting, increased use of the electronic version of HeartScore32 with as frequent recalibrations as is feasible, flagged by appropriate advisory notes, may be preferable to slavish adherence to paper charts that are more difficult to update. HeartScore already generates personalized patient management advice. There is a compelling need for ongoing cohort data collection throughout Europe and for more sophisticated data linkage systems to refine and facilitate risk estimation and management.

Conflict of interest: none declared.

References

1
Vikhireva
O
Pajak
A
Broda
G
Malyutina
S
Tamosiunas
A
Kubinova
R
Simonova
G
Skodova
Z
Bobak
M
Pikhart
H
SCORE performance in Central and Eastern Europe and former Soviet Union: MONICA and HAPIEE results
Eur Heart J
 , 
2014
, vol. 
35
 (pg. 
571
-
577
)
2
Cooney
M
Dudina
A
Graham
IM
for the SCORE investigators
SCORE ELD – Extending risk estimation to older people
Eur Heart J
 , 
2009
, vol. 
29
 
(Suppl)
(pg. 
266
-
2677
)
3
World Health Organisation
 
4
Bennett
K
Kabir
Z
Unal
B
Shelley
E
Critchley
J
Perry
I
Feely
J
Capewell
S
Explaining the recent decrease in coronary heart disease mortality rates in Ireland, 1985–2000
J Epidemiol Community Health
 , 
2006
, vol. 
60
 (pg. 
322
-
327
)
5
Capewell
S
Beaglehole
R
Seddon
M
McMurray
J
Explanation for the decline in coronary heart disease mortality rates in Auckland, New Zealand, Between 1982 and 1993
Circulation
 , 
2000
, vol. 
102
 (pg. 
1511
-
1516
)
6
Ford
E
Ajani
U
Croft
J
Critchley
J
Labarthe
D
Kottke
T
Giles
W
Capewell
S
Explaining the decrease in U.S deaths from coronary disease, 1980–2000
N Engl J Med
 , 
2007
, vol. 
356
 (pg. 
2388
-
2398
)
7
Laatikainen
L
Critchley
J
Vartiainen
E
Salomaa
V
Ketonen
M
Capewell
S
Explaining the decline in coronary heart disease mortality in Finland between 1982 and 1997
Am J Epidemiol
 , 
2005
, vol. 
162
 (pg. 
764
-
773
)
8
Unal
B
Critchley
J
Capewell
S
Explaining the decline in coronary heart disease mortality in England and Wales between 1981 and 2000
Circulation
 , 
2004
, vol. 
109
 (pg. 
1101
-
1107
)
9
Perk
J
De Backer
G
Gohlke
H
Graham
I
Reiner
Z
Verschuren
M
Albus
C
Benlian
P
Boysen
G
Cifkova
R
Deaton
C
Ebrahim
S
Fisher
M
Germano
G
Hobbs
R
Hoes
A
Karadeniz
S
Mezzani
A
Prescott
E
Ryden
L
Scherer
M
Syvanne
M
Scholte Op Reimer
WJ
Vrints
C
Wood
D
Zamorano
JL
Zannad
F
Cooney
MT
Bax
J
Baumgartner
H
Ceconi
C
Dean
V
Fagard
R
Funck-Brentano
C
Hasdai
D
Kirchhof
P
Knuuti
J
Kolh
P
McDonagh
T
Moulin
C
Popescu
BA
Sechtem
U
Sirnes
PA
Tendera
M
Torbicki
A
Vahanian
A
Windecker
S
Aboyans
V
Ezquerra
EA
Baigent
C
Brotons
C
Burell
G
Ceriello
A
De Sutter
J
Deckers
J
Del Prato
S
Diener
HC
Fitzsimons
D
Fras
Z
Hambrecht
R
Jankowski
P
Keil
U
Kirby
M
Larsen
ML
Mancia
G
Manolis
AJ
McMurray
J
Pajak
A
Parkhomenko
A
Rallidis
L
Rigo
F
Rocha
E
Ruilope
LM
van der Velde
E
Vanuzzo
D
Viigimaa
M
Volpe
M
Wiklund
O
Wolpert
C
European Guidelines on cardiovascular disease prevention in clinical practice (version 2012): the Fifth Joint Task Force of the European Society of Cardiology and Other Societies on Cardiovascular Disease Prevention in Clinical Practice (constituted by representatives of nine societies and by invited experts)
Eur Heart J
 , 
2012
, vol. 
33
 (pg. 
1635
-
1701
)
10
Lindman
AS
Veierod
MB
Pedersen
JI
Tverdal
A
Njolstad
I
Selmer
R
The ability of the SCORE high-risk model to predict 10-year cardiovascular disease mortality in Norway
Eur J Cardiovasc Prev Rehabil
 , 
2007
, vol. 
14
 (pg. 
501
-
507
)
11
van Dis
I
Kromhout
D
Geleijnse
JM
Boer
JM
Verschuren
WM
Evaluation of cardiovascular risk predicted by different SCORE equations: the Netherlands as an example
Eur J Cardiovasc Prev Rehabil
 , 
2010
, vol. 
17
 (pg. 
244
-
249
)
12
van der Meer
IM
de Maat
MP
Kiliaan
AJ
van der Kuip
DA
Hofman
A
Witteman
JC
The value of C-reactive protein in cardiovascular risk prediction: the Rotterdam Study
Arch Intern Med
 , 
2003
, vol. 
163
 (pg. 
1323
-
1328
)
13
Sharrett
AR
Ballantyne
CM
Coady
SA
Heiss
G
Sorlie
PD
Catellier
D
Patsch
W
Coronary heart disease prediction from lipoprotein cholesterol levels, triglycerides, lipoprotein(a), apolipoproteins A-I and B, and HDL density subfractions: the Atherosclerosis Risk in Communities (ARIC) Study
Circulation
 , 
2001
, vol. 
104
 (pg. 
1108
-
1113
)
14
Cooney
MT
Dudina
A
D'Agostino
R
Graham
IM
Cardiovascular risk-estimation systems in primary prevention: do they differ? Do they make a difference? Can we see the future?
Circulation
 , 
2010
, vol. 
122
 (pg. 
300
-
310
)
15
Cooney
MT
Dudina
AL
Graham
IM
Value and limitations of existing scores for the assessment of cardiovascular risk: a review for clinicians
J Am Coll Cardiol
 , 
2009
, vol. 
54
 (pg. 
1209
-
1227
)
16
Allan
G
Nouri
F
Korownyk
C
Kolber
MR
Vandermeer
B
McCormack
J
Agreement among cardiovascular disease risk calculators
Circulation
 , 
2013
, vol. 
127
 (pg. 
1929
-
1931
)
17
Jackson
R
Kerr
A
Wells
S
Vascular risk calculators: essential but flawed clinical tools?
Circulation
 , 
2013
, vol. 
127
 (pg. 
1929
-
1931
)
18
D'Agostino
RB
Sr
Vasan
RS
Pencina
MJ
Wolf
PA
Cobain
M
Massaro
JM
Kannel
WB
General cardiovascular risk profile for use in primary care: the Framingham Heart Study
Circulation
 , 
2008
, vol. 
117
 (pg. 
743
-
753
)
19
Conroy
RM
Pyorala
K
Fitzgerald
AP
Sans
S
Menotti
A
De Backer
G
De Bacquer
D
Ducimetiere
P
Jousilahti
P
Keil
U
Njolstad
I
Oganov
RG
Thomsen
T
Tunstall-Pedoe
H
Tverdal
A
Wedel
H
Whincup
P
Wilhelmsen
L
Graham
IM
Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project
Eur Heart J
 , 
2003
, vol. 
24
 (pg. 
987
-
1003
)
20
Liu
J
Hong
Y
D'Agostino
RB
Sr.
Wu
Z
Wang
W
Sun
J
Wilson
PW
Kannel
WB
Zhao
D
Predictive value for the Chinese population of the Framingham CHD risk assessment tool compared with the Chinese Multi-Provincial Cohort Study
JAMA
 , 
2004
, vol. 
291
 (pg. 
2591
-
2599
)
21
Panagiotakos
DB
Fitzgerald
AP
Pitsavos
C
Pipilis
A
Graham
I
Stefanadis
C
Statistical modelling of 10-year fatal cardiovascular disease risk in Greece: the HellenicSCORE (a calibration of the ESC SCORE project)
Hellenic J Cardiol
 , 
2007
, vol. 
48
 (pg. 
55
-
63
)
22
Hense
HW
Koesters
E
Wellmann
J
Meisinger
C
Volzke
H
Keil
U
Evaluation of a recalibrated Systematic Coronary Risk Evaluation cardiovascular risk chart: results from Systematic Coronary Risk Evaluation Germany
Eur J Cardiovasc Prev Rehabil
 , 
2008
, vol. 
15
 (pg. 
409
-
415
)
23
Hippisley-Cox
J
Coupland
C
Vinogradova
Y
Robson
J
May
M
Brindle
P
Derivation and validation of QRISK, a new cardiovascular disease risk score for the United Kingdom: prospective open cohort study
BMJ
 , 
2007
, vol. 
335
 pg. 
136
 
24
Ferrario
M
Chiodini
P
Chambless
LE
Cesana
G
Vanuzzo
D
Panico
S
Sega
R
Pilotto
L
Palmieri
L
Giampaoli
S
Prediction of coronary events in a low incidence population. Assessing accuracy of the CUORE Cohort Study prediction equation
Int J Epidemiol
 , 
2005
, vol. 
34
 (pg. 
413
-
421
)
25
Woodward
M
Brindle
P
Tunstall-Pedoe
H
Adding social deprivation and family history to cardiovascular risk assessment: the ASSIGN score from the Scottish Heart Health Extended Cohort (SHHEC)
Heart
 , 
2007
, vol. 
93
 (pg. 
172
-
176
)
26
D'Agostino
RB
Sr
Grundy
S
Sullivan
LM
Wilson
P
Validation of the Framingham coronary heart disease prediction scores: results of a multiple ethnic groups investigation
JAMA
 , 
2001
, vol. 
286
 (pg. 
180
-
187
)
27
Hippisley-Cox
J
Coupland
C
Vinogradova
Y
Robson
J
Minhas
R
Sheikh
A
Brindle
P
Predicting cardiovascular risk in England and Wales: prospective derivation and validation of QRISK2
BMJ
 , 
2008
, vol. 
336
 (pg. 
1475
-
1482
)
28
Kerr
AJ
Broad
J
Wells
S
Riddell
T
Jackson
R
Should the first priority in cardiovascular risk management be those with prior cardiovascular disease?
Heart
 , 
2009
, vol. 
95
 (pg. 
125
-
129
)
29
Cooney
MT
Vartiainen
E
Laatikainen
T
De Bacquer
D
McGorrian
C
Dudina
A
Graham
I
Cardiovascular risk age: concepts and practicalities
Heart
 , 
2012
, vol. 
98
 (pg. 
941
-
946
)
30
Cuende
JI
Cuende
N
Calaveras-Lagartos
J
How to calculate vascular age with the SCORE project scales: a new method of cardiovascular risk evaluation
Eur Heart J
 , 
2010
, vol. 
31
 (pg. 
2351
-
2358
)
31
Graham
I
Atar
D
Borch-Johnsen
K
Boysen
G
Burell
G
Cifkova
R
Dallongeville
J
De Backer
G
Ebrahim
S
Gjelsvik
B
Herrmann-Lingen
C
Hoes
A
Humphries
S
Knapton
M
Perk
J
Priori
SG
Pyorala
K
Reiner
Z
Ruilope
L
Sans-Menendez
S
Op Reimer
WS
Weissberg
P
Wood
D
Yarnell
J
Zamorano
JL
Walma
E
Fitzgerald
T
Cooney
MT
Dudina
A
Vahanian
A
Camm
J
De Caterina
R
Dean
V
Dickstein
K
Funck-Brentano
C
Filippatos
G
Hellemans
I
Kristensen
SD
McGregor
K
Sechtem
U
Silber
S
Tendera
M
Widimsky
P
Zamorano
JL
Altiner
A
Bonora
E
Durrington
PN
Fagard
R
Giampaoli
S
Hemingway
H
Hakansson
J
Kjeldsen
SE
Larsen
L
Mancia
G
Manolis
AJ
Orth-Gomer
K
Pedersen
T
Rayner
M
Ryden
L
Sammut
M
Schneiderman
N
Stalenhoef
AF
Tokgozoglu
L
Wiklund
O
Zampelas
A
European guidelines on cardiovascular disease prevention in clinical practice: full text
Fourth Joint Task Force of the European Society of Cardiology and other societies on cardiovascular disease prevention in clinical practice (constituted by representatives of nine societies and by invited experts)
Eur J Cardiovasc Prev Rehabil
 , 
2007
14 Suppl 2
 
S1–113
32
HeartScore
 
www.HeartScore.org (30 October 2013)

Author notes

The opinions expressed in this article are not necessarily those of the Editors of the European Heart Journal or of the European Society of Cardiology.
doi:10.1093/eurheartj/eht189.

Supplementary data

Comments

0 Comments