This editorial refers to ‘A putative placebo analysis of the effects of LCZ696 on clinical outcomes in heart failure’, by J. McMurrayet al., on page 434.

This issue of the European Heart Journal contains a major statement by the PARADIGM-HF Investigators,1 who present an ‘putative placebo’ analysis for LCZ696, a new medicine that yielded a remarkable reduction in total mortality and heart failure events in patients with significant heart failure with reduced ejection fraction (HF-REF). (NB: I serve as a consultant on Novartis's cardiovascular–metabolic advisory group, and have observed the development of this molecule from its inception through the present trial. This bias should be considered when reading this commentary.)

The previously published PARADIGM-HF Trial2 (NCT01035255) compared LCZ696 with enalapril, one of the most commonly used angiotensin-converting enzyme inhibitors (ACE-Is), and reported an impressive reduction in death and heart failure events. However, because PARADIGM-HF used an active comparator, the authors asked a logical question: ‘What would the result have been if LCZ696 were compared with placebo?’

In order to perform this ‘putative placebo’ analysis, the authors used historical controls from previous trials comparing enalapril with placebo. Unsurprisingly, their estimate finds that LCZ696 is far superior to putative placebo for the outcomes of death and major cardiovascular events. The PARADIGM-HF trial itself and the putative placebo analysis employed cutting-edge methods and were conducted by highly credible investigators. Thus, the question is not whether the effect is real; instead, as the clinical community absorbs this welcome news, we should consider the extent to which the size of the effect can be believed and what it means for the future of clinical therapeutics for heart failure.

Previously, many cardiovascular specialists were excited about omapatrilat,3 an ACE-I/neutral endopeptidase (NEP) inhibitor combination developed by Bristol-Myers Squibb that showed spectacular results in trials for hypertension, especially among African American patients. Unfortunately, when once-daily dosing was advanced despite pharmacodynamic studies that suggested a need for twice-daily dosing, a heart failure trial showed only a non-significant trend toward an advantage for omapatrilat over enalapril.4 Further, an excess of serious angio-oedema—a condition that ironically was most severe in the African American patients who, due to a propensity for refractory hypertension, had the most to gain from this novel therapy—caused development of ompatrilat to be abandoned.5

However, when Novartis' development team announced that it was able to create an angiotensin receptor blocker (ARB)/NEP inhibitor combination, our advisory group was thrilled, and, despite many sceptics within and outside of Novartis, the end result is gratifying. Nevertheless, many questions remain following this spectacular outcomes trial.

Interpreting the findings from McMurray et al

First, how believable is the putative placebo analysis? The authors conducted a splendid trial, but any putative placebo analysis must use historical controls—a method that always entails a degree of uncertainty. One potential risk is that the patient population of the new trial differs in significant ways from those of the reference trials: a key reason to conduct randomized controlled trials is the critical importance of contemporaneous, unbiased control groups. The authors have diligently provided evidence that, other than a difference in beta-blocker use (which could perhaps be expected to disadvantage LCZ696 in this comparison), the populations appear more similar than one might expect. Of course, all historical controls are subject to the risk of unmeasured confounders and, given the > 20-year interval between the reference SOLVD trial6 and PARADIGM-HF,2 scepticism is warranted.

A second issue to consider when weighing the importance of this study is constancy.7 Given changes in the population, the natural history of the disease, and the underlying therapeutic milieu, is the effect size of enalapril vs. placebo the same in 2014 as it was in 1994? The authors cleverly use findings from the CHARM-Alternative trial8 to provide a ‘mid-term’ snapshot. The data support the constancy assumption, but do not (and cannot!) definitively prove it. Substantial uncertainty thus remains, but this is true for almost all putative placebo analyses.

In addition to the usual concerns about putative placebo analyses, there are two fundamental design issues pertinent to PARADIGM-HF that call for caution when interpreting the size of the treatment effect. First, the design included a rigorous run-in phase that eliminated patients who could not tolerate either enalapril or LCZ696. This was justified by the investigators because they wanted to be certain that patients enrolled into the trial were taking the recommended dose of enalapril in order to ensure a fair test vs. LCZ696. Nevertheless, the run-in phase diminishes the generalizability of the results, especially when extrapolating to clinicians and patients who are considering whether to initiate LCZ696 in practice. At present, it is not possible to know whether the patient will tolerate this drug at the time treatment is initiated, and the key toxicities (hyperkalaemia and hypotension) tend to occur early and thus would be screened out in the run-in phase.

Second, the trial was stopped early by the Data Monitoring Committee (DMC). The concern here is not with the action of the DMC, as the data clearly showed a profound reduction in serious clinical outcomes including death, which merited early discontinuation for benefit. Rather, the issue is whether the magnitude of the result is generalizable. Historically, when trials are stopped early, they tend to represent a selection of extreme results and the true effect is typically smaller than that estimated by the trial.9,10 The PARADIGM-HF investigators, one of whom ‘wrote the book’ on early stopping,11 counter that PARADIGM-HF actually reached its projected number of events and that after the conclusion of the trial's active phase, the legacy effect showed continued separation of the event curves rather than the convergence that might be expected.

Other issues have been raised regarding the interpretation of PARADIGM-HF. Despite a population comprising participants with HF-REF, few patients were availed of implantable cardioverter/defibrillators (ICDs) or biventricular pacing. These technologies have been shown to reduce death and disability in patients with HF-REF, and thus it is uncertain whether access to them would have mitigated some of the treatment benefit. Although there was no significant heterogeneity by region, the trial was not powered to evaluate any differences in treatment effect as a product of care patterns.

Implications for clinical care

What does this mean for clinical care? Although the US Food and Drug Administration and other regulatory agencies must examine the primary data, the European Medicines Agency has granted a rare accelerated review to LCZ696,12 and clinicians, patients, and payers will face decisions about how to incorporate the compound into practice. In the event that further development occurs, regulators, health system gatekeepers, and clinicians will be presented with thorny questions: Should LCZ696 replace generic ACE-Is in patients who meet the criteria used in PARADIGM-HF? Should the results be extrapolated beyond the exact population enrolled in the trial? For health systems, the cost-effectiveness calculations are likely to estimate that LCZ606 will be a bargain, but pricing and reimbursement may prove contentious. It is to be hoped that the sponsor will work with health systems and national coverage approaches to emphasize value-based pricing and access for patients with limited financial means.

What about additional uses of LCZ696? A major trial is underway in patients with heart failure with preserved ejection fraction, and another trial is being planned for patients with acute decompensated heart failure. However, the big topic for discussion will be hypertension. Despite the large number of generic blood pressure medicines, refractory hypertension remains a huge problem, with some estimates identifying hypertension as the leading remedial cause of death and disability.13 This is especially true for economically disadvantaged minority groups in countries with developed economies, and these populations may preferentially benefit from the ARB/NEP inhibitor combination. Given the important potential clinical benefit, there is an urgent need for trials to examine LCZ696 in other areas of medicine.

The statistics on drug development are well known. Despite some contention about the exact numbers,14–16 the expense of bringing a new medicine to market is driven more by the costs of capital and of failures than by the direct costs of developing the new molecule. Rarely are major successes in this arena the result of totally rational planning, but in this case the previous work done on omapatrilat gave a boost to developers at Novartis, in concert with excellent triallists who had learned from previous heart failure trials. In a field with so many failures, this programme stands as an exemplar. Although I believe the effect in practice will be smaller than estimated in this trial with its run-in phase, deficits in use of ICDs and biventricular pacing, and early stopping by a diligent DMC, I also believe that the result is sufficiently large to merit early and widespread adoption in practice. Effective pricing, uptake by health systems, and new evidence-generating trials can continuously guide clinicians in the use of LCZ696 to achieve optimal outcomes for individuals and populations.

Conflict of interest: R.M.C. reports receiving grant funding and personal fees from Novartis; grants from the Patient-Centered Outcomes Research Institute, the National Institutes of Health, the US Food and Drug Administration, the Clinical Trials Transformation Initiative, Merck, Roche, Aterovax, Bayer, Janssen Pharmaceuticals, Eli Lilly & Company, and Schering-Plough; grants and personal fees from Amylin, Scios, and Bristol-Myers Squibb/Bristol-Myers Squibb Foundation; and personal fees from WebMD, Kowa Research Institute, Nile, Parkview, Orexigen, Pozen, Servier International, Bayer Healthcare, Bayer Pharma AG, CV Sight, Daiichi Sankyo/Lilly, Gambro, Gilead, Heart.org–Bayer, Medscape, Pfizer, Regeneron, TMC, GlaxoSmithKline, Genentech, Heart.org–Daiichi Sankyo, and Amgen. R.M.C. holds equity in Nitrox/N30 and Portola. A complete listing of disclosure information is also available at https://www.dcri.org/about-us/conflict-of-interest.

References

1
McMurray
J
Packer
M
Desai
A
Gong
J
Greenlaw
N
Lefkowitz
M
Rizkala
A
Shi
V
Rouleau
J
Solomon
S
Swedberg
K
Zile
MR
Andersen
K
Arango
JL
Arnold
M
Be˘lohlávek
J
Böhm
M
Boytsov
S
Burgess
L
Cabrera
W
Chen
CH
Erglis
A
Fu
M
Gomez
E
Gonzalez
A
Hagege
AA
Katova
T
Kiatchoosakun
S
Kim
KS
Bayram
E
Martinez
F
Merkely
B
Mendoza
I
Mosterd
A
Negrusz-Kawecka
M
Peuhkurinen
K
Ramires
F
Refsgaard
J
Senni
M
Sibulo
AS
Jr
Silva-Cardoso
J
Squire
I
Starling
RC
Vinereanu
D
Teerlink
JR
Wong
R
on behalf of the PARADIGM-HF Committees and Investigators
A putative placebo analysis of the effects of LCZ696 on clinical outcomes in heart failure
Eur Heart J
2015
, vol. 
36
 (pg. 
434
-
439
)
2
McMurray
JJ
Packer
M
Desai
AS
Gong
J
Lefkowitz
MP
Rizkala
AR
Rouleau
JL
Shi
VC
Solomon
SD
Swedberg
K
Zile
MR
PARADIGM-HF Investigators and Committees
Angiotensin-neprilysin inhibition versus enalapril in heart failure
N Engl J Med
2014
, vol. 
371
 (pg. 
993
-
1004
)
3
Campese
VM
Lasseter
KC
Ferrario
CM
Smith
WB
Ruddy
MC
Grim
CE
Smith
RD
Vargas
R
Habashy
MF
Vesterqvist
O
Delaney
CL
Liao
WC
Omapatrilat versus lisinopril: efficacy and neurohormonal profile in salt-sensitive hypertensive patients
Hypertension
2001
, vol. 
38
 (pg. 
1342
-
1348
)
4
Packer
M
Califf
RM
Konstam
MA
Krum
H
McMurray
JJ
Rouleau
JL
Swedberg
K
Comparison of omapatrilat and enalapril in patients with chronic heart failure: the Omapatrilat Versus Enalapril Randomized Trial of Utility in Reducing Events (OVERTURE)
Circulation
2002
, vol. 
106
 (pg. 
920
-
926
)
5
Pickering
T
The rise and fall of omapatrilat
 
Medscape 2002. http://www.medscape.com/viewarticle/443224 (1 December 2014)
6
Effect of enalapril on mortality and the development of heart failure in asymptomatic patients with reduced left ventricular ejection fractions. The SOLVD Investigators
N Engl J Med
1992
, vol. 
327
 (pg. 
685
-
691
)
7
D'Agostino
RB
Sr
Massaro
JM
Sullivan
LM
Non-inferiority trials: design concepts and issues—the encounters of academic consultants in statistics
Stat Med
2003
, vol. 
22
 (pg. 
169
-
186
)
8
Granger
CB
McMurray
JJ
Yusuf
S
Held
P
Michelson
EL
Olofsson
B
Ostergren
J
Pfeffer
MA
Swedberg
K
CHARM Investigators and Committees
Effects of candesartan in patients with chronic heart failure and reduced left-ventricular systolic function intolerant to angiotensin-converting-enzyme inhibitors: the CHARM-Alternative trial
Lancet
2003
, vol. 
362
 (pg. 
767
-
771
)
9
Pocock
S
White
I
Trials stopped early: too good to be true?
Lancet
1999
, vol. 
353
 (pg. 
943
-
944
)
10
Bassler
D
Briel
M
Montori
VM
Lane
M
Glasziou
P
Zhou
Q
Heels-Ansdell
D
Walter
SD
Guyatt
GH
Flynn
DN
Elamin
MB
Murad
MH
Abu Elnour
NO
Lampropulos
JF
Sood
A
Mullan
RJ
Erwin
PJ
Bankhead
CR
Perera
R
Ruiz Culebro
C
You
JJ
Mulla
SM
Kaur
J
Nerenberg
KA
Schünemann
H
Cook
DJ
Lutz
K
Ribic
CM
Vale
N
Malaga
G
Akl
EA
Ferreira-Gonzalez
I
Alonso-Coello
P
Urrutia
G
Kunz
R
Bucher
HC
Nordmann
AJ
Raatz
H
da Silva
SA
Tuche
F
Strahm
B
Djulbegovic
B
Adhikari
NK
Mills
EJ
Gwadry-Sridhar
F
Kirpalani
H
Soares
HP
Karanicolas
PJ
Burns
KE
Vandvik
PO
Coto-Yglesias
F
Chrispim
PP
Ramsay
T
STOPIT-2 Study Group
Stopping randomized trials early for benefit and estimation of treatment effects: systematic review and meta-regression analysis
JAMA
2010
, vol. 
303
 (pg. 
1180
-
1187
)
11
Pocock
SJ
When (not) to stop a clinical trial for benefit
JAMA
2005
, vol. 
294
 (pg. 
2228
-
2230
)
12
PBR Production and Manufacturing
EMA committee grants accelerated assessment to Novartis' LCZ696 for heart failure
 
13
MacMahon
S
Antihypertensive drug treatment: the potential, expected and observed effects on vascular disease
J Hypertens Suppl
1990
, vol. 
8
 (pg. 
S239
-
S244
)
14
Tufts Center for the Study of Drug Development
Cost to develop and win marketing approval for a new drug is $2.6 billion
 
Tufts CSDD News. November 18, 2014. Available at: http://csdd.tufts.edu/news/complete_story/pr_tufts_csdd_2014_cost_study (1 December 2014)
15
Millman
J
Does it really cost $2.6 billion to develop a new drug? Washington Post. November 18, 2014
 
16
Weisman
R
Group hits Tufts center's drug development figure. The Boston Globe. December 2, 2014
 

Author notes

The opinions expressed in this article are not necessarily those of the Editors of the European Heart Journal or of the European Society of Cardiology.

doi:10.1093/eurheartj/ehu455.