Abstract

Objective

To evaluate the role of neutrophil extracellular traps (NETs) in the genesis of joint hyperalgesia using an experimental model of arthritis and transpose the findings to clinical investigation.

Methods

C57BL/6 mice were subjected to antigen-induced arthritis (AIA) and treated with Pulmozyme (PLZ) to degrade NETs or Cl-amidine to inhibit NET production. Oedema formation, the histopathological score and mechanical hyperalgesia were evaluated. NETs were injected intra-articularly in wild type (WT), Tlr4−/−, Tlr9−/−, Tnfr1−/− and Il1r−/− mice, and the levels of cytokines and Cox2 expression were quantified. NETs were also quantified from human neutrophils isolated from RA patients and individual controls.

Results

AIA mice had increased NET concentration in joints, accompanied by increased Padi4 gene expression in the joint cells. Treatment of AIA mice with a peptidyl arginine deiminase 4 inhibitor or with PLZ inhibited the joint hyperalgesia. Moreover, the injection of NETs into joints of naïve animals generated a dose-dependent reduction of mechanical threshold, an increase of articular oedema, inflammatory cytokine production and cyclooxygenase-2 expression. In mice deficient for Tnfr1, Il1r, Tlr4 and Tlr9, joint hyperalgesia induced by NETs was prevented. Last, we found that neutrophils from RA patients were more likely to release NETs, and the increase in synovial fluid NET concentration correlated with an increase in joint pain.

Conclusion

The findings indicate that NETs cause hyperalgesia possibly through Toll-like receptor (TLR)-4 and TLR-9. These data support the idea that NETs contribute to articular pain, and this pathway can be an alternative target for the treatment of pain in RA.

Rheumatology key messages
  • Neutrophil extracellular traps (NETs) cause pain in antigen-induced arthritis.

  • Toll-like receptors are involved in hyperalgesia induced by NETs.

Introduction

RA is a chronic autoimmune disease that affects ∼0.5–1% of the world adult population [1] and is characterized by the presence of autoantibodies [2, 3] and symmetric inflammation of joints, leading to joint pain and cartilage and bone damage [4]. The aetiology of RA is not yet fully elucidated, but it is known that it involves a combination of genetic, environmental and hormonal factors [5–7]. One of the main symptoms of RA is increased sensitivity to joint pain, called hyperalgesia, which leads to loss of quality of life [8]. Despite advances in RA therapy, treatment for joint inflammation and consequent pain relief remains limited for many patients.

Several groups, including ours, have demonstrated the importance of pro-inflammatory cytokines triggering joint hyperalgesia in different animal models, including in the RA model [9, 10]. Cytokines, such as TNF-α and IL-1β, and chemokines released by immune cells stimulate the production of eicosanoids that sensitize the primary afferent neurons [11].

Cytokines also induce the recruitment of neutrophils to the joints, where they are also an important source of inflammatory mediators, including those involved in hyperalgesia. In fact, the blockage of neutrophil migration to inflamed joints prevents the majority of the inflammatory events, including joint pain [11]. In addition to interacting with other immune cells [12], neutrophils release enzymes, such as myeloperoxidase (MPO) and matrix metalloproteinases, and oxygen- and nitrogen-derived free radicals, which lead to joint tissue lesions, including cartilage and bone damage [13, 14]. They also release eicosanoids, which are involved in the sensitization of primary neurons [11]. In the past decade, neutrophils have been demonstrated to release neutrophil extracellular traps (NETs), which are composed of an extracellular DNA matrix containing cytotoxic enzymes and histones. During inflammation, NETs play a pivotal role in the host killing capacity. In fact, NETs kill different bacterial strains, fungi, protozoa and viruses [15]. However, NETs are also involved in other pathophysiological processes, including autoimmune diseases. Inhibition of peptidyl arginine deiminase 4 (PADI-4), an important enzyme involved in NETosis, reduces the severity of experimental RA [16]. It was demonstrated that NETs mediate tissue damage in different experimental models of autoimmune diseases [17, 18]. Furthermore, besides these effects, NET components are recognized as damage-associated molecular patterns (DAMPs), turning release of NETs into a magnifying process for the immune response in the development of autoimmunity [19].

Although NET production during experimental and clinical RA is well established [20], there is no evidence that NETs participate in the onset of joint hyperalgesia in RA. Therefore, in the present study, we address the possible participation of NETs in joint hyperalgesia using an experimental model of RA. We also investigate the possible association between the intensity of pain and the levels of NET production in clinical RA.

Methods

Patients

Peripheral blood samples were collected from 24 RA patients recruited from the Ribeirão Preto Medical School Hospital (University of São Paulo, Ribeirão Preto, Brazil). All patients fulfilled the 2010 ACR/EULAR classification criteria for RA [21] and had <2 years of symptoms. Thirteen healthy volunteers matched for age and gender were recruited as controls. The research was conducted according to the Human Ethics Committee of the University of São Paulo at Ribeirão Preto Medical School (document no. 2.724.944, Presentation Certificate for Ethical Appreciation no. 89092417.3.0000.5440). The visual analogue scale (VAS; 0–100 mm) was used to measure pain intensity in patients [22].

Human neutrophil isolation

Neutrophils were isolated from peripheral blood from RA patients and control individuals through Percoll gradients (72%, 63%, 54% and 45%). After centrifugation, polymorphonuclear leukocytes accumulated as a band between 72 and 63% Percoll. Total cell numbers were counted using light microscopy. The percentage of neutrophils was determined microscopically through haematoxylin and eosin staining. One million neutrophils were incubated in HBSS medium (Corning, Manassas, VA, USA) for 4 h, and the supernatants were used to determine NET concentration.

Animals

The experiments were performed on male C57BL/6 wild type (WT) mice and mice deficient in the genes for Toll-like receptor 4 (Tlr4; C57BL/6 background), Toll-like receptor 9 (Tlr9; C57BL/6 background), TNF receptor 1 (Tnfr1; C57BL/6 background) and IL-1 receptor (Il1r; C57BL/6 background), weighing between 20 and 25 g. They were housed in temperature-controlled rooms (22–25°C) and given water and food ad libitum at the animal facility in the Department of Pharmacology, School of Medicine of Ribeirão Preto, University of São Paulo, Brazil. Animal husbandry and procedures were in accordance with the guidelines of the Animal Ethics Committee of the School of Medicine of Ribeirão Preto (241/2018).

Induction of experimental antigen-induced arthritis

The induction of antigen-induced arthritis (AIA) was performed as previously described, with some alterations [23]. Briefly, the mice were sensitized with 500 µg of methylated bovine serum albumin (mBSA) in 0.2 ml of an emulsion containing 0.1 ml saline and 0.1 ml complete Freund’s adjuvant (1 mg/ml of Mycobacterium tuberculosis) and given by subcutaneous injection on day 0. The mice were boosted with the same preparation on day 7. Control mice received similar injections but without the mBSA. Twenty-one days after the initial injection, arthritis was induced in the immunized animals by intra-articular (i.a.) injection of mBSA (100 µg/cavity) into the right knee joint or into both knee joints. On day 26 after the first immunization, mice were challenged again the same way. Six, 12 and 24 h after the second challenge, the NET concentration was dosed. Twenty-four hours after the second challenge, the knee joint thicknesses were measured by calliper in millimetres. The results were expressed as the means and the difference between the diameter on day 0 (basal) and after second challenge (Δmm). The knee joints were opened and washed with PBS for quantification of NETs. The gene expression of Padi4 in these aspirated fluids was evaluated 24 h after the second challenge. The knees were fixed in 10% buffered formalin for histopathological analysis. An electronic von Frey test was performed as previously described [24] at 3, 6 and 24 h after the second challenge to evaluate hyperalgesia.

Purification and intra-articular injection of NETs

NETs were obtained as previously described [25]. Briefly, isolated bone marrow from WT mice was used to isolate neutrophils with Percoll gradients (72% and 65%). These neutrophils (98% purity) were challenged with 50 nM of phorbol 12-myristate 13-acetate for 3 h at 37°C in RPMI 1640. Supernatants were discarded, and NETs were removed through extensive pipetting with fresh PBS. The NETs were centrifuged to remove cellular components, and NETs-containing supernatants were collected and centrifuged. Supernatants were removed and the pellets resuspended in PBS. NETs were then quantified through GeneQuant (GE Healthcare Bio-Sciences Corp., Sheffield, UK). WT mice received three different doses of NETs (5, 10 and 20 ng) in the right joint or received 10 ng of NETs incubated in vitro with Pulmozyme® (Pulmozyme®, San Francisco, California, USA) (1:1) for 3 h at 37°C. Knockout mice for Tlr4, Tlr9, Tnfr1 and Il1r received 10 ng of NETs in the right joint.

Immunofluorescence of NETs

Purified NETs (50 µl) were spread on polylysine-treated glass slides and then fixed with paraformaldehyde 4%. Slides were blocked with a solution containing BSA 2% and 0.1% Triton X-100 and afterward incubated with a rabbit anti-citrulline H3 (1:1000) (Abcam, Cambridge, UK) and a mouse anti-MPO (Abcam) (1:1000). Detection was performed using an anti-rabbit (AlexaFluor 488) (Thermo Fisher Scientific, Waltham, MA, USA) and an anti-mouse antibodies (AlexaFluor 594) (Thermo Fisher Scientific) (1:2000 each). Nuclei were stained with 4′,6-diamidino-2-phenylindole (DAPI; Vectashield® Antifade Mounting Medium; Vector Laboratories, Burlingame, CA, USA). Fluorescence images were acquired on a confocal microscope (Carl Zeiss, Oberkochen, Germany) (Supplementary Figs S1a and b, available at Rheumatology online). Secondary antibody only and IgG controls were performed to guarantee that staining was not background (Supplementary Fig. S2a and b, available at Rheumatology online). Confirming that citrullination is expressed in NET, we assessed colocalization analysis between DAPI and H3 citrulline, and DAPI and MPO, in 10 different samples, by performed Pearson's correlation coefficient using ImageJ software for quantification. The co-localization of H3 citrulline was observed (Supplementary Fig. S1c, available at Rheumatology online).

Determination of articular hyperalgesia

Articular hyperalgesia of the femur–tibia joint was determined as previously described [24]. An increasing perpendicular force was applied to the central area of the plantar surface of the hind paw to induce flexion of the femur–tibia joint followed by paw withdrawal. The pressure of the force applied when the paw was withdrawn was recorded by a pressure meter. The test was performed by investigators blinded to the treatment and repeated until three consistent consecutive measurements (variation <1 g) were obtained. Mechanical threshold is expressed in grams, and hyperalgesia is equated to reduction of this threshold.

Cytokine measurements

Two hours after injection of NETs in WT, Tlr4/ and Tlr9/ knockout mice, the animals were terminally anaesthetized, and the knee joints were removed and homogenized in 500 µl of buffer containing protease inhibitors. TNF-α and IL-1β concentrations were determined as described previously [26] by ELISA using paired antibodies (R&D Systems, Minneapolis, MN, USA). The results are expressed as pg/mg of each cytokine.

Histological analysis

Femur–tibia joints were collected 24 h after the second challenge with mBSA, fixed in 10% buffered formalin for 2 days, decalcified in 14% ethylenediaminetetraacetic acid (pH 7.4) for 21 days and processed for histology. The paraffin blocks were cut into sagittal sections of 4 µm thickness. At least three serial vertical sections stained with haematoxylin and eosin were evaluated for each animal. Three independent observers who were blinded to the treatment graded the extent of synovitis (inflammatory cell influx, synovial hyperplasia and bone loss) as previously described [23]. The histological scoring system used was as follows: none (0), slight (1), mild (2), moderate (3) or severe (4) for inflammatory cell influx; synovial hyperplasia was scored 0–3, and bone loss was scored as present (1) or absent (0). The grades were summed to obtain an arthritis index (ranging from 0 to 8, with the results expressed as the mean histopathological score).

NET quantification

Articular cavity washes from mice and neutrophils isolated from blood RA patients and control individuals were used to quantify NETs. Briefly, an antibody bound to a 96-well clear-bottom black plate captured the enzyme MPO (PA5-16672, Thermo Fisher Scientific), and the amount of DNA bound to the enzyme was quantified using the Quant-iT™ PicoGreen® kit (Thermo Fisher Scientific) according to the manufacturer’s instructions. The fluorescence intensity (excitation at 488 nm and emission at 525 nm wavelength) was determined by a FlexStation 3 microplate reader (Molecular Devices, San Jose, CA, USA).

Reverse transcription–polymerase chain reaction assays

For the evaluation of Padi4 gene expression, AIA animals and their controls were euthanized 24 h after the second challenge with mBSA, and the joint washes of these animals were collected for RNA extraction using a Qiagen kit (Qiagen, Hilden, Germany) according to the directions supplied by the manufacturer. For the evaluation of Cox2 gene expression, synovial membranes were collected from naïve animals, WT animals and Tlr4, Tlr9, Tnfr1 and Il1r knockout mice 6 h after receiving 10 ng of i.a. NETs. Total cellular RNA from the synovial membrane was extracted using Trizol reagent (Thermo Fisher Scientific) according to the directions supplied by the manufacturer. Real-time quantitative PCR mRNA analysis was performed on an ABI Prism 7500 Sequence Detection System using the SYBR-green fluorescence system (Applied Biosystems, Foster City, California, USA) for quantification of amplicons. The primers used were the following: glyceraldehyde 3-phosphate dehydrogenase (Gapdh) forward: 5′-GGGTGTGAACCACGAGAAAT-3′; Gapdh reverse: 5′-CCTTCCACAATGCCAAAGTT-3′; Padi4 forward: 5′-TGACCAATGGATGCAGGACG-3′; Padi4 reverse: 5′-CTCTGTCCCTCGGGGAGTC-3′; Cox2 forward: 5′-GTGGAAAAACCTCGTCCAGA-3′; Cox2 reverse: 5′-GCTCGGCTTCCAGTATTGAG-3′.

Statistical analysis

The data are reported as the means (s.e.m.) and are representative of two separate experiments. Two-way ANOVA was used to compare the groups and doses at all times when the hyperalgesic responses were measured at different times after the stimulus injection. The means from different treatments were compared by one-way ANOVA with a Bonferroni correction or by Student’s t-test. Spearman’s rank-order correlation (r) was calculated to describe correlations between NET concentration from human neutrophils from RA patients and pain. P values <0.05 were considered significant. The experiments were repeated three times.

Results

NETs mediate joint edema and mechanical hyperalgesia in antigen-induced arthritis

First, we induced experimental arthritis through the AIA model with two challenges of mBSA (100 µg/joint) (Fig. 1A). The administration of mBSA (100 µg/joint) into the articular joint of immunized C57BL/6 mice induced a significant production of NETs compared with the control (saline injected i.a.) group. mBSA was administered into the joint injected 5 days prior with the same dose of mBSA, and the NET concentration in synovial fluid was determined 6, 12 and 24 h after the joint challenge. Compared with the controls (animals treated with saline), significant increases in the concentration of NETs were observed 12 h after the joint challenge, which was further enhanced at 24 h. The levels of NETs determined at 24 h were prevented by treatment of AIA animals with Pulmozyme (PLZ, 10 µg/joint) or Cl-amidine (1 mg/kg i.p.) 1 h before and 1 h after the second mBSA challenge (Fig. 1B). In addition, AIA animals had increased Padi4 gene expression in cells that emigrated into the articular joint, indicating that the increase in NET production may be associated with Padi4 expression (Fig. 1C). The pretreatment of AIA animals with PLZ or Cl-amidine reduced the oedema (Fig. 1D) and reduced the average histopathological score (Fig. 1E and F). Furhermore, PLZ and Cl-amidine treatment also reduced the joint hyperalgesia induced by mBSA (Fig. 1G).

NETs participate in the AIA model
Fig. 1

NETs participate in the AIA model

(A) AIA mice were immunized and challenged with mBSA twice, and the treatment with PLZ (10 µg/joint) was administrated 1 h before and 1 h after second challenge. (B) NET was quantified 6, 12 and 24 h after the second challenge with mBSA in AIA mice. Twenty-four hours after second challenge, NETs from AIA+PLZ mice were quantified. Mean (s.e.m.), n = 5/group. *P < 0.05 vs CT group; #P < 0.05 vs AIA group, one-way ANOVA followed by Bonferroni post hoc test. (C) Genic expression of Padi4 in joint neutrophils was evaluated 24 h after the second challenge. Mean (s.e.m.), n = 5/group. *P < 0.05 vs CT group, two-sided Student’s t-test. (D) Joint swelling was evaluated 24 h after second challenge. Mean (s.e.m.), n = 5/group. *P < 0.05 vs CT group; #P < 0.05 vs AIA group, one-way ANOVA followed by Bonferroni post hoc test. (E) Femur–tibia joints were collected 24 h after second challenge with mBSA, fixed and decalcified in EDTA (pH 7.4) for 21 days and processed. The paraffin blocks were cut into sagittal sections of 4 µm thickness. (F) Histopathological score representation. Mean (s.e.m.), n = 5/group. *P < 0.05 vs CT group; #P < 0.05 vs AIA group, two-sided Student’s t-test followed by Mann–Whitney test. (G) Articular hyperalgesia was evaluated 3, 6 and 24 h after the second challenge with mBSA. Mean (s.e.m.), n = 5/group. *P < 0.05 vs CT group; #P < 0.05 vs AIA group, two-way ANOVA followed by Bonferroni post hoc test. The experiments were repeated three times. AIA: antigen-induced arthritis; CT: control; EDTA: ethylenediaminetetraacetic acid; Gapdh: glyceraldehyde 3-phosphate dehydrogenase; mBSA: methylated bovine serum albumin; NETs: neutrophil extracellular traps; Padi4: peptidyl arginine deiminase 4; PLZ: Pulmozyme.

Participation of cytokines in NET-induced joint hyperalgesia

To add to the mechanism by which NETs mediate joint hyperalgesia, we investigated whether the administration of purified NETs into joints could induce hyperalgesia. Compared with saline, i.a. administration of NETs into naïve joints induced dose-dependent (5–20 ng/joint) mechanical hyperalgesia. The mechanical hyperalgesia was already significant 3 h after NET administration, reaching a peak at 6 h and maintaining significance until 24 h. The joint hyperalgesia induced by 10 and 20 ng of NETs was similar in intensity and duration to that induced by zymosan at 30 µg/joint (Fig. 2A). We also found that the ability of purified NETs to induce hyperalgesia depends on its structure, since i.a. administration of NETs previously incubated with PLZ for 3 h failed to induce hyperalgesic activity (Fig. 2B) or joint swelling (Fig. 2C).

NETs cause hyperalgesia dependent of TNF-α and IL-1β
Fig. 2

NETs cause hyperalgesia dependent of TNF-α and IL-1β

(A) Purified NETs (5, 10 or 20 ng) were injected in WT mice and articular hyperalgesia was evaluated 3, 6 and 24 h later. Mean (s.e.m.), n = 5/group. *P < 0.05 vs saline group, two-way ANOVA followed by Bonferroni post hoc test. (B) Purified NETs (10 ng) were incubated in vitro with PLZ (1:1) for 3 h and injected into joint of WT mice. Mean (s.e.m.), n = 5/group. *P < 0.05 vs saline group; #P < 0.05 vs NETs 10 ng group, two-way ANOVA followed by Bonferroni post hoc test. (C) Joint swelling was evaluated 24 h after injection i.a. of purified NETs (10 ng). Mean (s.e.m.), n = 5/group. *P < 0.05 vs saline group; #P < 0.05 vs NET 10 ng group, one-way ANOVA followed by Bonferroni post hoc test. (D) TNF-α was quantified in joint of WT mice 2 h after injection i.a. of purified NETs (10 ng). Mean (s.e.m.), n = 5/group. *P < 0.05 vs saline group, two-sided Student’s t-test. (E) Tnfr1−/− mice received purified NETs (10 ng) i.a. and articular hyperalgesia was evaluated 3, 6 and 24 h later. Mean (s.e.m.), n = 5/group. *P < 0.05 vs saline group; #P < 0.05 vs NET 10 ng group, two-way ANOVA followed by Bonferroni post hoc test. (F) IL-1β was quantified in joint of WT mice 2 h after injection i.a. of NET purified (10 ng). Mean (s.e.m.), n = 5/group. *P < 0.05 vs saline group, two-sided Student’s t-test. (G) Il1r−/− mice received purified NETs (10 ng) i.a. and articular hyperalgesia was evaluated 3, 6 and 24 h later. Mean (s.e.m.), n = 5/group. *P < 0.05 vs saline group; #P < 0.05 vs NET 10 ng group, two-way ANOVA followed by Bonferroni post hoc test. The experiments were repeated three times. i.a.: intra-articular; IL-1R, Il1r: IL-1 receptor; NETs: neutrophil extracellular traps; PLZ: Pulmozyme; TNFR-1, Tnfr1: TNF receptor 1; WT: wild type.

TNF-α and IL-1β are involved in joint hyperalgesia induced by mBSA in the AIA model [27]. Therefore, we investigated the possible involvement of these cytokines in NET-induced hyperalgesia. Similar to the administration of mBSA, i.a. administration of NETs induced significant production of TNF-α and IL-1β (Fig. 2D and F). Confirming the participation of these cytokines in NET-induced hyperalgesia, the administration of NETs in animals genetically deficient for Tnfr1 or Il1r receptor genes reduced the hyperalgesia 3 h later and prevented this response 6 and 24 h after NET injection, as observed in WT mice (Fig. 2E and G).

Participation of Toll-like receptors 4 and 9 in NET-induced hyperalgesia and cytokine production

Previously, it was demonstrated that inflammatory hyperalgesia depends on early activation of Toll-like receptors (TLRs), which coordinate the release of hyperalgesic cytokines [28]. To investigate the mechanism by which NETs are recognized in the joint to trigger local hyperalgesia, we tested the role of these two TLRs by injecting NETs i.a. into Tlr4- and Tlr9-deficient animals. Histones and DNA, constituents of the structure of NETs, are recognized by these two TLRs [29, 30]. These mice did not exhibit a reduced nociceptive threshold when purified NETs were injected i.a. (Fig. 3A and B), indicating that both receptors play a role in recognition of NETs. In addition, compared with WT mice, Tlr4/ and Tlr9/ mice injected with NETs presented a significant reduction of TNF-α and IL-1β concentrations in the joint (Fig. 3C and D), indicating that the release of these cytokines during NET-induced hyperalgesia depends on the activation of these receptors. Importantly, Tlr4/ and Tlr9/ mice have mechanical thresholds similar to WT mice since, when prostaglandin E2 (PGE2) was injected into TLR KO, the hyperalgesic response was similar to that observed in WT animals [31].

Recognition of NETs is dependent of TLR-4 and TLR-9 to causes hyperalgesia
Fig. 3

Recognition of NETs is dependent of TLR-4 and TLR-9 to causes hyperalgesia

(A) Tlr4−/− mice received purified NETs (10 ng) i.a. and articular hyperalgesia was evaluated 3, 6 and 24 h later. Mean (s.e.m.), n = 5/group. *P < 0.05 vs saline group; #P < 0.05 vs NET 10 ng group, two-way ANOVA followed by Bonferroni post hoc test. (B) Tlr9−/− mice received purified NETs (10 ng) i.a. and articular hyperalgesia was evaluated 3, 6 and 24 h later. Mean (s.e.m.), n = 5/group. *P < 0.05 vs saline group; #P < 0.05 vs NETs 10 ng group, two-way ANOVA followed by Bonferroni post hoc test. (C) TNF-α was quantified in joint of Tlr4−/− and Tlr9−/− mice 2 h after injection i.a. of purified NETs. Mean (s.e.m.), n = 5/group. *P < 0.05 vs saline group; #P < 0.05 vs NETs 10 ng group, one-way ANOVA followed by Bonferroni post hoc test. (D) IL-1β was quantified in joint of Tlr4−/− and Tlr9−/− mice 2 h after injection i.a. of purified NETs. Mean (s.e.m.), n = 5/group. *P < 0.05 vs saline group; #P < 0.05 vs NET 10 ng group, one-way ANOVA followed by Bonferroni post hoc test. The experiments were repeated three times. i.a.: intraarticular; NETs: neutrophil extracellular traps; TLR-4, Tlr4: Toll-like receptor 4; TLR-9, Tlr9: Toll-like receptor 9.

Participation of cyclooxygenase in NET-induced hyperalgesia

The treatment of WT animals that received NETs i.a. with indomethacin, a non-selective cyclooxygenase (COX) inhibitor (5 mg/kg, i.p.), prevented the mechanical hyperalgesia determined 6 h after NET injection (Fig. 4A). Previously, it was demonstrated that, during inflammatory hyperalgesia, the production of eicosanoids depends on the induction of COX-2 expression by the hyperalgesic cytokines [11]. Taking these findings into account, we further investigated the expression of Cox2 in the joint tissues of WT, Tlr4-, Tlr9-, Tnfr1- and Il1r-deficient mice injected with NETs i.a. Significantly increased expression of Cox2 was observed in WT mice when compared with the control group (animals injected with saline). On the other hand, Cox2 expression was partially reduced in all knockout groups compared with WT animals administered NETs i.a. (Fig. 4B). Together, the results suggest that COXs products participate of NETs-induced hyperalgesia.

NETs cause hyperalgesia dependent of COX-2
Fig. 4

NETs cause hyperalgesia dependent of COX-2

(A) WT mice were treated with indomethacin (5 mg/kg, i.p.) 1 h before injection of purified NETs (10 ng) i.a. and articular hyperalgesia was evaluated 6 h after the stimuli. Mean (s.e.m.), n = 5/group. *P < 0.05 vs saline group; #P < 0.05 vs NETs 10 ng group, one-way ANOVA followed by Bonferroni post hoc test. (B) Genic expression of Cox2 in joint was evaluated 6 h after injection of purified NETs (10 ng). Mean (s.e.m.), n = 5/group. *P < 0.05 vs saline group; #P < 0.05 vs NET 10 ng group, two-way ANOVA followed by Bonferroni post hoc test. The experiments were repeated three times. Cox2, COX-2: cyclooxygenase-2; Gapdh: glyceraldehyde 3-phosphate dehydrogenase; i.a.: intraarticular; Il1r: IL-1 receptor; i.p.: intraperitoneal; NETs: neutrophil extracellular traps; Tlr4: Toll-like receptor 4; Tlr9: Toll-like receptor 9; Tnfr1: TNF receptor 1; WT: wild type.

The pain level in RA patients is related to the concentration of NET production by circulating neutrophils

To translate these results, peripheral neutrophils isolated from 24 RA patients and 13 healthy subjects (Table 1) were cultured for 4 h, and the NET concentration was determined in the supernatants. Compared with healthy subjects, the neutrophils from RA patients released spontaneously (without any stimulus) higher levels of NETs (Fig. 5A). This result suggests that inflammatory mediators released during RA are stimulating the NET production by circulating neutrophils. Surprisingly, the VAS exhibited a positive correlation between the intensity of pain and the increased production of NETs (Fig. 5B), indicating a possible association between joint pain and peripheral neutrophil NET release.

Neutrophils from patients are more capable of releasing NETs and their concentration correlates with pain
Fig. 5

Neutrophils from patients are more capable of releasing NETs and their concentration correlates with pain

(A) Human neutrophils were isolated from peripheral blood from RA patients and individual controls. After 4 h the supernatants were used to quantify NETs. Mean (s.e.m.), two-sided Student’s t-test. (B) Concentration of NETs was correlated with pain scale. Spearman’s rank-order correlation (r) was calculated to describe correlations between the concentration of NETs released by human neutrophils and pain in RA patients. NETs: neutrophil extracellular traps.

Table 1

Clinical and laboratory profile of RA patients

PatientAge, yearsSexRheumatoid factor, IU/mlACPA, IU/mlDAS28VAS pain, 0–100NET, ng/ml
171F14.22243.294069.15
274F02781.53033.47
350M018.21.185012.2
447F06.23.926525.74
566F40287.17.849097.24
660F3282083.051043.58
751F332717.189043.58
871M687.32.09026.54
953F281200.95.8100156
1071F181076.3580189.61
1153F82202.83.482015.36
1264F1302211.532067.32
1339F2144.318033.88
1480F0109.72.190112.58
1566F40287.13.151033.80
1649F942135.9180161.6
1766M03.92.132042.78
1866M0164.6280150.03
1954F04.56.192012.53
2067M0256.66.5180101.23
2158F03.75.37020.48
2258F02.22.488059.6
2324F2212097.2690131.08
2457F02.94.527058.42
PatientAge, yearsSexRheumatoid factor, IU/mlACPA, IU/mlDAS28VAS pain, 0–100NET, ng/ml
171F14.22243.294069.15
274F02781.53033.47
350M018.21.185012.2
447F06.23.926525.74
566F40287.17.849097.24
660F3282083.051043.58
751F332717.189043.58
871M687.32.09026.54
953F281200.95.8100156
1071F181076.3580189.61
1153F82202.83.482015.36
1264F1302211.532067.32
1339F2144.318033.88
1480F0109.72.190112.58
1566F40287.13.151033.80
1649F942135.9180161.6
1766M03.92.132042.78
1866M0164.6280150.03
1954F04.56.192012.53
2067M0256.66.5180101.23
2158F03.75.37020.48
2258F02.22.488059.6
2324F2212097.2690131.08
2457F02.94.527058.42

VASpain: visual analogue scale for pain; NETs: neutrophil extracellular traps; ACPA: anti-citrullinated protein antibody.

Table 1

Clinical and laboratory profile of RA patients

PatientAge, yearsSexRheumatoid factor, IU/mlACPA, IU/mlDAS28VAS pain, 0–100NET, ng/ml
171F14.22243.294069.15
274F02781.53033.47
350M018.21.185012.2
447F06.23.926525.74
566F40287.17.849097.24
660F3282083.051043.58
751F332717.189043.58
871M687.32.09026.54
953F281200.95.8100156
1071F181076.3580189.61
1153F82202.83.482015.36
1264F1302211.532067.32
1339F2144.318033.88
1480F0109.72.190112.58
1566F40287.13.151033.80
1649F942135.9180161.6
1766M03.92.132042.78
1866M0164.6280150.03
1954F04.56.192012.53
2067M0256.66.5180101.23
2158F03.75.37020.48
2258F02.22.488059.6
2324F2212097.2690131.08
2457F02.94.527058.42
PatientAge, yearsSexRheumatoid factor, IU/mlACPA, IU/mlDAS28VAS pain, 0–100NET, ng/ml
171F14.22243.294069.15
274F02781.53033.47
350M018.21.185012.2
447F06.23.926525.74
566F40287.17.849097.24
660F3282083.051043.58
751F332717.189043.58
871M687.32.09026.54
953F281200.95.8100156
1071F181076.3580189.61
1153F82202.83.482015.36
1264F1302211.532067.32
1339F2144.318033.88
1480F0109.72.190112.58
1566F40287.13.151033.80
1649F942135.9180161.6
1766M03.92.132042.78
1866M0164.6280150.03
1954F04.56.192012.53
2067M0256.66.5180101.23
2158F03.75.37020.48
2258F02.22.488059.6
2324F2212097.2690131.08
2457F02.94.527058.42

VASpain: visual analogue scale for pain; NETs: neutrophil extracellular traps; ACPA: anti-citrullinated protein antibody.

Discussion

The participation of NETs in the pathology of autoimmune diseases, including RA, has already been described. During RA, NETs participate in joint tissue lesions [32]. However, the role of NETs in the pathophysiology of inflammatory pain, which is one of the major symptoms of RA and constitutes the highest complaint from patients [33], was not investigated. The data presented in this study demonstrated, for the first time, that NETs are released in the joints in the AIA model and mediate articular pain through activation of TLRs. Subsequently, cytokines are released that stimulate COX-2 expression. Moreover, in a translational manner, similarly to Khandpur and colleagues [32], we demonstrated that neutrophils from RA patients release more NETs than neutrophils from healthy individuals, and the levels of NETs in RA directly correlate with the clinical score of pain.

First, we first investigated if the mBSA challenge into the joints of AIA mice was capable of inducing NETs. We used this model because it has several similarities to RA, such as oedema formation, histopathological changes, increased proinflammatory cytokine production and joint hyperalgesia [24, 34, 35]. It has been shown that NET production increases in the AIA model, and NET levels are associated with increased expression of Padi4, the gene for an enzyme involved with the release of NETs [36]. Furthermore, the administration of purified NETs into naïve joints of mice induced dose- and time-dependent joint hyperalgesia and oedema. These events induced by the i.a. dose of 10 ng of NETs were similar to those induced by 30 µg of zymosan, a well-known inducer of joint pain and oedema [37]. The treatment of AIA mice with an inhibitor of PADI-4, Cl-amidine, reduced the joint oedema and hyperalgesia and the concentration of NETs. In addition to inhibiting PADI-4, NETs can be inhibited through DNases that degrade themselves, such as Pulmozyme, a deoxyribonuclease I used in the clinic to treat cystic fibrosis [38]. The Pulmozyme treatment reduced the concentration of NETs in the joints of AIA mice, and the animals showed reduced joint oedema, synovitis and joint hyperalgesia, events that have been associated with neutrophil migration [24, 39]. Furthermore, prior incubation of NETs with Pulmozyme inhibited their capacity to trigger oedema formation and joint hyperalgesia, indicating that the chemical structure of NETs is necessary for their action. These isolated NETs are purified and structurally have components like MPO and histone-H3 citrulline, and Hawez showed that phorbol 12-myristate 13-acetate can produce NETs with citrullination [40]. Thus, our data add knowledge of the mechanism involved in the arthritogenic and hyperalgesic effects of migrated neutrophils during AIA, events, at least in part, triggered by NET release. The Pulmozyme-treated animals showed a reduced nociceptive threshold fall (mechanical hyperalgesia) before the levels of NETs became statistically significant (3 h after the joint challenge), indicating that NETs are effective at mediating joint hyperalgesia, even at low concentrations. Corroborating our data, in the collagen-induced arthritis model, there was also an increase in NET production and the treatment of arthritic animals with a PADI-4 inhibitor reduced joint inflammation [16].

During inflammation, eicosanoids are produced mainly by COX induction [41]. Among the eicosanoids, PGE2 is one of the major mediators involved in the sensitization of primary sensitive neurons [11]. This explains the clinical effectiveness of COX inhibitors in the control of inflammatory hyperalgesia [42]. Our research group and others have demonstrated that the induction of COX-2 is mediated by cytokines (TNF-α and IL-1β) released at the inflammatory site, including inflamed joints [11, 43]. Considering these findings, we investigated a possible mechanism by which NETs could induce joint hyperalgesia. First, we demonstrated that purified NETs, but not degraded NETs, induce the production of TNF-α and IL-1β, which mediate joint hyperalgesia, since mice genetically deficient for Tnfr1 or Il1r did not develop NET-induced hyperalgesia, mainly in the latter phase of the response. These cytokines probably are involved with the maintenance of hyperalgesia, since our results show that at the beginning of pain response the animals deficient of these cytokines did not present significate reduction of NET-induced hyperalgesia. Consistently, AIA animals treated with etanercept, a TNF-blocker, or an antibody against IL-1β presented reduced hyperalgesia [44, 45].

TLRs play a central role in regulating innate immunity, recognizing the inflammatory stimuli and triggering the host innate response [46]. A previous study demonstrated that joint pain induced by different stimuli, including mBSA, is triggered by TLRs and nucleotide-binding oligomerization domain-like (NLRs) receptors [47, 48]. Histones, a critical constituent of NETs, can be recognized via TLR-4, and DNA, another important constituent of NETs, by TLR-9 [49, 50]. Accordingly, Tlr4- or Tlr9-deficient mice injected i.a. with purified NETs did not present a mechanical threshold fall as observed in WT mice; furthermore, no increases in articular concentrations of TNF-α or IL-1β were observed. We also observed that the Tlr4-, Tlr9-, Tnfr1- and Il1r-deficient mice had reduced expression of Cox2 upon i.a. injection of purified NETs. Confirming the participation of COX-2 in NET-induced hyperalgesia, treatment of mice with indomethacin inhibited the NET-induced joint hyperalgesia. From a clinical perspective, neutrophils from RA patients cultured in vitro were more prone to release of NETs than those of healthy controls, which in turn correlated positively with the VAS of joint pain, suggesting the same behaviour for synovial fluid neutrophils.

In conclusion, we describe for the first time that NETs released in joints in the AIA model of arthritis induce the release of TNF-α and IL-1β possibly via TLR-4 and TLR-9. Subsequently, these cytokines lead to increase of COX-2 expression, contributing to hyperalgesia. Thus, inhibition of NET production could be a new potential target for analgesic therapies for inflammatory pain.

Acknowledgements

We are grateful for the excellent technical assistance of Lívia Ambrósio, Marcella Daruge, Juliana Abumansur, Ieda Regina dos Santos, Sérgio Roberto Rosa, Ana Kátia dos Santos and Diva Montanha. All authors were involved in drafting the article or revising it critically for important intellectual content, and all authors approved the final version to be published. A.H.S. conceived and designed the study, planned and performed all the experiments, analysed the data and drafted the manuscript. C.C.M. and A.M.G.M. contributed to performing several experiments and helped revise the manuscript. F.F.L.S., L.C.B. and R.D.R.O. contributed to the human data and helped revise the manuscript. S.Y.F. and T.A.S. designed the study, planned the experiments, contributed to histological staining and analyses, and helped to revise the manuscript. J.C.A.F., T.M.C., P.L.J. and F.Q.C. designed the study, planned the experiments, analysed the data and drafted the manuscript.

Funding: The research leading to these results received funding from the São Paulo Research Foundation (FAPESP) under grant agreement no. 2013/08216-2 (Center for Research in Inflammatory Diseases—CRID). The project also had support from CAPES and CNPq, Brazil.

Disclosure statement: The authors have declared no conflicts of interest.

Data availability statement

The data under lying this article are available in the article and in its online supplementary material.

Supplementary data

Supplementary data are available at Rheumatology online.

References

1

Silman
AJ
,
Pearson
JE.
Epidemiology and genetics of rheumatoid arthritis
.
Arthritis Res
2002
;
4
:
S265
72
.

2

Waaler
E.
On the occurrence of a factor in human serum activating the specific agglutination of sheep red corpuscles
.
Acta Pathol Microbiol Scand
2009
;
17
:
172
88
.

3

Bläß
S
,
Engel
J-M
,
Burmester
G-RD.
The immunologic homunculus in rheumatoid arthritis
.
Arthritis Rheum
1999
;
42
:
2499
506
.

4

Buchbender
C
,
Ostendorf
B
,
Mattes-György
K
et al.
Synovitis and bone inflammation in early rheumatoid arthritis: high-resolution multi-pinhole SPECT versus MRI
.
Diagn Interv Radiol
2013
;
19
:
20
4
.

5

Kerlan-Candon
S
,
Combe
B
,
Vincent
R
et al.
HLA-DRB1 gene transcripts in rheumatoid arthritis
.
Clin Exp Immunol
2001
;
124
:
142
9
.

6

Heliovaara
M
,
Aho
K
,
Aromaa
A
,
Knekt
P
,
Reunanen
A.
Smoking and risk of rheumatoid arthritis
.
J Rheumatol
1993
;
20
:
1830
5
.

7

McInnes
IB
,
Schett
G.
The pathogenesis of rheumatoid arthritis
.
N Engl J Med
2011
;
365
:
2205
19
.

8

Edwards
RR
,
Wasan
AD
,
Bingham
CO
et al.
Enhanced reactivity to pain in patients with rheumatoid arthritis
.
Arthritis Res Ther
2009
;
11
:
R61
.

9

Rittner
HL
,
Mousa
SA
,
Labuz
D
et al.
Selective local PMN recruitment by CXCL1 or CXCL2/3 injection does not cause inflammatory pain
.
J Leukoc Biol
2006
;
79
:
1022
32
.

10

Cunha
FQ
,
Poole
S
,
Lorenzetti
BB
,
Ferreira
SH.
The pivotal role of tumour necrosis factor alpha in the development of inflammatory hyperalgesia
.
Br J Pharmacol
1992
;
107
:
660
4
.

11

Cunha
TM
,
Verri
WA
Jr
,
Schivo
IR
et al.
Crucial role of neutrophils in the development of mechanical inflammatory hypernociception
.
J Leukoc Biol
2008
;
83
:
824
32
.

12

Pelletier
M
,
Maggi
L
,
Micheletti
A
et al.
Evidence for a cross-talk between human neutrophils and Th17 cells
.
Blood
2010
;
115
:
335
43
.

13

Klebanoff
SJ.
Myeloperoxidase: friend and foe
.
J Leukoc Biol
2005
;
77
:
598
625
.

14

Wang
CH
,
Dai
JY
,
Wang
L
et al.
Expression of CD147 (EMMPRIN) on neutrophils in rheumatoid arthritis enhances chemotaxis, matrix metalloproteinase production and invasiveness of synoviocytes
.
J Cell Mol Med
2011
;
15
:
850
60
.

15

Kumar
S
,
Gupta
E
,
Kaushik
S
,
Jyoti
A.
Neutrophil extracellular traps: formation and involvement in disease progression
.
Iran J Allergy Asthma Immunol
2018
;
17
:
208
20
.

16

Willis
VC
,
Banda
NK
,
Cordova
KN
et al.
Protein arginine deiminase 4 inhibition is sufficient for the amelioration of collagen-induced arthritis
.
Clin Exp Immunol
2017
;
188
:
263
74
.

17

Villanueva
E
,
Yalavarthi
S
,
Berthier
CC
et al.
Netting neutrophils induce endothelial damage, infiltrate tissues, and expose immunostimulatory molecules in systemic lupus erythematosus
.
J Immunol
2011
;
187
:
538
52
.

18

Hakkim
A
,
Fürnrohr
BG
,
Amann
K
et al.
Impairment of neutrophil extracellular trap degradation is associated with lupus nephritis
.
Proc Natl Acad Sci USA
2010
;
107
:
9813
8
.

19

Jorch
SK
,
Kubes
P.
An emerging role for neutrophil extracellular traps in noninfectious disease
.
Nat Med
2017
;
23
:
279
87
.

20

Papadaki
G
,
Kambas
K
,
Choulaki
C
et al.
Neutrophil extracellular traps exacerbate Th1-mediated autoimmune responses in rheumatoid arthritis by promoting DC maturation
.
Eur J Immunol
2016
;
46
:
2542
54
.

21

Aletaha
D
,
Neogi
T
,
Silman
AJ
et al.
Rheumatoid arthritis classification criteria: an American College of Rheumatology/European League Against Rheumatism collaborative initiative
.
Arthritis Rheum
2010
;
62
:
2569
81
.

22

Bird
SB
,
Dickson
EW.
Clinically significant changes in pain along the visual analog scale
.
Ann Emerg Med
2001
;
38
:
639
43
.

23

Pinto
LG
,
Talbot
J
,
Peres
RS
et al.
Joint production of IL-22 participates in the initial phase of antigen-induced arthritis through IL-1β production
.
Arthritis Res Ther
2015
;
17
:
235
.

24

Pinto
LG
,
Cunha
TM
,
Vieira
SM
et al.
IL-17 mediates articular hypernociception in antigen-induced arthritis in mice
.
Pain
2010
;
148
:
247
56
.

25

Noubouossie
DF
,
Whelihan
MF
,
Yu
YB
et al.
In vitro activation of coagulation by human neutrophil DNA and histone proteins but not neutrophil extracellular traps
.
Blood
2017
;
129
:
1021
29
.

26

Cunha
TM
,
Verri
WA
Jr
,
Silva
JS
et al.
A cascade of cytokines mediates mechanical inflammatory hypernociception in mice
.
Proc Natl Acad Sci USA
2005
;
102
:
1755
60
.

27

Sachs
D
,
Coelho
FM
,
Costa
VV
et al.
Cooperative role of tumour necrosis factor-α, interleukin-1β and neutrophils in a novel behavioural model that concomitantly demonstrates articular inflammation and hypernociception in mice
.
Br J Pharmacol
2011
;
162
:
72
83
.

28

Su
M
,
Ran
Y
,
He
Z
et al.
Inhibition of toll-like receptor 4 alleviates hyperalgesia induced by acute dural inflammation in experimental migraine
.
Mol Pain
2018
;
14
:
1744806918754612
.

29

Xu
J
,
Zhang
X
,
Monestier
M
,
Esmon
NL
,
Esmon
CT.
Extracellular histones are mediators of death through TLR2 and TLR4 in mouse fatal liver injury
.
J Immunol
2011
;
187
:
2626
31
.

30

Müller
T
,
Hamm
S
,
Bauer
S.
TLR9-mediated recognition of DNA
.
Handb Exp Pharmacol
2008
;
183
:
51
70
.

31

Calil
IL
,
Zarpelon
AC
,
Guerrero
AT
et al.
Lipopolysaccharide induces inflammatory hyperalgesia triggering a TLR4/MyD88-dependent cytokine cascade in the Mice Paw
.
PLoS One
2014
;
9
:
e90013
.

32

Khandpur
R
,
Carmona-Rivera
C
,
Vivekanandan-Giri
A
et al.
NETs are a source of citrullinated autoantigens and stimulate inflammatory responses in rheumatoid arthritis
.
Sci Transl Med
2013
;
5
:
178ra40
.

33

Lee
YC.
Effect and treatment of chronic pain in inflammatory arthritis
.
Curr Rheumatol Rep
2013
;
15
:
300
.

34

Royzman
D
,
Andreev
D
,
Stich
L
et al.
Soluble CD83 triggers resolution of arthritis and sustained inflammation control in IDO dependent manner
.
Front Immunol
2019
;
10
:
633
. doi:10.3389/fimmu.2019.00633.

35

Zarpelon
AC
,
Fattori
V
,
Souto
FO
et al.
The sesquiterpene lactone, budlein A, inhibits antigen-induced arthritis in mice: role of NF-κB and cytokines
.
Inflammation
2017
;
40
:
2020
32
.

36

Claushuis
TAM
,
van der Donk
LEH
,
Luitse
AL
et al.
Role of peptidylarginine deiminase 4 in neutrophil extracellular trap formation and host defense during Klebsiella pneumoniae-induced pneumonia-derived sepsis
.
J Immunol
2018
;
201
:
1241
52
.

37

Guazelli
CFS
,
Staurengo-Ferrari
L
,
Zarpelon
AC
et al.
Quercetin attenuates zymosan-induced arthritis in mice
.
Biomed Pharmacother
2018
;
102
:
175
84
.

38

Albadawi
H
,
Oklu
R
,
Raacke Malley
RE
et al.
Effect of DNase I treatment and neutrophil depletion on acute limb ischemia-reperfusion injury in mice
.
J Vasc Surg
2016
;
64
:
484
93
.

39

Verri
WA
Jr ,
Cunha
TM
,
Parada
CA
et al.
IL-15 mediates immune inflammatory hypernociception by triggering a sequential release of IFN-γ, endothelin, and prostaglandin
.
Proc Natl Acad Sci USA
2006
;
103
:
9721
5
.

40

Hawez
A
,
Al-Haidari
A
,
Madhi
R
,
Rahman
M
,
Thorlacius
H.
MiR-155 regulates PAD4-dependent formation of neutrophil extracellular traps
. Front Immunol
2019
;
10
:
2462
. doi: 10.3389/fimmu.2019.02462

41

Schuligoi
R
,
Amann
R
,
Prenn
C
,
Peskar
BA.
Effects of the cyclooxygenase-2 inhibitor NS-398 on thromboxane and leukotriene synthesis in rat peritoneal cells
.
Inflamm Res
1998
;
47
:
227
30
.

42

Sinatra
R.
Role of COX-2 inhibitors in the evolution of acute pain management
.
J Pain Symptom Manage
2002
;
24
:
S18
27
.

43

Ke
J
,
Long
X
,
Liu
Y
et al.
Role of NF-κB in TNF-α-induced COX-2 expression in synovial fibroblasts from human TMJ
.
J Dent Res
2007
;
86
:
363
7
.

44

Boettger
MK
,
Hensellek
S
,
Richter
F
et al.
Antinociceptive effects of tumor necrosis factor α neutralization in a rat model of antigen-induced arthritis: evidence of a neuronal target
.
Arthritis Rheum
2008
;
58
:
2368
78
.

45

Ebbinghaus
M
,
Uhlig
B
,
Richter
F
et al.
The role of interleukin-1β in arthritic pain: main involvement in thermal, but not mechanical, hyperalgesia in rat antigen-induced
Arthritis. Arthritis Rheum
2012
;
64
:
3897
907
.

46

Kanzok
SM
,
Hoa
NT
,
Bonizzoni
M
et al.
Origin of Toll-like receptor-mediated innate immunity
.
J Mol Evol
2004
;
58
:
442
8
.

47

Lacagnina
MJ
,
Watkins
LR
,
Grace
PM.
Toll-like receptors and their role in persistent pain
.
Pharmacol Ther
2018
;
184
:
145
58
.

48

McCormack
WJ
,
Parker
AE
,
O'Neill
LA.
Toll-like receptors and NOD-like receptors in rheumatic diseases
.
Arthritis Res Ther
2009
;
11
:
243
.

49

Tadie
JM
,
Bae
HB
,
Jiang
S
et al.
HMGB1 promotes neutrophil extracellular trap formation through interactions with Toll-like receptor 4
.
Am J Physiol Lung Cell Mol Physiol
2013
;
304
:
L342
9
.

50

Liu
L
,
Mao
Y
,
Xu
B
et al.
Induction of neutrophil extracellular traps during tissue injury: involvement of STING and Toll-like receptor 9 pathways
.
Cell Prolif
2019
;
52
:
e12579
.

This article is published and distributed under the terms of the Oxford University Press, Standard Journals Publication Model (https://academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model)

Supplementary data

Comments

0 Comments
Submit a comment
You have entered an invalid code
Thank you for submitting a comment on this article. Your comment will be reviewed and published at the journal's discretion. Please check for further notifications by email.