Abstract

Background

Immunotherapy is an effective “precision medicine” treatment for several cancers. Imaging signatures of the underlying genome (radiogenomics) in glioblastoma patients may serve as preoperative biomarkers of the tumor-host immune apparatus. Validated biomarkers would have the potential to stratify patients during immunotherapy clinical trials, and if trials are beneficial, facilitate personalized neo-adjuvant treatment. The increased use of whole genome sequencing data, and the advances in bioinformatics and machine learning make such developments plausible. We performed a systematic review to determine the extent of development and validation of immune-related radiogenomic biomarkers for glioblastoma.

Methods

A systematic review was performed following PRISMA guidelines using the PubMed, Medline, and Embase databases. Qualitative analysis was performed by incorporating the QUADAS 2 tool and CLAIM checklist. PROSPERO registered: CRD42022340968. Extracted data were insufficiently homogenous to perform a meta-analysis.

Results

Nine studies, all retrospective, were included. Biomarkers extracted from magnetic resonance imaging volumes of interest included apparent diffusion coefficient values, relative cerebral blood volume values, and image-derived features. These biomarkers correlated with genomic markers from tumor cells or immune cells or with patient survival. The majority of studies had a high risk of bias and applicability concerns regarding the index test performed.

Conclusions

Radiogenomic immune biomarkers have the potential to provide early treatment options to patients with glioblastoma. Targeted immunotherapy, stratified by these biomarkers, has the potential to allow individualized neo-adjuvant precision treatment options in clinical trials. However, there are no prospective studies validating these biomarkers, and interpretation is limited due to study bias with little evidence of generalizability.

Key Points
  • There are few studies that aim to develop or validate immune-related radiogenomic biomarkers for glioblastoma.

  • Radiological biomarkers of key components of the tumor-host immune apparatus have been developed based on apparent diffusion coefficient values, cerebral blood volume values, or radiomics.

Importance of the Study

We present the first systematic review of immune-related radiogenomic biomarker studies for glioblastoma. Radiological biomarkers of the tumor-host immune apparatus based on apparent diffusion coefficient values, cerebral blood volume values, and image-derived features including VASARI (Visually AcceSAble Rembrandt Images) and more complex radiomics have been developed within the last decade. The summarized evidence provides a basis to further develop and validate future immune-related radiogenomic biomarkers. If validated, these biomarkers have the potential to be further utilized for patient stratification during immunotherapy clinical trials for glioblastoma.

Radiogenomics focuses on the relationship between genomics and imaging phenotypes and is increasingly being applied in the research setting to characterize tumors which can be heterogeneous. Characterization might be useful to determine an individual’s likelihood of disease progression or immune responsiveness.1–5 Due to their infiltrative nature, diffuse gliomas typically have a very poor prognosis with the most common type glioblastoma, having a median overall survival of only 14.6 months despite standard-of-care treatment (which generally comprises surgery with maximal safe tumor resection, followed by radiotherapy with concomitant and adjuvant temozolomide chemotherapy).6,7 Recent immunotherapy trials have shown that a subgroup of glioblastoma patients benefit from immune checkpoint inhibitors.8–10 Furthermore, in a randomized multicenter trial of recurrent glioblastoma, anti-programmed cell death protein-1 (PD-1) neo-adjuvant immunotherapy has shown survival benefit.11 The challenge, however, is that the majority of patients in these studies have shown poor response to immunotherapy, attributable to the immunosuppressive tumor microenvironment (TME) with limited presence of immune cell populations. Current immunotherapies such as PD-1/PD-L1 inhibitors and chimeric antigen receptor T-cell therapy depend on the presence of these tumor-infiltrating lymphocytes within the TME, but these constitute only 10%–15% of all tumor-associated leukocytes.12,13 In addition, PD-1 expression in human glioma tissues is relatively low as compared to other cancers and is heterogeneous.14 Despite these challenges, there has been an increased interest in tumor-host immune apparatus target identification in glioblastoma.9,11 One such area of interest has been to identify preoperative imaging biomarkers that can stratify patients for neo-adjuvant treatment after diagnostic magnetic resonance imaging (MRI). Early and noninvasive diagnosis and treatment therefore has the potential to improve patient quality of life and prolong survival. Noninvasive biomarkers monitoring immunotherapy may also improve patient care.1–5

Herein we systematically reviewed 9 studies that developed and validated MRI biomarkers that have the potential to be used, or have been used, for glioblastoma immunotherapy. The primary objective was to analyze immune-related radiogenomic biomarkers. The secondary objective was to highlight alternative methods to develop immunotherapy biomarkers which were not radiogenomic.

Materials and Methods

We performed a systematic review (registered in PROSPERO; ID number CRD42022340968) of immune-related radiogenomic biomarkers in glioblastoma. The search strategy followed Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA)15 (Figure 1; Supplementary Table S1).

Search strategy of systematic review for immune-related radiogenomic biomarkers in glioblastoma.
Figure 1.

Search strategy of systematic review for immune-related radiogenomic biomarkers in glioblastoma.

Search Strategy and Selection Criteria

Search terms were applied to PubMed, MEDLINE, and EMBASE databases using medical subject headings (MeSH) terms16 to identify original research articles published from January 1990 to January 2023 (Supplementary Table S2). A low-precision “high sensitivity search”17 was conducted using subject headings and exploding terms. Studies not published in English,18 editorials, conference proceedings, commentaries, letters, book chapters, laboratory-based or animal studies, preprints, or articles without peer review were excluded.

Inclusion Criteria

The patients studied were adults aged over 18 diagnosed with glioblastoma. All studies with abstracts where MRI was used to develop and/or validate biomarkers of the tumor-host immune apparatus were included.

Exclusion Criteria

All studies related to non-glial tumors; pediatric patients; vaccine trials; imaging other than MRI; and invasive studies including intratumoral injections or nanoparticle administration, were excluded.

Appraisal of Quality

The Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS 2) tool19 was used to assess the quality of the studies focusing on risk of bias and concerns regarding applicability. Relevant items from the Checklist for Artificial Intelligence in Medical Imaging (CLAIM) were also used to appraise studies20 (Supplementary Table S3).

Data Extraction

Data related to the type of study; MRI sequences; genomic markers; radiological markers, and their performance accuracy; and machine learning techniques employed, were extracted. Biomarkers were defined as diagnostic, prognostic, predictive, or monitoring according to the FDA-NIH BEST (Biomarkers, Endpoints, and other Tools) applied to neuro-oncology.21

Data Analysis

PG, a neurosurgeon with 6 years of clinical and research experience performed the literature search, which was independently reviewed by TB, a neuroradiologist with 15 years of clinical and research experience. Any discrepancies were resolved after discussion. A meta-analysis could not be performed due to a lack of sufficient homogenous data from the systematic review and marked heterogeneity in the methodology of studies.

Results

Nine studies were included from 686 screened studies based on the PRISMA assessment (Figure 1). All studies22–30 were retrospective and published after 2016 following the release of iRANO criteria for assessment of response to immunotherapy.31 Seven studies were radiogenomic and were the focus of the systematic review to achieve the primary objective (Table 1). The remaining 2 were non-radiogenomic (Table 2) but included for illustrative purposes to highlight how researchers can develop immunotherapy biomarkers without any association with genomic information (secondary objective).

Table 1.

Characteristics of Radiogenomic Studies Included in the Systematic Review

PaperStudy designTarget conditionDataset(s)Available demographic information
% male
Age (mean ± SD)
Ethnicity n (%)
Reference standardIndex testIndex test features selectedType of test setTest set performance
Cho HR et al., 201819Retrospective
Single center
Myeloid cell marker expression level (CD11b, CD68, CSF1R, CD163, CD33,
CD123, CD83, CD63, CD49d, CD117)
Lymphoid cell marker expression level (CD4, Cd3e, CD25, CD8)
60 patients
Preoperative MRI: T2 FLAIR
T1 CE, ADC, DSC
Manual Segmentation of VOI
58% male
Mean age 54.2 ± 11.4
Data from Korea
Ethnicity: N/A
RNA-level analysis using quantitative RT-PCRCBV & ADC & tumor volumenCBV within T2 FLAIR VOI (whole tumor) & T1 CE VOI (enhancing tumor) masks for CD68, CSF1R, CD33 & CD4.
nCBV within T1 CE VOI (enhancing tumor) mask for CD11b.
ADC within T2 FLAIR VOI (whole tumor) & T1 CE VOI (enhancing tumor) masks for CD49d & CD3e.
ADC within T2 FLAIR VOI (whole tumor) mask for CD33 & CD123.
ADC within T1 CE VOI (enhancing tumor) mask for CD25.
FLAIR volume (whole tumor) & T1 CE VOI (enhancing tumor) mask
for CD123, CD49d & CD117.
N/A
(Train set only)
N/A
(Train set only: index test features selected if P value < .05 with Pearson’s correlation analysis)
Liao X et al., 201920Retrospective
Multicenter
Prognosis:
Survival data (< 1 year & > 1 year)–not immune-related
Diagnosis:
Immune-related & non-immune-related gene expression levels including:
EREG,
TIMP1,
CHIT1,
ROS1
137 patients—MRI data
Preoperative MRI: T2 FLAIR
MRI data:
Training: 70%
Test set: 30%
Manual Segmentation of VOI
129 patients—Gene expression level and survival
46 patients -Intersection data (Gene expression level and MRI)
63.2% male
Mean age 61.7 ± 12.7
Data from US
Ethnicity: N/A
Prognosis:
Survival data (< 1 year and > 1 year)
Diagnosis:
RNA-level analysis using quantitative RT-PCR
4 different models: GBDT, logistic regression, SVM, KNN72 radiomic features from T2 FLAIR MRI VOI selected for survival
(first order and texture)
Prognosis:
Internal hold out
(72 radiomic features & survival; n = 129)
Diagnosis:
N/A
(Train set only:72 radiomic features & gene expression level; n = 46)
Prognosis:
GBDT accuracy = 0.81
AUC-ROC = 0.79 < 1 year; & = 0.81 > 1 year
Diagnosis:
N/A
(Train set only:
moderate (0.3 < |r| < 0.5) to high (|r| > 0.5) Pearson’s correlation)
Jajamovich GH et al., 201622Retrospective
Multicenter
Gene expression level signatures including dendritic cell maturation
Molecular subtypes of glioblastoma
12 042 genes for 558 patients (TCGA)
Matched preoperative MRI data from 50 patients (TCIA)
Preoperative MRI: T1, T1 CE, DWI, ADC
Semi-automatic segmentation of VOI (Growcut method)
Gene data: 39% male, average age: 58.3 ± 14.2
MRI data:
66% male
Mean age: 60.7 ± 12.6
15 mesenchymal, 10 classical, 16 neural & 9 proneural glioblastoma patients with MRI images
Data from US
Ethnicity: N/A
RNA-level microarray analysis
Molecular subtypes using nearest-centroid-based classification
Gene signature subgroups based on k-means clustering
ADC (mean, SD, skewness, kurtosis, entropy)Mean ADC values from T1 CE VOI (enhancing tumor) mask selected for (1) tumor molecular subtypes & (2) other subgroups of gene signature (including immune response related subgroup containing CD4, CD86, major histocompatibility complex class I and II).N/A
(Train set only)
N/A
(Train set only:
Neural vs non-neural subtypes (P = .02, AUC-ROC = 0.75, CI: 0.57–0.88)
(Train set only: index test features selected if P value < .05 with Spearman’s correlation analysis. Gave ρ = −0.51 for immune response-related subgroup.)
Liu D et al., 202323Retrospective
Multicenter
Immune cell infiltration scoreFor the development and validation of immune cell infiltration score:
(1) Discovery Set TCGA & GEO cohort (n = 400 patients; Gene expression level & survival)
(2) Validation Set CGGA cohort (n = 374 patients; Gene expression level & survival)
Matched dataset TCGA-TCIA and CPTAC cohorts (n = 70; Gene expression level & MRI and survival)
Independent dataset NBH cohort (n = 149; MRI and survival)
Preoperative MRI: T1 CE, T2
Manual segmentation of VOI
TCGA cohort: 64.8% male
Mean age: 59.41 (SD 13.7)
GEO cohort
58.5% male
Mean age 52.06 (SD 13.6)
CCGA cohort
60.4% male
Mean age: 48.12 (SD 13.37)
Matched cohort:
62.9% male
Mean age: 60.34 (SD 12.67)
NBH cohort:
59.1% male
Mean age: 59.17 (SD 10.6)
Data from US & China
Ethnicity: N/A
Diagnosis:
LM22 signature for immune cell expression using CIBERSORT. Immune & stromal content using ESTIMATE.
Immune cell infiltration score = ΣPC1A −ΣPC1B
Grouped as high or low immune cell infiltration score
Prognosis:
Survival data
SVM Model11 radiomic features from MRI T2 & T1 CE VOI were selected for immune cell infiltration grouping.
(note: high interrater reliability of features was also a selection criterion)
Diagnosis:
cross-validation only (11 radiomic features & immune cell infiltration group; n = 70)
Prognosis:
External hold-out (11 radiomic features & survival; n = 149)
Diagnosis:
cross-validation only AUC-ROC = 0.96; accuracy = 0.94; recall = 0.91;
F1 score = 0.93
Prognosis:
Cox HR = 0.63 (0.46–0.88; P = .051)
Rao et al., 201624Retrospective
Multicenter
Prognosis:
Survival (median survival difference of 1 year)-not immune-related
Diagnosis:
gene expression levels (immune-related & non-immune-related; mRNA & miRNA expression data)
92 patients:
44 patients-training set; 48 patients-test set
Preoperative MRI: VASARI (Visually AcceSAble Rembrandt Images) standardized feature set from T1, T2, T1 CE, T2 FLAIR MRI images
No segmentation performed for the study
65% male
Age: N/A
Data from US
Ethnicity: N/A
Prognosis: Survival data (OS, PFS)
Diagnosis:
Normalized gene expression data from mRNA sequencing
k-adaptive partitioned
VASARI features: volume-class, enhancement quality, proportion contrast-enhancing tumor, proportion noncontrast-enhancing tumor, proportion necrosis, proportion edema, T1/FLAIR-envelope ratio, enhancing margin thickness, distribution, & hemorrhage
3 radiomic features
(volume-class,
T1/FLAIR ratio,
hemorrhage) selected for
survival
(> 2: Group 1; ≤ 2: Group 0)
Prognosis:
Internal hold-out
(radiomic feature groups & survival/PFS; n = 48)
Diagnosis:
N/A
(Train set only;
radiomic groups & gene expression level; n = 48)
Prognosis:
High (median: 19 months) vs low survival (median: 7 months) group logrank test P = .0001
PFS P = .058
Diagnosis:
N/A
(Train set only: radiomic groups have differential gene expression; with 10 combinations representing immune-related & metabolic pathways when multiple testing corrections for significance with false discovery rate cut off:0.1)
Narang et al., 201725Retrospective
Multicenter
Gene expression levels related to CD3 T cell activity79 patients (TCGA) used for biomarker development
Preoperative MRI: T1 CE, T2 FLAIR
Training and testing MD Anderson cohort: n = 69; 35 patients- training set; 34 patients- test set
Semi-automatic segmentation of VOI
52% male
Mean age: 57.96 (SD 13.8)
Data from US
Biomarker development: Normalized gene expression data for CD3E/D/G from mRNA sequencing
Training and testing dataset: CD3 immunohistochemistry-derived cell counts
Symbolic regression model6 texture-based radiomic features (GLSZM, kurtosis, NGTDM)Diagnosis:
Internal hold-out
(radiomic features & dichotomized CD3 counts (n = 34)
CD3 prediction model (using 6 features) AUC-ROC = 0.85 (95% CI: 0.66–0.94)
Accuracy = 0.77 (95% CI: 0.59–0.89); recall = 0.73; F1 score = 0.80
Hsu et al., 202026Retrospective
Multicenter
Diagnosis:
Gene Expression levels & corresponding immune signatures (CTL, aDC, Treg, MDSC)
Prognosis:
Survival (median OS)
154 samples (TCGA RNAseq data)
116 patients (TCIA MRI data)
Matched data for training (MRI & gene expression): 32
Independent Test data: 84 (MRI, survival; limited gene expression data)
Preoperative MRI: T1 CE, DWI
Manual segmentation of VOI
60% male
Median age: 62.5 (Q1–Q3: 52.3–70.3; training data); 59 (Q1–Q3: 52.0–66.0; test data)
Data from US
Ethnicity: N/A
Diagnosis:
Gene set enrichment analysis to obtain enrichment levels of immune cells; categorized into immune signatures.
Normalized gene expression data from mRNA sequencing & microarray
Prognosis:
Survival data (OS)
Logistic regression2–18 radiomics features: first order, GLRLM, GLCM from ADC (and T1 CE, from within T1 CE VOI mask; selected for each immune signature.
Also radiomics features: selected for survival group (median OS > 500 days) vs < 270 days survival).
Diagnosis:
cross-validation only
(radiomic features & immunophenotype groups; n = 32)
Internal hold-out
N/A
(radiomic features & limited immunophenotype groups; n = 84)
Prognosis:
Internal hold-out
N/A
(T1 CE trained model radio-immune patient groups & survival data;
n = 84)
Diagnosis:
cross-validation only:
CTL:
Accuracy: 0.72 (T1 CE), 0.71 (ADC);
AUC: 0.70 (T1 CE)
aDC:
Accuracy: 0.75 (T1 CE), 0.61 (ADC);
AUC: 0.74 (T1 CE); 0.61 (ADC)
Treg:
Accuracy: 0.81 (T1 CE), 0.68 (ADC);
AUC: 0.77 (T1 CE), 0.56 (ADC)
MDSC:
Accuracy: 0.88 (T1 CE), 0.79 (ADC); AUC: 0.85 (T1 CE), 0.70 (ADC)
Prognosis:
Internal hold out for comparison of immunophenotypes: for 2 selected types (median OS > 500 days vs < 270 days survival) group logrank test P = .02
PaperStudy designTarget conditionDataset(s)Available demographic information
% male
Age (mean ± SD)
Ethnicity n (%)
Reference standardIndex testIndex test features selectedType of test setTest set performance
Cho HR et al., 201819Retrospective
Single center
Myeloid cell marker expression level (CD11b, CD68, CSF1R, CD163, CD33,
CD123, CD83, CD63, CD49d, CD117)
Lymphoid cell marker expression level (CD4, Cd3e, CD25, CD8)
60 patients
Preoperative MRI: T2 FLAIR
T1 CE, ADC, DSC
Manual Segmentation of VOI
58% male
Mean age 54.2 ± 11.4
Data from Korea
Ethnicity: N/A
RNA-level analysis using quantitative RT-PCRCBV & ADC & tumor volumenCBV within T2 FLAIR VOI (whole tumor) & T1 CE VOI (enhancing tumor) masks for CD68, CSF1R, CD33 & CD4.
nCBV within T1 CE VOI (enhancing tumor) mask for CD11b.
ADC within T2 FLAIR VOI (whole tumor) & T1 CE VOI (enhancing tumor) masks for CD49d & CD3e.
ADC within T2 FLAIR VOI (whole tumor) mask for CD33 & CD123.
ADC within T1 CE VOI (enhancing tumor) mask for CD25.
FLAIR volume (whole tumor) & T1 CE VOI (enhancing tumor) mask
for CD123, CD49d & CD117.
N/A
(Train set only)
N/A
(Train set only: index test features selected if P value < .05 with Pearson’s correlation analysis)
Liao X et al., 201920Retrospective
Multicenter
Prognosis:
Survival data (< 1 year & > 1 year)–not immune-related
Diagnosis:
Immune-related & non-immune-related gene expression levels including:
EREG,
TIMP1,
CHIT1,
ROS1
137 patients—MRI data
Preoperative MRI: T2 FLAIR
MRI data:
Training: 70%
Test set: 30%
Manual Segmentation of VOI
129 patients—Gene expression level and survival
46 patients -Intersection data (Gene expression level and MRI)
63.2% male
Mean age 61.7 ± 12.7
Data from US
Ethnicity: N/A
Prognosis:
Survival data (< 1 year and > 1 year)
Diagnosis:
RNA-level analysis using quantitative RT-PCR
4 different models: GBDT, logistic regression, SVM, KNN72 radiomic features from T2 FLAIR MRI VOI selected for survival
(first order and texture)
Prognosis:
Internal hold out
(72 radiomic features & survival; n = 129)
Diagnosis:
N/A
(Train set only:72 radiomic features & gene expression level; n = 46)
Prognosis:
GBDT accuracy = 0.81
AUC-ROC = 0.79 < 1 year; & = 0.81 > 1 year
Diagnosis:
N/A
(Train set only:
moderate (0.3 < |r| < 0.5) to high (|r| > 0.5) Pearson’s correlation)
Jajamovich GH et al., 201622Retrospective
Multicenter
Gene expression level signatures including dendritic cell maturation
Molecular subtypes of glioblastoma
12 042 genes for 558 patients (TCGA)
Matched preoperative MRI data from 50 patients (TCIA)
Preoperative MRI: T1, T1 CE, DWI, ADC
Semi-automatic segmentation of VOI (Growcut method)
Gene data: 39% male, average age: 58.3 ± 14.2
MRI data:
66% male
Mean age: 60.7 ± 12.6
15 mesenchymal, 10 classical, 16 neural & 9 proneural glioblastoma patients with MRI images
Data from US
Ethnicity: N/A
RNA-level microarray analysis
Molecular subtypes using nearest-centroid-based classification
Gene signature subgroups based on k-means clustering
ADC (mean, SD, skewness, kurtosis, entropy)Mean ADC values from T1 CE VOI (enhancing tumor) mask selected for (1) tumor molecular subtypes & (2) other subgroups of gene signature (including immune response related subgroup containing CD4, CD86, major histocompatibility complex class I and II).N/A
(Train set only)
N/A
(Train set only:
Neural vs non-neural subtypes (P = .02, AUC-ROC = 0.75, CI: 0.57–0.88)
(Train set only: index test features selected if P value < .05 with Spearman’s correlation analysis. Gave ρ = −0.51 for immune response-related subgroup.)
Liu D et al., 202323Retrospective
Multicenter
Immune cell infiltration scoreFor the development and validation of immune cell infiltration score:
(1) Discovery Set TCGA & GEO cohort (n = 400 patients; Gene expression level & survival)
(2) Validation Set CGGA cohort (n = 374 patients; Gene expression level & survival)
Matched dataset TCGA-TCIA and CPTAC cohorts (n = 70; Gene expression level & MRI and survival)
Independent dataset NBH cohort (n = 149; MRI and survival)
Preoperative MRI: T1 CE, T2
Manual segmentation of VOI
TCGA cohort: 64.8% male
Mean age: 59.41 (SD 13.7)
GEO cohort
58.5% male
Mean age 52.06 (SD 13.6)
CCGA cohort
60.4% male
Mean age: 48.12 (SD 13.37)
Matched cohort:
62.9% male
Mean age: 60.34 (SD 12.67)
NBH cohort:
59.1% male
Mean age: 59.17 (SD 10.6)
Data from US & China
Ethnicity: N/A
Diagnosis:
LM22 signature for immune cell expression using CIBERSORT. Immune & stromal content using ESTIMATE.
Immune cell infiltration score = ΣPC1A −ΣPC1B
Grouped as high or low immune cell infiltration score
Prognosis:
Survival data
SVM Model11 radiomic features from MRI T2 & T1 CE VOI were selected for immune cell infiltration grouping.
(note: high interrater reliability of features was also a selection criterion)
Diagnosis:
cross-validation only (11 radiomic features & immune cell infiltration group; n = 70)
Prognosis:
External hold-out (11 radiomic features & survival; n = 149)
Diagnosis:
cross-validation only AUC-ROC = 0.96; accuracy = 0.94; recall = 0.91;
F1 score = 0.93
Prognosis:
Cox HR = 0.63 (0.46–0.88; P = .051)
Rao et al., 201624Retrospective
Multicenter
Prognosis:
Survival (median survival difference of 1 year)-not immune-related
Diagnosis:
gene expression levels (immune-related & non-immune-related; mRNA & miRNA expression data)
92 patients:
44 patients-training set; 48 patients-test set
Preoperative MRI: VASARI (Visually AcceSAble Rembrandt Images) standardized feature set from T1, T2, T1 CE, T2 FLAIR MRI images
No segmentation performed for the study
65% male
Age: N/A
Data from US
Ethnicity: N/A
Prognosis: Survival data (OS, PFS)
Diagnosis:
Normalized gene expression data from mRNA sequencing
k-adaptive partitioned
VASARI features: volume-class, enhancement quality, proportion contrast-enhancing tumor, proportion noncontrast-enhancing tumor, proportion necrosis, proportion edema, T1/FLAIR-envelope ratio, enhancing margin thickness, distribution, & hemorrhage
3 radiomic features
(volume-class,
T1/FLAIR ratio,
hemorrhage) selected for
survival
(> 2: Group 1; ≤ 2: Group 0)
Prognosis:
Internal hold-out
(radiomic feature groups & survival/PFS; n = 48)
Diagnosis:
N/A
(Train set only;
radiomic groups & gene expression level; n = 48)
Prognosis:
High (median: 19 months) vs low survival (median: 7 months) group logrank test P = .0001
PFS P = .058
Diagnosis:
N/A
(Train set only: radiomic groups have differential gene expression; with 10 combinations representing immune-related & metabolic pathways when multiple testing corrections for significance with false discovery rate cut off:0.1)
Narang et al., 201725Retrospective
Multicenter
Gene expression levels related to CD3 T cell activity79 patients (TCGA) used for biomarker development
Preoperative MRI: T1 CE, T2 FLAIR
Training and testing MD Anderson cohort: n = 69; 35 patients- training set; 34 patients- test set
Semi-automatic segmentation of VOI
52% male
Mean age: 57.96 (SD 13.8)
Data from US
Biomarker development: Normalized gene expression data for CD3E/D/G from mRNA sequencing
Training and testing dataset: CD3 immunohistochemistry-derived cell counts
Symbolic regression model6 texture-based radiomic features (GLSZM, kurtosis, NGTDM)Diagnosis:
Internal hold-out
(radiomic features & dichotomized CD3 counts (n = 34)
CD3 prediction model (using 6 features) AUC-ROC = 0.85 (95% CI: 0.66–0.94)
Accuracy = 0.77 (95% CI: 0.59–0.89); recall = 0.73; F1 score = 0.80
Hsu et al., 202026Retrospective
Multicenter
Diagnosis:
Gene Expression levels & corresponding immune signatures (CTL, aDC, Treg, MDSC)
Prognosis:
Survival (median OS)
154 samples (TCGA RNAseq data)
116 patients (TCIA MRI data)
Matched data for training (MRI & gene expression): 32
Independent Test data: 84 (MRI, survival; limited gene expression data)
Preoperative MRI: T1 CE, DWI
Manual segmentation of VOI
60% male
Median age: 62.5 (Q1–Q3: 52.3–70.3; training data); 59 (Q1–Q3: 52.0–66.0; test data)
Data from US
Ethnicity: N/A
Diagnosis:
Gene set enrichment analysis to obtain enrichment levels of immune cells; categorized into immune signatures.
Normalized gene expression data from mRNA sequencing & microarray
Prognosis:
Survival data (OS)
Logistic regression2–18 radiomics features: first order, GLRLM, GLCM from ADC (and T1 CE, from within T1 CE VOI mask; selected for each immune signature.
Also radiomics features: selected for survival group (median OS > 500 days) vs < 270 days survival).
Diagnosis:
cross-validation only
(radiomic features & immunophenotype groups; n = 32)
Internal hold-out
N/A
(radiomic features & limited immunophenotype groups; n = 84)
Prognosis:
Internal hold-out
N/A
(T1 CE trained model radio-immune patient groups & survival data;
n = 84)
Diagnosis:
cross-validation only:
CTL:
Accuracy: 0.72 (T1 CE), 0.71 (ADC);
AUC: 0.70 (T1 CE)
aDC:
Accuracy: 0.75 (T1 CE), 0.61 (ADC);
AUC: 0.74 (T1 CE); 0.61 (ADC)
Treg:
Accuracy: 0.81 (T1 CE), 0.68 (ADC);
AUC: 0.77 (T1 CE), 0.56 (ADC)
MDSC:
Accuracy: 0.88 (T1 CE), 0.79 (ADC); AUC: 0.85 (T1 CE), 0.70 (ADC)
Prognosis:
Internal hold out for comparison of immunophenotypes: for 2 selected types (median OS > 500 days vs < 270 days survival) group logrank test P = .02

TCGA, The Cancer Genome Atlas; ADC, apparent diffusion coefficient; IAADC VOI, volume of interest with intermediate apparent diffusion coefficient; GBDT, gradient boost decision tree; KNN, K nearest neighbors; PCA, principal component analysis; LDA, linear discriminant analysis; SVM, support vector machine; MGMT, O6-methylguanine-DNA methyltransferase; MRI, magnetic resonance imaging; TAMs, tumor-associated macrophages; AUC, area under the curve; T1, T1 weighted sequence; CE, contrast enhanced; T2, T2 weighted sequence; FLAIR, fluid attenuated inversion recovery; DWI, diffusion weighted imaging; RANO, response assessment in neuro-oncology criteria; ML, machine learning; DSC, dynamic susceptibility contrast; VOI, volume of interest; ROI, region of interest; nCBV, normalized relative CBV; OS, overall survival; PFS, progression-free survival; GLSZM, gray-level size zone matrix; NGTDM, neighborhood gray tone difference matrix; CTL, cytotoxic T lymphocytes; aDC, activated dendritic cells; MDSC, myeloid-derived suppressor cells; Treg, T regulatory cells.

Table 1.

Characteristics of Radiogenomic Studies Included in the Systematic Review

PaperStudy designTarget conditionDataset(s)Available demographic information
% male
Age (mean ± SD)
Ethnicity n (%)
Reference standardIndex testIndex test features selectedType of test setTest set performance
Cho HR et al., 201819Retrospective
Single center
Myeloid cell marker expression level (CD11b, CD68, CSF1R, CD163, CD33,
CD123, CD83, CD63, CD49d, CD117)
Lymphoid cell marker expression level (CD4, Cd3e, CD25, CD8)
60 patients
Preoperative MRI: T2 FLAIR
T1 CE, ADC, DSC
Manual Segmentation of VOI
58% male
Mean age 54.2 ± 11.4
Data from Korea
Ethnicity: N/A
RNA-level analysis using quantitative RT-PCRCBV & ADC & tumor volumenCBV within T2 FLAIR VOI (whole tumor) & T1 CE VOI (enhancing tumor) masks for CD68, CSF1R, CD33 & CD4.
nCBV within T1 CE VOI (enhancing tumor) mask for CD11b.
ADC within T2 FLAIR VOI (whole tumor) & T1 CE VOI (enhancing tumor) masks for CD49d & CD3e.
ADC within T2 FLAIR VOI (whole tumor) mask for CD33 & CD123.
ADC within T1 CE VOI (enhancing tumor) mask for CD25.
FLAIR volume (whole tumor) & T1 CE VOI (enhancing tumor) mask
for CD123, CD49d & CD117.
N/A
(Train set only)
N/A
(Train set only: index test features selected if P value < .05 with Pearson’s correlation analysis)
Liao X et al., 201920Retrospective
Multicenter
Prognosis:
Survival data (< 1 year & > 1 year)–not immune-related
Diagnosis:
Immune-related & non-immune-related gene expression levels including:
EREG,
TIMP1,
CHIT1,
ROS1
137 patients—MRI data
Preoperative MRI: T2 FLAIR
MRI data:
Training: 70%
Test set: 30%
Manual Segmentation of VOI
129 patients—Gene expression level and survival
46 patients -Intersection data (Gene expression level and MRI)
63.2% male
Mean age 61.7 ± 12.7
Data from US
Ethnicity: N/A
Prognosis:
Survival data (< 1 year and > 1 year)
Diagnosis:
RNA-level analysis using quantitative RT-PCR
4 different models: GBDT, logistic regression, SVM, KNN72 radiomic features from T2 FLAIR MRI VOI selected for survival
(first order and texture)
Prognosis:
Internal hold out
(72 radiomic features & survival; n = 129)
Diagnosis:
N/A
(Train set only:72 radiomic features & gene expression level; n = 46)
Prognosis:
GBDT accuracy = 0.81
AUC-ROC = 0.79 < 1 year; & = 0.81 > 1 year
Diagnosis:
N/A
(Train set only:
moderate (0.3 < |r| < 0.5) to high (|r| > 0.5) Pearson’s correlation)
Jajamovich GH et al., 201622Retrospective
Multicenter
Gene expression level signatures including dendritic cell maturation
Molecular subtypes of glioblastoma
12 042 genes for 558 patients (TCGA)
Matched preoperative MRI data from 50 patients (TCIA)
Preoperative MRI: T1, T1 CE, DWI, ADC
Semi-automatic segmentation of VOI (Growcut method)
Gene data: 39% male, average age: 58.3 ± 14.2
MRI data:
66% male
Mean age: 60.7 ± 12.6
15 mesenchymal, 10 classical, 16 neural & 9 proneural glioblastoma patients with MRI images
Data from US
Ethnicity: N/A
RNA-level microarray analysis
Molecular subtypes using nearest-centroid-based classification
Gene signature subgroups based on k-means clustering
ADC (mean, SD, skewness, kurtosis, entropy)Mean ADC values from T1 CE VOI (enhancing tumor) mask selected for (1) tumor molecular subtypes & (2) other subgroups of gene signature (including immune response related subgroup containing CD4, CD86, major histocompatibility complex class I and II).N/A
(Train set only)
N/A
(Train set only:
Neural vs non-neural subtypes (P = .02, AUC-ROC = 0.75, CI: 0.57–0.88)
(Train set only: index test features selected if P value < .05 with Spearman’s correlation analysis. Gave ρ = −0.51 for immune response-related subgroup.)
Liu D et al., 202323Retrospective
Multicenter
Immune cell infiltration scoreFor the development and validation of immune cell infiltration score:
(1) Discovery Set TCGA & GEO cohort (n = 400 patients; Gene expression level & survival)
(2) Validation Set CGGA cohort (n = 374 patients; Gene expression level & survival)
Matched dataset TCGA-TCIA and CPTAC cohorts (n = 70; Gene expression level & MRI and survival)
Independent dataset NBH cohort (n = 149; MRI and survival)
Preoperative MRI: T1 CE, T2
Manual segmentation of VOI
TCGA cohort: 64.8% male
Mean age: 59.41 (SD 13.7)
GEO cohort
58.5% male
Mean age 52.06 (SD 13.6)
CCGA cohort
60.4% male
Mean age: 48.12 (SD 13.37)
Matched cohort:
62.9% male
Mean age: 60.34 (SD 12.67)
NBH cohort:
59.1% male
Mean age: 59.17 (SD 10.6)
Data from US & China
Ethnicity: N/A
Diagnosis:
LM22 signature for immune cell expression using CIBERSORT. Immune & stromal content using ESTIMATE.
Immune cell infiltration score = ΣPC1A −ΣPC1B
Grouped as high or low immune cell infiltration score
Prognosis:
Survival data
SVM Model11 radiomic features from MRI T2 & T1 CE VOI were selected for immune cell infiltration grouping.
(note: high interrater reliability of features was also a selection criterion)
Diagnosis:
cross-validation only (11 radiomic features & immune cell infiltration group; n = 70)
Prognosis:
External hold-out (11 radiomic features & survival; n = 149)
Diagnosis:
cross-validation only AUC-ROC = 0.96; accuracy = 0.94; recall = 0.91;
F1 score = 0.93
Prognosis:
Cox HR = 0.63 (0.46–0.88; P = .051)
Rao et al., 201624Retrospective
Multicenter
Prognosis:
Survival (median survival difference of 1 year)-not immune-related
Diagnosis:
gene expression levels (immune-related & non-immune-related; mRNA & miRNA expression data)
92 patients:
44 patients-training set; 48 patients-test set
Preoperative MRI: VASARI (Visually AcceSAble Rembrandt Images) standardized feature set from T1, T2, T1 CE, T2 FLAIR MRI images
No segmentation performed for the study
65% male
Age: N/A
Data from US
Ethnicity: N/A
Prognosis: Survival data (OS, PFS)
Diagnosis:
Normalized gene expression data from mRNA sequencing
k-adaptive partitioned
VASARI features: volume-class, enhancement quality, proportion contrast-enhancing tumor, proportion noncontrast-enhancing tumor, proportion necrosis, proportion edema, T1/FLAIR-envelope ratio, enhancing margin thickness, distribution, & hemorrhage
3 radiomic features
(volume-class,
T1/FLAIR ratio,
hemorrhage) selected for
survival
(> 2: Group 1; ≤ 2: Group 0)
Prognosis:
Internal hold-out
(radiomic feature groups & survival/PFS; n = 48)
Diagnosis:
N/A
(Train set only;
radiomic groups & gene expression level; n = 48)
Prognosis:
High (median: 19 months) vs low survival (median: 7 months) group logrank test P = .0001
PFS P = .058
Diagnosis:
N/A
(Train set only: radiomic groups have differential gene expression; with 10 combinations representing immune-related & metabolic pathways when multiple testing corrections for significance with false discovery rate cut off:0.1)
Narang et al., 201725Retrospective
Multicenter
Gene expression levels related to CD3 T cell activity79 patients (TCGA) used for biomarker development
Preoperative MRI: T1 CE, T2 FLAIR
Training and testing MD Anderson cohort: n = 69; 35 patients- training set; 34 patients- test set
Semi-automatic segmentation of VOI
52% male
Mean age: 57.96 (SD 13.8)
Data from US
Biomarker development: Normalized gene expression data for CD3E/D/G from mRNA sequencing
Training and testing dataset: CD3 immunohistochemistry-derived cell counts
Symbolic regression model6 texture-based radiomic features (GLSZM, kurtosis, NGTDM)Diagnosis:
Internal hold-out
(radiomic features & dichotomized CD3 counts (n = 34)
CD3 prediction model (using 6 features) AUC-ROC = 0.85 (95% CI: 0.66–0.94)
Accuracy = 0.77 (95% CI: 0.59–0.89); recall = 0.73; F1 score = 0.80
Hsu et al., 202026Retrospective
Multicenter
Diagnosis:
Gene Expression levels & corresponding immune signatures (CTL, aDC, Treg, MDSC)
Prognosis:
Survival (median OS)
154 samples (TCGA RNAseq data)
116 patients (TCIA MRI data)
Matched data for training (MRI & gene expression): 32
Independent Test data: 84 (MRI, survival; limited gene expression data)
Preoperative MRI: T1 CE, DWI
Manual segmentation of VOI
60% male
Median age: 62.5 (Q1–Q3: 52.3–70.3; training data); 59 (Q1–Q3: 52.0–66.0; test data)
Data from US
Ethnicity: N/A
Diagnosis:
Gene set enrichment analysis to obtain enrichment levels of immune cells; categorized into immune signatures.
Normalized gene expression data from mRNA sequencing & microarray
Prognosis:
Survival data (OS)
Logistic regression2–18 radiomics features: first order, GLRLM, GLCM from ADC (and T1 CE, from within T1 CE VOI mask; selected for each immune signature.
Also radiomics features: selected for survival group (median OS > 500 days) vs < 270 days survival).
Diagnosis:
cross-validation only
(radiomic features & immunophenotype groups; n = 32)
Internal hold-out
N/A
(radiomic features & limited immunophenotype groups; n = 84)
Prognosis:
Internal hold-out
N/A
(T1 CE trained model radio-immune patient groups & survival data;
n = 84)
Diagnosis:
cross-validation only:
CTL:
Accuracy: 0.72 (T1 CE), 0.71 (ADC);
AUC: 0.70 (T1 CE)
aDC:
Accuracy: 0.75 (T1 CE), 0.61 (ADC);
AUC: 0.74 (T1 CE); 0.61 (ADC)
Treg:
Accuracy: 0.81 (T1 CE), 0.68 (ADC);
AUC: 0.77 (T1 CE), 0.56 (ADC)
MDSC:
Accuracy: 0.88 (T1 CE), 0.79 (ADC); AUC: 0.85 (T1 CE), 0.70 (ADC)
Prognosis:
Internal hold out for comparison of immunophenotypes: for 2 selected types (median OS > 500 days vs < 270 days survival) group logrank test P = .02
PaperStudy designTarget conditionDataset(s)Available demographic information
% male
Age (mean ± SD)
Ethnicity n (%)
Reference standardIndex testIndex test features selectedType of test setTest set performance
Cho HR et al., 201819Retrospective
Single center
Myeloid cell marker expression level (CD11b, CD68, CSF1R, CD163, CD33,
CD123, CD83, CD63, CD49d, CD117)
Lymphoid cell marker expression level (CD4, Cd3e, CD25, CD8)
60 patients
Preoperative MRI: T2 FLAIR
T1 CE, ADC, DSC
Manual Segmentation of VOI
58% male
Mean age 54.2 ± 11.4
Data from Korea
Ethnicity: N/A
RNA-level analysis using quantitative RT-PCRCBV & ADC & tumor volumenCBV within T2 FLAIR VOI (whole tumor) & T1 CE VOI (enhancing tumor) masks for CD68, CSF1R, CD33 & CD4.
nCBV within T1 CE VOI (enhancing tumor) mask for CD11b.
ADC within T2 FLAIR VOI (whole tumor) & T1 CE VOI (enhancing tumor) masks for CD49d & CD3e.
ADC within T2 FLAIR VOI (whole tumor) mask for CD33 & CD123.
ADC within T1 CE VOI (enhancing tumor) mask for CD25.
FLAIR volume (whole tumor) & T1 CE VOI (enhancing tumor) mask
for CD123, CD49d & CD117.
N/A
(Train set only)
N/A
(Train set only: index test features selected if P value < .05 with Pearson’s correlation analysis)
Liao X et al., 201920Retrospective
Multicenter
Prognosis:
Survival data (< 1 year & > 1 year)–not immune-related
Diagnosis:
Immune-related & non-immune-related gene expression levels including:
EREG,
TIMP1,
CHIT1,
ROS1
137 patients—MRI data
Preoperative MRI: T2 FLAIR
MRI data:
Training: 70%
Test set: 30%
Manual Segmentation of VOI
129 patients—Gene expression level and survival
46 patients -Intersection data (Gene expression level and MRI)
63.2% male
Mean age 61.7 ± 12.7
Data from US
Ethnicity: N/A
Prognosis:
Survival data (< 1 year and > 1 year)
Diagnosis:
RNA-level analysis using quantitative RT-PCR
4 different models: GBDT, logistic regression, SVM, KNN72 radiomic features from T2 FLAIR MRI VOI selected for survival
(first order and texture)
Prognosis:
Internal hold out
(72 radiomic features & survival; n = 129)
Diagnosis:
N/A
(Train set only:72 radiomic features & gene expression level; n = 46)
Prognosis:
GBDT accuracy = 0.81
AUC-ROC = 0.79 < 1 year; & = 0.81 > 1 year
Diagnosis:
N/A
(Train set only:
moderate (0.3 < |r| < 0.5) to high (|r| > 0.5) Pearson’s correlation)
Jajamovich GH et al., 201622Retrospective
Multicenter
Gene expression level signatures including dendritic cell maturation
Molecular subtypes of glioblastoma
12 042 genes for 558 patients (TCGA)
Matched preoperative MRI data from 50 patients (TCIA)
Preoperative MRI: T1, T1 CE, DWI, ADC
Semi-automatic segmentation of VOI (Growcut method)
Gene data: 39% male, average age: 58.3 ± 14.2
MRI data:
66% male
Mean age: 60.7 ± 12.6
15 mesenchymal, 10 classical, 16 neural & 9 proneural glioblastoma patients with MRI images
Data from US
Ethnicity: N/A
RNA-level microarray analysis
Molecular subtypes using nearest-centroid-based classification
Gene signature subgroups based on k-means clustering
ADC (mean, SD, skewness, kurtosis, entropy)Mean ADC values from T1 CE VOI (enhancing tumor) mask selected for (1) tumor molecular subtypes & (2) other subgroups of gene signature (including immune response related subgroup containing CD4, CD86, major histocompatibility complex class I and II).N/A
(Train set only)
N/A
(Train set only:
Neural vs non-neural subtypes (P = .02, AUC-ROC = 0.75, CI: 0.57–0.88)
(Train set only: index test features selected if P value < .05 with Spearman’s correlation analysis. Gave ρ = −0.51 for immune response-related subgroup.)
Liu D et al., 202323Retrospective
Multicenter
Immune cell infiltration scoreFor the development and validation of immune cell infiltration score:
(1) Discovery Set TCGA & GEO cohort (n = 400 patients; Gene expression level & survival)
(2) Validation Set CGGA cohort (n = 374 patients; Gene expression level & survival)
Matched dataset TCGA-TCIA and CPTAC cohorts (n = 70; Gene expression level & MRI and survival)
Independent dataset NBH cohort (n = 149; MRI and survival)
Preoperative MRI: T1 CE, T2
Manual segmentation of VOI
TCGA cohort: 64.8% male
Mean age: 59.41 (SD 13.7)
GEO cohort
58.5% male
Mean age 52.06 (SD 13.6)
CCGA cohort
60.4% male
Mean age: 48.12 (SD 13.37)
Matched cohort:
62.9% male
Mean age: 60.34 (SD 12.67)
NBH cohort:
59.1% male
Mean age: 59.17 (SD 10.6)
Data from US & China
Ethnicity: N/A
Diagnosis:
LM22 signature for immune cell expression using CIBERSORT. Immune & stromal content using ESTIMATE.
Immune cell infiltration score = ΣPC1A −ΣPC1B
Grouped as high or low immune cell infiltration score
Prognosis:
Survival data
SVM Model11 radiomic features from MRI T2 & T1 CE VOI were selected for immune cell infiltration grouping.
(note: high interrater reliability of features was also a selection criterion)
Diagnosis:
cross-validation only (11 radiomic features & immune cell infiltration group; n = 70)
Prognosis:
External hold-out (11 radiomic features & survival; n = 149)
Diagnosis:
cross-validation only AUC-ROC = 0.96; accuracy = 0.94; recall = 0.91;
F1 score = 0.93
Prognosis:
Cox HR = 0.63 (0.46–0.88; P = .051)
Rao et al., 201624Retrospective
Multicenter
Prognosis:
Survival (median survival difference of 1 year)-not immune-related
Diagnosis:
gene expression levels (immune-related & non-immune-related; mRNA & miRNA expression data)
92 patients:
44 patients-training set; 48 patients-test set
Preoperative MRI: VASARI (Visually AcceSAble Rembrandt Images) standardized feature set from T1, T2, T1 CE, T2 FLAIR MRI images
No segmentation performed for the study
65% male
Age: N/A
Data from US
Ethnicity: N/A
Prognosis: Survival data (OS, PFS)
Diagnosis:
Normalized gene expression data from mRNA sequencing
k-adaptive partitioned
VASARI features: volume-class, enhancement quality, proportion contrast-enhancing tumor, proportion noncontrast-enhancing tumor, proportion necrosis, proportion edema, T1/FLAIR-envelope ratio, enhancing margin thickness, distribution, & hemorrhage
3 radiomic features
(volume-class,
T1/FLAIR ratio,
hemorrhage) selected for
survival
(> 2: Group 1; ≤ 2: Group 0)
Prognosis:
Internal hold-out
(radiomic feature groups & survival/PFS; n = 48)
Diagnosis:
N/A
(Train set only;
radiomic groups & gene expression level; n = 48)
Prognosis:
High (median: 19 months) vs low survival (median: 7 months) group logrank test P = .0001
PFS P = .058
Diagnosis:
N/A
(Train set only: radiomic groups have differential gene expression; with 10 combinations representing immune-related & metabolic pathways when multiple testing corrections for significance with false discovery rate cut off:0.1)
Narang et al., 201725Retrospective
Multicenter
Gene expression levels related to CD3 T cell activity79 patients (TCGA) used for biomarker development
Preoperative MRI: T1 CE, T2 FLAIR
Training and testing MD Anderson cohort: n = 69; 35 patients- training set; 34 patients- test set
Semi-automatic segmentation of VOI
52% male
Mean age: 57.96 (SD 13.8)
Data from US
Biomarker development: Normalized gene expression data for CD3E/D/G from mRNA sequencing
Training and testing dataset: CD3 immunohistochemistry-derived cell counts
Symbolic regression model6 texture-based radiomic features (GLSZM, kurtosis, NGTDM)Diagnosis:
Internal hold-out
(radiomic features & dichotomized CD3 counts (n = 34)
CD3 prediction model (using 6 features) AUC-ROC = 0.85 (95% CI: 0.66–0.94)
Accuracy = 0.77 (95% CI: 0.59–0.89); recall = 0.73; F1 score = 0.80
Hsu et al., 202026Retrospective
Multicenter
Diagnosis:
Gene Expression levels & corresponding immune signatures (CTL, aDC, Treg, MDSC)
Prognosis:
Survival (median OS)
154 samples (TCGA RNAseq data)
116 patients (TCIA MRI data)
Matched data for training (MRI & gene expression): 32
Independent Test data: 84 (MRI, survival; limited gene expression data)
Preoperative MRI: T1 CE, DWI
Manual segmentation of VOI
60% male
Median age: 62.5 (Q1–Q3: 52.3–70.3; training data); 59 (Q1–Q3: 52.0–66.0; test data)
Data from US
Ethnicity: N/A
Diagnosis:
Gene set enrichment analysis to obtain enrichment levels of immune cells; categorized into immune signatures.
Normalized gene expression data from mRNA sequencing & microarray
Prognosis:
Survival data (OS)
Logistic regression2–18 radiomics features: first order, GLRLM, GLCM from ADC (and T1 CE, from within T1 CE VOI mask; selected for each immune signature.
Also radiomics features: selected for survival group (median OS > 500 days) vs < 270 days survival).
Diagnosis:
cross-validation only
(radiomic features & immunophenotype groups; n = 32)
Internal hold-out
N/A
(radiomic features & limited immunophenotype groups; n = 84)
Prognosis:
Internal hold-out
N/A
(T1 CE trained model radio-immune patient groups & survival data;
n = 84)
Diagnosis:
cross-validation only:
CTL:
Accuracy: 0.72 (T1 CE), 0.71 (ADC);
AUC: 0.70 (T1 CE)
aDC:
Accuracy: 0.75 (T1 CE), 0.61 (ADC);
AUC: 0.74 (T1 CE); 0.61 (ADC)
Treg:
Accuracy: 0.81 (T1 CE), 0.68 (ADC);
AUC: 0.77 (T1 CE), 0.56 (ADC)
MDSC:
Accuracy: 0.88 (T1 CE), 0.79 (ADC); AUC: 0.85 (T1 CE), 0.70 (ADC)
Prognosis:
Internal hold out for comparison of immunophenotypes: for 2 selected types (median OS > 500 days vs < 270 days survival) group logrank test P = .02

TCGA, The Cancer Genome Atlas; ADC, apparent diffusion coefficient; IAADC VOI, volume of interest with intermediate apparent diffusion coefficient; GBDT, gradient boost decision tree; KNN, K nearest neighbors; PCA, principal component analysis; LDA, linear discriminant analysis; SVM, support vector machine; MGMT, O6-methylguanine-DNA methyltransferase; MRI, magnetic resonance imaging; TAMs, tumor-associated macrophages; AUC, area under the curve; T1, T1 weighted sequence; CE, contrast enhanced; T2, T2 weighted sequence; FLAIR, fluid attenuated inversion recovery; DWI, diffusion weighted imaging; RANO, response assessment in neuro-oncology criteria; ML, machine learning; DSC, dynamic susceptibility contrast; VOI, volume of interest; ROI, region of interest; nCBV, normalized relative CBV; OS, overall survival; PFS, progression-free survival; GLSZM, gray-level size zone matrix; NGTDM, neighborhood gray tone difference matrix; CTL, cytotoxic T lymphocytes; aDC, activated dendritic cells; MDSC, myeloid-derived suppressor cells; Treg, T regulatory cells.

Table 2.

Non-Radiogenomic Studies in the Review

PaperStudy DesignTarget conditionDataset(s)Available demographic information
% male
Age (mean ± SD)
Ethnicity n (%)
Reference standardIndex testIndex test features selectedType of test setTest set performance
George E et al., 202218Retrospective
Multicenter
OS
PFS
113 patients from PD-L1
inhibition immunotherapy trial (NCT02336165)
pretreatment & 8-week posttreatment MRIs: T1, T1 CE, T2, T2 FLAIR
Manual segmentation of VOI
3 train-test combinations giving range (n-n):
Train = 60–74
Test = 29–43
69%
55.2 ± 11.5 years
Data from US
Ethnicity:
White 99 (87.6%)
African American 1 (0.9%)
Asian 1 (0.9%)
Other 3 (2.7%)
Unknown 9 (8.0%)
Survival data
PFS derived from modified RANO32 (unclear number of readers & seniority)
Random Forest
model
Radiomics shape & texture extracted from T2 FLAIR VOI (whole tumor) & T1 CE VOI (enhancing tumor) masks.
Note: only features within top 20 in all 3 test sets for OS: GLCM correlation T1 & maximal axial diameter in T1 CE VOI.
Note: only feature within top 20 in all 3 test sets for PFS: GLRLM RLV T2 in T2 FLAIR VOI.
External
(3 combinations of sites—similar to cross-validation methodology)
AUC
pretreatment OS 0.47–0.52
PFS 0.47–0.52
AUC
Posttreatment
OS 0.69–0.75 PFS 0.68–0.71
Qin L et al., 201721Retrospective
Multicenter
Anti-PD-1
+/− Anti- CTLA-4 therapy response in
recurrent glioblastoma
10 immunotherapy trial patients (NCT02017717; NCT02054806)
(5 benefit group and 5 no-benefit group)
Postoperative MRI: T1, T1C, T2 FLAIR, ADC
Manual segmentation of VOI
Trial data from respective trialsSurvival data (< 5 months & > 5 months)
Note: without unequivocal imaging, clinical, or histopathologic evidence of progression
RANO33 measures on T1 CE image
Intermediate ADC volume
(IADC VOI)
IADC VOI change from FLAIR VOIN/A
(Train set only)
N/A
(Train set only; 100% accuracy)
PaperStudy DesignTarget conditionDataset(s)Available demographic information
% male
Age (mean ± SD)
Ethnicity n (%)
Reference standardIndex testIndex test features selectedType of test setTest set performance
George E et al., 202218Retrospective
Multicenter
OS
PFS
113 patients from PD-L1
inhibition immunotherapy trial (NCT02336165)
pretreatment & 8-week posttreatment MRIs: T1, T1 CE, T2, T2 FLAIR
Manual segmentation of VOI
3 train-test combinations giving range (n-n):
Train = 60–74
Test = 29–43
69%
55.2 ± 11.5 years
Data from US
Ethnicity:
White 99 (87.6%)
African American 1 (0.9%)
Asian 1 (0.9%)
Other 3 (2.7%)
Unknown 9 (8.0%)
Survival data
PFS derived from modified RANO32 (unclear number of readers & seniority)
Random Forest
model
Radiomics shape & texture extracted from T2 FLAIR VOI (whole tumor) & T1 CE VOI (enhancing tumor) masks.
Note: only features within top 20 in all 3 test sets for OS: GLCM correlation T1 & maximal axial diameter in T1 CE VOI.
Note: only feature within top 20 in all 3 test sets for PFS: GLRLM RLV T2 in T2 FLAIR VOI.
External
(3 combinations of sites—similar to cross-validation methodology)
AUC
pretreatment OS 0.47–0.52
PFS 0.47–0.52
AUC
Posttreatment
OS 0.69–0.75 PFS 0.68–0.71
Qin L et al., 201721Retrospective
Multicenter
Anti-PD-1
+/− Anti- CTLA-4 therapy response in
recurrent glioblastoma
10 immunotherapy trial patients (NCT02017717; NCT02054806)
(5 benefit group and 5 no-benefit group)
Postoperative MRI: T1, T1C, T2 FLAIR, ADC
Manual segmentation of VOI
Trial data from respective trialsSurvival data (< 5 months & > 5 months)
Note: without unequivocal imaging, clinical, or histopathologic evidence of progression
RANO33 measures on T1 CE image
Intermediate ADC volume
(IADC VOI)
IADC VOI change from FLAIR VOIN/A
(Train set only)
N/A
(Train set only; 100% accuracy)
Table 2.

Non-Radiogenomic Studies in the Review

PaperStudy DesignTarget conditionDataset(s)Available demographic information
% male
Age (mean ± SD)
Ethnicity n (%)
Reference standardIndex testIndex test features selectedType of test setTest set performance
George E et al., 202218Retrospective
Multicenter
OS
PFS
113 patients from PD-L1
inhibition immunotherapy trial (NCT02336165)
pretreatment & 8-week posttreatment MRIs: T1, T1 CE, T2, T2 FLAIR
Manual segmentation of VOI
3 train-test combinations giving range (n-n):
Train = 60–74
Test = 29–43
69%
55.2 ± 11.5 years
Data from US
Ethnicity:
White 99 (87.6%)
African American 1 (0.9%)
Asian 1 (0.9%)
Other 3 (2.7%)
Unknown 9 (8.0%)
Survival data
PFS derived from modified RANO32 (unclear number of readers & seniority)
Random Forest
model
Radiomics shape & texture extracted from T2 FLAIR VOI (whole tumor) & T1 CE VOI (enhancing tumor) masks.
Note: only features within top 20 in all 3 test sets for OS: GLCM correlation T1 & maximal axial diameter in T1 CE VOI.
Note: only feature within top 20 in all 3 test sets for PFS: GLRLM RLV T2 in T2 FLAIR VOI.
External
(3 combinations of sites—similar to cross-validation methodology)
AUC
pretreatment OS 0.47–0.52
PFS 0.47–0.52
AUC
Posttreatment
OS 0.69–0.75 PFS 0.68–0.71
Qin L et al., 201721Retrospective
Multicenter
Anti-PD-1
+/− Anti- CTLA-4 therapy response in
recurrent glioblastoma
10 immunotherapy trial patients (NCT02017717; NCT02054806)
(5 benefit group and 5 no-benefit group)
Postoperative MRI: T1, T1C, T2 FLAIR, ADC
Manual segmentation of VOI
Trial data from respective trialsSurvival data (< 5 months & > 5 months)
Note: without unequivocal imaging, clinical, or histopathologic evidence of progression
RANO33 measures on T1 CE image
Intermediate ADC volume
(IADC VOI)
IADC VOI change from FLAIR VOIN/A
(Train set only)
N/A
(Train set only; 100% accuracy)
PaperStudy DesignTarget conditionDataset(s)Available demographic information
% male
Age (mean ± SD)
Ethnicity n (%)
Reference standardIndex testIndex test features selectedType of test setTest set performance
George E et al., 202218Retrospective
Multicenter
OS
PFS
113 patients from PD-L1
inhibition immunotherapy trial (NCT02336165)
pretreatment & 8-week posttreatment MRIs: T1, T1 CE, T2, T2 FLAIR
Manual segmentation of VOI
3 train-test combinations giving range (n-n):
Train = 60–74
Test = 29–43
69%
55.2 ± 11.5 years
Data from US
Ethnicity:
White 99 (87.6%)
African American 1 (0.9%)
Asian 1 (0.9%)
Other 3 (2.7%)
Unknown 9 (8.0%)
Survival data
PFS derived from modified RANO32 (unclear number of readers & seniority)
Random Forest
model
Radiomics shape & texture extracted from T2 FLAIR VOI (whole tumor) & T1 CE VOI (enhancing tumor) masks.
Note: only features within top 20 in all 3 test sets for OS: GLCM correlation T1 & maximal axial diameter in T1 CE VOI.
Note: only feature within top 20 in all 3 test sets for PFS: GLRLM RLV T2 in T2 FLAIR VOI.
External
(3 combinations of sites—similar to cross-validation methodology)
AUC
pretreatment OS 0.47–0.52
PFS 0.47–0.52
AUC
Posttreatment
OS 0.69–0.75 PFS 0.68–0.71
Qin L et al., 201721Retrospective
Multicenter
Anti-PD-1
+/− Anti- CTLA-4 therapy response in
recurrent glioblastoma
10 immunotherapy trial patients (NCT02017717; NCT02054806)
(5 benefit group and 5 no-benefit group)
Postoperative MRI: T1, T1C, T2 FLAIR, ADC
Manual segmentation of VOI
Trial data from respective trialsSurvival data (< 5 months & > 5 months)
Note: without unequivocal imaging, clinical, or histopathologic evidence of progression
RANO33 measures on T1 CE image
Intermediate ADC volume
(IADC VOI)
IADC VOI change from FLAIR VOIN/A
(Train set only)
N/A
(Train set only; 100% accuracy)

Study Datasets

All studies included patients with histologically diagnosed “glioblastomas, isocitrate dehydrogenase (IDH)-wild type” or “astrocytoma, IDH-mutant, grade 4” who had undergone standard of care treatment.6,34

Among the radiogenomic studies, 6/7 (85.7%) were multicenter and one was performed using a dataset of 60 consecutive patients from a single center.23 The Cancer Imaging Archive (TCIA) MRI data (https://www.cancerimagingarchive.net/collection/tcga-gbm/) and corresponding genomic data from The Cancer Genome Atlas were used as datasets in all the multicenter studies.24,26–30 In one TCIA-TCGA study, Liao et al.24 developed radiomic biomarkers corresponding to immune-related gene expression.35–37 The study included 137 patients with TCIA MRIs, of which 46 had corresponding genomic information. In a second study, Jajamovich et al.26 developed imaging biomarkers from 558 patients with TCGA genomic information, of which 50 had corresponding MRIs. In a third study, Liu et al.27 used multiple datasets (TCGA, Chinese Glioma Genome Atlas, and Clinical Proteomic Tumor Analysis Consortium RNA-sequencing data; GSE13041 and GSE83300 RNA microarray data; TCIA and local institution imaging data) and developed biomarkers using a cohort of 774 patients with mRNA gene expression data from multicenter datasets including 70 patients matched with MRI and mRNA data (TCGA, Clinical Proteomic Tumor Analysis Consortium). Subsequently, the biomarkers were validated using MRI and survival data from a third independent cohort of 149 patients from a single center. In the fourth study, Rao et al.28 studied 92 patients from the TCGA database with MRI, mRNA, miRNA, and survival data. In the fifth study, Narang et al.29 developed biomarkers using matched MRI and mRNA data from 79 patients within the TCIA-TCGA database. The biomarkers were then trained on 35 patients and tested on 34 patients from a separate hospital cohort. Hsu et al.30 identified biomarkers using matched MRI and mRNA data of 32 patients from TCIA-TCGA database and tested them on 84 patients with MRI and survival data from the TCIA database; limited mRNA data were also available in the test set.

Out of the 2 non-radiogenomic studies, one analyzed recurrent tumors25 and the other included a mixture of newly diagnosed and recurrent tumors.22 Both studies included patients from immunotherapy clinical trials.22,25 Specifically, George et al.22 used data from a multicenter phase II programmed death-ligand 1 clinical trial (NCT02336165) with a sample size of 113 patients partitioned into training and test sets. In the second study, Qin et al.25 studied 10 consecutive patients enrolled in clinical trials of anti-PD-1 therapy with or without anti-CTLA-4 therapy (NCT02017717; NCT02054806).

Magnetic Resonance Imaging

The images used to develop biomarkers were obtained from either T1-weighted (T1), T1-weighted contrast-enhanced (T1 CE), T2-weighted (T2), T2-weighted Fluid Attenuated Inversion Recovery (T2 FLAIR), dynamic susceptibility contrast-enhanced (DSC) sequences or diffusion-weighted imaging/apparent diffusion coefficient maps (DWI/ADC). All radiogenomic studies included either T2 FLAIR (4/7, 57.1%) or T1 CE (6/7, 85.7%) images as a minimum.

Machine Learning, Radiomics, and Statistical Analysis

Eight studies (8/9; 88.9%) used manual or semi-automated segmentation for determining the image volume of interest and classified extracted image features with classical machine learning or advanced statistical modeling techniques while one study28 did not use segmentation and applied VASARI (Visually AcceSAble Rembrandt Images) standardized features to advanced statistical modeling techniques. No deep-learning techniques were used. The extracted image features were either radiomic-based and obtained from structural images or consisted of quantitative ADC metrics. An exception was one study, which also extracted cerebral blood volume metrics in addition to ADC metrics.23 Radiomic features were extracted using Pyradiomics24,27 (https://github.com/AIM-Harvard/pyradiomics) or the open source radiomics package by Vallières22 (https://github.com/mvallieres/radiomics).

All radiogenomic studies23,24,26–30 (7/7, 100%) developed diagnostic imaging biomarkers that identified glioblastoma with immune-related gene signatures,24,26–30 immune cell markers23 or immune infiltration scores.27 Four radiogenomic studies (4/7; 57.1%)24,27,28,30 also demonstrated that the imaging biomarkers were prognostic by correlating imaging features with survival. The 2 non-radiogenomic studies developed a prognostic22 biomarker related to survival, and a predictive imaging biomarker25 that correlated with immunotherapy-related treatment response, respectively.

The radiogenomic studies23,24,26–30 (7/7, 100%) developed biomarkers by correlating MRI features with immune-related gene expression levels23,26,28–30 (diagnostic biomarkers), composite scores derived from them called “immune cell infiltration scores”27 (diagnostic biomarkers) or survival data24,27,28,30 (prognostic biomarkers). In 5/7 (71.4%) studies23,24,27,28,30 indirect methods were used to determine that the imaging biomarkers were clinically meaningful (Table 3) by correlating the classified groups of (1) an imaging-based survival classifier with immune-related gene expression levels,24,28,30 or (2) an imaging-based immune-related gene expression level classifier with progression-free survival,23 or (3) an imaging-based immune cell infiltration classifier with survival.27

Table 3.

Radiological Biomarkers Identified in the Systematic Review

PaperRadiogenomic
biomarker
Radiological biomarkerPrognosticMonitoringDiagnostic (Radiogenomic component)PredictiveDirect method of biomarker developmentIndirect methods of biomarker development
Cho et al.19YesQuantitative MRI features (ADC, nCBV, tumor volume)N/AN/AYes
(Expression levels of immune cell markers)
N/ACorrelation of ADC, nCBV, tumor volume features & expression levels of immune cell markersExpression levels of immune cell markers & PFS (without images)
Note: PFS derived from RANO32
Liao et al.20Yes (secondary)Radiomic MRI features (T2 FLAIR)Yes
(Radiomics and survival—not immune-related)
N/AYes
(Indirect: expression levels of immune-related genes and radiomics)
N/AUsing survival data of patients to classify radiomic features -not immune-relatedExpression levels of the genes identified (all immune-related) distinguished 2 survival groups.
These immune-related gene expression levels were then compared to radiomics.
Jajamovich et al.22YesQuantitative MRI features (ADC)N/AN/AYes
(tumor subtype. Immune-related gene expression signature subgroup)
N/ACorrelation of ADC features and (1) tumor subtype and (2) immune-related gene expression signature subgroupN/A
Liu et al.23YesRadiomics MRI features (T2 and T1 CE)Yes
(Radiomics and survival)
N/AYes
(Immune cell infiltration score and radiomics)
N/AUsing radiomic features to classify patients into groups with high or low immune cell infiltration scoresAssessment of prognosis by (1) correlating immune cell infiltration scores with survival in 2 datasets, then, (2) correlating radiomics with immune cell infiltration scores in a third dataset (correlation of immune cell infiltration scores and survival endured), then, and (3) correlating radiomics
and survival in fourth dataset
Rao et al.24Yes (secondary)Quantitative and qualitative MRI features (VASARI)Yes
(MRI features and survival
-not immune-related)
N/AYes
(Expression level of immune-related genes and MRI features)
N/AUsing survival data to classify radiomic feature groups- not immune-relatedExpression level of genes identified (immune-related and non-immune-related) that distinguished 2 radiomic feature group
Narang et al.25YesRadiomics MRI features (T1 CE, T2 FLAIR)N/AN/AYes
(Gene expression levels related to CD3 T cells)
N/ACorrelation of radiomics features with gene expression signature for CD3 T cellsN/A
Hsu et al.26YesRadiomics MRI features (T1 CE, ADC)Yes
(radio-immune patient groups and survival)
N/AYes
(immune gene signatures and radiomics)
N/AUsing radiomic features to classify patients into groups with different gene expression immune signaturesPredicted immunophenotype patient groups with significant differences in median overall survival
George et al.18NoRadiomics features (VOI structural images)Yes
(Radiomics and survival)
N/AN/AN/AUsing survival data of patients in immunotherapy clinical trials to regress radiomic featuresN/A
Qin et al.21NoQuantitative MRI features (IADC VOI)N/AYes
(longitudinal change in IADC VOI during immunotherapy)
N/AYes
(IADC VOI change and therapeutic benefit)
Using survival data of patients in immunotherapy clinical trials to determine feature change longitudinally(RANO33 but minimally supportive)
PaperRadiogenomic
biomarker
Radiological biomarkerPrognosticMonitoringDiagnostic (Radiogenomic component)PredictiveDirect method of biomarker developmentIndirect methods of biomarker development
Cho et al.19YesQuantitative MRI features (ADC, nCBV, tumor volume)N/AN/AYes
(Expression levels of immune cell markers)
N/ACorrelation of ADC, nCBV, tumor volume features & expression levels of immune cell markersExpression levels of immune cell markers & PFS (without images)
Note: PFS derived from RANO32
Liao et al.20Yes (secondary)Radiomic MRI features (T2 FLAIR)Yes
(Radiomics and survival—not immune-related)
N/AYes
(Indirect: expression levels of immune-related genes and radiomics)
N/AUsing survival data of patients to classify radiomic features -not immune-relatedExpression levels of the genes identified (all immune-related) distinguished 2 survival groups.
These immune-related gene expression levels were then compared to radiomics.
Jajamovich et al.22YesQuantitative MRI features (ADC)N/AN/AYes
(tumor subtype. Immune-related gene expression signature subgroup)
N/ACorrelation of ADC features and (1) tumor subtype and (2) immune-related gene expression signature subgroupN/A
Liu et al.23YesRadiomics MRI features (T2 and T1 CE)Yes
(Radiomics and survival)
N/AYes
(Immune cell infiltration score and radiomics)
N/AUsing radiomic features to classify patients into groups with high or low immune cell infiltration scoresAssessment of prognosis by (1) correlating immune cell infiltration scores with survival in 2 datasets, then, (2) correlating radiomics with immune cell infiltration scores in a third dataset (correlation of immune cell infiltration scores and survival endured), then, and (3) correlating radiomics
and survival in fourth dataset
Rao et al.24Yes (secondary)Quantitative and qualitative MRI features (VASARI)Yes
(MRI features and survival
-not immune-related)
N/AYes
(Expression level of immune-related genes and MRI features)
N/AUsing survival data to classify radiomic feature groups- not immune-relatedExpression level of genes identified (immune-related and non-immune-related) that distinguished 2 radiomic feature group
Narang et al.25YesRadiomics MRI features (T1 CE, T2 FLAIR)N/AN/AYes
(Gene expression levels related to CD3 T cells)
N/ACorrelation of radiomics features with gene expression signature for CD3 T cellsN/A
Hsu et al.26YesRadiomics MRI features (T1 CE, ADC)Yes
(radio-immune patient groups and survival)
N/AYes
(immune gene signatures and radiomics)
N/AUsing radiomic features to classify patients into groups with different gene expression immune signaturesPredicted immunophenotype patient groups with significant differences in median overall survival
George et al.18NoRadiomics features (VOI structural images)Yes
(Radiomics and survival)
N/AN/AN/AUsing survival data of patients in immunotherapy clinical trials to regress radiomic featuresN/A
Qin et al.21NoQuantitative MRI features (IADC VOI)N/AYes
(longitudinal change in IADC VOI during immunotherapy)
N/AYes
(IADC VOI change and therapeutic benefit)
Using survival data of patients in immunotherapy clinical trials to determine feature change longitudinally(RANO33 but minimally supportive)

VOI, volume of interest, N/A, not applicable, ADC, apparent diffusion coefficient, IAADC VOI, volume of interest with intermediate apparent diffusion coefficient, RF: Random Forest, GBDT: Gradient boom decision tree, SVM, support vector machine, OS, overall survival, PFS, progression-free survival, VASARI, Visually AcceSAble Rembrandt Image.

Table 3.

Radiological Biomarkers Identified in the Systematic Review

PaperRadiogenomic
biomarker
Radiological biomarkerPrognosticMonitoringDiagnostic (Radiogenomic component)PredictiveDirect method of biomarker developmentIndirect methods of biomarker development
Cho et al.19YesQuantitative MRI features (ADC, nCBV, tumor volume)N/AN/AYes
(Expression levels of immune cell markers)
N/ACorrelation of ADC, nCBV, tumor volume features & expression levels of immune cell markersExpression levels of immune cell markers & PFS (without images)
Note: PFS derived from RANO32
Liao et al.20Yes (secondary)Radiomic MRI features (T2 FLAIR)Yes
(Radiomics and survival—not immune-related)
N/AYes
(Indirect: expression levels of immune-related genes and radiomics)
N/AUsing survival data of patients to classify radiomic features -not immune-relatedExpression levels of the genes identified (all immune-related) distinguished 2 survival groups.
These immune-related gene expression levels were then compared to radiomics.
Jajamovich et al.22YesQuantitative MRI features (ADC)N/AN/AYes
(tumor subtype. Immune-related gene expression signature subgroup)
N/ACorrelation of ADC features and (1) tumor subtype and (2) immune-related gene expression signature subgroupN/A
Liu et al.23YesRadiomics MRI features (T2 and T1 CE)Yes
(Radiomics and survival)
N/AYes
(Immune cell infiltration score and radiomics)
N/AUsing radiomic features to classify patients into groups with high or low immune cell infiltration scoresAssessment of prognosis by (1) correlating immune cell infiltration scores with survival in 2 datasets, then, (2) correlating radiomics with immune cell infiltration scores in a third dataset (correlation of immune cell infiltration scores and survival endured), then, and (3) correlating radiomics
and survival in fourth dataset
Rao et al.24Yes (secondary)Quantitative and qualitative MRI features (VASARI)Yes
(MRI features and survival
-not immune-related)
N/AYes
(Expression level of immune-related genes and MRI features)
N/AUsing survival data to classify radiomic feature groups- not immune-relatedExpression level of genes identified (immune-related and non-immune-related) that distinguished 2 radiomic feature group
Narang et al.25YesRadiomics MRI features (T1 CE, T2 FLAIR)N/AN/AYes
(Gene expression levels related to CD3 T cells)
N/ACorrelation of radiomics features with gene expression signature for CD3 T cellsN/A
Hsu et al.26YesRadiomics MRI features (T1 CE, ADC)Yes
(radio-immune patient groups and survival)
N/AYes
(immune gene signatures and radiomics)
N/AUsing radiomic features to classify patients into groups with different gene expression immune signaturesPredicted immunophenotype patient groups with significant differences in median overall survival
George et al.18NoRadiomics features (VOI structural images)Yes
(Radiomics and survival)
N/AN/AN/AUsing survival data of patients in immunotherapy clinical trials to regress radiomic featuresN/A
Qin et al.21NoQuantitative MRI features (IADC VOI)N/AYes
(longitudinal change in IADC VOI during immunotherapy)
N/AYes
(IADC VOI change and therapeutic benefit)
Using survival data of patients in immunotherapy clinical trials to determine feature change longitudinally(RANO33 but minimally supportive)
PaperRadiogenomic
biomarker
Radiological biomarkerPrognosticMonitoringDiagnostic (Radiogenomic component)PredictiveDirect method of biomarker developmentIndirect methods of biomarker development
Cho et al.19YesQuantitative MRI features (ADC, nCBV, tumor volume)N/AN/AYes
(Expression levels of immune cell markers)
N/ACorrelation of ADC, nCBV, tumor volume features & expression levels of immune cell markersExpression levels of immune cell markers & PFS (without images)
Note: PFS derived from RANO32
Liao et al.20Yes (secondary)Radiomic MRI features (T2 FLAIR)Yes
(Radiomics and survival—not immune-related)
N/AYes
(Indirect: expression levels of immune-related genes and radiomics)
N/AUsing survival data of patients to classify radiomic features -not immune-relatedExpression levels of the genes identified (all immune-related) distinguished 2 survival groups.
These immune-related gene expression levels were then compared to radiomics.
Jajamovich et al.22YesQuantitative MRI features (ADC)N/AN/AYes
(tumor subtype. Immune-related gene expression signature subgroup)
N/ACorrelation of ADC features and (1) tumor subtype and (2) immune-related gene expression signature subgroupN/A
Liu et al.23YesRadiomics MRI features (T2 and T1 CE)Yes
(Radiomics and survival)
N/AYes
(Immune cell infiltration score and radiomics)
N/AUsing radiomic features to classify patients into groups with high or low immune cell infiltration scoresAssessment of prognosis by (1) correlating immune cell infiltration scores with survival in 2 datasets, then, (2) correlating radiomics with immune cell infiltration scores in a third dataset (correlation of immune cell infiltration scores and survival endured), then, and (3) correlating radiomics
and survival in fourth dataset
Rao et al.24Yes (secondary)Quantitative and qualitative MRI features (VASARI)Yes
(MRI features and survival
-not immune-related)
N/AYes
(Expression level of immune-related genes and MRI features)
N/AUsing survival data to classify radiomic feature groups- not immune-relatedExpression level of genes identified (immune-related and non-immune-related) that distinguished 2 radiomic feature group
Narang et al.25YesRadiomics MRI features (T1 CE, T2 FLAIR)N/AN/AYes
(Gene expression levels related to CD3 T cells)
N/ACorrelation of radiomics features with gene expression signature for CD3 T cellsN/A
Hsu et al.26YesRadiomics MRI features (T1 CE, ADC)Yes
(radio-immune patient groups and survival)
N/AYes
(immune gene signatures and radiomics)
N/AUsing radiomic features to classify patients into groups with different gene expression immune signaturesPredicted immunophenotype patient groups with significant differences in median overall survival
George et al.18NoRadiomics features (VOI structural images)Yes
(Radiomics and survival)
N/AN/AN/AUsing survival data of patients in immunotherapy clinical trials to regress radiomic featuresN/A
Qin et al.21NoQuantitative MRI features (IADC VOI)N/AYes
(longitudinal change in IADC VOI during immunotherapy)
N/AYes
(IADC VOI change and therapeutic benefit)
Using survival data of patients in immunotherapy clinical trials to determine feature change longitudinally(RANO33 but minimally supportive)

VOI, volume of interest, N/A, not applicable, ADC, apparent diffusion coefficient, IAADC VOI, volume of interest with intermediate apparent diffusion coefficient, RF: Random Forest, GBDT: Gradient boom decision tree, SVM, support vector machine, OS, overall survival, PFS, progression-free survival, VASARI, Visually AcceSAble Rembrandt Image.

Cho et al.23 compared MRI-derived ADC and normalized relative cerebral blood volume (nCBV) values with lymphoid and myeloid cell marker expression levels, demonstrating that CD68 (tumor-associated macrophages; TAMs), CSF1R (TAMs), CD33 (myeloid-derived suppressor cell) and CD4 (regulatory T-cell) levels positively correlate with nCBV values; and CD3e (cytotoxic T-cell) and CD49d (bone marrow-derived cells) negatively correlate with ADC values. These findings persisted regardless of whether enhancing tumor or whole tumor was analyzed. CD123 (dendritic cells), CD49d, and CD117 (mast cells) levels also negatively correlated with tumor volume. To determine if the immune cell markers selected in the study were clinically meaningful, a Cox proportional hazard analysis of progression-free survival was performed with only CD49d expression proving significant.

Liao et al.24 used Pyradiomics to extract shape, first order, and texture-based radiomic features from 2D FLAIR images, and employed 4 different models on the data, namely Gradient Boosting Decision Tree (GBDT), logistic regression, support vector machine (SVM) and k-nearest neighbors (KNN). They showed that GBDT performance was best among the 4 models with an accuracy of 0.81 for classifying images into those related to short or long survivors. Six gene expression levels differed between the 2 survivor classes, 3 of which were moderately highly correlated with the most discriminative radiomic features. These 3 genes were tissue inhibitors of metalloproteinases 1 (TIMP1), repressor of silencing 1, and epiregulin (EREG), all of which have immune-related functions.35–37

Using a different approach, Jajamovich et al.26 used MRI-derived ADC correlation analysis on gene expression data grouped into molecular subtypes as well as gene subgroups. The researchers demonstrated a negative correlation of mean ADC values with an immune-related gene signature subgroup containing CD4, CD86, and major histocompatibility complex class I and II which are associated with dendritic cell maturation, the complement system, and macrophage function.

Liu et al.,27 refined gene expression grouping further still using extracted shape, first order, wavelet, and texture-based radiomic features from intra- and peri-tumoral regions. Key features were selected using recursive feature elimination and SVM to generate a predictive model that classified tumors into those with low or high immune cell infiltration scores. These immune cell infiltration scores represented those immune cell infiltration patterns in the gene expression data that persisted in different datasets and were shown to be prognostic for survival. In an independent MRI dataset, the SVM model classified patients into predicted classes of low and high immune cell infiltration; only survival data was available as a reference standard.

Rao et al.28 used MRI VASARI features to dichotomize the data into 2 groups with corresponding scores according to the tumor volume class, T1/FLAIR ratio, and hemorrhage values. These radiomic groups were prognostic for survival and showed significant differences in gene expression levels within immune-related pathways (inducible co-stimulator (iCOS-iCOSL) signaling in T helper cells; retinoid X receptor (RXR) activation; and phosphoinositide 3-kinase (PI3K) signaling in B lymphocytes).

Narang et al.29 obtained 6 radiomic-based imaging features (Gray-Level Size Zone Matrix, kurtosis, Neighborhood Gray Tone Difference Matrix) after feature selection tailored to gene expression levels of CD3 T cells using the Boruta algorithm. Using dichotomized CD3 counts, they trained and tested the classifier using the 6 features. A multivariate regression analysis demonstrated that the classifier was not confounded by clinical factors or tumor volume.

Hsu et al.30 identified radiomic-based imaging features related to T1 CE and ADC images (first order, gray-level run-length matrix, gray-level co-occurrence matrix (GLCM)) that were able to classify clustering-derived immune cell subset patient groups based on immune profile combinations (cytotoxic T lymphocytes (CTLs), activated dendritic cells (aDCs), T regulatory cells (Tregs), myeloid-derived suppressor cells) using logistic regression models. The features were selected using random forest and information gain algorithms.

Radiological Imaging Biomarker Summary

Biomarkers extracted from MRI volumes of interest that correlated with various immune-related markers in patients with glioblastoma included ADC values, nCBV values, and image-based (VASARI, radiomics) features.

ADC biomarkers were negatively correlated with, firstly, CD3e and CD49d expression levels and, secondly, an immune-related gene signature (CD4, CD86, major histocompatibility complex class I and II) in respective studies.23,26 Similarly, nCBV biomarkers were positively correlated with expression levels of CD68, CSF1R, CD33 and CD4.23 Radiomic biomarkers (shape, first order, wavelet, and texture) were predictive of firstly, immune infiltration patterns/scores or CD3 expression levels in respective studies,27,29 or secondly survival, which was shown to be correlated with immune-related genes (TIMP1, repressor of silencing 1, EREG), immune cell infiltration scores or other immune signatures, in respective studies.24,27,30 Simpler radiomic biomarkers (tumor volume-class, T1/FLAIR ratio, and hemorrhage phenotype) were predictive of survival, which was shown to be correlated with immune-related pathways (iCOS-iCOSL, RXR, and PI3K).28 Similarly, tumor volume was negatively correlated with CD123, CD49d, and CD117.23 The immune-related genomic and corresponding radiological biomarkers identified in this review are summarized in Table 4.

Table 4.

Immune-Related Genomic Biomarkers With Corresponding Radiological Biomarkers Identified in the Review

PaperImmune-related genomic biomarker/sImmune Function/ associated immune cellsClinical statusRadiological biomarkerRadiological status
Cho et al.23CD68, CSF1R, CD33, CD4, CD49d, CD11b, CD123, CD25, CD117CD68,38 CSF1R38,39: TAMs
CD3340: myeloid-derived suppressor cells (MDSCs)
CD441–43: helper T cells, cytotoxic T cells
CD3e44,45: Helper T cells, cytotoxic T cells
CD49d46: myeloid cells
CD11b47: macrophages, neutrophils, NK cells, memory B cells, cytotoxic T cells
CD12348:dendritic cells
CD2549: T cells, B cells, NK cells, regulatory T cells
CD11750: hematopoietic stem and progenitor cells, pro-B cells, pro-T cells
EstablishedQuantitative MRI features
(ADC, nCBV, T2 FLAIR)
Not established
Liao et al.24TIMP1, ROS1, EREG, and CHIT1TIMP151: Dendritic cells, macrophage, neutrophils
ROS152: Under research
EREG53: Influence expression of PD-L1
CHIT154: macrophages
Not establishedRadiomic MRI features
(T2 FLAIR)
Not established
Jajamovich et al.26CD4, CD86, MHC I, and MHC IICD4,41–43 CD86,55 MHC I,56,57 MHC II58,59: Dendritic cell maturation, TREM1 signaling, communication between innate and adaptive immune cells, production of nitric oxide and reactive oxygen species in macrophages, complement systemEstablishedQuantitative MRI features (ADC)Not established
Liu et al.27Immune cell infiltration score (low vs high)N/AN/ARadiomic MRI features
(T2, T1 CE)
Not established
Rao et al.28Immune-related pathways derived from gene expression levelsN/AN/AQuantitative and qualitative MRI features (VASARI; T1, T2, T1 CE, T2 FLAIR)Not established
Narang et al.29 CD3CD360: Helper T cells, cytotoxic T cellsEstablishedRadiomic MRI features
(T1 CE, T2 FLAIR)
Not established
Hsu et al.30Enrichment-based Immune phenotypes based on cytotoxic T cells, activated dendritic cells, regulatory T cells (Tregs), myeloid-derived suppressor cells (MDSCs)N/AN/ARadiomic MRI features
(T1 CE, ADC)
Not established
George et al.22Response to anti-PD-L1 immunotherapyPD-L161,62: T cellsEstablishedRadiomic MRI features
(T1, T1 CE, T2 FLAIR)
Not established
Qin et al.25Response to Anti-PD-1 +/− CTLA-4 immunotherapyPD-1,61,62 CTLA-463: T cellsEstablishedQuantitative MRI features (ADC, T2 FLAIR)Not established
PaperImmune-related genomic biomarker/sImmune Function/ associated immune cellsClinical statusRadiological biomarkerRadiological status
Cho et al.23CD68, CSF1R, CD33, CD4, CD49d, CD11b, CD123, CD25, CD117CD68,38 CSF1R38,39: TAMs
CD3340: myeloid-derived suppressor cells (MDSCs)
CD441–43: helper T cells, cytotoxic T cells
CD3e44,45: Helper T cells, cytotoxic T cells
CD49d46: myeloid cells
CD11b47: macrophages, neutrophils, NK cells, memory B cells, cytotoxic T cells
CD12348:dendritic cells
CD2549: T cells, B cells, NK cells, regulatory T cells
CD11750: hematopoietic stem and progenitor cells, pro-B cells, pro-T cells
EstablishedQuantitative MRI features
(ADC, nCBV, T2 FLAIR)
Not established
Liao et al.24TIMP1, ROS1, EREG, and CHIT1TIMP151: Dendritic cells, macrophage, neutrophils
ROS152: Under research
EREG53: Influence expression of PD-L1
CHIT154: macrophages
Not establishedRadiomic MRI features
(T2 FLAIR)
Not established
Jajamovich et al.26CD4, CD86, MHC I, and MHC IICD4,41–43 CD86,55 MHC I,56,57 MHC II58,59: Dendritic cell maturation, TREM1 signaling, communication between innate and adaptive immune cells, production of nitric oxide and reactive oxygen species in macrophages, complement systemEstablishedQuantitative MRI features (ADC)Not established
Liu et al.27Immune cell infiltration score (low vs high)N/AN/ARadiomic MRI features
(T2, T1 CE)
Not established
Rao et al.28Immune-related pathways derived from gene expression levelsN/AN/AQuantitative and qualitative MRI features (VASARI; T1, T2, T1 CE, T2 FLAIR)Not established
Narang et al.29 CD3CD360: Helper T cells, cytotoxic T cellsEstablishedRadiomic MRI features
(T1 CE, T2 FLAIR)
Not established
Hsu et al.30Enrichment-based Immune phenotypes based on cytotoxic T cells, activated dendritic cells, regulatory T cells (Tregs), myeloid-derived suppressor cells (MDSCs)N/AN/ARadiomic MRI features
(T1 CE, ADC)
Not established
George et al.22Response to anti-PD-L1 immunotherapyPD-L161,62: T cellsEstablishedRadiomic MRI features
(T1, T1 CE, T2 FLAIR)
Not established
Qin et al.25Response to Anti-PD-1 +/− CTLA-4 immunotherapyPD-1,61,62 CTLA-463: T cellsEstablishedQuantitative MRI features (ADC, T2 FLAIR)Not established

VOI, volume of interest; CD, cluster of differentiation; TAMs, tumor-associated macrophages; MHC, major histocompatibility complex.

Regarding the clinical status of the immune markers, we define “established” and “not established” arbitrarily as being established as an immune cell surface markers and vice-versa; regarding radiological status, “established” and “not established” as the radiological markers are clinically used as a biomarker for immune status and not radiologically established marker for immune status respectively.

Table 4.

Immune-Related Genomic Biomarkers With Corresponding Radiological Biomarkers Identified in the Review

PaperImmune-related genomic biomarker/sImmune Function/ associated immune cellsClinical statusRadiological biomarkerRadiological status
Cho et al.23CD68, CSF1R, CD33, CD4, CD49d, CD11b, CD123, CD25, CD117CD68,38 CSF1R38,39: TAMs
CD3340: myeloid-derived suppressor cells (MDSCs)
CD441–43: helper T cells, cytotoxic T cells
CD3e44,45: Helper T cells, cytotoxic T cells
CD49d46: myeloid cells
CD11b47: macrophages, neutrophils, NK cells, memory B cells, cytotoxic T cells
CD12348:dendritic cells
CD2549: T cells, B cells, NK cells, regulatory T cells
CD11750: hematopoietic stem and progenitor cells, pro-B cells, pro-T cells
EstablishedQuantitative MRI features
(ADC, nCBV, T2 FLAIR)
Not established
Liao et al.24TIMP1, ROS1, EREG, and CHIT1TIMP151: Dendritic cells, macrophage, neutrophils
ROS152: Under research
EREG53: Influence expression of PD-L1
CHIT154: macrophages
Not establishedRadiomic MRI features
(T2 FLAIR)
Not established
Jajamovich et al.26CD4, CD86, MHC I, and MHC IICD4,41–43 CD86,55 MHC I,56,57 MHC II58,59: Dendritic cell maturation, TREM1 signaling, communication between innate and adaptive immune cells, production of nitric oxide and reactive oxygen species in macrophages, complement systemEstablishedQuantitative MRI features (ADC)Not established
Liu et al.27Immune cell infiltration score (low vs high)N/AN/ARadiomic MRI features
(T2, T1 CE)
Not established
Rao et al.28Immune-related pathways derived from gene expression levelsN/AN/AQuantitative and qualitative MRI features (VASARI; T1, T2, T1 CE, T2 FLAIR)Not established
Narang et al.29 CD3CD360: Helper T cells, cytotoxic T cellsEstablishedRadiomic MRI features
(T1 CE, T2 FLAIR)
Not established
Hsu et al.30Enrichment-based Immune phenotypes based on cytotoxic T cells, activated dendritic cells, regulatory T cells (Tregs), myeloid-derived suppressor cells (MDSCs)N/AN/ARadiomic MRI features
(T1 CE, ADC)
Not established
George et al.22Response to anti-PD-L1 immunotherapyPD-L161,62: T cellsEstablishedRadiomic MRI features
(T1, T1 CE, T2 FLAIR)
Not established
Qin et al.25Response to Anti-PD-1 +/− CTLA-4 immunotherapyPD-1,61,62 CTLA-463: T cellsEstablishedQuantitative MRI features (ADC, T2 FLAIR)Not established
PaperImmune-related genomic biomarker/sImmune Function/ associated immune cellsClinical statusRadiological biomarkerRadiological status
Cho et al.23CD68, CSF1R, CD33, CD4, CD49d, CD11b, CD123, CD25, CD117CD68,38 CSF1R38,39: TAMs
CD3340: myeloid-derived suppressor cells (MDSCs)
CD441–43: helper T cells, cytotoxic T cells
CD3e44,45: Helper T cells, cytotoxic T cells
CD49d46: myeloid cells
CD11b47: macrophages, neutrophils, NK cells, memory B cells, cytotoxic T cells
CD12348:dendritic cells
CD2549: T cells, B cells, NK cells, regulatory T cells
CD11750: hematopoietic stem and progenitor cells, pro-B cells, pro-T cells
EstablishedQuantitative MRI features
(ADC, nCBV, T2 FLAIR)
Not established
Liao et al.24TIMP1, ROS1, EREG, and CHIT1TIMP151: Dendritic cells, macrophage, neutrophils
ROS152: Under research
EREG53: Influence expression of PD-L1
CHIT154: macrophages
Not establishedRadiomic MRI features
(T2 FLAIR)
Not established
Jajamovich et al.26CD4, CD86, MHC I, and MHC IICD4,41–43 CD86,55 MHC I,56,57 MHC II58,59: Dendritic cell maturation, TREM1 signaling, communication between innate and adaptive immune cells, production of nitric oxide and reactive oxygen species in macrophages, complement systemEstablishedQuantitative MRI features (ADC)Not established
Liu et al.27Immune cell infiltration score (low vs high)N/AN/ARadiomic MRI features
(T2, T1 CE)
Not established
Rao et al.28Immune-related pathways derived from gene expression levelsN/AN/AQuantitative and qualitative MRI features (VASARI; T1, T2, T1 CE, T2 FLAIR)Not established
Narang et al.29 CD3CD360: Helper T cells, cytotoxic T cellsEstablishedRadiomic MRI features
(T1 CE, T2 FLAIR)
Not established
Hsu et al.30Enrichment-based Immune phenotypes based on cytotoxic T cells, activated dendritic cells, regulatory T cells (Tregs), myeloid-derived suppressor cells (MDSCs)N/AN/ARadiomic MRI features
(T1 CE, ADC)
Not established
George et al.22Response to anti-PD-L1 immunotherapyPD-L161,62: T cellsEstablishedRadiomic MRI features
(T1, T1 CE, T2 FLAIR)
Not established
Qin et al.25Response to Anti-PD-1 +/− CTLA-4 immunotherapyPD-1,61,62 CTLA-463: T cellsEstablishedQuantitative MRI features (ADC, T2 FLAIR)Not established

VOI, volume of interest; CD, cluster of differentiation; TAMs, tumor-associated macrophages; MHC, major histocompatibility complex.

Regarding the clinical status of the immune markers, we define “established” and “not established” arbitrarily as being established as an immune cell surface markers and vice-versa; regarding radiological status, “established” and “not established” as the radiological markers are clinically used as a biomarker for immune status and not radiologically established marker for immune status respectively.

Bias Assessment and Applicability Concerns

A qualitative analysis of the risk of bias and concerns regarding applicability was performed for each study and is summarized in Supplementary Figure S1. Six (6/9; 67%) studies had a high risk of index test bias. The risk of bias was high or unclear in 6/9 (67%) studies regarding patient selection and was unclear in 4/9 (44%) studies regarding the reference standard used. Concerns of study applicability were high regarding the index test in 6/9 (67%) studies, high or unclear regarding patient selection in 7/9 (78%) studies, and unclear regarding the reference standard used in 5/9 (56%) studies.

Discussion

Summary of Findings

The systematic review demonstrated that radiological biomarkers, namely ADC values, nCBV values, and radiomic features (VASARI, texture, shape, histogram, and wavelet) extracted from different MRI sequences, correlated with immune-related genetic markers and were developed as noninvasive radiogenomic biomarkers. Some studies used internal hold-out datasets for analytical biomarker validation21; however, none used external hold-out datasets to validate the trained biomarker. Some non-radiogenomic biomarkers (ie, without any correlation with immune-related genetic markers) were developed to predict response to immunotherapy. All reviewed studies are best considered as “proof of concept.”

Limitations

Studies Assessed

All studies employed retrospective designs. Limitations encompassed 6 main areas.

First, differences in the type of genomic data (single vs bulk RNA-sequencing data; microarray data, polymerase chain reaction or immunohistochemistry-based data) and their harmonization in each study confound pooled inferences from the different studies (Supplementary Table S4).

Second, patients underwent MRI imaging in different centers where there were differences in scanner manufacturer and local MRI sequence protocols. Different postprocessing steps were deployed in each study to tackle these differences but lack uniformity (Supplemental Table S5). It is plausible that there could be subsequent variability in the imaging features between centers confounding pooled inferences from the different studies.

Third, patient selection for the majority of studies was based on what had been included in public datasets (especially TCIA/TCGA) or small sets of local hospital data. Not only did the sample appear to be similar or the same in almost all studies (from TCIA/TCGA), but there was no clear and detailed explanation regarding the process of patient selection. For example, there was no clarity regarding patient selection being continuous or at random. Furthermore, other eligibility criteria varied amongst all the studies and again the details were unclear in the majority of studies. Confounded patient selection may mean that the study samples are not representative of the intended population (“glioblastomas, isocitrate dehydrogenase (IDH)-wild type” and “astrocytoma, IDH-mutant, grade 4”) which limits the generalizability of the results to the clinic. It is noteworthy that even if generalizable to the pooled grade 4 gliomas, the biomarkers developed in the studies have not been optimized for IDH-wild-type glioblastoma alone (as the datasets preceded the 2021 WHO classification).

Fourth, details regarding the reference standards used in the majority of studies were unclear and it would be challenging to reproduce them. Furthermore, tumor heterogeneity within the TME is likely to confound reference standards and may be a limitation in all the studies as the biopsy sample of the tumor, and subsequent tumor-tissue genomic data, may not entirely represent the overall TME of the tumor.64,65 The majority of the studies23,24,26–28 have not addressed other confounding variables such as age at diagnosis, resection status (biopsy, subtotal resection, total resection), postsurgical treatment (complete/incomplete Stupp protocol) and second-line treatment including immunotherapy that are likely to influence the development and validation of prognostic biomarkers.24,27,28 Moreover, diagnostic biomarkers can also be confounded by the unique interaction between the central nervous system, immune system, and advanced age in patients with glioma.66 An example relevant to 2 of the included studies23,26 is that microglia express higher basal levels of MHCII and CD11b with age.67

Fifth, the variable index tests developed as radiogenomic biomarkers did not undergo rigorous analytical validation and none were clinically validated.21 Internal hold-out test sets were used effectively to validate prognostic biomarkers after training in 2 studies24,28 and a diagnostic biomarker in one study29 (none were temporal hold-out test sets). Overall, these findings limit the generalizability of the results to the clinic.

Sixth, most studies employed indirect methods for biomarker development and validation. For example, an imaging biomarker might predict a gene expression signature; a separate dataset containing no imaging data might show that the same gene expression signature can predict survival. The separate dataset is not a hold test set for validating an imaging biomarker for either a gene expression signature or survival. The limitation is that such indirect methodology for imaging biomarker development shows there is some clinical relevance, but this is not analytical validation.21 Most studies likely employed such methods as there are few datasets containing imaging data that is matched with gene expression (for diagnostic biomarkers) or survival (for prognostic biomarkers).

Review Process

Pooled diffuse glioma (WHO grades 2–4) studies were excluded from the review process as it was beyond the research question, but we acknowledge that the biomarkers obtained in these studies might be of use in glioblastoma.68,69

Publication bias may have affected the range of performance accuracy of the biomarkers included in this systematic review. The potential for publication bias may be heightened by the omission of preprints and materials that have not undergone peer review. This is particularly relevant in the data science community, where the rapid pace of development often outstrips the slower process of peer review, leading some researchers to avoid submitting their work to peer-reviewed journals.17 The composition of the research team could therefore influence this bias. Teams with a stronger clinical focus might be more likely to seek publication in peer-reviewed journals, whereas those with a stronger emphasis on data science might not.

Study Explanations and Relevance From a National and International Perspective

The focus of most of these studies was on prognosis which may be of limited relevance to either identifying immune-related targets for immunotherapy; or for predicting therapeutic response to immunotherapy. Novel immunotherapeutic approaches are currently being explored for glioblastoma but the translational landscape from basic scientific evidence to efficacious clinical treatment is still far behind other cancers.9,70–80 Two areas of research can be combined to help develop panels of biomarkers which may be useful to stratify immunotherapy to treat particular tumors, and thereby contribute meaningfully to translation. First, studies focusing on immune-related genes and the immune tumor microenvironment (TME) in glioblastoma as well as melanoma, ovarian, lung, and colon cancers have demonstrated potential immunotherapy targets and therefore desirable prediction classes for radiogenomic analysis.9,35–37,64–66,72–76,81–85 Second, there is an expanding arsenal of techniques to extract features including radiomics and deep learning features that can be used to develop imaging biomarkers in glioblastoma,86–91 and even a decade ago non-immune radiogenomic glioblastoma studies demonstrated considerable promise.92 It is plausible that these 2 advancements, alongside an expanding number of new data repositories, may lead to the development of important biomarkers and allow translation to succeed—the review shows we are currently at a proof-of-concept stage.

Current Evidence in the Field

This is the first systematic review of immune-related radiogenomic biomarker studies for glioblastoma. One study that did not focus on glioblastoma patients but also included oligodendroglioma and astrocytoma patients, developed an immune TME radiomic signature.93 Here it was shown that the heterogeneity of the immune TME harbors prognostic impact. Other studies of interest have used different modalities. Nagle et al.94 demonstrated imaging biomarkers for labeled CD8 T cells using positron emission tomography (PET) imaging in glioblastoma mouse models and showed the ability to quantify CD8 T cells noninvasively. Similarly, various radiomic signatures associated with CD8 T cells were identified in a systematic review by Ramlee et al.95 related to various cancers including glioma (high and low-grade), gastrointestinal cancer, head and neck cancer, hepatobiliary cancer, lung cancer, breast cancer, and melanoma and their respective CD8 T-cell-related radiomic signature obtained from imaging modalities such as PET, CT, and MRI.

Large high-quality multicenter studies are possible and should be the standard to aim for in neuro-oncology. In other oncology disciplines, this has been demonstrated. For example, Sun et al.96 developed and validated CT-derived radiomic biomarkers related to tumor-infiltrating CD8 T cells in patients included in phase I trials of anti-programmed cell death protein-1 (PD-1) or anti-programmed cell death ligand 1 (PD-L1) monotherapy for solid malignant tumors. Similarly, Trebeschi et al.97 developed CT-derived radiomic biomarkers for predicting response to immunotherapy in advanced melanoma and lung cancer patients. It is also noteworthy that platforms such as ImaGene (https://github.com/skr1/Imagene) have demonstrated the potential for reproducibility of radiogenomic analysis with initial feasibility experiments analyzing invasive breast carcinoma, and head and neck squamous cell carcinoma.98

Implications for Future Research and Clinical Practice

The present review has revealed an absence of high-quality studies regarding immune-related radiogenomic markers in glioblastoma with concerns regarding bias and generalizability. Future large, multicenter, prospective studies using radiomic or deep learning methods are required for the development and validation of pertinent biomarkers. It is plausible that features extracted from images of modalities such as advanced MRI (including permeability, perfusion, diffusion, chemical exchange saturation transfer), MR spectroscopic imaging, and PET might provide additional information on tumor biology and microenvironment. Future studies could also develop and validate biomarkers for either IDH-wild-type glioblastoma alone which likely has a unique immune TME (biomarkers for postbiopsy settings at recurrence or during immunotherapy treatment),99 or for lesions that are suspected to be glioblastoma (biomarkers for prebiopsy and neo-adjuvant settings which might include enhancing lower grade gliomas and other mimics). Candidate biomarkers need to be clinically validated in the setting of prospective studies. Whether a clinically validated biomarker demonstrates impact when used in conjunction with an intervention would require the biomarker to be integrated into immunotherapy clinical trials such as the CheckMate 143 study.10 Even if prospective biomarker studies are clinically validated soon, for example, to provide a panel of diagnostic biomarkers ready for patient stratification in downstream research, the scarce level 1 evidence for immunotherapy benefit currently means that biomarker studies demonstrating impact (ie, validated predictive biomarkers) when used in conjunction with an intervention, are unlikely to emerge soon.

Future studies might also use spatial transcriptomics or single-cell sequencing to better understand the role of immune cells in disease progression and lead to the discovery of new classes for radiogenomic analysis. Ultimately, there is the potential to produce noninvasive imaging biomarkers for neo-adjuvant immunotherapy stratification as part of personalized medicine within the next decade.

Funding

TCB supported by the Wellcome Trust [WT 203148/Z/16/Z]. PG is supported by King’s College London postgraduate research (PGR) international studentship.

Acknowledgment

We thank all staff supporting the programme of work from (1) the KCL School of Biomedical Engineering & Imaging Sciences in particular, Giusi Manfredi, Vicky Goh, Patrick Wong, Denise Barton, Valentina Vitiello and Sebastien Ourselin, as well as (2) from King’s College Hospital NHS Foundation Trust, in particular, Ann-Marie Murtagh, Jasmine Palmer and all others in R & D. We thank Dr James Arnold for reviewing the manuscript.

Conflict of interest statement

None.

Authorship statement

Study concept and design: P.G., M.M., and T.C.B.; Literature review and qualitative analysis: P.G. and T.C.B.; Writing the manuscript: P.G., M.M., and T.C.B.. All authors reviewed and approved the final manuscript.

Data availability

All data has been made available in the supplemental file.

References

1.

Mazurowski
MA.
Radiogenomics: what it is and why it is important
.
J Am Coll Radiol.
2015
;
12
(
8
):
862
866
.

2.

Corr
F
,
Grimm
D
,
Saß
B
, et al. .
Radiogenomic predictors of recurrence in glioblastoma-a systematic review
.
J Pers Med
.
2022
;
12
(
3
):
402
.

3.

Anil
R
,
Colen
RR.
Imaging genomics in glioblastoma multiforme: A predictive tool for patients prognosis, survival, and outcome
.
Magn Reson Imaging Clin N Am.
2016
;
24
(
4
):
731
740
.

4.

Liu
D
,
Chen
J
,
Hu
X
, et al. .
Imaging-genomics in glioblastoma: Combining molecular and imaging signatures
.
Front Oncol.
2021
;
11
:
699265
.

5.

Wijethilake
N
,
Islam
M
,
Meedeniya
D
,
Chitraranjan
C
,
Perera
I
,
Ren
H.
Radiogenomics of glioblastoma: Identification of radiomics associated with molecular subtypes
. In:
Kia
S
, Mohy-ud-Din
et al. , eds, 
Machine Learning in Clinical Neuroimaging and Radiogenomics in Neuro-oncology. MLCN RNO-AI 2020 2020. Lecture Notes in Computer Science
.
Vol 12449
.
Cham
:
Springer
;
2020
.

6.

Stupp
R
,
Mason
WP
,
van den Bent
MJ
, et al. ;
European Organisation for Research and Treatment of Cancer Brain Tumor and Radiotherapy Groups
.
Radiotherapy plus concomitant and adjuvant temozolomide for glioblastoma
.
N Engl J Med.
2005
;
352
(
10
):
987
996
.

7.

Lamborn
KR
,
Yung
WK
,
Chang
SM
, et al. ;
North American Brain Tumor Consortium
.
Progression-free survival: An important end point in evaluating therapy for recurrent high-grade gliomas
.
Neuro Oncol.
2008
;
10
(
2
):
162
170
.

8.

Yang
T
,
Kong
Z
,
Ma
W.
PD-1/PD-L1 immune checkpoint inhibitors in glioblastoma: Clinical studies, challenges and potential
.
Hum Vaccin Immunother
.
2021
;
17
(
2
):
546
553
.

9.

Hao
C
,
Chen
G
,
Zhao
H
, et al. .
PD-L1 expression in glioblastoma, the clinical and prognostic significance: A systematic literature review and meta-analysis
.
Front Oncol.
2020
;
10
:
1015
.

10.

Reardon
DA
,
Brandes
AA
,
Omuro
A
, et al. .
Effect of nivolumab vs bevacizumab in patients with recurrent glioblastoma: The checkmate 143 phase 3 randomized clinical trial
.
JAMA Oncol
.
2020
;
6
(
7
):
1003
1010
.

11.

Cloughesy
TF
,
Mochizuki
AY
,
Orpilla
JR
, et al. .
Neoadjuvant anti-PD-1 immunotherapy promotes a survival benefit with intratumoral and systemic immune responses in recurrent glioblastoma
.
Nat Med.
2019
;
25
(
3
):
477
486
.

12.

Mitsdoerffer
M
,
Aly
L
,
Barz
M
, et al. .
The glioblastoma multiforme tumor site promotes the commitment of tumor-infiltrating lymphocytes to the TH17 lineage in humans
.
Proc Natl Acad Sci U S A.
2022
;
119
(
34
):
e2206208119
.

13.

Andersen
BM
,
Faust Akl
C
,
Wheeler
MA
, et al. .
Glial and myeloid heterogeneity in the brain tumour microenvironment
.
Nat Rev Cancer.
2021
;
21
(
12
):
786
802
.

14.

Chen
RQ
,
Liu
F
,
Qiu
XY
,
Chen
XQ.
The prognostic and therapeutic value of PD-L1 in glioma
.
Front Pharmacol.
2019
;
9
:
1503
.

15.

Page
MJ
,
McKenzie
JE
,
Bossuyt
PM
, et al. .
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
.
Syst Rev
2021
;
10
:
89
.

16.

Baumann
N.
How to use the medical subject headings (MeSH)
.
Int J Clin Pract.
2016
;
70
(
2
):
171
174
.

17.

Booth
TC
,
Grzeda
M
,
Chelliah
A
, et al. .
Imaging biomarkers of glioblastoma treatment response: A systematic review and meta-analysis of recent machine learning studies
.
Front Oncol.
2022
;
12
:
799662
.

18.

Din
M
,
Agarwal
S
,
Grzeda
M
, et al. .
Detection of cerebral aneurysms using artificial intelligence: A systematic review and meta-analysis
.
J Neurointerv Surg.
2023
;
15
(
3
):
262
271
.

19.

Whiting
PF
,
Rutjes
AW
,
Westwood
ME
, et al. ;
QUADAS-2 Group
.
QUADAS-2: A revised tool for the quality assessment of diagnostic accuracy studies
.
Ann Intern Med.
2011
;
155
(
8
):
529
536
.

20.

Mongan
J
,
Moy
L
,
Kahn
CE
, Jr
.
Checklist for artificial intelligence in medical imaging (CLAIM): A guide for authors and reviewers
.
Radiol Artif Intell
.
2020
;
2
(
2
):
e200029
.

21.

Cagney
DN
,
Sul
J
,
Huang
RY
, et al. .
The FDA NIH Biomarkers, EndpointS, and other Tools (BEST) resource in neuro-oncology
.
Neuro Oncol
.
2018
;
20
(
9
):
1162
1172
.

22.

George
E
,
Flagg
E
,
Chang
K
, et al. .
Radiomics-based machine learning for outcome prediction in a multicenter phase II study of programmed death-ligand 1 inhibition immunotherapy for glioblastoma
.
AJNR Am J Neuroradiol.
2022
;
43
(
5
):
675
681
.

23.

Cho
HR
,
Jeon
H
,
Park
CK
,
Park
SH
,
Choi
SH.
Radiogenomics profiling for glioblastoma-related immune cells reveals CD49d expression correlation with MRI parameters and Prognosis
.
Sci Rep.
2018
;
8
(
1
):
16022
.

24.

Liao
X
,
Cai
B
,
Tian
B
, et al. .
Machine-learning based radiogenomics analysis of MRI features and metagenes in glioblastoma multiforme patients with different survival time
.
J Cell Mol Med.
2019
;
23
(
6
):
4375
4385
.

25.

Qin
L
,
Li
X
,
Stroiney
A
, et al. .
Advanced MRI assessment to predict benefit of anti-programmed cell death 1 protein immunotherapy response in patients with recurrent glioblastoma
.
Neuroradiology.
2017
;
59
(
2
):
135
145
.

26.

Jajamovich
GH
,
Valiathan
CR
,
Cristescu
R
,
Somayajula
S.
Integrative analysis of diffusion-weighted MRI and genomic data to inform treatment of glioblastoma
.
J Neurooncol.
2016
;
129
(
2
):
289
300
.

27.

Liu
D
,
Chen
J
,
Ge
H
, et al. .
Radiogenomics to characterize the immune-related prognostic signature associated with biological functions in glioblastoma
.
Eur Radiol.
2023
;
33
(
1
):
209
220
.

28.

Rao
A
,
Rao
G
,
Gutman
DA
, et al. ;
TCGA Glioma Phenotype Research Group
.
TCGA Glioma Phenotype Research Group. A combinatorial radiographic phenotype may stratify patient survival and be associated with invasion and proliferation characteristics in glioblastoma
.
J Neurosurg.
2016
;
124
(
4
):
1008
1017
.

29.

Narang
S
,
Kim
D
,
Aithala
S
, et al. .
Tumor image-derived texture features are associated with CD3 T-cell infiltration status in glioblastoma
.
Oncotarget
.
2017
;
8
(
60
):
101244
101254
.

30.

Hsu
JB
,
Lee
GA
,
Chang
TH
, et al. .
Radiomic immunophenotyping of GSEA-assessed immunophenotypes of glioblastoma and its implications for prognosis: A feasibility studY
.
Cancers (Basel)
.
2020
;
12
(
10
):
3039
.

31.

Okada
H
,
Weller
M
,
Huang
R
, et al. .
Immunotherapy response assessment in neuro-oncology: A report of the RANO working group
.
Lancet Oncol.
2015
;
16
(
15
):
e534
e542
.

32.

Nasseri
M
,
Gahramanov
S
,
Netto
JP
, et al. .
Evaluation of pseudoprogression in patients with glioblastoma multiforme using dynamic magnetic resonance imaging with ferumoxytol calls RANO criteria into question
.
Neuro Oncol
.
2014
;
16
(
8
):
1146
1154
.

33.

Wen
PY
,
Macdonald
DR
,
Reardon
DA
, et al. .
Updated response assessment criteria for high-grade gliomas: response assessment in neuro-oncology working group
.
J Clin Oncol.
2010
;
28
(
11
):
1963
1972
.

34.

Louis
DN
,
Perry
A
,
Wesseling
P
, et al. .
The 2021 WHO classification of tumors of the central nervous system: A summary
.
Neuro Oncol
.
2021
;
23
(
8
):
1231
1251
.

35.

Liu
L
,
Yang
S
,
Lin
K
, et al. .
Sp1 induced gene TIMP1 is related to immune cell infiltration in glioblastoma
.
Sci Rep.
2022
;
12
:
11181
.

36.

Sugiyama
S
,
Nakabayashi
K
,
Baba
I
,
Sasazuki
T
,
Shirasawa
S.
Role of epiregulin in peptidoglycan-induced proinflammatory cytokine production by antigen presenting cells
.
Biochem Biophys Res Commun.
2005
;
337
(
1
):
271
274
.

37.

Human Gene Database
. https://www.genecards.org/
Accessed on February 24, 2024
.

38.

Wang
L
,
Zhang
C
,
Zhang
Z
, et al. .
Specific clinical and immune features of CD68 in glioma via 1,024 samples
.
Cancer Manag Res
.
2018
;
10
:
6409
6419
.

39.

Ries
CH
,
Cannarile
MA
,
Hoves
S
, et al. .
Targeting tumor-associated macrophages with anti-CSF-1R antibody reveals a strategy for cancer therapy
.
Cancer Cell
.
2014
;
25
(
6
):
846
859
.

40.

Olingy
CE
,
Dinh
HQ
,
Hedrick
CC.
Monocyte heterogeneity and functions in cancer
.
J Leukoc Biol.
2019
;
106
(
2
):
309
322
.

41.

Luckheeram
RV
,
Zhou
R
,
Verma
AD
,
Xia
B.
CD4⁺T cells: differentiation and functions
.
Clin Dev Immunol.
2012
;
2012
:
925135
.

42.

Chatzileontiadou
DSM
,
Sloane
H
,
Nguyen
AT
,
Gras
S
,
Grant
EJ.
The Many Faces of CD4+ T cells: Immunological and structural characteristics
.
Int J Mol Sci .
2020
;
22
(
1
):
73
.

43.

Raphael
I
,
Joern
RR
,
Forsthuber
TG.
Memory CD4+ T cells in immunity and autoimmune diseases
.
Cells
.
2020
;
9
(
3
):
531
.

44.

Wu
W
,
Zhou
Q
,
Masubuchi
T
, et al. .
Multiple signaling roles of CD3ε and Its Application in CAR-T Cell Therapy
.
Cell.
2020
;
182
(
4
):
855
871.e23
.

45.

Bettini
ML
,
Guy
C
,
Dash
P
, et al. .
Membrane association of the CD3ε signaling domain is required for optimal T cell development and function
.
J Immunol.
2014
;
193
(
1
):
258
267
.

46.

Haile
LA
,
Gamrekelashvili
J
,
Manns
MP
,
Korangy
F
,
Greten
TF.
CD49d is a new marker for distinct myeloid-derived suppressor cell subpopulations in mice
.
J Immunol.
2010
;
185
(
1
):
203
210
.

47.

Christensen
JE
,
Andreasen
SO
,
Christensen
JP
,
Thomsen
AR.
CD11b expression as a marker to distinguish between recently activated effector CD8(+) T cells and memory cells
.
Int Immunol.
2001
;
13
(
4
):
593
600
.

48.

El Achi
H
,
Dupont
E
,
Paul
S
,
Khoury
JD.
CD123 as a biomarker in hematolymphoid malignancies: Principles of detection and targeted therapies
.
Cancers (Basel)
.
2020
;
12
(
11
):
3087
.

49.

Flynn
MJ
,
Hartley
JA.
The emerging role of anti-CD25 directed therapies as both immune modulators and targeted agents in cancer
.
Br J Haematol.
2017
;
179
(
1
):
20
35
.

50.

Myburgh
R
,
Kiefer
JD
,
Russkamp
NF
, et al. .
Anti-human CD117 CAR T-cells efficiently eliminate healthy and malignant CD117-expressing hematopoietic cells
.
Leukemia.
2020
;
34
(
10
):
2688
2703
.

51.

Liu
L
,
Yang
S
,
Lin
K
, et al. .
Sp1 induced gene TIMP1 is related to immune cell infiltration in glioblastoma
.
Sci Rep.
2022
;
12
(
1
):
11181
.

52.

Birchmeier
C
,
Sharma
S
,
Wigler
M.
Expression and rearrangement of the ROS1 gene in human glioblastoma cells
.
Proc Natl Acad Sci U S A.
1987
;
84
(
24
):
9270
9274
.

53.

Zhou
Y
,
Xiao
D
,
Jiang
X
,
Nie
C.
EREG is the core onco-immunological biomarker of cuproptosis and mediates the cross-talk between VEGF and CD99 signaling in glioblastoma
.
J Transl Med.
2023
;
21
(
1
):
28
.

54.

Di Francesco
AM
,
Verrecchia
E
,
Manna
S
,
Urbani
A
,
Manna
R.
The chitinases as biomarkers in immune-mediate diseases
.
Clin Chem Lab Med.
2022
;
61
(
8
):
1363
1381
.

55.

Wennhold
K
,
Thelen
M
,
Lehmann
J
, et al. .
CD86+ antigen-presenting B cells are increased in cancer, localize in tertiary lymphoid structures, and induce specific T-cell Responses
.
Cancer Immunol Res
.
2021
;
9
(
9
):
1098
1108
.

56.

Cornel
AM
,
Mimpen
IL
,
Nierkens
S.
MHC class i downregulation in cancer: Underlying mechanisms and potential targets for cancer immunotherapy
.
Cancers (Basel)
.
2020
;
12
(
7
):
1760
.

57.

Wu
X
,
Li
T
,
Jiang
R
, et al. .
Targeting MHC-I molecules for cancer: Function, mechanism, and therapeutic prospects
.
Mol Cancer.
2023
;
22
(
1
):
194
.

58.

Axelrod
ML
,
Cook
RS
,
Johnson
DB
,
Balko
JM.
Biological consequences of MHC-II expression by tumor cells in cancer
.
Clin Cancer Res.
2019
;
25
(
8
):
2392
2402
.

59.

Kim
JY
,
Cha
H
,
Kim
K
, et al. .
MHC II immunogenicity shapes the neoepitope landscape in human tumors
.
Nat Genet.
2023
;
55
(
2
):
221
231
.

60.

Menon
AP
,
Moreno
B
,
Meraviglia-Crivelli
D
, et al. .
Modulating T cell responses by targeting CD3
.
Cancers (Basel)
.
2023
;
15
(
4
):
1189
.

61.

Jiang
Y
,
Chen
M
,
Nie
H
,
Yuan
Y.
PD-1 and PD-L1 in cancer immunotherapy: Clinical implications and future considerations
.
Hum Vaccin Immunother
.
2019
;
15
(
5
):
1111
1122
.

62.

Tang
Q
,
Chen
Y
,
Li
X
, et al. .
The role of PD-1/PD-L1 and application of immune-checkpoint inhibitors in human cancers
.
Front Immunol.
2022
;
13
:
964442
.

63.

Sobhani
N
,
Tardiel-Cyril
DR
,
Davtyan
A
, et al. .
CTLA-4 in regulatory T cells for cancer immunotherapy
.
Cancers (Basel)
.
2021
;
13
(
6
):
1440
.

64.

Mathur
R
,
Wang
Q
,
Schupp
PG
, et al. .
Glioblastoma evolution and heterogeneity from a 3D whole-tumor perspective
.
Cell.
2024
;
187
(
2
):
446
463.e16
.

65.

Baig
S
,
Winkler
F.
A holistic view of the malignant organism we call glioblastoma
.
Cell.
2024
;
187
(
2
):
271
273
.

66.

Ladomersky
E
,
Zhai
L
,
Lauing
KL
, et al. .
Advanced age increases immunosuppression in the brain and decreases immunotherapeutic efficacy in subjects with glioblastoma
.
Clin Cancer Res.
2020
;
26
(
19
):
5232
5245
.

67.

Rogers
J
,
Luber-Narod
J
,
Styren
SD
,
Civin
WH.
Expression of immune system-associated antigens by cells of the human central nervous system: Relationship to the pathology of Alzheimer’s disease
.
Neurobiol Aging.
1988
;
9
:
339
349
.

68.

Duan
J
,
Zhang
Z
,
Chen
Y
, et al. .
Imaging phenotypes from MRI for the prediction of glioma immune subtypes from RNA sequencing: A multicenter study
.
Mol Oncol.
2023
;
17
(
Doi
):
629
646
.

69.

Chaddad
A
,
Daniel
P
,
Zhang
M
, et al. .
Deep radiomic signature with immune cell markers predicts the survival of glioma patients
.
Neurocomputing
.
2022
;
469
:
366
375
.

70.

DeCordova
S
,
Shastri
A
,
Tsolaki
AG
, et al. .
Molecular heterogeneity and immunosuppressive microenvironment in glioblastoma
.
Front Immunol.
2020
;
11
:
1402
.

71.

Liang
P
,
Chai
Y
,
Zhao
H
,
Wang
G.
Predictive analyses of prognostic-related immune genes and immune infiltrates for glioblastoma
.
Diagnostics (Basel)
.
2020
;
10
(
3
):
177
.

72.

Pombo Antunes
AR
,
Scheyltjens
I
,
Duerinck
J
, et al. .
Understanding the glioblastoma immune microenvironment as basis for the development of new immunotherapeutic strategies
.
Elife
.
2020
;
9
:
e52176
.

73.

Xiong
W
,
Li
C
,
Kong
G
, et al. .
Glioblastoma: Two immune subtypes under the surface of the cold tumor
.
Aging (Albany NY)
.
2022
;
14
(
10
):
4357
4375
.

74.

Zhang
H
,
Chen
Y.
Identification of glioblastoma immune subtypes and immune landscape based on a large cohort
.
Hereditas.
2021
;
158
:
30
.

75.

Bouffet
E
,
Larouche
V
,
Campbell
BB
, et al. .
Immune checkpoint inhibition for hypermutant glioblastoma multiforme resulting from germline biallelic mismatch repair deficiency
.
J Clin Oncol.
2016
;
34
(
19
):
2206
2211
.

76.

Schalper
KA
,
Rodriguez-Ruiz
ME
,
Diez-Valle
R
, et al. .
Neoadjuvant nivolumab modifies the tumor immune microenvironment in resectable glioblastoma
.
Nat Med.
2019
;
25
(
3
):
470
476
.

77.

Verhaak
RG
,
Hoadley
KA
,
Purdom
E
, et al. ;
Cancer Genome Atlas Research Network
.
Integrated genomic analysis identifies clinically relevant subtypes of glioblastoma characterized by abnormalities in PDGFRA, IDH1, EGFR, and NF1
.
Cancer Cell
.
2010
;
17
(
1
):
98
110
.

78.

Kreatsoulas
D
,
Bolyard
C
,
Wu
BX
, et al. .
Translational landscape of glioblastoma immunotherapy for physicians: Guiding clinical practice with basic scientific evidence
.
J Hematol Oncol
.
2022
;
15
(
1
):
80
.

79.

Lim
M
,
Xia
Y
,
Bettegowda
C
,
Weller
M.
Current state of immunotherapy for glioblastoma
.
Nat Rev Clin Oncol.
2018
;
15
(
7
):
422
442
.

80.

Zaidi
SE
,
Moelker
E
,
Singh
K
, et al. .
Novel immunotherapeutic approaches for the treatment of glioblastoma
.
BioDrugs
.
2023
;
37
(
4
):
489
503
.

81.

Huo
X
,
Yang
M
,
Zhang
X
,
Wang
S
,
Sun
H.
Identification of tumor microenvironment scoring scheme based on bioinformatics analysis of immune cell infiltration pattern of ovarian cancer
.
J Oncol
.
2022
;
2022
:
7745675
.

82.

Liu
J
,
Wang
Y
,
Yuan
S
,
Wei
J
,
Bai
J.
Construction of an immune cell infiltration score to evaluate the prognosis and therapeutic efficacy of ovarian cancer patients
.
Front Immunol.
2021
;
12
:
751594
.

83.

Chen
Y
,
Zhao
J.
Identification of an immune gene signature based on tumor microenvironment characteristics in colon adenocarcinoma
.
Cell Transplant.
2021
;
30
:
9636897211001314
.

84.

Zhou
S
,
Sun
Y
,
Chen
T
, et al. .
The Landscape of the tumor microenvironment in skin cutaneous melanoma reveals a prognostic and immunotherapeutically relevant gene signature
.
Front Cell Dev Biol.
2021
;
9
:
739594
.

85.

Song
Y
,
Sun
Y
,
Sun
T
,
Tang
R.
Comprehensive bioinformatics analysis identifies tumor microenvironment and immune-related genes in small cell lung cancer
.
Comb Chem High Throughput Screen.
2020
;
23
(
5
):
381
391
.

86.

Taha
B
,
Boley
D
,
Sun
J
,
Chen
CC.
State of radiomics in glioblastoma
.
Neurosurgery.
2021
;
89
(
2
):
177
184
.

87.

Zhu
M
,
Li
S
,
Kuang
Y
, et al. .
Artificial intelligence in the radiomic analysis of glioblastomas: A review, taxonomy, and perspective
.
Front Oncol.
2022
;
12
:
924245
.

88.

Gevaert
O
,
Mitchell
LA
,
Achrol
AS
, et al. .
Glioblastoma multiforme: Exploratory radiogenomic analysis by using quantitative image features
.
Radiology.
2014
;
273
(
1
):
168
174
.

89.

Pope
WB
,
Sayre
J
,
Perlina
A
, et al. .
MR imaging correlates of survival in patients with high-grade gliomas
.
AJNR Am J Neuroradiol.
2005
;
26
(
10
):
2466
2474
.

90.

Cui
Y
,
Tha
KK
,
Terasaka
S
, et al. .
Prognostic imaging biomarkers in glioblastoma: Development and independent validation on the basis of multiregion and quantitative analysis of MR images
.
Radiology.
2016
;
278
(
2
):
546
553
.

91.

Gillies
RJ
,
Kinahan
PE
,
Hricak
H.
Radiomics: Images are more than pictures, they are data
.
Radiology.
2016
;
278
(
2
):
563
577
.

92.

Jamshidi
N
,
Diehn
M
,
Bredel
M
,
Kuo
MD.
Illuminating radiogenomic characteristics of glioblastoma multiforme through integration of MR imaging, messenger RNA expression, and DNA copy number variation
.
Radiology.
2014
;
270
(
1
):
1
2
.

93.

Kim
AR
,
Choi
KS
,
Kim
MS
, et al. .
Absolute quantification of tumor-infiltrating immune cells in high-grade glioma identifies prognostic and radiomics values
.
Cancer Immunol Immunother.
2021
;
70
(
7
):
1995
2008
.

94.

Nagle
VL
,
Henry
KE
,
Hertz
CAJ
, et al. .
Imaging tumor-infiltrating lymphocytes in brain tumors with [64Cu]Cu-NOTA-anti-CD8 PET
.
Clin Cancer Res.
2021
;
27
(
7
):
1958
1966
.

95.

Ramlee
S
,
Hulse
D
,
Bernatowicz
K
, et al. .
Radiomic signatures associated with CD8+ tumor-infiltrating lymphocytes: A systematic review and quality assessment Study
.
Cancers (Basel)
.
2022
;
14
(
15
):
3656
.

96.

Sun
R
,
Limkin
EJ
,
Vakalopoulou
M
, et al. .
A radiomics approach to assess tumour-infiltrating CD8 cells and response to anti-PD-1 or anti-PD-L1 immunotherapy: an imaging biomarker, retrospective multicohort study
.
Lancet Oncol.
2018
;
19
(
9
):
1180
1191
.

97.

Trebeschi
S
,
Drago
SG
,
Birkbak
NJ
, et al. .
Predicting response to cancer immunotherapy using noninvasive radiomic biomarkers
.
Ann Oncol.
2019
;
30
(
6
):
998
1004
.

98.

Sukhadia
SS
,
Tyagi
A
,
Venkataraman
V
, et al. .
ImaGene: a web-based software platform for tumor radiogenomic evaluation and reporting
.
Bioinform Adv
.
2022
;
2
(
1
):
vbac079
.

99.

Chen
E
,
Ling
AL
,
Reardon
DA
,
Antonio Chiocca
EA.
Lessons learned from phase 3 trials of immunotherapy for glioblastoma: Time for longitudinal sampling
?
Neuro Oncol
.
2024
;
26
(
2
):
211
225
.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.