Abstract

Introduction

Frailty is associated with adverse outcomes among patients attending emergency departments (EDs). While multiple frailty screens are available, little is known about which variables are important to incorporate and how best to facilitate accurate, yet prompt ED screening. To understand the core requirements of frailty screening in ED, we conducted an international, modified, electronic two-round Delphi consensus study.

Methods

A two-round electronic Delphi involving 37 participants from 10 countries was undertaken. Statements were generated from a prior systematic review examining frailty screening instruments in ED (logistic, psychometric and clinimetric properties). Reflexive thematic analysis generated a list of 56 statements for Round 1 (August–September 2021). Four main themes identified were: (i) principles of frailty screening, (ii) practicalities and logistics, (iii) frailty domains and (iv) frailty risk factors.

Results

In Round 1, 13/56 statements (23%) were accepted. Following feedback, 22 new statements were created and 35 were re-circulated in Round 2 (October 2021). Of these, 19 (54%) were finally accepted. It was agreed that ideal frailty screens should be short (<5 min), multidimensional and well-calibrated across the spectrum of frailty, reflecting baseline status 2–4 weeks before presentation. Screening should ideally be routine, prompt (<4 h after arrival) and completed at first contact in ED. Functional ability, mobility, cognition, medication use and social factors were identified as the most important variables to include.

Conclusions

Although a clear consensus was reached on important requirements of frailty screening in ED, and variables to include in an ideal screen, more research is required to operationalise screening in clinical practice.

Key Points

  • An ideal emergency department (ED) frailty screening instrument should be brief to administer and ideally take <5 min to score.

  • It should reflect baseline function in the immediate 2–4 weeks before the current presentation.

  • Delphi participants agreed that a feasible and cost-effective, rather than ideal, screening instrument was most important.

  • Frailty screening should be prompt and completed at the point of first contact in ED and within 4 h of ED attendance.

  • Uncertainty concerning the feasibility, efficacy and cost-effectiveness of frailty screening are barriers to widespread use.

Introduction

The proportion of people aged ≥60 years is growing, resulting in a greater number of complex presentations to emergency departments (EDs) [1, 2]. Frailty, an age-associated predisposition to adverse healthcare outcomes [3] is increasingly prevalent in this setting. A recent systematic review and meta-analysis reported a prevalence of 12% using any physical definition and 24% using the deficit accumulation model among community-dwellers aged ≥50 years across 62 countries [4]. Older adults living with frailty are at particular risk after an ED visit, with longer admissions, high rates of functional and cognitive decline, greater risk of readmission and institutionalisation after discharge and higher mortality [5, 6]. Frailty is also common among older ED attendees with studies suggesting up to 60% are frail [6, 7]. Identifying frailty early is important to triage people to appropriate care pathways and more detailed comprehensive geriatric assessment (CGA) to improve outcomes [8]. Screening for frailty helps creates awareness among healthcare professionals regarding the complexity of older adults, which leads to more holistic, person-centred care [5]. Frailty risk stratification also allows faster and more efficient use of time and resources in a busy ED [5].

The development of geriatric emergency medicine (GEM) as a discipline within emergency medicine has paralleled awareness of the impact of frailty on older people attending ED. Indeed, the need to better understand the effectiveness and feasibility of frailty screening and the tools used to stratify risk among these patients are highlighted in a recent list of the 10 high priority research questions in European GEM [9]. However, it remains unclear how to best identify and triage frailty in ED in ‘real time’ and in particular how to differentiate between low- and high-risk individuals in ED [10]. Despite a multitude of published studies, there is an absence of high-accuracy screening instruments validated for use in ED [11]. Few have been validated against ‘gold standard’ frailty assessments as determined by CGA [12] and the optimal domains and variables to include in such instruments to predict adverse outcomes is unknown [13]. Ideal instruments should be accurate at diagnosing frailty across a variety of patients with different presentations, without requiring any extra equipment, personnel or time to administer [14]. Many other important questions remain unclear including whether the focus should be on case-finding rather than screening and which staff should screen and when [14]. Given the wide range of health care professionals involved in GEM care, future research connecting these relevant professionals is also highlighted as a priority [9].

The Delphi consensus technique is a well-established approach to answering complex research questions by attaining a consensus view across subject and context experts [15]. The Delphi consensus process has been used successfully to identify and examine definitions of frailty [16, 17] and to describe optimal approaches to assess frailty in inpatient (acute medical care) settings [18]. The objective of this paper was to conduct an international electronic Delphi (e-Delphi) consensus study to identify the core requirements of an ideal frailty screening instrument, exploring important principles, practices and logistics to facilitate accurate and timely screening of frailty in ED.

Methods

Design and participants

The Delphi process is based on a series of ‘rounds’, where a group of experts are asked opinions on a particular issue. The questions for each round are based in part of the findings of the previous one, allowing the study to evolve over time in response to earlier findings [15]. Participants can view the results of previous rounds, allowing time to reflect on the views of others and reconsider their own opinions accordingly. Finally, the findings of each round are always shared with the broader group anonymously, to reduce bias. Thus, the Delphi process is designed to allow the development of a consensus view that answers the research question [15]. This study employed a modified e-Delphi design, incorporating two rounds of surveys circulated electronically. The process is outlined in Figure 1. Thirty-nine international experts with different professional backgrounds from 10 countries were invited to participate in the study with the aim of gathering a broad range of opinions. Participants were selected based on their professional expertise relating to frailty in acute care settings, particularly authors of peer-reviewed publications examining the acute management of frailty or those with membership of international frailty or GEM associations. These associations included the specialist interest group of the European Union Geriatric Medicine Society and the International Federation of Emergency Medicine. Participants ideally had to have published peer-reviewed research papers within the last 5 years in this area. There was also a focus on interdisciplinarity. Participants included physicians, academic researchers, frailty educators, health and social care professionals, senior nursing professionals and public health experts. This was to ensure that the Delphi group reflected the diversity of frailty domains and the interprofessional collaborative nature of GEM. The core steering group (EM, RO’C of University College Cork and the Mercy University Hospital, Cork, and SC of the University College London) selected participants. All participants provided informed consent. Ethical approval was granted in advance from the Clinical Research Ethical Committee of University College Cork (ECM 3 (bbb) 11/05/2021).

Methods flow chart.
Figure 1

Methods flow chart.

Questionnaire development and circulation

Before this Delphi study, a systematic review was conducted to identify published frailty screening instruments used in ED (PROSPERO trial registration number CRD42020216780) [12]. The questions, items and other details along with their psychometric and clinimetric properties (target sample, administration time, etc.) were directly extracted as text. Statements for Round 1 were subsequently synthesised from these data by reflexive thematic analysis. Reflexive thematic analysis is an easily accessible and theoretically flexible interpretative approach to qualitative data analysis that facilitates the identification and analysis of patterns or themes in a given dataset [19]. Through the reflexive approach, themes are not predefined in order to find codes [19]. Themes are produced by organising codes around a central organising concept using the six-stage analytical process defined by Braun and Clarke [19]. From this process, a list of statements was generated based on the question: ‘What are the core requirements of frailty screening in the emergency department?’. Data extracted from the included studies were analysed by two authors (EM, RO’C), before being reviewed and confirmed by an external expert (SC). Following this feedback, further synthesis included merging the most common codes and grouping themes under major categories, including adaptations of relevant existing research on frailty variables and domains by Soong, Van Oostrom and Carpenter, respectively [18, 20, 21]. The reflexive thematic analysis resulted in an initial list of 56 statements that were incorporated into the first round of the e-Delphi survey, according to three main themes (categories) illustrated in a concept map in the Supplementary Appendix. In summary, the themes were grouped as follows:

  1. The ‘principles’ of frailty screening in ED;

  2. The ‘logistics’ of frailty screening in ED;

  3. The ‘domains’ of frailty (physical, psychological, cognitive and social).

Participants had 2 weeks to respond and complete each round. To improve response rates, individualised reminders were sent. An online survey software tool (SurveyMonkey™, Momentive Inc., San Mateo, CA, USA) was utilised to facilitate the survey, which was administered in English.

Delphi rounds

The first round was circulated between 19 August 2021 and 3 September 2021 and the second round between 11 October 2021 and 26 October 2021. Participants rated each statement on a 5-item Likert scale indicating whether from one ‘Strongly Agree’ to five ‘Strongly Disagree’. An option was also provided to add free-text comments after each section. An agreement level of 80% was applied for accepting statements, i.e. those rated as one ‘Strongly Agree’ or two ‘Agree’ by ≥80% of participants [22–29]. Statements not meeting this criterion were automatically excluded. Tabulated feedback was shared with participants after Round 1. Feedback entered in the open-ended comments section in Round 1 was collated and mapped under existing statements or refined for Round 2 as below:

  • Edited statement: Round 1 statement that reached 80% group consensus agreement with the refinement of the wording of the statement to reflect group feedback.

  • New statements: Based on qualitative comments and responses from free text sections in Round 1.

  • Statements that did not reach agreement in Round 1 but were revised and re-circulated following editing according to feedback in open-ended comments sections.

  • Merged statements: Statements accepted by 80% group consensus in R1, independently of each other, and combined due to overlapping in content, aim or objective.

Prior to synthesising, the core steering group (EM and RO’C), reviewed the final list of statements, alongside the 17 comments received from participants. Based on these, statements were grouped by theme, condensed where required and the wording refined. The final set of statements was forwarded to all participants at the end of the two Delphi rounds.

Results

Round 1

In all, 37/39 participants from ten countries completed Round 1 (response rate 95%). Table 1 provides details on the characteristics of all 37 invited participants from 10 countries. More than half were female (n = 24, 62%), the largest proportion worked in emergency medicine (n = 11, 30%). Approximately half were from Europe (n = 22, 56%) and half from other parts of the world, predominantly North America.

Table 1

Characteristics of all Delphi participants (n = 37).

CharacteristicsNumber%
Sex
 Female2462%
 Male1335%
Area of expertise
 Emergency medicine physician (clinical)616%
 Emergency medicine physician (academic)514%
 Geriatric medicine physician (clinical)411%
 Geriatric medicine physician (academic)616%
 Health and social care professional719%
 Nursing514%
 Health sciences/public health410%
Country
 Ireland1643%
 Canada514%
 USA410%
 Australia410%
 Netherlands25%
 Italy25%
 Belgium12%
 UK12%
 China12%
 Thailand12%
CharacteristicsNumber%
Sex
 Female2462%
 Male1335%
Area of expertise
 Emergency medicine physician (clinical)616%
 Emergency medicine physician (academic)514%
 Geriatric medicine physician (clinical)411%
 Geriatric medicine physician (academic)616%
 Health and social care professional719%
 Nursing514%
 Health sciences/public health410%
Country
 Ireland1643%
 Canada514%
 USA410%
 Australia410%
 Netherlands25%
 Italy25%
 Belgium12%
 UK12%
 China12%
 Thailand12%
Table 1

Characteristics of all Delphi participants (n = 37).

CharacteristicsNumber%
Sex
 Female2462%
 Male1335%
Area of expertise
 Emergency medicine physician (clinical)616%
 Emergency medicine physician (academic)514%
 Geriatric medicine physician (clinical)411%
 Geriatric medicine physician (academic)616%
 Health and social care professional719%
 Nursing514%
 Health sciences/public health410%
Country
 Ireland1643%
 Canada514%
 USA410%
 Australia410%
 Netherlands25%
 Italy25%
 Belgium12%
 UK12%
 China12%
 Thailand12%
CharacteristicsNumber%
Sex
 Female2462%
 Male1335%
Area of expertise
 Emergency medicine physician (clinical)616%
 Emergency medicine physician (academic)514%
 Geriatric medicine physician (clinical)411%
 Geriatric medicine physician (academic)616%
 Health and social care professional719%
 Nursing514%
 Health sciences/public health410%
Country
 Ireland1643%
 Canada514%
 USA410%
 Australia410%
 Netherlands25%
 Italy25%
 Belgium12%
 UK12%
 China12%
 Thailand12%

From the initial questionnaire circulated, 13/56 (23%) of the statements were accepted in Round 1. Seven were accepted outright, three were revised based on feedback and three other statements, though reaching the ≥80% threshold, were merged with three other statements with which they overlapped. In total, 45 responses were received in the open-ended comments sections, which contributed to the development of 22 new statements for Round 2. Hence, 43/56 statements were rejected or merged, mainly comprising logistical and frailty risk factor statements. In total, 35 statements were forwarded to be rated in Round 2.

Round 2

Thirty-two individuals participated in Round 2 (response rate 86%). Seventeen comments were received in the open-text comments sections, the majority regarding the principles of frailty screening. Finally, 19/35 (54%) statements were accepted. The distribution of survey responses and details of the specific statements included and excluded are provided in the Supplementary Appendix. Each round is summarised in Figure 2. The final 19 statements are presented in Table 2. The list of rejected statements (combined percentage who disagreed or strongly disagreed with each) are presented in Table 3.

Summary results of Rounds 1 and 2 of the e-Delphi consensus.
Figure 2

Summary results of Rounds 1 and 2 of the e-Delphi consensus.

Table 2

Final consensus statements on the core requirements of frailty screening in the emergency department (ED) (n = 19 accepted statements) R1 = Round 1.

ThemeStatement% Agreement
1. Principles of frailty screening in ED1. Frailty screening in ED should measure the overall general baseline pre-morbid frailty status of people shortly before ED presentation (i.e. their recent status—approximately 2–4 weeks before the current illness that resulted in their presentation to ED). (accepted but edited statement in R1)97%
2. Screening for frailty in ED is cost-effective (i.e. that the benefit to patients and hospitals outweighs the associated monetary/financial and time/opportunity costs). (New statement)81%
3. Frailty screening in the ED should be part of a broader ED protocol or pathway to account for the special care needs of older adults. (New statement)97%
4. Where frailty is identified in ED after screening and confirmed (subsequent assessment or already documented status), it is feasible to start individualised interventions in ED (i.e. tailored to the individual person’s characteristics or needs rather than taking a broad, more generalised ‘one-size-fits-all’ approach). (New statement)94%
5. It is more important to have a feasible ED frailty screening instrument than an ideal frailty screening instrument. (New statement)94%
6. Short, rapid, frailty screening instruments in ED should identify older adults at high risk of adverse outcomes (e.g. predictive of hospital re-admission, prolonged length of stay, death). (Accepted statement in R1)97%
7. Frailty screening instruments for use in ED should be well-calibrated across the spectrum of frailty severity, disability and socioeconomic strata accounting for different levels of health literacy. (new statement)81%
8. A short frailty screening instrument for use in ED should be multidimensional, incorporating questions targeting different domains (e.g. two or more, including cognition, function in activities of daily living, healthcare utilisation, nutrition, physical status). (Accepted statement in R1)97%
2. Logistics of frailty screening in ED9. Frailty screening should be completed within 4 h of a patient attending ED. (Accepted statement 1e in R1)88%
10. The administration time of a short frailty screen for ED should be under 5 min. (Accepted statement in R1)94%
11. Frailty screening should be undertaken at point of first contact in ED, where it is appropriate (i.e. patient is sufficiently stable and capable of being screened) and provided ED resources allow. (New statement)81%
12. ED frailty screening should be conducted 24/7 (i.e. all the time) as part of routine ED practice. (New statement)88%
13. Frailty education initiatives for staff are required to support frailty screening in the ED. (New statement)100%
14. Short frailty screening instruments for use in ED need to be incorporated into the ED IT system to support routine, automatic mandated frailty screening. (New statement)97%
3. Important domains to include in frailty screening instruments in ED15. Functional ability (i.e. presence or absence of full functional capacity to undertake activities of daily living—e.g. washing, dressing, toileting, feeding, mobility, transferring, managing finances etc.). (Merged 3d/4w statements in R1)94%
16. Mobility factors (e.g. use of walking aids/frame, balance issues, falls history, etc.). (Merged 3e/4n statements in R1)100%
17. Cognition (e.g. any history of cognitive impairment, dementia, delirium, memory concerns, attention issues, deterioration in decision making, etc.). (Merged 3 g/4q statements in R1)97%
18. Medication use (e.g. polypharmacy, number or types of medication etc.). (Accepted statement in R1)81%
19. Social factors (e.g. Living situation alone or with others, sheltered housing, socio-economic status, social connections, such as social network or trusted people and family/friend supports etc.). (Accepted statement in R1)94%
ThemeStatement% Agreement
1. Principles of frailty screening in ED1. Frailty screening in ED should measure the overall general baseline pre-morbid frailty status of people shortly before ED presentation (i.e. their recent status—approximately 2–4 weeks before the current illness that resulted in their presentation to ED). (accepted but edited statement in R1)97%
2. Screening for frailty in ED is cost-effective (i.e. that the benefit to patients and hospitals outweighs the associated monetary/financial and time/opportunity costs). (New statement)81%
3. Frailty screening in the ED should be part of a broader ED protocol or pathway to account for the special care needs of older adults. (New statement)97%
4. Where frailty is identified in ED after screening and confirmed (subsequent assessment or already documented status), it is feasible to start individualised interventions in ED (i.e. tailored to the individual person’s characteristics or needs rather than taking a broad, more generalised ‘one-size-fits-all’ approach). (New statement)94%
5. It is more important to have a feasible ED frailty screening instrument than an ideal frailty screening instrument. (New statement)94%
6. Short, rapid, frailty screening instruments in ED should identify older adults at high risk of adverse outcomes (e.g. predictive of hospital re-admission, prolonged length of stay, death). (Accepted statement in R1)97%
7. Frailty screening instruments for use in ED should be well-calibrated across the spectrum of frailty severity, disability and socioeconomic strata accounting for different levels of health literacy. (new statement)81%
8. A short frailty screening instrument for use in ED should be multidimensional, incorporating questions targeting different domains (e.g. two or more, including cognition, function in activities of daily living, healthcare utilisation, nutrition, physical status). (Accepted statement in R1)97%
2. Logistics of frailty screening in ED9. Frailty screening should be completed within 4 h of a patient attending ED. (Accepted statement 1e in R1)88%
10. The administration time of a short frailty screen for ED should be under 5 min. (Accepted statement in R1)94%
11. Frailty screening should be undertaken at point of first contact in ED, where it is appropriate (i.e. patient is sufficiently stable and capable of being screened) and provided ED resources allow. (New statement)81%
12. ED frailty screening should be conducted 24/7 (i.e. all the time) as part of routine ED practice. (New statement)88%
13. Frailty education initiatives for staff are required to support frailty screening in the ED. (New statement)100%
14. Short frailty screening instruments for use in ED need to be incorporated into the ED IT system to support routine, automatic mandated frailty screening. (New statement)97%
3. Important domains to include in frailty screening instruments in ED15. Functional ability (i.e. presence or absence of full functional capacity to undertake activities of daily living—e.g. washing, dressing, toileting, feeding, mobility, transferring, managing finances etc.). (Merged 3d/4w statements in R1)94%
16. Mobility factors (e.g. use of walking aids/frame, balance issues, falls history, etc.). (Merged 3e/4n statements in R1)100%
17. Cognition (e.g. any history of cognitive impairment, dementia, delirium, memory concerns, attention issues, deterioration in decision making, etc.). (Merged 3 g/4q statements in R1)97%
18. Medication use (e.g. polypharmacy, number or types of medication etc.). (Accepted statement in R1)81%
19. Social factors (e.g. Living situation alone or with others, sheltered housing, socio-economic status, social connections, such as social network or trusted people and family/friend supports etc.). (Accepted statement in R1)94%
Table 2

Final consensus statements on the core requirements of frailty screening in the emergency department (ED) (n = 19 accepted statements) R1 = Round 1.

ThemeStatement% Agreement
1. Principles of frailty screening in ED1. Frailty screening in ED should measure the overall general baseline pre-morbid frailty status of people shortly before ED presentation (i.e. their recent status—approximately 2–4 weeks before the current illness that resulted in their presentation to ED). (accepted but edited statement in R1)97%
2. Screening for frailty in ED is cost-effective (i.e. that the benefit to patients and hospitals outweighs the associated monetary/financial and time/opportunity costs). (New statement)81%
3. Frailty screening in the ED should be part of a broader ED protocol or pathway to account for the special care needs of older adults. (New statement)97%
4. Where frailty is identified in ED after screening and confirmed (subsequent assessment or already documented status), it is feasible to start individualised interventions in ED (i.e. tailored to the individual person’s characteristics or needs rather than taking a broad, more generalised ‘one-size-fits-all’ approach). (New statement)94%
5. It is more important to have a feasible ED frailty screening instrument than an ideal frailty screening instrument. (New statement)94%
6. Short, rapid, frailty screening instruments in ED should identify older adults at high risk of adverse outcomes (e.g. predictive of hospital re-admission, prolonged length of stay, death). (Accepted statement in R1)97%
7. Frailty screening instruments for use in ED should be well-calibrated across the spectrum of frailty severity, disability and socioeconomic strata accounting for different levels of health literacy. (new statement)81%
8. A short frailty screening instrument for use in ED should be multidimensional, incorporating questions targeting different domains (e.g. two or more, including cognition, function in activities of daily living, healthcare utilisation, nutrition, physical status). (Accepted statement in R1)97%
2. Logistics of frailty screening in ED9. Frailty screening should be completed within 4 h of a patient attending ED. (Accepted statement 1e in R1)88%
10. The administration time of a short frailty screen for ED should be under 5 min. (Accepted statement in R1)94%
11. Frailty screening should be undertaken at point of first contact in ED, where it is appropriate (i.e. patient is sufficiently stable and capable of being screened) and provided ED resources allow. (New statement)81%
12. ED frailty screening should be conducted 24/7 (i.e. all the time) as part of routine ED practice. (New statement)88%
13. Frailty education initiatives for staff are required to support frailty screening in the ED. (New statement)100%
14. Short frailty screening instruments for use in ED need to be incorporated into the ED IT system to support routine, automatic mandated frailty screening. (New statement)97%
3. Important domains to include in frailty screening instruments in ED15. Functional ability (i.e. presence or absence of full functional capacity to undertake activities of daily living—e.g. washing, dressing, toileting, feeding, mobility, transferring, managing finances etc.). (Merged 3d/4w statements in R1)94%
16. Mobility factors (e.g. use of walking aids/frame, balance issues, falls history, etc.). (Merged 3e/4n statements in R1)100%
17. Cognition (e.g. any history of cognitive impairment, dementia, delirium, memory concerns, attention issues, deterioration in decision making, etc.). (Merged 3 g/4q statements in R1)97%
18. Medication use (e.g. polypharmacy, number or types of medication etc.). (Accepted statement in R1)81%
19. Social factors (e.g. Living situation alone or with others, sheltered housing, socio-economic status, social connections, such as social network or trusted people and family/friend supports etc.). (Accepted statement in R1)94%
ThemeStatement% Agreement
1. Principles of frailty screening in ED1. Frailty screening in ED should measure the overall general baseline pre-morbid frailty status of people shortly before ED presentation (i.e. their recent status—approximately 2–4 weeks before the current illness that resulted in their presentation to ED). (accepted but edited statement in R1)97%
2. Screening for frailty in ED is cost-effective (i.e. that the benefit to patients and hospitals outweighs the associated monetary/financial and time/opportunity costs). (New statement)81%
3. Frailty screening in the ED should be part of a broader ED protocol or pathway to account for the special care needs of older adults. (New statement)97%
4. Where frailty is identified in ED after screening and confirmed (subsequent assessment or already documented status), it is feasible to start individualised interventions in ED (i.e. tailored to the individual person’s characteristics or needs rather than taking a broad, more generalised ‘one-size-fits-all’ approach). (New statement)94%
5. It is more important to have a feasible ED frailty screening instrument than an ideal frailty screening instrument. (New statement)94%
6. Short, rapid, frailty screening instruments in ED should identify older adults at high risk of adverse outcomes (e.g. predictive of hospital re-admission, prolonged length of stay, death). (Accepted statement in R1)97%
7. Frailty screening instruments for use in ED should be well-calibrated across the spectrum of frailty severity, disability and socioeconomic strata accounting for different levels of health literacy. (new statement)81%
8. A short frailty screening instrument for use in ED should be multidimensional, incorporating questions targeting different domains (e.g. two or more, including cognition, function in activities of daily living, healthcare utilisation, nutrition, physical status). (Accepted statement in R1)97%
2. Logistics of frailty screening in ED9. Frailty screening should be completed within 4 h of a patient attending ED. (Accepted statement 1e in R1)88%
10. The administration time of a short frailty screen for ED should be under 5 min. (Accepted statement in R1)94%
11. Frailty screening should be undertaken at point of first contact in ED, where it is appropriate (i.e. patient is sufficiently stable and capable of being screened) and provided ED resources allow. (New statement)81%
12. ED frailty screening should be conducted 24/7 (i.e. all the time) as part of routine ED practice. (New statement)88%
13. Frailty education initiatives for staff are required to support frailty screening in the ED. (New statement)100%
14. Short frailty screening instruments for use in ED need to be incorporated into the ED IT system to support routine, automatic mandated frailty screening. (New statement)97%
3. Important domains to include in frailty screening instruments in ED15. Functional ability (i.e. presence or absence of full functional capacity to undertake activities of daily living—e.g. washing, dressing, toileting, feeding, mobility, transferring, managing finances etc.). (Merged 3d/4w statements in R1)94%
16. Mobility factors (e.g. use of walking aids/frame, balance issues, falls history, etc.). (Merged 3e/4n statements in R1)100%
17. Cognition (e.g. any history of cognitive impairment, dementia, delirium, memory concerns, attention issues, deterioration in decision making, etc.). (Merged 3 g/4q statements in R1)97%
18. Medication use (e.g. polypharmacy, number or types of medication etc.). (Accepted statement in R1)81%
19. Social factors (e.g. Living situation alone or with others, sheltered housing, socio-economic status, social connections, such as social network or trusted people and family/friend supports etc.). (Accepted statement in R1)94%
Table 3

Rejected statements (combined % that either disagreed or strongly disagreed with the statement) R1 = Round 1.

NumberStatement% Rejection
1Current short frailty screening instruments are not sufficiently accurate to justify their use as frailty screens in the ED. (New statement)69%
2The most important outcome that frailty screening instruments used in ED should predict is mortality (new statement)59%
3.The most important outcome that frailty screening instruments used in ED should predict is re-attendance to ED or re-admission to hospital (new statement)59%
4.The most important outcome that frailty screening instruments used in ED should predict is prolonged length of stay after admission (new statement)56%
5.Interventions following on from frailty screening in ED should prioritise prevention (low resource interventions for early-stage frailty or at-risk individuals) rather than those with established frailty (more high resource complex interventions) (new statement)53%
6Triage is not an appropriate environment to use a short frailty screening instrument (new statement)47%
7The focus of identifying frailty in the ED should be on case finding (targeting suspected at-risk individuals only usually based on clinical judgement as to potential benefit) rather than screening (unselected systematic approach for all those attending in a certain population, e.g. over a certain age, etc. including those who may not appear overtly frail) (new statement)38%
8ED is not an appropriate setting to undertake a test of strength (e.g. hand grip strength and/or objective test of mobility (e.g. timed get up & go) as part of a short frailty screening instrument (revised statements 4i&4 L in R1)34%
9.Frailty screening in ED should target across the spectrum of risk, aiming to identify both low and high-risk older adults, even if this reduces the accuracy of the instrument for frailty and subsequent adverse outcomes (new statement)28%
10.There is sufficient research evidence to justify frailty screening in ED (i.e. that the level of evidence published to date strongly supports that this approach benefits patients e.g. improves health outcomes) (new statement)22%
11.A collateral history from an active caregiver must be sought to facilitate frailty screening in ED (revised statement 2 h in R1)19%
12.ED Frailty screening should not be assigned exclusively to one particular healthcare group (e.g. only nursing staff), but should be undertaken by all healthcare staff providing care to patients in ED (revised statement 2e in R1)16%
13.A one-size-fits-all approach to frailty screening instruments should be used in the ED (i.e. EDs should use a single common screening instrument for all presentations) (new statement)10%
14.All healthcare staff who provide care in ED should be competent in undertaking frailty screening (new statement)10%
15.Routine hospital medical data (electronic or other) should be included in an ED frailty screen to help assess pre-discharge risk in ED settings in ‘real-time’ (new statement)10%
16.Frailty screening (paper-based or electronic) in the ED should not require any additional equipment (e.g. manometer or sensors etc.) (new statement)6%
NumberStatement% Rejection
1Current short frailty screening instruments are not sufficiently accurate to justify their use as frailty screens in the ED. (New statement)69%
2The most important outcome that frailty screening instruments used in ED should predict is mortality (new statement)59%
3.The most important outcome that frailty screening instruments used in ED should predict is re-attendance to ED or re-admission to hospital (new statement)59%
4.The most important outcome that frailty screening instruments used in ED should predict is prolonged length of stay after admission (new statement)56%
5.Interventions following on from frailty screening in ED should prioritise prevention (low resource interventions for early-stage frailty or at-risk individuals) rather than those with established frailty (more high resource complex interventions) (new statement)53%
6Triage is not an appropriate environment to use a short frailty screening instrument (new statement)47%
7The focus of identifying frailty in the ED should be on case finding (targeting suspected at-risk individuals only usually based on clinical judgement as to potential benefit) rather than screening (unselected systematic approach for all those attending in a certain population, e.g. over a certain age, etc. including those who may not appear overtly frail) (new statement)38%
8ED is not an appropriate setting to undertake a test of strength (e.g. hand grip strength and/or objective test of mobility (e.g. timed get up & go) as part of a short frailty screening instrument (revised statements 4i&4 L in R1)34%
9.Frailty screening in ED should target across the spectrum of risk, aiming to identify both low and high-risk older adults, even if this reduces the accuracy of the instrument for frailty and subsequent adverse outcomes (new statement)28%
10.There is sufficient research evidence to justify frailty screening in ED (i.e. that the level of evidence published to date strongly supports that this approach benefits patients e.g. improves health outcomes) (new statement)22%
11.A collateral history from an active caregiver must be sought to facilitate frailty screening in ED (revised statement 2 h in R1)19%
12.ED Frailty screening should not be assigned exclusively to one particular healthcare group (e.g. only nursing staff), but should be undertaken by all healthcare staff providing care to patients in ED (revised statement 2e in R1)16%
13.A one-size-fits-all approach to frailty screening instruments should be used in the ED (i.e. EDs should use a single common screening instrument for all presentations) (new statement)10%
14.All healthcare staff who provide care in ED should be competent in undertaking frailty screening (new statement)10%
15.Routine hospital medical data (electronic or other) should be included in an ED frailty screen to help assess pre-discharge risk in ED settings in ‘real-time’ (new statement)10%
16.Frailty screening (paper-based or electronic) in the ED should not require any additional equipment (e.g. manometer or sensors etc.) (new statement)6%
Table 3

Rejected statements (combined % that either disagreed or strongly disagreed with the statement) R1 = Round 1.

NumberStatement% Rejection
1Current short frailty screening instruments are not sufficiently accurate to justify their use as frailty screens in the ED. (New statement)69%
2The most important outcome that frailty screening instruments used in ED should predict is mortality (new statement)59%
3.The most important outcome that frailty screening instruments used in ED should predict is re-attendance to ED or re-admission to hospital (new statement)59%
4.The most important outcome that frailty screening instruments used in ED should predict is prolonged length of stay after admission (new statement)56%
5.Interventions following on from frailty screening in ED should prioritise prevention (low resource interventions for early-stage frailty or at-risk individuals) rather than those with established frailty (more high resource complex interventions) (new statement)53%
6Triage is not an appropriate environment to use a short frailty screening instrument (new statement)47%
7The focus of identifying frailty in the ED should be on case finding (targeting suspected at-risk individuals only usually based on clinical judgement as to potential benefit) rather than screening (unselected systematic approach for all those attending in a certain population, e.g. over a certain age, etc. including those who may not appear overtly frail) (new statement)38%
8ED is not an appropriate setting to undertake a test of strength (e.g. hand grip strength and/or objective test of mobility (e.g. timed get up & go) as part of a short frailty screening instrument (revised statements 4i&4 L in R1)34%
9.Frailty screening in ED should target across the spectrum of risk, aiming to identify both low and high-risk older adults, even if this reduces the accuracy of the instrument for frailty and subsequent adverse outcomes (new statement)28%
10.There is sufficient research evidence to justify frailty screening in ED (i.e. that the level of evidence published to date strongly supports that this approach benefits patients e.g. improves health outcomes) (new statement)22%
11.A collateral history from an active caregiver must be sought to facilitate frailty screening in ED (revised statement 2 h in R1)19%
12.ED Frailty screening should not be assigned exclusively to one particular healthcare group (e.g. only nursing staff), but should be undertaken by all healthcare staff providing care to patients in ED (revised statement 2e in R1)16%
13.A one-size-fits-all approach to frailty screening instruments should be used in the ED (i.e. EDs should use a single common screening instrument for all presentations) (new statement)10%
14.All healthcare staff who provide care in ED should be competent in undertaking frailty screening (new statement)10%
15.Routine hospital medical data (electronic or other) should be included in an ED frailty screen to help assess pre-discharge risk in ED settings in ‘real-time’ (new statement)10%
16.Frailty screening (paper-based or electronic) in the ED should not require any additional equipment (e.g. manometer or sensors etc.) (new statement)6%
NumberStatement% Rejection
1Current short frailty screening instruments are not sufficiently accurate to justify their use as frailty screens in the ED. (New statement)69%
2The most important outcome that frailty screening instruments used in ED should predict is mortality (new statement)59%
3.The most important outcome that frailty screening instruments used in ED should predict is re-attendance to ED or re-admission to hospital (new statement)59%
4.The most important outcome that frailty screening instruments used in ED should predict is prolonged length of stay after admission (new statement)56%
5.Interventions following on from frailty screening in ED should prioritise prevention (low resource interventions for early-stage frailty or at-risk individuals) rather than those with established frailty (more high resource complex interventions) (new statement)53%
6Triage is not an appropriate environment to use a short frailty screening instrument (new statement)47%
7The focus of identifying frailty in the ED should be on case finding (targeting suspected at-risk individuals only usually based on clinical judgement as to potential benefit) rather than screening (unselected systematic approach for all those attending in a certain population, e.g. over a certain age, etc. including those who may not appear overtly frail) (new statement)38%
8ED is not an appropriate setting to undertake a test of strength (e.g. hand grip strength and/or objective test of mobility (e.g. timed get up & go) as part of a short frailty screening instrument (revised statements 4i&4 L in R1)34%
9.Frailty screening in ED should target across the spectrum of risk, aiming to identify both low and high-risk older adults, even if this reduces the accuracy of the instrument for frailty and subsequent adverse outcomes (new statement)28%
10.There is sufficient research evidence to justify frailty screening in ED (i.e. that the level of evidence published to date strongly supports that this approach benefits patients e.g. improves health outcomes) (new statement)22%
11.A collateral history from an active caregiver must be sought to facilitate frailty screening in ED (revised statement 2 h in R1)19%
12.ED Frailty screening should not be assigned exclusively to one particular healthcare group (e.g. only nursing staff), but should be undertaken by all healthcare staff providing care to patients in ED (revised statement 2e in R1)16%
13.A one-size-fits-all approach to frailty screening instruments should be used in the ED (i.e. EDs should use a single common screening instrument for all presentations) (new statement)10%
14.All healthcare staff who provide care in ED should be competent in undertaking frailty screening (new statement)10%
15.Routine hospital medical data (electronic or other) should be included in an ED frailty screen to help assess pre-discharge risk in ED settings in ‘real-time’ (new statement)10%
16.Frailty screening (paper-based or electronic) in the ED should not require any additional equipment (e.g. manometer or sensors etc.) (new statement)6%

Discussion

This paper is the first, to our knowledge, to present the results of an e-Delphi consensus study examining the core requirements of frailty screening in the ED with a focus on important principles and practicalities (logistics), as well as the central domains to include in an ideal, short, ED-specific frailty screening instrument. The study brought together international participants with expertise in frailty and its identification and management in ED. The diverse panel provided a broad understanding of the concept and the requirements to deliver screening in this complex and often challenging environment. This study signposts ways that these can be overcome. It also indicates areas where currently little or no consensus exists. The 19 statements accepted by the participants can be grouped by three overarching themes as follows.

Principles of frailty screening in ED

This Delphi highlights that a short frailty screen for use in ED should be multidimensional, measuring recent pre-morbid frailty status, ~2–4 weeks before the current illness, and be capable of identifying patients at high risk of adverse outcomes. Participants highlighted that early frailty screening will help to streamline comprehensive frailty assessments to provide tailored intervention plans that are actionable in ED. They also accepted that frailty screening in ED, was in principle, cost-effective [30]. This is despite there being as yet, insufficient data to support this, albeit there is emerging evidence in other settings, provided there is geriatric medicine support [31, 32]. Economic policy considerations for more intensive hospital-based frailty screening are being discussed internationally [33, 34]. In Canada, a health advisory group has recommended scaling up frailty screening in view of the public health benefits of early frailty intervention [33]. In Europe, significant financial investment in hospital ‘front door’ frailty services has occurred in several countries [34]. Delphi participants also reiterated that an ideal frailty screening instrument should be acceptable to patients and should be possible to perform or administer safely, affordably and efficiently [35].

Logistics of frailty screening in ED

Limited consensus on the practical elements of frailty screening was reached. Most agreed that screening should be initiated promptly. The 4-hr screening window, from arrival to completion, chosen by the Delphi participants reflects acute care recommendations by the American College of Emergency Physicians (2013) and similar guidelines that emphasise the importance of early identification to improve older adult outcomes [36]. As no consensus currently exists on the optimal time to screen for frailty in ED, the 4-hr time-point, suggests a pragmatic choice by the Delphi participants, recognising the priority to stabilise patients and ED resource limitations.

Overly lengthy administration time is often identified as a key barrier to the use of frailty screening tools by ED staff, with some tools requiring 30–40 min to complete [37]. Given resource constraints, frailty screens should be quick to administer, ideally taking <5 min. Although no consensus was reached on the most appropriate location for frailty screening, participants indicated that it should be conducted at the first point of contact in ED, where possible. This is usually triage. Approximately half (47%) of respondents indicated that triage was a suitable area. A previous Delphi consensus on frailty assessment in hospital conducted in the UK indicated that acute medical units or geriatric medicine wards might be the optimal settings for frailty screening [18]. This previous study suggested that screening should ideally happen within the first 24 h, which may reflect that the majority of emergency medical admissions in the UK occur via acute medical units. That Delphi consensus differs from this current work as it was not ED specific and included only UK-based healthcare professionals. Further, ED staff were not represented in that Delphi. In our study, participants agreed that automation and incorporation into existing information technology systems were needed to facilitate routine screening. Whole group consensus (100% agreement) was reached on the importance of frailty education initiatives for ED staff. This reinforces the results of studies suggesting that many ED staff report limited frailty training, relying on clinical judgement rather than objective screening tools to identify frailty-associated deficits [5, 38–40]. Educating the clinical workforce on the specific needs and considerations of those with frailty in ED is highlighted as a key goal for age-attuned hospital environments [41].

Frailty screening domains

The time-accuracy trade-off principle should be considered when selecting items/subtests to include in a screening instrument, i.e. the number incorporated must be balanced with administration tim [42]. Shorter instruments forego some diagnostic accuracy, while those that do not capture the full scope of frailty have lower diagnostic accuracy [43]. Starting with a list of domains containing 11 variables, participants reached consensus on five (functional ability, mobility, cognition, medication use and social factors), reflecting the broad biopsychosocial model of frailty. There is robust evidence for their inclusion. Older adults report functional independence as the most important factor in a universal health outcome ranking and functional assessments accurately predict adverse events post-discharge including ED re-attendance [44, 45]. Similarly, mobility assessments are recommended in many GEM guidelines to ensure safe discharge from ED [46], although the most suitable mobility assessments in this setting are unclear [47]. Screening for polypharmacy in ED is also recommended as older adults admitted to EDs are high-risk for adverse drug reactions [48], with at least 40% of older attendees having polypharmacy (≥5 prescribed medications) that is associated with increased mortality [5]. The prevalence of impaired cognition among older ED patients ranges from 20% to 40%; it is an important indicator of other comorbidities and occult frailty [49]. Cognitive impairment in older ED patients, irrespective of its cause, is associated with functional decline and/or mortality after 3 and 12 months [48, 50, 51]. Finally, social factors, such as living arrangements are central to a holistic integrated view of older adults and likewise associated with adverse outcomes [52]. Older adults who live alone are 60% more likely to visit the ED than those who lived with their spouses [52].

Rejected statements

Forty statements were rejected in Round 1 and sixteen in Round 2. No statement was universally (100%) rejected. The highest rejection rate from Round 1 related to statements regarding the logistics of screening (e.g. screening should take place in an inpatient ward, outpatient or family physician clinic and screening should be undertaken by the admitting speciality team). Other statements that did not reach agreement related to outcomes/metrics that should be the focus of screening (e.g. mortality, ED re-attendance and length of stay) and whether prevention should be prioritised over complex management. In this sense, respondents appear to support the routine identification of frailty to inform clinical practice rather than case-finding individuals at high risk for specific adverse outcomes. Accurate prediction of adverse outcomes among individual adults attending ED is difficult [5], and at present it may be more pragmatic to prioritise frailty screening to create awareness and prompt further assessment than predict healthcare utilisation or future mortality. The Delphi group did not agree that all healthcare personnel should be responsible for undertaking frailty screening in ED. This decision is not unexpected given moves to develop dedicated multi-disciplinary frailty intervention teams in ED, with dedicated time and expertise to screen for frailty and highlight people suitable for CGA [53].

Strengths and limitations

A high participation rate was maintained throughout the Delphi rounds, with extensive feedback received from the group. A high level of agreement (80%), was required for statements to be accepted. Barrios et al. [54] report that consensus increases after feedback indicates at least 75% group agreement. This higher level of agreement was chosen to ensure a clear alignment of opinion among the group. Despite attempts to include a broad range of different professional skills from culturally diverse areas, the results represent opinions from a limited number of geographical regions, predominantly from western countries, with most from Europe and North America. This may have resulted in some important perspectives not being included. The largest contribution was from Ireland, which could be viewed as selection bias as the first author’s team work in the Irish healthcare system. The selection of experts, while consistent with similar Delphi studies, is essentially subjective [16, 17]. Such selection bias could mean that the consensus lacks breadth and is less generalisable. Selection bias is a risk inherent to the Delphi methodology. The authors acknowledge the final participant group comprised a limited numbers of nursing and health and social care professionals, despite wider recruitment efforts. Therefore, the consensus guidelines generated in this study will require further validation and evaluation with a more diverse Delphi membership panel. Another limitation is that members of the Delphi panel were provided with pre-written statements which creates an anchoring effect and subsequent bias. In this study, we did not facilitate a final consensus meeting. Rowe et al. [55] suggests that a majority opinion exerts considerable influence on minority opinion even when the majority holds an incorrect answer, and anonymity helps contributors focus on content; a final consensus meeting may have changed the nature of the consensus.

Implications of this research

Consideration can be given to integrating these Delphi findings into national and international clinical practice recommendations to guide clinicians and policymakers in these regions. They could also contribute to international research standards for GEM to standardise future reporting of frailty screening and management studies [13]. This should lead to higher quality and larger databases to analyse existing frailty screening instruments and processes. Indeed, the transdisciplinary nature of this Delphi participants group produced much discussion on the requirement for collaborative agreement on frailty definitions and outcome measures in clinical studies to standardise reporting across studies, settings and specialities. The findings also confirm the need for additional studies examining optimal management processes and pathways arising from the screening process, supporting calls to shift the focus from identification and stratification to evidence-based management, including transitional and integrated care interventions for frail patients attending ED [56]. However, it must be cautioned that given the make-up of the Delphi panel some findings may be less generalisable, especially to Asian, African and South American healthcare systems.

Conclusions

This consensus suggests that an ideal ED frailty screening instrument should be brief to administer and ideally take <5 min to score. It should reflect baseline function in the immediate 2–4 weeks before the current presentation. Delphi participants agreed that a feasible and cost-effective, rather than ideal, screening instrument was most important. It is proposed that frailty screening should be prompt and completed at the point of first contact in ED and within 4 h of ED attendance. The consensus also provides guidance on which items should ideally be included in frailty screening instruments for use in ED to capture important elements of frailty (i.e. questions or measures of functional ability, mobility, cognition, medication burden and social factors such that these could be incorporated into a new frailty screen and compared with existing instruments in a future study. Uncertainty concerning the feasibility, efficacy and cost-effectiveness of frailty screening combined with the lack of routine frailty education for ED staff are barriers to be overcome. Further research is now needed to operationalise and examine frailty screening models and pathways in ED.

Declaration of Conflicts of Interest

None.

Declaration of Sources of Funding

None.

References

1.

DeDonato
E
,
Hall
SE
,
Hogan
TM
,
Gleason
LJ
.
Interprofessional education of emergency department team on falls in older adults
.
J Am Geriatr Soc
2020
;
68
:
E7
9
.

2.

Ukkonen
M
,
Jämsen
E
,
Zeitlin
R
et al.
Emergency department visits in older patients: a population-based survey
.
BMC Emerg Med
2019
;
19
:
20
.

3.

Clegg
A
,
Young
J
,
Iliffe
S
,
Rikkert
MO
,
Rockwood
K
.
Frailty in elderly people
.
Lancet
2013
;
381
:
752
62
.
Erratum in: Lancet. 2013 Oct 19;382(9901):1328
.

4.

O’Caoimh
R
,
Sezgin
D
,
O’Donovan
MR
et al.
Prevalence of frailty in 62 countries across the world: a systematic review and meta-analysis of population-level studies
.
Age Ageing
2021
;
50
:
96
104
.

5.

Dam
CS
van,
Trappenburg
MC
,
Ter Wee
MM
et al.
The prognostic accuracy of clinical judgment versus a validated frailty screening instrument in older patients at the emergency department: findings of the AmsterGEM study
.
Ann Emerg Med
2022
;
80
:
422
31
.

6.

O'Caoimh
R
,
Costello
M
,
Small
C
et al.
Comparison of frailty screening instruments in the emergency department
.
Int J Environ Res Public Health
2019
;
16
:
3626
.

7.

Salvi
F
,
Morichi
V
,
Grilli
A
et al.
Screening for frailty in elderly emergency department patients by using the identification of seniors at risk (ISAR)
.
J Nutr Health Aging
2012
;
16
:
313
8
.

8.

Wallis
SJ
,
Wall
J
,
Biram
RW
,
Romero-Ortuno
R
.
Association of the clinical frailty scale with hospital outcomes
.
QJM
2015
;
108
:
943
9
.

9.

Mooijaart
SP
,
Nickel
CH
,
Conroy
SP
et al.
A European research agenda for geriatric emergency medicine: a modified Delphi study
.
Eur Geriatr Med
2021
;
12
:
413
22
.

10.

Hwang
U
,
Carpenter
C
.
Assessing geriatric vulnerability for post emergency department adverse outcomes: challenges abound while progress is slow
.
Emerg Med J
2016
;
33
:
2
3
.

11.

Carpenter
CR
,
Mooijaart
SP
.
Geriatric Screeners 2.0: time for a paradigm shift in emergency department vulnerability research
.
J Am Geriatr Soc
2020
;
68
:
1402
5
.

12.

Moloney
E
,
Sezgin
D
,
O'Donovan
M
et al.
The diagnostic accuracy and clinimetric properties of screening instruments to identify frail older adults attending emergency departments: a protocol for a mixed methods systematic review and meta-analysis
.
Int J Environ Res Public Health
2022
;
19
:
1380
.

13.

Heeren
P
,
Devriendt
E
,
Wellens
NIH
et al.
Old and new geriatric screening tools in a Belgian emergency department: a diagnostic accuracy study
.
J Am Geriatr Soc
2020
;
68
:
1454
61
.

14.

Carpenter
CR
,
Émond
M
.
Pragmatic barriers to assessing post-emergency department vulnerability for poor outcomes in an ageing society
.
Neth J Med
2016
;
74
:
327
9
.

15.

Barrett
D
,
Heale
R
.
What are Delphi studies?
Evid Based Nurs
2020
;
23
:
68
9
.

16.

Rodríguez-Mañas
L
,
Féart
C
,
Mann
G
et al.
Searching for an operational definition of frailty: a Delphi method based consensus statement: the frailty operative definition-consensus conference project
.
J Gerontol A Biol Sci Med Sci
2013
;
68
:
62
7
.

17.

Sezgin
D
,
O'Donovan
M
,
Woo
J
et al.
Early identification of frailty: developing an international Delphi consensus on pre-frailty
.
Arch Gerontol Geriatr
2022
;
99
:
104586
.

18.

Soong
JT
,
Poots
AJ
,
Bell
D
.
Finding consensus on frailty assessment in acute care through Delphi method
.
BMJ Open
2016
;
6
:
e012904
.

19.

Braun
V
,
Clarke
V
.
Using thematic analysis in psychology
.
Qual Res Psychol
2006
;
3
:
77
101
.

20.

Oostrom
SH
van,
A
DL
van der,
Rietman
ML
et al.
A four-domain approach of frailty explored in the Doetinchem cohort study
.
BMC Geriatr
2017
;
17
:
196
.

21.

Carpenter
CR
,
Shelton
E
,
Fowler
S
et al.
Risk factors and screening instruments to predict adverse outcomes for undifferentiated older emergency department patients: a systematic review and meta-analysis
.
Acad Emerg Med
2015
;
22
:
1
21
.

22.

Keeney
S
,
Hasson
F
,
McKenna
H
.
Consulting the oracle: ten lessons from using the Delphi technique in nursing research
.
J Adv Nurs
2006
;
53
:
205
12
.

23.

Falzarano
M
,
Pinto
ZG
.
Seeking consensus through the use of the Delphi technique in health sciences research
.
J Allied Health
2013
;
42
:
99
10
.

24.

Diamond
IR
,
Grant
RC
,
Feldman
BM
et al.
Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies
.
J Clin Epidemiol
2014
;
67
:
401
9
.

25.

McMillan
SS
,
King
M
,
Tully
MP
.
How to use the nominal group and Delphi techniques
.
Int J Clin Pharm
2016
;
38
:
55
662
.

26.

Nair
R
,
Aggarwal
R
,
Khanna
D
.
Methods of formal consensus in classification/diagnostic criteria and guideline development
.
Semin Arthritis Rheum
2011
;
41
:
95
105
.

27.

Giannarou
L
,
Zervas
E
.
Using Delphi technique to build consensus in practice
.
Int J Bus Sci Appl Manag
2014
;
9
:
65
82
.

28.

Ulshak
FL
.
Human Resource Development: The Theory and Practice of Need Assessment
.
Reston (VA) Reston Publishing
, University of Michigan,
1983
.

29.

Green
PJ
. The content of a college-level outdoor leadership course for Land-Based Outdoor Pursuits in the Pacific Northwest: A Delphi Consensus. In:
Paper Presented at the Conference of the Northwest District Association for the American Alliance for Health, Physical Education, Recreation, and Dance
.
Spokane, WA
; Unpublished doctoral dissertation, University of Oregon
(1981, March)
.

30.

Theou
O
,
Campbell
S
,
Malone
ML
,
Rockwood
K
.
Older adults in the emergency department with frailty
.
Clin Geriatr Med
2018
;
34
:
369
86
.

31.

Leahy
A
,
McNamara
R
,
Reddin
C
et al.
The impact of frailty screening of older adults with multidisciplinary assessment of those at risk during emergency hospital attendance on the quality, safety and cost-effectiveness of care (SOLAR): a randomised controlled trial
.
Trials
2021
;
22
:
581
.

32.

Li
Z
,
Habbous
S
,
Thain
J
et al.
Cost-effectiveness analysis of frailty assessment in older patients undergoing coronary artery bypass grafting surgery
.
Can J Cardiol
2020
;
36
:
490
9
.

33.

Grimes
K
,
Kitts
J
,
Tholl
B
,
Samuelson-Kiraly
C
,
Mitchell
JI
.
Policy and economic considerations for frailty screening in the Canadian healthcare system
.
J Frailty Aging
2018
;
7
:
233
9
.

34.

Gwyther
H
,
Shaw
R
,
Jaime Dauden
EA
et al.
Understanding frailty: a qualitative study of European healthcare policy-makers’ approaches to frailty screening and management
.
BMJ Open
2018
;
8
:
e018653
.

35.

Dobrow
MJ
,
Hagens
V
,
Chafe
R
,
Sullivan
T
,
Rabeneck
L
.
Consolidated principles for screening based on a systematic review and consensus process
.
CMAJ
2018
;
190
:
E422
9
.

36.

American College of Emergency Physicians; American Geriatrics Society; Emergency Nurses Association; Society for Academic Emergency Medicine; Geriatric Emergency Department Guidelines Task Force. Geriatric emergency department guidelines.

Ann Emerg Med
2014;
63
(5): e7–25.

37.

Lim
SH
,
Ang
SY
,
Abu Bakar Aloweni
FB
,
Østbye
T
.
An integrative review on screening for frailty in acute care: accuracy, barriers to implementation and adoption strategies
.
Geriatr Nurs
2019
;
40
:
603
13
.

38.

Warnier
RMJ
,
Rossum
E
van,
Du Moulin
MFMT
et al.
The opinions and experiences of nurses on frailty screening among older hospitalized patients. An exploratory study
.
BMC Geriatr
2021
;
21
:
624
.

39.

Liu
X
,
Le
MK
,
Lim
AYC
et al.
Perspectives on frailty screening, management and its implementation among acute care providers in Singapore: a qualitative study
.
BMC Geriatr
2022
;
22
:
58
.

40.

Moloney
E
,
O'Donovan
MR
,
Sezgin
D
,
McGrath
K
,
Timmons
S
,
O'Caoimh
R
.
Frailty knowledge, use of screening tools, and educational challenges in emergency Departments in Ireland: a multisite survey
.
J Emerg Nurs
2023
;
50
:
22
35
.

41.

Conroy
SP
,
Turpin
S
.
New horizons: urgent care for older people with frailty
.
Age Ageing
2016
;
45
:
577
84
.

42.

Larner
AJ
.
Performance-based cognitive screening instruments: an extended analysis of the time versus accuracy trade-off
.
Diagnostics (Basel)
2015
;
5
:
504
12
.

43.

Walston
J
,
Buta
B
,
Xue
QL
.
Frailty screening and interventions: considerations for clinical practice
.
Clin Geriatr Med
2018
;
34
:
25
38
.

44.

Fried
TR
.
Health outcome prioritization as a tool for decision making among older persons with multiple chronic conditions
.
Arch Intern Med
2011
;
171
:
1856
.

45.

Bissett
M
,
Cusick
A
,
Lannin
NA
.
Functional assessments utilised in emergency departments: a systematic review
.
Age Ageing
2013
;
42
:
163
72
.

46.

Lucke
JA
,
Mooijaart
SP
,
Heeren
P
et al.
Providing care for older adults in the emergency department: expert clinical recommendations from the European task force on geriatric emergency medicine
.
Eur Geriatr Med
2022
;
13
:
309
17
.

47.

Eagles
D
,
Yadav
K
,
Perry
JJ
,
Sirois
MJ
,
Emond
M
.
Mobility assessments of geriatric emergency department patients: a systematic review
.
CJEM
2018
;
20
:
353
61
.

48.

Lucke
JA
,
Gelder
J
de,
Heringhaus
C
et al.
Impaired cognition is associated with adverse outcome in older patients in the emergency department; the acutely presenting older patients (APOP) study
.
Age Ageing
2018
;
47
:
679
84
.

49.

Jackson
TA
,
Gladman
JR
,
Harwood
RH
et al.
Challenges and opportunities in understanding dementia and delirium in the acute hospital
.
PLoS Med
2017
;
14
:
e1002247
.

50.

Litovitz
GL
,
Hedberg
M
,
Wise
TN
,
White
JD
,
Mann
LS
.
Recognition of psychological and cognitive impairments in the emergency department
.
Am J Emerg Med
1985
;
3
:
400
2
.

51.

Schofield
I
,
Stott
DJ
,
Tolson
D
,
McFadyen
A
,
Monaghan
J
,
Nelson
D
.
Screening for cognitive impairment in older people attending accident and emergency using the 4-item abbreviated mental test
.
Eur J Emerg Med
2010
;
17
:
340
2
.

52.

Hastings
SN
,
George
LK
,
Fillenbaum
GG
,
Park
RS
,
Burchett
BM
,
Schmader
KE
.
Does lack of social support lead to more ED visits for older adults?
Am J Emerg Med
2008
;
26
:
454
61
.

53.

Carpenter
CR
,
Bromley
M
,
Caterino
JM
et al.
Optimal older adult emergency care: introducing multidisciplinary geriatric emergency department guidelines from the American College of Emergency Physicians, American Geriatrics Society, Emergency Nurses Association, and Society for Academic Emergency Medicine
.
Acad Emerg Med
2014
;
21
:
806
9
.

54.

Barrios
M
,
Guilera
G
,
Nuño
L
,
Gómez-Benito
J
.
Consensus in the Delphi method: what makes a decision change?
Technol Forecast Soc Change
2021
;
163
: 1–10, 120484.

55.

Rowe
G
,
Wright
G
,
McColl
A
.
Judgment change during Delphi-like procedures: the role of majority influence, expertise, and confidence
.
Technol Forecast Soc Change
2005
;
72
:
377
99
.

56.

Preston
L
,
Chambers
D
,
Campbell
F
,
Cantrell
A
,
Turner
J
,
Goyder
E
.
What evidence is there for the identification and management of frail older people in the emergency department? A systematic mapping review
.
Health Ser Deliv Res
2018
;
6
:
1
142
.

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (https://creativecommons.org/licenses/by-nc/4.0/), which permits non-commercial re-use, distribution, and reproduction in any medium, provided the original work is properly cited. For commercial re-use, please contact [email protected]

Supplementary data

Comments

0 Comments
Submit a comment
You have entered an invalid code
Thank you for submitting a comment on this article. Your comment will be reviewed and published at the journal's discretion. Please check for further notifications by email.