TURKISH JOURNAL OF ONCOLOGY 2019 , Vol 34 , Num 4
Geriatric Assessment in Oncology: G8 Screening Tool Validation and Reliability Study
Esra ATAKUL3,İmatullah AKYAR1,Deniz KOÇOĞLU TANYER2
1Department of Medical Nursing, Hacettepe University, Faculty of Nursing, Ankara-Turkey
2Department of Public Health Nursing, Selçuk University, Faculty of Health Sciences, Konya-Turkey
3Department of Hematology-Oncology, Health Sciences University, Dr. Abdurrahman Yurtaslan Oncology Training and Research Hospital, Ankara-Turkey
DOI : 10.5505/tjo.2019.2010

Summary

OBJECTIVE
The present study aimed to test the validity and reliability of the Geriatrics 8 (G8) tool, a risk-screening tool for further comprehensive geriatric assessment, with hematologic cancer patients aged 65 years and older.

METHODS
This methodological study included 110 patients followed up for hematologic cancer. Data were collected using the patient identification form, the G8 screening tool, and the Edmonton Frail Scale. Language and content validity, internal consistency, confirmatory factor, sensitivity and specificity and concurrent validity analyses were also used.

RESULTS
Patients (mean age: 73.9±6.10) were diagnosed with lymphoma (30.9%), multiple myeloma (21.8%), leukemia (20.9%), myelodysplastic syndrome (19.1%). Confirmatory factor model fit index analysis ?²/ df and p-values (0.14) showed a good fit and GFI, AGFI, SRMR, and RMSEA values showed acceptable fit. The Cronbach"s alpha coefficient was 0.655, area under the ROC curve was 0.824 (95%, 0.745?0.904), and sensitivity and specificity were 61.0% and 88.9%, respectively.

CONCLUSION
The findings indicated that the G8 screening tool was found a valid and reliable tool for geriatric patients diagnosed with cancer to determine the risk and need for further comprehensive geriatric assessment.

Introduction

Older adults are among the fastest-growing age group of the population and by 2030 are expected to represent 20% and 30% of the US and European populations, respectively.[1] Approximately 70% of the cancer deaths and 60% of all new cancer cases occur in adults aged 65 years and older, and cancer incidence is 11 times higher than the younger population.[2,3] Although the number of cases increasing, standards and guidelines for routine care for older adults diagnosed with cancer are limited, and this group is not adequately represented in clinical trials.[4]

Older adults are different from each other regarding physiological, psychological, social health, functionality, independence level, comorbidities, and cultural aspects. The differences in the aging process, combined with heterogeneity in health, functional, and social status between individuals or within an individual timeline, lead to differences in treatment and care. The limited representation of older adults in clinical trials adds challenges in oncology care. [5] As a result, the complexity and uniqueness of older adults diagnosed with cancer urge to provide evidence-based planned treatment and care.[4-6] Commonly, to guide the provision of evidence-based treatment and care, and to assess the adult and multifactorial process of aging comprehensive geriatric assessment (CGA) is used. The CGA is an interdisciplinary approach where multidimensional medical, functional, psychosocial, and environmental assessments are conducted to develop a coordinated and long-term plan for the diagnosis and treatment of elderly individuals.[7-9]

The CGA approach has been used in the care of older adults diagnosed with cancer since the 1990s. [10] The Geriatric Oncology of the National Comprehensive Cancer Network, the International Society of Geriatric Oncology, and the European Organization for Research and Treatment of Cancer also advised utilizing CGA in the care of the older adults diagnosed with cancer.[4,11-13] The CGA found to be useful in determining prognosis, risks, and treatment benefits and laying the groundwork for interventions to improve patient outcomes.[4,14] Previous studies showed that individualized care developed through CGA was helpful in achieving maximum treatment efficacy and minimum toxicity; whereas non-CGA based care of older adults diagnosed with cancer resulted in disruptions.[15,16]

Deschodt et al.[17] (2013) reported that the multidisciplinary CGA approach has three stages: 1) case finding or screening (identifying high-risk groups), 2) assessment (comprehensive assessment), and 3) implementation (evidence-based care based on need). To include CGA in routine care, which is a standard of care in oncology practice, older adults diagnosed with cancer must be screened to check whether full CGA is required or not.[18,19] Given the time and resource barriers related to CGA, the use of geriatric screening tool become prominent;[5,20,21] multiple screening tools, such as abbreviated Comprehensive Geriatric Assessment,[22] Cancer-Specific Geriatric Assessment instrument,[23] Vulnerable Elderly Survey- 13,[24] Fried Frailty Criteria,[5,21] and Geriatrics 8 (G8).[25] Although the choice of the tool depends on clinical resources, G8 was recommended by SIOG with its highest sensitivity.[25-27] This study aimed to investigate the psychometric properties and screening performance of the G8 screening tool, with geriatric hematologic patients aged 65 years and older.

Methods

Study Design
This methodological study was conducted to investigate the validity and reliability, and psychometric properties of the Turkish version of the "G8 screening tool", used to evaluate geriatric risk profiles of patients over 65 years of age diagnosed with hematologic cancer.

Setting and Sample
The study population consisted of hematologic cancer patients aged 65 years and older who were admitted to hematology outpatient clinics of a state hospital. Study samples constituted as representing at least 10 patients per item of the scale. A total of 110 patients were included in this study to increase the representational power. Patients aged 65 years and older, diagnosed with hematologic cancer, literate, without communication problems and cognitive disorders (advanced Alzheimer"s disease and dementia), and provided informed consent were included in this study.

Data Collection
Data were collected from 110 patients who were admitted at a state hospital between May 4th-February 20th, 2017. The patients admitted to the outpatient clinic were approached after their visit, while the patients in inpatient units were approached before the morning rounds. Patients were provided with information before this study, and informed consent was obtained from each patient. The researchers conducted face-toface interviews to collect data for this study. Data collection lasted about 10 minutes per participant.

Data Collection Tools
Data were collected using patient identification form, the G8 screening tool and the Edmonton Frail Scale. Patient identification form consists of 16 questions about the socio-demographic characteristics of patients and disease characteristics.

The G8 screening tool was developed by Soubeyran et al. in 2012, to assess the need for CGA in older adults diagnosed with cancer. The tool was created by adding the item "age" to the seven items selected from the Mini Nutritional Assessment scale. G8 selects the groups that need further comprehensive assessment. Among the items selected from the Mini Nutritional Assessment scale are nutritional status, weight loss, body mass index, number of medications used, and perceived health. Age is considered in three categories (<80 years, 80?85 years, and >85 years). The G8 score ranges from 0 to 17. The items are interpreted using the scoring values in the Mini Nutritional Assessment scale. Scores ?14 indicate abnormal. In addition to nutritional status, the G8 screening tool produces results about CGA areas, such as patients" comorbidity, mental distress, and cognitive status.[25,28]

Edmonton Frail Scale was developed by Rolfson et al.[29] (2006) in Canada to assess frailty in older adults. The Cronbach alpha coefficient of the original scale is 0.62. The reliability and validity test of the scale in Turkey was carried out by Aygor & Fadıloglu. The number of items in the scale was not changed while it was being adapted to the Turkish population, and the Cronbach alpha of the scale was reported to be 0.75.[30] The scale consists of nine frailty domains included in the CGA and considered to be determinants of frailty. These domains are cognition, functional performance, general health status, functional independence, social support, pharmacological condition, nutritional aspect, mental condition, and continence. The scale consists of 11 items. General health status and pharmacological conditions are individually assessed with two questions, while the other domains are individually assessed with a single question. Cognition and functional independence are assessed using the "clock" and "timed up and go" tests, respectively. The questions are scored 0, 1, or 2. Scale concludes as not frail (scored 0-4), and frail as apparently vulnerable (scored 5-6), mildly frail (scored 7-8), moderate frailty (scored 9-10), and severe frailty (scored >11).[24] In this study, the Edmonton Frail Scale was used to assess the sensitivity and specificity of the G8 screening tool.

Ethical Considerations
Permission to use and adaptation of G8 screening tool obtained from investigators (Dr. P.S), and this study was approved by the Ethical Committee for Non-Interventional Clinical Investigations of the university (# GO 15/488-27). Written consent was provided by the hospital"s administration. All participants signed a written consent form.

Data Analysis
Data were analyzed using IBM Statistical Package for Social Sciences, v.23. Language validity analysis, content validity analysis, sensitivity and specificity analysis, and concurrent validity (ROC curve analysis) were performed for the Turkish adaptation of the scale. Descriptive statistics (mean, standard deviation, median, minimum, maximum, number, and percentile) were used to describe the categorical and continuous variables.

Results

Study Group
The mean age of participants was 73.9±6.10 (range 65- 92) years, 51.7% were men, 52.7% had a primary school degree, 80.9% were married, 50.5% had 4 or more children, 70.9% lived with their children, and 61.8% described their economic status as "expenses equal income". The participants were diagnosed with lymphoma (30.9%), multiple myeloma (21.8%), leukemia (20.9%), myelodysplastic syndrome (19.1%), leukocyte disorder (6.4%), and aplastic anemia (grouping based on WHO 2001 classification of hematological malignancies). Approximately 70% of the patients had at least one chronic disease. The duration of follow-up was 3.05±1.56 (max: 9) years.

Validity Results
Language Validity Analysis: The tool was translated into Turkish by three faculty members (two nursing faculty, one physician). Three translations gathered into a single version by the researchers. The tool was back-translated (Turkish to English) by three experts (nursing faculty, physician, and interpreter). The backtranslated version was compared with the original tool and found to be consistent. An expert Turkish linguist checked the final version for grammar, spelling, and punctuation.

Content Validity Analysis: Content validity analysis was performed by experts to determine whether the items represent and cover the concept to be measured, as well as the comprehensibility. The tool was evaluated by five experts from internal medicine, hematology, nutrition and dietetics and geriatrics fields. The experts rated each item on the scale according to Davis technique (1: not appropriate, 2: slightly appropriate, 3: appropriate, 4: very appropriate). The items were re-evaluated with expert evaluations, the content validity indices calculated according to the ratings from experts. The content validity indices of the scale items calculated, and the content validity index for each item was found to be 1.

Construct Validity and Internal Consistency Analysis: Confirmatory factor analysis used to test the construct validity of the G8 screening tool. Confirma tory factor model fit index analysis, χ²/sd and p-values (0.14) showed a good fit and GFI, AGFI, SRMR, and RMSEA values showed acceptable fit. The CFI was slightly below the acceptable fit, but it was acceptable since it was greater than 0.90. Model fit indices showed compliance of the measurement model as sufficient and, therefore, the G8 screening tool was valid (Table 1). The reliability of the G8 tool was assessed using Cronbach"s alpha and half-divide method. The Cronbach's alpha coefficient and Spearman-Brown coefficient were calculated as 0.655 and 0.60, respectively (Tables 2, 3). G8 tool was found to be quite reliable.

Table 1: Confirmatory factor model fit index analysis

Table 2: Cronbach's alpha coefficient

Table 3: G8 total score item correlations

Reliability Results
Concurrent validity (Sensitivity and Specificity Analysis): The Edmonton Frail Scale was used to test the concurrent validity of the G8 screening tool. Sensitivity measurement was used to determine the group requiring further comprehensive assessment (scored abnormal) while specificity measurement is used to recognize those who are normal within the normal group (Table 4). The area under the G8 screening tool"s total score was 0.824, and the measurement power was "good" (Fig. 1). The sensitivity and specificity were 61.0% and 88.9%, respectively.

Table 4: ROC analysis

Fig 1: ROC curve.

Discussion

Geriatric care focuses on quality of life and functionality, with an individualized, holistic approach. Cancer diagnosis in older adults makes treatment and care more complicated due to comorbidities and additional geriatric problems, which urges individual treatment and care. CGA ensures that the risks of side effects are assessed, geriatric conditions are identified, and diagnosis and multidisciplinary interventions are used to obtain positive health outcomes in older adults. Geriatric assessment, which helps to identify effective interventions, is very important in improving function, quality of life, and individualized treatment and care. Many studies have been conducted to evaluate the screening tools since the International Society of Geriatric Oncology guidelines emphasized in 2005 the need for risk screening of older adults with cancer. [31,32] The Turkish version of the G8 screening tool, the most widely used tool, was adapted in this study to investigate the need for the CGA of older adults diagnosed with hematologic cancer.

The adaptation of the G8 screening tool to Turkish began with language validity and content validity analysis based on expert opinion. Confirmatory factor analysis, half-divide method, sensitivity and specificity analysis, and ROC curve analysis were performed to determine the validity of the scale. The validity and reliability analysis of the tool showed that the G8 screening tool had acceptable validity, good fit, and good reliability. The screening tool was applied by an oncology nurse to outpatients and inpatients in about five minutes each. The G8 screening tool can be applied to older outpatients and inpatients quickly and easily in intense work environments where time and resources are limited.

ROC analysis was performed for sensitivity and specificity analysis. In the original study, the G8 screening tool had a cut-off point of ≤14, a sensitivity of 85%, and a specificity of 65%.[25] According to the systematic review of Decoster et al., the G8 screening tool was used in eight studies (3.816 patients), with a sensitivity ranging from 65% to 92% (over 80% in 6 studies) and a specificity ranging from 3% to 75% (over 60% in 4 studies). Velghe et al. (2014) conducted a study on elderly individuals diagnosed with aggressive hematologic cancer and their findings showed that the sensitivity and specificity of the tool to be 89% and 100%, respectively.[33] In this study, the cut-off point, sensitivity, and specificity of the 17-point scale were found as 14.5, 61.0%, and 88.9%, respectively.

According to the Edmonton Frail Scale, 41.3% of the participants were considered frail (median scale: 6, mean: 6.06±3.25). According to the G8 screening tool, 59.1% of the participants constituted the further need group for CGA (<14.5). The G8 median score was 14.5, while the mean score was 13.21±2.82 (range 4-17). In the original study in which the G8 screening tool was developed, the score ranged from 6.5 to 17, and the median was 12.[25]

Limitations of this Study
This study had some limitations. First, the general health status of participants was found to be similar, and they were monitored with a specific treatment policy in the same institution. However, this study was conducted with patients from outpatient and inpatient units. Therefore, this should be considered in the implementation of the results. Second, the measurements were performed only once, and no further evaluation was conducted with repeated measurements.

Conclusion

Geriatric assessment in oncology settings can help to determine the vulnerability, and functionality, predict toxicity and survival, help in clinical decision-making, treatment and care plan.[34] The results obtained from the analysis of the tool translated into Turkish agree well with the findings reported in the previous studies. In this study, our results show that the G8 is a useful tool for older adults diagnosed with hematologic cancer. We believe that the G8 can be used to determine further CGA needs. Therefore, we recommend studies to assess the psychometric properties of the G8 screening tool for healthy outpatients aged 65 years and older.

Peer-review: Externally peer-reviewed.
Conflict of Interest: None declared.

Financial Support: None declared.

Authorship contributions: Concept - E.A., İ.A.; Design - E.A., İ.A.; Supervision - İ.A., D.T.; Materials -E.A.; Data collection &/or processing - E.A.; Analysis and/or interpretation - D.T., İ.A.; Literature search - İ.A., E.A.; Writing - İ.A., E.A., D.T.; Critical review - İ.A., D.T.

References

1) Federal Interagency forum on Aging Related Statistics. Older Americans 2000: key indicators of well-being. 2002. Washington DC. Access: [https://agingstats. gov/docs/PastReports/2000/OA2000.pdf]. Accessed 22 April 2019.

2) Yancik R. Cancer burden in the aged: an epidemiologic and demographic overview. Cancer 1997;80(7):1273-83.

3) Berger NA, Savvides P, Koroukian SM, Kahana EF, Deimling GT, Rose JH, et al. Cancer in the elderly. Trans Am Clin Climatol Assoc 2006;117:147-55.

4) Given B, Given CW. Older adults and cancer treatment. Cancer 2008;113(12 suppl): 3505-11.

5) Loh KP, Soto-Perez-de-Celis E, Hsu T, de Glas NA, Battisti NM, Baldini C, et al. What every oncologist should know about geriatric assessment for older patients with cancer: young international society of geriatric oncology position paper. J Oncol Pract. 2018;14(2):85-94.

6) Akdemir N, Akyar I. Geriatric nursing. J Acad Geriatr 2009;1(2):73-81.

7) Rubenstein LZ, Stuck AE, Siu AL, Wieland D. Impacts of geriatric evaluation and management programs on defined outcomes: overview of the evidence. J Am Geriatr Soc 1991;39(9 Pt 2):8-16.

8) Kane RL. Choosing and Using and Assessment Tool. In: Kane RL, Kane RA, editors. Assessing Older Persons: Measures, Meaning, and Practical Applications. 1st Edition. UK: Oxford University Press; 2004. p. 237-60.

9) Gallo J, Bogner HR. Multidimensional assessment. In: Gallo JJ, Bogner HR, Fulmer T, Paveza GJ, editors. Handbook of Geriatric Assessment. 4th Edition. USA: Jones & Bartlett Publishers; 2006. p. 6-11.

10) Extermann M, Aapro M, Bernabei R, Cohen HJ, Droz JP, Lichtman S, et al. Task Force on CGA of the International Society of Geriatric Oncology. Use of comprehensive geriatric assessment in older cancer patients: Recommendations from the task force on CGA of the International Society of Geriatric Oncology (SIOG). Crit Rev Oncol Hematol 2005;55(3):241-52.

11) Droz JP, Balducci L, Bolla M, Emberton M, Fitzpatrick JM, Joniau S, et al. Management of prostate cancer in older men: recommendations of a working group of the International Society of Geriatric Oncology. BJU Int 2010;106(4):462-9.

12) NCCN Clinical Practice Guidelines in Oncology Senior Adult Oncology Version 2. 2011 [Internet]. National Comprehensive Cancer Network. [cited 2019 April 22]. Available at: http://www.nccn.org/professionals/physician_ gls/pdf/senior.pdf. Accessed 2019, Oct 2.

13) International Society of Geriatric Oncology.Comprehensive Geriatric Assessment (CGA) of the older patient with cancer. SIOG [cited 2019 April 22]. Available from: http://www.siog.org/content/comprehensive- geriatric-assessment-cga-older-patientcancer.

14) Owusu C, Berger NA. Comprehensive geriatric assessment in the older cancer patient: coming of age in clinical cancer care. Clin Pract (Lond) 2014;11(6):749-62.

15) Yancik R, Ries LA. Cancer in older persons: an international issue in an aging world. Semin Oncol 2004;31(2):128-36.

16) Kalsi T, Babic-Illman G, Ross PJ, Maisey NR, Hughes S, Fields P, et al. The impact of comprehensive geriatric assessment interventions on tolerance to chemotherapy in older people. Br J Cancer 2015;112(9):1435-44.

17) Deschodt M, de Casterle BD, Milisen K. Gerontological care in nursing education programmes. J Adv Nurs 2010;66(1):139-48.

18) Puts MT, Hardt J, Monette J, Girre V, Springall E, Alibhai SM. Use of geriatric assessment for older adults in the oncology setting: a systematic review. J Natl Cancer Inst 2012;104(15):1133-63.

19) Kenis C, Decoster L, Van Puyvelde K, De Greve J, Conings G, Milisen K, et al. Performance of two geriatric screening tools in older patients with cancer. J Clin Oncol 2014;32(1):19-26.

20) Shahrokni A, Kim SJ, Bosl GJ, Korc-Grodzicki B. How we care for an older patient with cancer. J Oncol Pract 2017;13(2):95-102.

21) Marosi C, Köller M. Challenge of cancer in the elderly. ESMO Open 2016;1(3):e000020.

22) Overcash JA, Beckstead J, Moody L, Extermann M, Cobb S. The abbreviated comprehensive geriatric assessment (aCGA) for use in the older cancer patient as a prescreen: scoring and interpretation. Crit Rev Oncol Hematol 2006;59(3):205-10.

23) Hurria A, Gupta S, Zauderer M, Zuckerman EL, Cohen HJ, Muss H, et al. Developing a cancer?specific geriatric assessment: A feasibility study. Cancer J 2005;104(9):1998-2005.

24) Hentschel L, Rentsch A, Lenz F, Hornemann B, Schmitt J, Baumann M, et al. A questionnaire study to assess the value of the vulnerable elders survey, G8, and predictors of toxicity as screening tools for frailty and toxicity in geriatric cancer patients. Oncol Res Treat 2016;39(4):210-6.

25) Soubeyran P, Bellera C, Goyard J, Heitz D, Cure H, Rousselot H, et al. Validation of the G8 screening tool in geriatric oncology: The ONCODAGE project. J Clin Oncol 2011;29(15 suppl):9001.

26) Bostankolu Ö, Öztürk B, Coşkun U, Büyükberber S, Benekli M. Cancer chemotherapy in elderly patients. Int J Hematol Oncol 2008;18(3):186-92.

27) Martinez-Tapia C, Canoui-Poitrine F, Bastuji-Garin S, Soubeyran P, Mathoulin-Pelissier S, Tournigand C, et al. Optimizing the G8 screening tool for older patients with cancer: diagnostic performance and validation of a six-item version. Oncologist 2016;21(2):188-95.

28) Bellera C, Rainfray M, Mathoulin-Pelissier S, Martens C, Delva F, Fonck, M, et al. Screening older cancer patients: first evaluation of the G-8 geriatric screening tool. Ann Oncol 2012; 23(8):2166-72.

29) Rolfson DB, Majumdar SR, Tsuyuki RT, Tahir A, Rockwood K. Validity and reliability of the Edmonton Frail Scale. Age Ageing 2006;35(5):526-9.

30) Aygör HE, Fadıloğlu Ç, Şahin S, Aykar FŞ, Akçiçek F. Validation of Edmonton Frail Scale into elderly Turkish population. Arch Gerontol Geriatr 2018;76:133-7.

31) Decoster L, Van Puyvelde K, Mohile S, Wedding U, Basso U, Colloca G, et al. Screening tools for multidimensional health problems warranting a geriatric assessment in older cancer patients: an update on SIOG recommendations. Ann Oncol 2015;26(2):288-300.

32) Balducci L, Beghe C. The application of the principles of geriatrics to the management of the older person with cancer. Crit Rev Oncol Hematol 2000;35(3):147-54.

33) Velghe A, Petrovic M, De Buyser S, Demuynck R, Noens L. Validation of the G8 screening tool in older patients with aggressive haematological malignancies. Eur J Oncol Nurs 2014;18(6):645-8.

34) Hamaker ME, Schiphorst AH, ten Bokkel Huinink D, Schaar C, van Munster BC. The effect of a geriatric evaluation on treatment decisions for older cancer patients-a systematic review. Acta Oncol 2014;53(3):289-96.