Effectiveness, cost effectiveness, acceptability and implementation barriers/enablers of chronic kidney disease management programs for Indigenous people in Australia, New Zealand and Canada: a systematic review of mixed evidence

Abstract

Background

Indigenous peoples in Australia, New Zealand and Canada carry a greater burden of chronic kidney disease (CKD) than the general populations in each country, and this burden is predicted to increase. Given the human and economic cost of dialysis, understanding how to better manage CKD at earlier stages of disease progression is an important priority for practitioners and policy-makers. A systematic review of mixed evidence was undertaken to examine the evidence relating to the effectivness, cost-effectiveness and acceptability of chronic kidney disease management programs designed for Indigenous people, as well as barriers and enablers of implementation of such programs.

Methods

Published and unpublished studies reporting quantitative and qualitative data on health sector-led management programs and models of care explicitly designed to manage, slow progression or otherwise improve the lives of Indigenous people with CKD published between 2000 and 2014 were considered for inclusion. Data on clinical effectiveness, ability to self-manage, quality of life, acceptability, cost and cost-benefit, barriers and enablers of implementation were of interest. Quantitative data was summarized in narrative and tabular form and qualitative data was synthesized using the Joanna Briggs Institute meta-aggregation approach.

Results

Ten studies were included. Six studies provided evidence of clinical effectiveness of CKD programs designed for Indigenous people, two provided evidence of cost and cost-effectiveness of a CKD program, and two provided qualitative evidence of barriers and enablers of implementation of effective and/or acceptable CKD management programs. Common features of effective and acceptable programs were integration within existing services, nurse-led care, intensive follow-up, provision of culturally-appropriate education, governance structures supporting community ownership, robust clinical systems supporting communication and a central role for Indigenous Health Workers.

Conclusions

Given the human cost of dialysis and the growing population of people living with CKD, there is an urgent need to draw lessons from the available evidence from this and other sources, including studies in the broader population, to better serve this population with programs that address the barriers to receiving high-quality care and improve quality of life.

Background

Chronic Kidney Disease (CKD) occurs more frequently and in younger age groups amongst Aboriginal and Torres Strait Islander Australians than non-Indigenous Australians, with rates three to five times the national average in urban areas and up to 30 times the national average in remote areas [1]. Mortality is correspondingly high, with national data indicating CKD is a primary or associated cause of death in 16 % of Indigenous deaths [2]. A disproportionately high burden of CKD has also been found among First Nations people in Canada and Maori people in New Zealand, where there are similar persistent patterns of heath inequities between Indigenous and non-Indigenous people [3–5]. The incidence end-stage kidney disease (ESKD) has almost doubled between 1991 and 2008 and is projected to increase by 130 % from 2009 to 2020 [2, 6]. Dialysis is expensive, invasive, and leads to decreased quality of life, particularly for people living in rural and remote locations, who often have to leave their homes for extended periods and/or travel long distances to access treatment [7].

Reducing this burden will require cross-sector primary prevention strategies addressing risk factors across the life course, including increasing access to appropriate health care and early screening, [1, 8] as well as improved access to effective and acceptable treatment programs for those with CKD. This review is concerned with programs targeting Indigenous people with established CKD and as such has a deliberate focus on a narrow part of the treatment continuum [9] (Fig. 1). The review was initiated by renal staff working on the ‘front line’ in primary care settings in central Australia, who expressed an urgent need to find ways of stopping the rapid increase in ESKD, and in particular of understanding what may assist those with early-stage CKD to delay, or prevent, the need for dialysis. The goals of CKD management programs include reducing cardiovascular risk, identifying and managing complications, providing appropriate and timely interdisciplinary health-care, and supporting lifestyle modifications [9–12].

Fig. 1

Focus of this review in relation to the prevention and management pathway for CKD

A recent systematic review of CKD programs in the United Kingdom, United States and Canada, found that care provided by a multidisciplinary team, compared to standard medical care, delayed the progression of CKD [13]. The four studies included in this review focused on education as the primary preventative strategy. A comprehensive preliminary search of relevant databases revealed that there is no existing systematic review examining evidence on the effectiveness, cost effectiveness, acceptability and/or implementation barriers/enablers of CKD management programs designed for Indigenous people living in Australia or elsewhere.

The present review sought to address the following questions:

• 1. What is the effectiveness of CKD programs designed for Indigenous people in relation to outcomes, including, though not limited to: clinical indicators of CKD management such as blood pressure control; the delayed progression of kidney disease/time to dialysis; and quality of life?

• 2. What are the costs and costs relative to benefits of CKD programs designed for Indigenous people from the perspectives of individual patients and their families, the primary health services that deliver them, tertiary health services and society as a whole?

• 3. What do patient and provider experiences of CKD programs designed for Indigenous people reveal about the acceptability of programs, as well as barriers and enablers of implementation?

Methods

A protocol for the review was published in the Joanna Briggs Institute (JBI) Database of Systematic Reviews and Implementation Reports [14]. This project was developed in accordance with the National Health and Medical Research Council’s Values and Ethics: Guidelines for ethical research in Aboriginal and Torres Strait Islander Research [15], and with the South Australian Aboriginal Health Research Accord [16].

Search and study selection

The search strategy sought published and unpublished studies in English, published between 2000 and 2014. Earlier studies were considered less relevant due to advances in technology and data collection. Following the JBI and Cochrane guidelines [17, 18], a four-step search strategy was designed with a view to accessing the most relevant published literature, and also took into account the large amount of Indigenous health research evidence contained in grey literature [19] (Table 1).

Table 1 Four-step search strategy

The PubMed search strategy is shown in Table 2.

Table 2 Pubmed search terms

The search results were imported into the EndNote (Thomson Reuters) citation manager and pooled into a single library. After removing duplicates, titles and abstracts were screened against the inclusion criteria by two reviewers (RR and KE) working independently. Those articles clearly not meeting the inclusion criteria were excluded. The full texts of the remaining articles were examined and those meeting the inclusion criteria were assessed for methodological quality.

Assessment of quality of included studies

Two reviewers (RR and KE) assessed methodological quality using relevant Joanna Briggs Institute (JBI) standardized critical appraisal instruments [17]. Quantitative papers examining CKD program effectiveness were assessed using the tools contained in the ‘JBI Meta-Analysis of Statistics Assessment and Review Instrument’ (JBI-MAStARI). JBI-MAStARI has separate tools for appraising different study designs. In the absence of a specific tool tailored for appraisal of uncontrolled before and after studies, these were appraised using the ‘descriptive/case series’ appraisal tool. Studies of costs and cost effectiveness were assessed using the tools contained in the ‘JBI Analysis of Cost, Technology and Utilization Assessment and Review Instrument’ (JBI-ACTUARI). Qualitative papers were assessed using the tool in the ‘JBI Qualitative Assessment and Review Instrument’ (JBI-QARI).

Any disagreements that arose between the reviewers were resolved through discussion or with a third reviewer (JG). Studies were classified as good quality if more than 80 % of appraisal characteristics were endorsed, moderate quality if 50–80 % of characteristics were endorsed and poor quality if less than 50 % were endorsed. Those rated as poor quality were excluded.

Data extraction

Quantitative, economic and qualitative data were extracted from papers included in the review by three reviewers (RR, KE and JG) who worked independently using the standardized data extraction tools from JBI-MAStARI, JBI-ACTUARI and JBI-QARI [17]. Details about study characteristics (e.g., interventions, populations, settings and study methods) were extracted, as well as findings for the outcomes/phenomena of interest relevant to the review. Authors were contacted where necessary to clarify reported data or access information not reported.

Data synthesis

The findings from included quantitative studies were synthesized using narrative and tables. The findings of qualitative studies were synthesized using the JBI meta-aggregation synthesis tool in JBI-QARI. This involved the aggregation of findings to generate a set of representative statements and categorizing the findings on the basis of similarity in meaning. These categories were then subjected to a meta-synthesis to produce a single, comprehensive set of synthesized findings [17, 20]. The heterogeneity of studies in terms of interventions, populations, reported data and study designs precluded both meta-analysis and second level aggregated synthesis. As such, the results for each question are presented separately below.

Results

Search and study selection

As shown in Fig. 2, the search returned 2246 unique citations that were screened by title and abstract against the review inclusion criteria. The full texts of 136 papers were then reviewed independently by the primary and secondary reviewer (RR and KE), and reference lists checked for additional relevant articles. Checking the reference lists yielded one additional article that was included for full-text examination. Of these 137 articles, 85 were excluded on the basis of study design, 23 on the basis of population of interest, 2 were conducted in inpatient settings and 12 were duplicates (eg. where there were multiple publications from the same study). Four articles were not accessible after extensive efforts to access electronically and contacting the authors. A list of the studies excluded at full text examination with reasons for exclusion is provided as an additional file. Of the ten included studies, six provided quantitative evidence addressing the question of intervention effectiveness, two on costs (1) and cost effectiveness (1), two provided qualitative evidence on barriers/enablers on CKD program implementation and one study provided quantitative evidence on CKD program acceptability.

Fig. 2

PRISMA Diagram: Search and Study Selection

Methodological quality of included studies

The majority of articles were rated as moderate quality, two were good quality and one study of poor quality was excluded [21]. Common weaknesses included a lack of randomisation and insufficient follow-up period for quantitative studies, a lack of clarity around the credibility of values assigned to costs and outcomes for economic studies, and the absence of a statement about the cultural or theoretical position of the researcher, or addressing their influence on the research for qualitative studies. The critical appraisal tools are published in full elsewhere [17] (Table 3).

Table 3 Critical appraisal of studies meeting the inclusion criteria

Findings on the effectiveness of CKD programs

Study characteristics

As outlined in Table 4, of the six studies providing quantitative evidence on program effectiveness, four were conducted in New Zealand [22–25] and two in Australia [26, 27]. Four of these were uncontrolled prospective cohort designs carried out over one [24, 25] or 2 years [23, 27]. Of a number of possible publications reporting effectiveness of the Menzies Renal Treatment Program (MRTP), the thesis by Kondalsamy-Chennakesavan [26] was selected because it was the most relevant and comprehensive, including two comparisons: 1) before and after the MRTP was handed over to the Tiwi Health Board (THB); and 2) outcomes from the MRTP versus the THB-run Continuing Care Trial (CCT). Australian participants were younger, on average, than the New Zealand participants (weighted averages 44.1 years and 57.8 years respectively). The 437 participants overall were split evenly between men and women (49.9 % men).

Table 4 Characteristics of studies addressing question 1

Findings

Studies reported clinical indicators of CKD management including blood pressure control, the use of anti-hypertensive medication, albumin-creatinine ratio (ACR), glycemic index (HbA1c) and glomerular filtration rate. No studies reported data on hard end-points such as dialysis or death. There were also no data reported on quality of life or other psychosocial variables, such as depression or stress.

Relevant clinical outcomes from all studies are shown in Table 5. All intervention groups showed significant reductions in systolic blood pressure from baseline or in relation to comparator groups. All groups who reported on ACR reported reductions, although this was non-significant in Shephard [27] This study was limited by very small sample size. Where it was reported, glycated hemoglobin was lower at follow-up for most programs, except for Kondalsamy-Chennakesavan [26], where results were mixed following the handover of the program to the Tiwi Health Board when it was incorporate into routine primary health care. Findings relating to estimated glomerular filtration rate (eGFR) are also mixed. eGFR is an important indicator of CKD function but is complicated as a measure of program effect because it can decrease in the short term with use of antihypertensive medications. For many people with CKD, GFR reduces steadily over time, while for others it may follow a non-linear trajectory [28].

Table 5 Findings relating to question 1

Indicators of health knowledge and behavior were not widely measured. Hotu et al. [22] measured medication adherence by self-report questionnaire, and found that 80 % took their medication ‘most of the time’ in the intervention arm, compared to 71 % in usual care. In Shephard et al. [27], tablet counts indicated that 72 % of participants took their medication at least 80 % of the time. Walker et al. [24, 25] measured ‘self-management’ from the perspectives of patients and clinicians using 13 questions of the Partners in Health instrument [29] and reported improvements in 12 of 13 domains.

Findings on the cost and cost effectiveness of CKD programs

Study characteristics

Two studies provided evidence relating to costs or cost-effectiveness of CKD programs from the perspective of service providers. Baker et al. [30] measured the cost-effectiveness of the Menzies Renal Treatment Program (MRTP), which was also included in the quantitative review [26], and Gador-Whyte et al. [31] compared the estimated the costs of delivering best-practice care, as defined by Central Australian Rural Practitioners’ Association (CARPA) guidelines [32], with actual expenditure for patients with Type 2 diabetes and/or CKD in an Aboriginal Community Controlled Health Service in remote Central Australia.

Findings

When comparing the MRTP to usual care, Baker et al. [30] found that the risk of starting dialysis in the treatment group relative to historical controls over a 4.7 year period was reduced by 57 % (p = 0.03), as shown in Table 6. Moreover, that over the 4.7 years, 36.8 person years of dialysis were avoided by implementing the MRTP. The reduced number of dialysis starts generated net savings of $4.2 million (in 1997–1998 AUD). Sensitivity analysis indicated that these findings were robust to changes in costing assumptions (Table 7).

Table 6 Characteristics of studies addressing question 2

Table 7 Comparison of the effects and costs of the MRTP and control at 4.7 years (Baker et al.) [26]

Gador-Whyte et al. [31] reported a total funding gap of $198,728 per annum or $1733 per patient between the projected cost of best practice care and actual expenditure in 2009–2010. No sensitivity analysis was conducted, therefore it is unclear whether funding gaps of similar magnitudes have applied, and continue to exist, in other ACCHS and community settings with different staffing and cost structures. The study also identified workforce shortages, low health literacy and a high acute care workload as factors that may prevent delivery of best practice care (Table 8).

Table 8 Costs of usual and best practice care for patients in an ACCHS setting (Gador-Whyte et al.) [27]

Findings on acceptability and barriers/enablers of implementation

Study characteristics

The two qualitative studies included in the review, from Australia and New Zealand, described experiences of CKD programs/models of care to Indigenous people from the perspective of providers. Characteristics of included qualitative studies are shown in Table 9. Tchan et al. [33] evaluated the Outback Vascular Health Service (OVHS), described as a chronic disease outreach program. The study documents service provider experiences of providing care to Aboriginal people with CKD, which reveal barriers and enablers of implementing acceptable and effective CKD care to Aboriginal people. Walker et al. [34] is a descriptive, exploratory study describing pre-dialysis nurses’ experiences of delivering care to CKD patients on outpatient clinics. It offers evidence relating to barriers and enablers to providing effective CKD care to Maori and Pasifika patients.

Table 9 Characteristics of studies addressing question 3

Shephard et al. [27] present the results of a brief survey of program acceptability developed for the Umoona Kidney Program. This 7-item questionnaire was administered to 50 Aboriginal community members, including the participants in the program. Items such as ‘Are you happy with the way the kidney team treats you?’ were measured on a 5-point scale from ‘very much yes’ to ‘very much no.’

Findings

Twenty-nine findings on barriers or enablers of CKD program implementation were identified and extracted from the two qualitative studies. Twelve unsupported findings (those without supporting data) in Tchan et al. [33] were excluded. The 17 remaining findings, summarized in Fig. 3, were grouped into four categories. These categories were synthesized into one overall finding. There was no qualitative evidence from the perspectives of patients.

Fig. 3

Synthesis of qualitative findings addressing question 3

The survey of acceptability reported by Shepard et al. [27] found very positive attitudes amongst community members towards the Umoona Kidney Project. However, the small sample and bias inherent in the phrasing of questions and mode of administration make this questionnaire difficult to interpret with confidence.

Discussion

The purpose of this review was to examine evidence on the effectiveness, cost effectiveness and acceptability CKD management programs for Indigenous people, as well as barriers and enablers of implementation. Given the broad scope of these questions, which were directed at providing guidance for the design and implementation of future CKD programs, the inclusion criteria were broad and inclusive in regards to the types of programs and outcomes considered. In light of this, the small number of included studies, in particular addressing questions 2 and 3, was surprising. An examination of the studies excluded from this review indicates that there is a lot written but not a lot of it is intervention research. While the heterogeneity, small sample sizes and moderate quality of the included studies limit generalizability, the findings do indicate that targeted CKD programs are effective in improving clinical outcomes for Indigenous people with CKD, such as maintaining blood pressure within target ranges and reducing HbA1c and albuminuria. Alongside data on the effectiveness of programs, the inclusion of evidence on cost, cost-effectiveness, acceptability, and barriers and enablers of implementation was considered important for informing the future program development, given the unique economic, social and cultural contexts in which CKD programs for Indigenous peoples are implemented. The small quantity of research addressing these questions suggests that little is currently known about the how CKD management programs for Indigenous peoples are experienced, in particular from the perspectives of clients, their families or communities; and also indicates that economic evaluation is not routinely included in CKD program evaluation. Nonetheless the body of evidence included in the review provides a useful indication of the particular features that should be considered in the design of CKD management programs for Indigenous people.

All programs were multifaceted. While it is not possible to draw conclusions about the particular components of programs that may be causally related to improved outcomes, we identified characteristics common to many of the programs. Future qualitative and quantitative research could explore these questions more fully. Common components of effective programs were: the integration or coordination with primary care; nurse-led or Indigenous Health Worker-led care; intensive follow-up including home-visits; the provision of anti-hypertensive medication following a step-wise protocol; and addressing barriers to adherence such as cost and lack of transport. Education also emerged as a key component of effective programs, but it had to be delivered in ways that accounted for literacy and culture. These program features were consistent with the findings addressing the question of acceptability, and barriers and enablers of implementation. There is also overlap between these findings and evidence in non-Indigenous populations, which indicates that nurse-led and/or multidisciplinary [13, 35], protocol-driven [36] care embedded in primary health care and including patient education tends to lead to better outcomes [13, 35, 36].

To address the question of cost and cost effectiveness (Q2), we sought to identify studies of CKD management programs that considered cost and cost-effectiveness in their evaluations. Such studies involve weighing up factors and conditions specific to a particular time and context. As such, our ability to draw generalizable conclusions from the two included studies is limited. For example, the effectiveness data in Baker et al. [30] should be considered in light of the medical advances that have occurred in routine practice since the data was collected between 1995 and 1998 (although the study was published in 2005). Similarly, Gador-Whyte et al. [31] conducted their study in 2010–2011, and since that time relevant changes to the funding structures of Aboriginal Community Controlled Health Organizations have occurred, such as the introduction of the Practice Incentive Program (PIP) Indigenous Health Incentive, which provides eligible Indigenous health services with a payment for each patient who is registered for chronic disease care, and an additional payment for those who receive a target level of care in a calendar year [37, 38].

Nonetheless, the studies provide some insights relating to the resourcing of CKD programs. Gador-Whyte et al. [31] provide a valuable outline of what constitutes best-practice care in a remote Aboriginal Health Service. The funding short-fall between projected (best-practice) and actual expenditure appeared across clinical staff, administrative staff and other operating costs. It was noted that an acute work-load, health literacy, under-staffing and high staff turnover were barriers to the provision of best-practice care, reflecting broader issues such as the challenge of recruiting and retaining staff in remote communities, rather than a funding shortfall per se. Baker et al. [30] suggest that from a government perspective, the Menzies Renal Treatment Program was a ‘good buy’ for health, as it generated improvement in health outcomes and reduced suffering for patients, as well as monetary savings by reducing dialysis start numbers. The positive impact on quality of life is the stronger and, arguably, sufficient argument for investing in primary and secondary prevention programs. Furthermore, effective management of CKD is likely to have additional benefits for the prevention of other acute and chronic health problems (such as cardiovascular disease), leading to other social and economic benefits that should be taken into account.

Regarding the question of acceptability, and barriers and enablers of implementation (Q3), the two studies included in this review reveal important enablers to implementing CKD management programs to Indigenous people such as governance structures that support community ownership and culturally relevant care; flexible care that can meet the needs of people in their particular context; and robust clinical systems that support communication, staff autonomy and capacity building. In particular, the important role of nurses and Indigenous Health Workers was again highlighted in both studies. These program features are in line with Gibson et al. [39] who found that community engagement, coordination of care, embedding culturally safe care, for example by employing Indigenous people, and respecting patients’ perspectives enabled the implementation of chronic disease care. Excluding IHWs from decision-making and poorly performing electronic support systems were barriers to implementation.

Conclusions

Overall, the findings of this review point to the benefit of CKD care that caters to people in their social and cultural environments. That is, care that is embedded within existing healthcare services that people already use. Health services utilising intensive outreach aim to remove barriers to adhering to medical regimens and attending appointments, as well as enabling education and assisting with goal setting in an appropriate location for individuals and families. The role of nurses and/or Indigenous health workers was emphasised in delivering effective outreach and education, and the role of primary health care services was emphasised, in line with recent policy recommendations [39–41].

There is no doubt that more rigorous evaluations of programs over longer time-frames would assist a better understanding the longer-term effectiveness and sustainability of CKD programs, and to understand the mechanisms by which programs lead to change. Researchers should also be encouraged to adhere to best practice by outlining program theories, to enable the assessment of program fidelity, and a better understanding of why and how a program effect occurs. However, given the human cost of dialysis and the growing population of people living with CKD, there is a critical need to draw lessons from the available evidence, including this and other sources in Australia and internationally, to better serve Indigenous people with programs that address the barriers to receiving high-quality care and improve quality of life.