This article has Open Peer Review reports available.

# Identifying seasonal and temporal trends in the pressures experienced by hospitals related to unscheduled care

- NJ Walker
^{1}Email authorView ORCID ID profile, - HC Van Woerden
^{2, 3}, - V Kiparoglou
^{1}and - Y Yang
^{4}

**16**:307

https://doi.org/10.1186/s12913-016-1555-7

© The Author(s). 2016

**Received: **10 September 2015

**Accepted: **5 July 2016

**Published: **26 July 2016

## Abstract

### Background

As part of an electronic dashboard operated by Public Health Wales, senior managers at hospitals in Wales report daily “escalation” scores which reflect management opinion on the pressure a hospital is experiencing and ability to meet ongoing demand with respect to unscheduled care. An analysis was undertaken of escalation scores returned for 18 hospitals in Wales between the years 2006 and 2014 inclusive, with a view to identifying systematic temporal patterns in pressure experienced by hospitals in relation to unscheduled care.

### Methods

Exploratory data analysis indicated the presence of within-year cyclicity in average daily scores over all hospitals. In order to quantify this cyclicity, a Generalised Linear Mixed Model was fitted which incorporated a trigonometric function (sine and cosine) to capture within-year change in escalation. In addition, a 7-level categorical day of the week effect was fitted as well as a 3-level categorical Christmas holiday variable based on patterns observed in exploration of the raw data.

### Results

All of the main effects investigated were found to be statistically significant. Firstly, significant differences emerged in terms of overall pressure reported by individual hospitals. Furthermore, escalation scores were found to vary systematically within-year in a wave-like fashion for all hospitals (but not between hospitals) with the period of highest pressure consistently observed to occur in winter and lowest pressure in summer. In addition to this annual variation, pressure reported by hospitals was also found to be influenced by day of the week (low at weekends, high early in the working week) and especially low over the Christmas period but high immediately afterwards.

### Conclusions

Whilst unpredictable to a degree, quantifiable pressure experienced by hospitals can be anticipated according to models incorporating systematic temporal patterns. In the context of finite resources for healthcare services, these findings could optimise staffing schedules and inform resource utilisation.

## Keywords

## Background

Hospitals may struggle to operate effectively and meet quality standards when admission rates are high in relation to available resources such as beds, staff and operational capacity [1, 2]. Whilst healthcare planners use different strategies to control demand for elective treatments (for example by introducing a waiting list for treatments or operations, by bringing forward discharge to community or social care, and by ensuring resources match demand as far as possible), short term demand for emergency care is harder to manage. As most hospitals provide both elective and emergency care and run at high occupancy rates, there are times when hospitals may still struggle to fully meet demand and provide care for the population they serve. Although undesirable, such episodes are inevitable in light of finite resource allocation to healthcare budgets and the high operational costs involved in running a health service. Inadequate staffing and high bed occupancy rates result in overcrowding which can have an adverse influence on a range of patient outcomes [3] with some studies indicating a link to an increase in in-hospital patient mortality [4, 5] in addition to the spread of infectious pathogens within the hospital environment such as Methicillin-resistant *Staphylococcus Aureus* (MRSA) [6]. Overcrowding in hospitals is also observed to have an adverse effect on staff wellbeing [7]. The challenges faced in meeting the demands of running healthcare systems are likely to intensify in future as technologically complex and costly interventions increase in number and the demographic structure of target populations changes, particularly in terms of an increase in life expectancy and an elderly population with extensive comorbidity [8, 9].

Part of this pressure arises from unscheduled admissions referred to Emergency Departments (ED) and primary care practitioners due to sudden onset of illness or injury [10]. This is an especially challenging area of care to plan for due to its inherent unpredictability. In 2012–13, there were 5.3 million emergency admissions to hospitals in the UK, an increase of 47 % over the last 15 years [11] and overcrowding in ED has become a major problem [12].

There are nonetheless likely to be predictable temporal patterns in unscheduled care pressure, notably in relation to annual, weekly and daily cycles. Consistent monthly differences have been reported elsewhere in relation to objective measures of pressure such as the number of admissions and inpatient days [13]. Fullerton and Crawford [14] found that bed occupancy was influenced by both season and day of the week in relation to data from a large teaching hospital although these trends were found to vary between specialties. Furthermore, Jones [15] demonstrated the existence of long-term patterns in bed occupancy and highlighted the importance of identifying periods of time where this phenomenon is likely to be volatile. Understanding these patterns can help inform the planning of staff rotas and resource allocation.

- 1.
Steady state (hospital able to cope with current rate of admissions with available resources)

- 2.
Moderate pressure (admissions likely to exceed capacity)

- 3.
Severe pressure (admissions are exceeding capacity)

- 4.
Extreme pressure (admissions significantly exceeding capacity)

A more detailed rationale is provided by Piggott et al. [16] including the triggers (based on, for example, the time taken for patients’ first contact with an assessing clinician) which underlie transition between the four states.

In the current paper, the authors analyse daily escalation scores from Welsh hospitals, where available, between the years 2006 and 2014 inclusive in order to gain an insight into temporal trends in unscheduled care pressure. This contrasts with other documented analyses of seasonal trends which utilise specific quantitative measures of hospital pressure such as bed occupancy [14], admission rates and in-hospital mortality [5]. Furthermore, we consider data from a number of hospitals simultaneously, affording an insight into possible heterogeneity between hospitals in terms of pressure intensity and temporal patterns. Computer models have an increasingly important part to play in optimising the management and delivery of emergency services [17–20]. Detailed information on systematic temporal patterns of pressure in hospitals is likely to enhance the accuracy and usefulness of such models. The models used here are relatively easy to implement and the results can usefully contribute to computer models as well as potentially informing staffing rosters in a climate where resource allocation needs to be optimised.

## Methods

Historic escalation scores from 1st January 2006 to 20 October 2014 were obtained for 18 major hospitals in Wales that provide unscheduled care. The dataset was provided by the NHS Wales Informatics Service, on behalf of the Unscheduled Care Lead for Wales. The time of day recorded in the database was not utilised in analysis, as there was uncertainty as to whether the time of day that each escalation score was electronically recorded reflected the time of day when the score was reported. To preserve anonymity, the hospitals are labelled with a numeric code (1–18) for presentational purposes.

In order to address potential issues regarding pseudo-replication (i.e. multiple observations per day), it was decided to use only one score per day for each hospital for analytical purposes. To this end, where more than one score was present, the median value on a given day was taken and rounded to the nearest integer where decimals were involved (e.g. 2.3 to 2, 1.5 to 2). This had the effect of returning a single score for each hospital on each day (where available) which was on the original integer scale between 1 and 4. Where scores had been stepped up or down during the day, the upward rounding of .5 favoured the higher of two values. This was felt to be the best reflection of the pressure the hospital had been under that day.

### Statistical model

The means of these median daily scores, computed as described above, were then calculated across all 18 hospitals with respect to (i) each date for which records were available spanning the period 2006 to 2014 inclusive (ii) calendar date within a year. These were inspected graphically in order to ascertain the presence of any systematic trends. In a similar way, the mean score was calculated for each day of the week across all hospitals in the dataset and these are presented in tabular form.

Statistical analysis was carried out in order to assess the possible existence of correlation between various temporal factors and the daily escalation scores and to define the nature of such relationships. A model was fitted in which the graded escalation score was modelled as a binary phenomenon where *n* = 3, such that scores 1–4 map to a number of positive outcomes 0–3 out of a maximum of 3. In order to assess the trends apparent from exploratory analysis, daily escalation scores were regressed against hospital, calendar date and day of the week.

### Trigonometric functions for annual cyclicity

^{0}, angles 90

^{0}, 180

^{0}and 270

^{0}approximate the passing of 3, 6 and 9 months respectively. A similar approach can be used to model any process that changes periodically in a wave-like motion over regular time cycles, e.g. changing temperature over a 24-h period, or total daily hours of sunlight recorded over a year.

Fitting both the sine and the cosine of angle θ allows for estimation of both the *amplitude* and *shift* of the underlying trend. According to mathematical convention, angle θ was measured in radians (2π radians = 360^{0}). For more details on this modelling approach, see Stolwijk et al. [21].

### Day of the week and christmas effects

Day of the week was fitted as a categorical variable with 7 levels, one for each day. Exploratory data analysis indicated clear differences between days in recorded escalation, but not according to a clear parametric form, thus this less parsimonious approach fitting 7 independent effects was adopted.

Exploratory analyses also highlighted a lull in reported pressure over the Christmas period followed by a compensatory increase in the days immediately after the Christmas holiday. Thus a categorical variable “Christmas effect” was created which took a value of 2 for calendar dates December 21–28 inclusive, a value of 3 for dates January 3–9 inclusive and a baseline value of 1 for all other dates. These dates were chosen to approximate the periods for which these effects appeared to be present from looking at the data. Potential effects associated with other public holidays were not included in these models, although work elsewhere [22] suggests the possible existence of such effects.

### Statistical model

*n*= 3 (thus four possible outcomes–0, 1, 2 and 3 corresponding to the four graded escalation scores 1, 2, 3 and 4 respectively). This was analysed using logistic regression in a Generalised Linear Model (GLM) framework, with a binomial distribution chosen to model the error in the response and a logit link function [23]. Escalation score was regressed against the following explanatory variables: hospital, sine and cosine of angle θ, day of the week and Christmas effect. In addition, the interactions between (i) hospital and sine (ii) hospital and cosine were included to assess whether the trigonometric model was different across hospitals. This model is summarised in the following equation:

*P*= binomial probability parameter, α = global constant, β

_{ hos p }= hospital–specific constant, β

_{ sine }= global sine coefficient, β

_{ cosine }= global cosine coefficient, β

_{ hosp.sine }= hospital-specific sine coefficient, β

_{ hosp.cosine }= hospital-specific cosine coefficient, β

_{ day }= day of the week effect, β

_{ chr }= Christmas effect,

*x*

_{1}= sine of θ,

*x*

_{2}= cosine of θ.

Main effects associated with the interactions fitted (i.e. hospital, sine and cosine) were automatically retained where the relevant interactions were significant.

*P*determines the expected escalation score for a given hospital on a given day. The predicted score can be estimated (returning a number on a continuum between 1 and 4) by back-transforming as follows:

*Ê* = expected escalation score and \( \widehat{B}=\mathrm{logit}(P) \) calculated using the model estimates of the β parameters (β_{
hosp
}, β_{
sine
} etc.).

A value of 1 is added to transform the binomial score (0–3) back to the scale of the escalation score (1–4).

Where:

*y* = escalation score (1, 2, 3 or 4), \( \left(\begin{array}{l}n\\ {}x\end{array}\right)=\frac{n!}{x!\left(n-x\right)!} \) and \( \widehat{P}=\frac{ \exp \left(\widehat{B}\right)}{\left(1+ \exp \left(\widehat{B}\right)\right)} \).

A degree of temporal autocorrelation in escalation score was anticipated further to the effect of model covariates such that an escalation score reported on one day has a high probability of being the same on the following day. Thus the above model was fitted using the Generalised Linear Mixed Model (GLMM) procedure in GenStat [24] incorporating day, nested within hospital, as a structured random effect. A first-order autoregressive structure (AR1) was selected to model this correlation. The statistical significance of putative autocorrelation was assessed by comparing deviance for this model against a similar model where autocorrelation was absent. Inference was based on estimated dispersion as opposed to a fixed value of 1, giving rise to approximate F-tests. The degrees of freedom for the denominator in relation to these tests were estimated according to the method presented by Kenward and Roger [25]. The model was fitted using the marginal method of Breslow and Clayton [26]. Model coefficients are reported on the logit scale.

The predicted escalation score *Ê* was calculated using the above formula separately for each hospital for each day of the year, matching calendar date to angle θ and averaging over other variables in the model. The predicted escalation profiles were then plotted and compared graphically with mean escalation scores by calendar date for the whole dataset.

Residuals from the best fitting model were assessed in terms of (i) the standardised deviance residual histogram (ii) standardised deviance residuals plotted against fitted values (iii) the normal-plot of standardised deviance residuals (iv) the half-normal plot of the same [24]. None of the above residuals highlighted significant deviation from model assumptions. All statistical analyses were carried out in GenStat 18th Edition [24].

## Results

Over the duration of the period investigated (1 Jan 2006 to 20 October 2014 inclusive) the number of escalation scores recorded by each hospital per day varied. Typically, one score only was available (*n* = 1 on 55.5 % of days) but sometimes this number was higher (*n* = 2 on 12.1 %; *n* = 3 on 5.9 % and *n* = 4 or more on 2.8 % of days) and sometimes no score was recorded at all (23.7 % of days). Days where no score was available were treated as missing data. The highest frequency of scores reported by a hospital on one day was 10. As described in the methods section, a single median value was taken on days on which more than one score was recorded.

*Ê*) for each of the 18 hospitals and these are plotted alongside the overall average escalation score for each calendar date across the whole dataset (Fig. 3).

Means of daily escalation scores for (i) hospitals (ii) days of the week between 2006-2014

Hospital | Number of days where data recorded (% of total days) | Mean of daily escalation score |
---|---|---|

1 | 2330 (72.5 %) | 2.21 |

2 | 3051 (94.9 %) | 2.60 |

3 | 2870 (89.3 %) | 2.87 |

4 | 1315 (40.9 %) | 1.87 |

5 | 2731 (89.5 %) | 1.88 |

6 | 2562 (79.7 %) | 2.31 |

7 | 3055 (95.0 %) | 2.27 |

8 | 2557 (79.5 %) | 2.66 |

9 | 1998 (62.1 %) | 2.03 |

10 | 2184 (67.9 %) | 2.42 |

11 | 2975 (92.5 %) | 2.41 |

12 | 2855 (88.8 %) | 2.81 |

13 | 2853 (88.7 %) | 2.81 |

14 | 2969 (92.3 %) | 2.18 |

15 | 2640 (82.1 %) | 1.76 |

16 | 2739 (85.2 %) | 1.82 |

17 | 1896 (59.0 %) | 1.97 |

18 | 564 (17.5 %) | 1.66 |

Day of the Week | ||

Sunday | 5487 (66.3 %) | 2.30 |

Monday | 6710 (81.0 %) | 2.46 |

Tuesday | 6707 (81.2 %) | 2.43 |

Wednesday | 6643 (80.4 %) | 2.35 |

Thursday | 6647 (80.5 %) | 2.30 |

Friday | 6595 (79.8 %) | 2.16 |

Saturday | 5360 (64.9 %) | 2.11 |

*p*< 0.001) for the fitting of AR1 parameter ϕ whose estimate and standard error were as follows: ϕ = 0.93, S.E. (ϕ) = 0.0018. Given the improvement in model fit described above, inference was based on the random-effect model including hospital/day autocorrelation. All main effects were found to be statistically significant, but both the trigonometric interactions were non-significant (for sine*hospital; F-statistic = 0.94, adjusted degrees of freedom = 17, 1301.6,

*p*= 0.5 and for cosine*hospital; F-statistic = 1.3, adjusted d.f. = 17, 1304.7,

*p*= 0.2) so the interactions were removed and inference is based on the model including main effects only (Table 2). The significance of both the sine and cosine of θ indicates that reported pressure follows a wave-like pattern within yearly cycles and that this phenomenon is observed across hospitals. It could be hypothesised that the nature of this pattern is different between hospitals but this is not supported by the results in relation to the interactions (in an earlier specification of the model not including autocorrelation, these interactions were significant, but the inclusion of AR1 correlation resulted in these effects being overridden).

Coefficients (logit-scale), test statistics and p-values from full model, regressing escalation score against (i) sine of θ (ii) cosine of θ (iii) Day of the Week (iv) Christmas effect (v) Hospital

Variable | Level | β (logit scale) | F-stat (adjusted d.f.) & |
---|---|---|---|

A | −0.57 | ||

Sine | +0.15 | 29.2 (1, 1356.1), | |

Cosine | +0.28 | 97.6 (1, 1377.0), | |

Day of the week | 591.4 (6, 34417.3), | ||

Sunday | 0 | ||

Monday | +0.33 | ||

Tuesday | +0.28 | ||

Wednesday | +0.17 | ||

Thursday | +0.094 | ||

Friday | −0.11 | ||

Saturday | −0.29 | ||

Christmas effect | 221.4 (2, 20842.0), | ||

Baseline | 0 | ||

Christmas | −0.80 | ||

Post-Christmas | +0.34 | ||

Hospital | 37.7 (17, 1200), | ||

Hospital 1 | 0 | ||

Hospital 2 | +0.64 | ||

Hospital 3 | +1.03 | ||

Hospital 4 | −0.49 | ||

Hospital 5 | −0.37 | ||

Hospital 6 | +0.29 | ||

Hospital 7 | +0.19 | ||

Hospital 8 | +0.68 | ||

Hospital 9 | −0.15 | ||

Hospital 10 | +0.40 | ||

Hospital 11 | +0.38 | ||

Hospital 12 | +0.94 | ||

Hospital 13 | +0.94 | ||

Hospital 14 | +0.049 | ||

Hospital 15 | −0.50 | ||

Hospital 16 | −0.51 | ||

Hospital 17 | −0.29 | ||

Hospital 18 | −0.79 |

Using calculus arguments and the sine/cosine model coefficients from the model (Table 2) allows for the estimation of predicted dates of lowest/highest pressure. According to model estimates the period of maximum pressure typically occurs in winter (28 January) and minimum pressure in summer (29 July) after adjusting for other model effects. In the absence of hospital*sine/cosine interactions, the dates of minimum/maximum pressure were assumed to be the same for all hospitals. The difference between minimum and maximum projected escalation varied from a lowest value of 0.33 (1.5 to 1.83) for hospital 18 to a highest value of 0.48 (2.20 to 2.67) for hospital 10. Both day of the week and Christmas effects were found to be statistically significant (day of the week – F-statistic = 591.4, adjusted d.f. = 6, 34417.3; *p* < 0.001; for Christmas effect–F-statistic = 221.4, adjusted d.f. = 2, 20842.0; *p* < 0.001). These results bear out the presence of reduced pressure attributable to unscheduled care up to and during the main days of Christmas (β = −0.80) and a modest increase after the Christmas period (β = +0.34). In terms of days of the week, the lowest escalation scores tend to be seen on Saturdays (β = −0.29) and the highest on Mondays (β = +0.33) relative to a baseline of 0 (Sunday).

## Discussion

In this paper, we present results from statistical models linking reported pressure scores to individual hospitals and (i) annual cycles (ii) day of the week (iii) the days during and after the Christmas period. Before considering these temporal patterns, it is clear that differences exist between hospitals in terms of overall pressure. This is evident from the raw data as per numbers presented in Table 1 and supported by the model results presented in Table 2. It may be significant that the three hospitals reporting the highest overall levels of pressure (hospitals 3, 12 and 13 in order of highest to lowest) were all based in major urban centres whereas the three hospitals reporting the lowest pressure (18, 15 and 16 in order of lowest to highest) were relatively rural.

The same general pattern of high and low pressure in winter and summer respectively is observed across hospitals. A significant part of the pressure in winter is likely to be associated with seasonal illness [27], although this phenomenon appears to be more general, being seen in apparently unrelated specialties such as orthopaedics [14]. It is possible to speculate that the reduced pressure from unscheduled care in summer may in part be due to a significant proportion of the population being away on holiday at any one time, although this is likely to be compensated for by a rise in the transient population during the tourist season.

As well as a difference in overall intensity of reported pressure, there is also some variability in the scale of difference between projected “quiet” and “busy” times of the year between hospitals. In the absence of hospital*sine/cosine interactions, this can be seen as a result of greater variation at hospitals with average scores close to an overall mean of 2.5 (i.e. halfway between the minimum score of 1 and maximum of 4) and least variation where average scores tend toward the extremes of 1 or 4. Such heterogeneity may in part reflect cultural differences in utilising escalation scores, although one can only speculate without extraneous information on metrics relating to the triggers underlying movement between escalation levels.

We see consistent differences in escalation according to day of the week, both with respect to raw data and model results. In particular, reported pressure tends to be lower at the weekend and then higher early in the working week (Monday and Tuesday). This finding is in broad agreement with results from analysis of bed occupancy rates which were found to be lower on average at the weekend [14, 22]. With respect to the data here, this may at first appear surprising if we anticipate a rise in unscheduled admissions on Friday and Saturday evenings due to alcohol related incidents. However, it may be the case that reduced discharge from hospital at weekends [28], combined with elective admissions on Mondays delays the adverse impact of weekend admissions on bed capacity and hence escalation score. There is some evidence to suggest that the risk of mortality may vary across the week [5, 29, 30]. This could be related to differences in staffing patterns, utilisation of hospital resources or differences in the profile of admissions [31]. Although within-day patterns were not considered in our analyses, there is likely to be systematic variation on this timescale too. For example, patterns in elective admissions and discharges have been observed to vary throughout the day in an analysis of data from a trust in England [32]. Circadian differences in admission time have also been reported in more specific instances such as asthma incidence [33]. However, it was not possible with the dataset in its present guise to investigate this aspect of temporal change further.

A phenomenon of delayed admission may be responsible for the sharp drop in reported pressure over the Christmas period, particularly given the subsequent rise observed in early January. This phenomenon may also be a function of increased discharge rate in the period prior to Christmas [32] which can have the effect of temporarily freeing up bed space.

Results from the current analysis broadly corroborate findings elsewhere with respect to seasonal change [14, 27], day of the week differences [22] and an effect associated with the Christmas period [14, 22]. However, the current model was predicated on a partially subjective measure taking values 1,2 3 or 4 as opposed to a quantitative metric (e.g. bed occupancy) taking continuous values over a wide range which is generally how this work has been approached elsewhere. The escalation score is a “catch-all” measure for a hospital which is influenced by a number of phenomena such as seasonal illness, staffing levels and different specialties which are themselves subject to particular patterns in pressure over time [14]. An advantage of working with this dataset was the ability to look at individual hospitals and the similarities/differences between them allowing us to assess whether one model is appropriate for all hospitals or not.

Whilst the best-fitting model provides statistical evidence of systematic temporal patterns in pressure arising from unscheduled care, the presence of significant autocorrelation in hospitals over time indicates a strong association between reported escalation on a given day and the day after. This aspect of pressure cannot be anticipated on the basis of long-term temporal patterns. However, the finding does imply that when pressure reaches a critical level, it is likely to remain there for a number of days.

Caution must be attached to the interpretation of these results in light of the subjective nature of the outcome (reported escalation). Differences in model results between hospitals may be due to differing escalation score thresholds among the respective hospital managers. This highlights a potential advantage of moving to a more objective measure for capturing pressure attributable to unscheduled care based on recorded metrics (e.g. percentage bed occupancy or hours lost by waiting ambulances) and work on the development of such a measure using data from the Welsh dashboard is in progress.

The trigonometric models used, whilst highlighting significant seasonal trends in hospital-level pressure (evident from the raw data as per Fig. 2) are nonetheless restrictive with respect to enforcing a half-year gap between the maximum and minimum point in the cycle. It may be that this gap is uneven (e.g. 5 & 7 months) and/or that this varies between hospitals. The extent of the data allows for potentially more sophisticated modelling such as time-series analysis which has been used, for example, in forecasting emergency call rates [34] although this would be facilitated by the existence of a measure of hospital pressure on a continuous scale (which can thus be modelled with Gaussian error) as opposed to the discrete measure used here.

## Conclusions

An obvious solution to overcrowding in EDs is to increase nursing staff numbers above a critical level at all times but in the context of increasing healthcare costs and limits on spending more pragmatic solutions need to be sought [35]. A number of studies have looked into the identification of an optimal nurse to patient ratio [36, 37] although no consistent picture emerges as to what this figure might be. It is evident that greater nursing hours per patient are associated with better patient outcomes [5, 38, 39] although there are also dangers attached to overuse of individual staff, both for nurse and patient. Whilst it may not be feasible in the current climate to simply assign staff numbers in excess of a pre-defined threshold, models taking into account the temporal patterns we have considered here may assist in adjusting staff rosters to optimise service in the context of limited resources. There is an increasing need for sophisticated evidence-based modelling to ensure cost-correct staffing [40] and detailed quantitative information on systematic temporal trends can make an important contribution in this endeavour.

Although the data were recorded in Wales it is likely that the findings with respect to seasonal cycles, day of the week differences and a rise and fall during and after the Christmas period are likely to be generalisable to other parts of the UK. However, we have also seen within this dataset that a degree of inter-hospital difference may be present (certainly in terms of overall pressure, possibly also in terms of within-year patterns in change), thus it may be preferable for hospitals to be considered individually in this regard. Generalisations to systems outside the UK are more difficult to make, but some commonality may be expected in culturally similar countries (e.g. in Europe, USA) with geographical proximity to the UK also likely to have some bearing.

## Abbreviations

ED, Emergency Department; GLM, Generalised Linear Model; GLMM, Generalised Linear Mixed Model; MRSA, Methicillin-resistant Staphylococcus Aureus

## Declarations

### Acknowledgements

The authors are grateful for advice and support from colleagues in Public Health Wales NHS Trust, Welsh Ambulance Service NHS Trust, NHS Wales Informatics Service and Welsh Assembly Government.

### Funding

Dr. Vasiliki Kiparoglou, Dr. Yaling Yang and Dr. Neil Walker were funded by the NIHR Oxford Biomedical Research Centre.

### Availability of data and materials

The data may be obtained from the authors for academic purposes, subject to appropriate Caldicott Guardian and data protection requirements being met.

### Authors’ contributions

NW carried out all analyses, wrote the initial draft and carried out revisions in discussion with co-authors. HvW made substantial contributions to draft revisions and provided expertise with regard to the history of the escalation scores used in Wales. YY and VK were involved in formative discussions of paper plan, provided feedback on analysis and results and made important contributions to revision of the manuscript. All authors read and approved the final manuscript.

### Competing interests

The authors declare that they have no competing interests.

### Consent for publication

Not applicable.

### Ethics approval and consent to participate

Not applicable.

**Open Access**This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

## Authors’ Affiliations

## References

- Jones R. Hospital bed occupancy demystified. Br J Healthc Manag. 2011;17(6):242–8.View ArticleGoogle Scholar
- Wise J. Staffing issues are often to blame for poor NHS performance, says regulator. BMJ. 2012;344, e4455.View ArticlePubMedGoogle Scholar
- Derlet RW, Richards JR. Overcrowding in the nation’s emergency departments: complex causes and disturbing effects. Ann Emerg Med. 2000;35(1):63–8.View ArticlePubMedGoogle Scholar
- Sprivulis PC, et al. The association between hospital overcrowding and mortality among patients admitted via Western Australian emergency departments. Med J Aust. 2006;184(5):208.PubMedGoogle Scholar
- Schilling PL, et al. A comparison of in-hospital mortality risk conferred by high hospital occupancy, differences in nurse staffing levels, weekend admission, and seasonal influenza. Med Care. 2010;48(3):224–32.View ArticlePubMedGoogle Scholar
- Clements A, et al. Overcrowding and understaffing in modern health-care systems: key determinants in meticillin-resistant Staphylococcus aureus transmission. Lancet Infect Dis. 2008;8(7):427–34.View ArticlePubMedGoogle Scholar
- Virtanen M, et al. Overcrowding in hospital wards as a predictor of antidepressant treatment among hospital staff. Am J Psychiatr. 2008;165(11):1482–6.View ArticlePubMedGoogle Scholar
- Fan N. Rising health care costs and the increasing role of government in medicine. Del Med J. 2014;86(5):137–8.PubMedGoogle Scholar
- Leibach EK. Healthcare costs are increasing dramatically. Clin Lab Sci. 2011;24(4):233–4.PubMedGoogle Scholar
- Drinkwater J, et al. Operationalising unscheduled care policy: a qualitative study of healthcare professionals’ perspectives. Br J Gen Pract. 2013;63(608):e192–9.View ArticlePubMedPubMed CentralGoogle Scholar
- Morse A. Emergency admissions to hospital: managing the demand. Norwich: National Audit Office; 2013.Google Scholar
- McCarthy ML. Overcrowding in emergency departments and adverse outcomes. BMJ. 2011;342:d2830.View ArticlePubMedGoogle Scholar
- Jensen G, Kronick R. The cyclical behavior of hospital utilization and staffing. Health Serv Res. 1984;19(2):161–80.PubMedPubMed CentralGoogle Scholar
- Fullerton K, Crawford V. The winter bed crisis—quantifying seasonal effects on hospital bed usage. QJM: Int J Med. 1999;92(4):199–206.View ArticleGoogle Scholar
- Jones R. Volatility in bed occupancy for emergency admissions. Br J Healthc Manag. 2011;17(9):424–30.View ArticleGoogle Scholar
- Piggot H, et al. Protocol for the management of emergency pressures and escalation. Bangor: Betsi Cadwaladr University Health Board; 2015.Google Scholar
- Aboueljinane L, Sahin E, Jemai Z. A review on simulation models applied to emergency medical service operations. Comput Ind Eng. 2013;66(4):734–50.View ArticleGoogle Scholar
- Brailsford SC, et al. Emergency and on-demand health care: modelling a large complex system. J Oper Res Soc. 2004;55(1):34–42.View ArticleGoogle Scholar
- Mackay M, Lee M. Choice of models for the analysis and forecasting of hospital beds. Health Care Manag Sci. 2005;8(3):221–30.View ArticlePubMedGoogle Scholar
- Costa AX, et al. Mathematical modelling and simulation for planning critical care capacity. Anaesthesia. 2003;58(4):320–7.View ArticlePubMedGoogle Scholar
- Stolwijk A, Straatman H, Zielhuis G. Studying seasonality by using sine and cosine functions in regression analysis. J Epidemiol Community Health. 1999;53(4):235–8.View ArticlePubMedPubMed CentralGoogle Scholar
- Fusco D, et al. Cyclic fluctuations in hospital bed occupancy in Roma (Italy): supply or demand driven? Health Serv Manag Res. 2003;16(4):268–75.View ArticleGoogle Scholar
- Collett D. Modelling binary data. Boca Raton: CRC press; 2002.Google Scholar
- Payne R, et al. GenStat release 11 reference manual, part 2 directives. Hemel Hempstead: VSN International; 2008.Google Scholar
- Kenward MG, Roger JH. Small sample inference for fixed effects from restricted maximum likelihood. Biometrics. 1997;53:983–97.View ArticlePubMedGoogle Scholar
- Breslow NE, Clayton DG. Approximate inference in generalized linear mixed models. J Am Stat Assoc. 1993;88(421):9–25.Google Scholar
- Morina D, et al. A statistical model for hospital admissions caused by seasonal diseases. Stat Med. 2011;30(26):3125–36.View ArticlePubMedGoogle Scholar
- Varnava A, et al. Restricted weekend service inappropriately delays discharge after acute myocardial infarction. Heart. 2002;87(3):216–9.View ArticlePubMedPubMed CentralGoogle Scholar
- Cram P, et al. Effects of weekend admission and hospital teaching status on in-hospital mortality. Am J Med. 2004;117(3):151–7.View ArticlePubMedGoogle Scholar
- Concha OP, et al. Do variations in hospital mortality patterns after weekend admission reflect reduced quality of care or different patient cohorts? A population-based study. BMJ Qual Saf. 2014;23(3):215–22.View ArticlePubMedGoogle Scholar
- Attenello FJ, et al. Incidence of “never events” among weekend admissions versus weekday admissions to US hospitals: national analysis. BMJ. 2015;350:h1460.View ArticlePubMedPubMed CentralGoogle Scholar
- Allder S, Silvester K, Walley P. Understanding the current state of patient flow in a hospital. Clin Med. 2010;10(5):441–4.View ArticleGoogle Scholar
- Buff DD, et al. Circadian patterns of emergency asthma presentations: implications for staffing and treatment. Respir Care. 1995;40(6):624–30.PubMedGoogle Scholar
- Channouf N, et al. The application of forecasting techniques to modeling emergency medical system calls in Calgary, Alberta. Health Care Manag Sci. 2006;10(1):25–45.View ArticleGoogle Scholar
- Romano M. Making room for more beds. With additional patients streaming in every day, hospitals must learn to think creatively to find space for everyone. Mod Healthc. 2003;33(11):6–7. 1.Google Scholar
- Donaldson N, Shapiro S. Impact of California mandated acute care hospital nurse staffing ratios: a literature synthesis. Policy Polit Nurs Pract. 2010;11(3):184–201.View ArticlePubMedGoogle Scholar
- Lang TA, et al. Nurse-patient ratios: a systematic review on the effects of nurse staffing on patient, nurse employee, and hospital outcomes. J Nurs Adm. 2004;34(7–8):326–37.View ArticlePubMedGoogle Scholar
- Needleman J, et al. Nurse-staffing levels and the quality of care in hospitals. N Engl J Med. 2002;346(22):1715–22.View ArticlePubMedGoogle Scholar
- Wilcox ME, et al. Do intensivist staffing patterns influence hospital mortality following ICU admission? A systematic review and meta-analyses. Crit Care Med. 2013;41(10):2253–74.View ArticlePubMedGoogle Scholar
- Pickard B, Warner M. Demand management: A methodology for outcomes-driven staffing and patient flow management. Nurse Leader. 2007;5(2):30–4.View ArticleGoogle Scholar