Long-Term Outcomes of FIM Motor Items Predicted From Acute Stage NIHSS of Patients With Middle Cerebral Artery Infarct
Article information
Abstract
Objective
To outline the association between the National Institutes of Health Stroke Scale (NIHSS) in the acute stage and the Functional Independence Measure (FIM) of motor items several months later.
Methods
Seventy-nine infarct cases with middle-cerebral-artery region transferred to long-term rehabilitation facilities were analyzed. Patients were allocated to either the model-development group or the confirmatory group at a 2:1 ratio. Independent variables were based on the NIHSS during the acute care and on demographic factors such as age and modified Rankin Scale (mRS) before onset. Multivariate logistic analyses were performed to predict the independence of each FIM motor item. These models were evaluated in the confirmatory group.
Results
Multivariate logistic analyses in the model-development group (n=53) indicated that at least one NIHSS item was statistically significantly associated with the functional independence of a single FIM motor item. Of the NIHSS items, the affected lower extremity item was the most widely associated with 11 of the FIM motor items, except for eating and shower transfer. The affected upper extremity function was the second widely involved factor associated with 7 of the FIM motor items including eating, grooming, bathing, toileting, bed transfer, toilet transfer, and shower transfer. Age and mRS were also statistically significant contributing factors. The obtained predictive models were assessed in the confirmatory group (n=26); these were successful except for the stairs climb item.
Conclusion
In combination with age and pre-stroke status, the NIHSS items (especially the affected extremity items) may be useful for the prediction of long-term outcome in terms of activities in daily living.
INTRODUCTION
As the elderly population is increasing worldwide [1], the number of stroke patients is also rapidly rising; the number of first time stroke patients worldwide was 16.9 million in 2010 [2]. These patients often suffer from neural sequelae such as hemiparesis, which results in disabilities whereby the patient requires assistance for their activities in daily living (ADL) [3]. This aspect imposes a heavy burden on both medical and social welfare costs. The goals of rehabilitative treatment for stroke patients are to alleviate patients’ disabilities and to thus reduce social costs. To design an effective rehabilitative treatment, outcome prediction is critically important.
Several test scales have been used in daily clinical practices for stroke patients. In the acute stage, the National Institute of Health Stroke Scale (NIHSS) is the most commonly used because of its practical applicability at the bedside [4]. However, this impairment assessment may undermine its applicability for the long-term outcome prediction when disability in ADL is often considered to be the most serious clinical concern.
The Functional Independence Measure (FIM) [5] is also a frequently used assessment tool for stroke patients. FIM calculates 13 motor and 5 cognitive items in reference to ADL, and directly reflects the burdens of care. Nevertheless, scoring FIM is often difficult within a few days after the onset at the bedside, where activities of FIM items are usually not allowed (e.g., bathing and/or stairs climb). In contrast to NIHSS, which is often assessed during the acute stage, FIM is often used in long-term rehabilitation settings, several months after onset.
As mentioned above, a long-term outcome prediction is needed in terms of ADL from the acute stage, when only impairment level assessment is currently possible. However, only a few studies have been carried out that outline the association between NIHSS in the acute stage and FIM motor items several months later. In this study, we assessed the relationships between NIHSS and FIM motor assessment items with adjustments made to demographic and clinical data such as age and lesion size in order to address this gap. To minimize variability of stroke symptoms, we focused on cerebral infarct in the middle cerebral artery (MCA) areas, the most common type of stroke [6].
MATERIALS AND METHODS
This is a retrospective cohort study. The Ethics and Hospital Committees of Goshi Hospital approved this study.
Patients
We sampled patients with MCA infarct who were admitted to Goshi Hospital from October 2011 to April 2014. The diagnosis of infarct was made using a diffusionweighted magnetic resonance imaging (MRI) scanner (Intera 1.5T Pulsar; Philips, Eindhoven, The Netherlands) at the Department of Emergency of Goshi Hospital. According to the Japanese medical insurance system, a stroke patient typically receives inpatient medical treatments of a few weeks in an acute medical service hospital and is then transferred to a long-term rehabilitative facility. Therefore, to focus on the long-term outcomes that were accurately assessed by FIM, we sampled the patients who were transferred to 13 long-term rehabilitation facilities allied with Goshi Hospital via the local healthcare network system. Their maximal therapy sessions were 3 hours per day, 7 days a week.
Exclusion criteria for patients were worsening clinical courses by primary disease or severe comorbidity (e.g., neurological deterioration due to branch atheromatous disease, fracture, etc.) in acute care and/or long-term rehabilitative facilities, as well as refusal of rehabilitative treatment and/or incomplete dataset for NIHSS or FIM.
From the medical records during hospitalization, we collected the patients’ data including age, gender, mRS [7] before the onset, lesion laterality, diffusion-weighted MRI imaging-Alberta Stroke Program Early CT Score +deep white matter lesions (DWI-ASPECTS+W) [8], infarction type, use of recombinant tissue plasminogen activator (rt-PA), removal of thrombosis of internal carotid artery, carotid artery stenting, botulinum toxin injection, length of stay of acute care hospital and rehabilitation facilities, and day of initiation of rehabilitative treatment.
NIHSS and FIM measurements
NIHSS is a scale used to measure the patients’ level of stroke impairment by scoring the following 15 items: consciousness (3 subclasses), gaze, visual-field loss, facial palsy, right and left upper extremity motor strength, right and left lower extremity motor strength, limb ataxia, sensory loss, language, dysarthria, and extinction/attention items. The total score (ranging from 0 to 42) is often used as an index of stroke severity. NIHSS data obtained on the first day of rehabilitative treatment were entered into the analytical database for the current study. In this study, the right or left sides of the NIHSS items were categorized as ‘affected’ or ‘unaffected’ depending on the lesion side.
FIM consists of 13 motor items and 5 cognitive items. In this study, we focused on the FIM motor assessment items of eating, grooming, bathing, dressing upper body, dressing lower body, toileting, bowel management, bladder management, transfers to bed/chair/wheelchair, transfers to toilet, transfers to tub/shower, walking or wheelchair propulsion, and stair climb. Each item was scored on a 7-point scale: (1) total assistance; (2) maximal assistance; (3) moderate assistance; (4) minimal contact assistance; (5) supervision or set-up; (6) modified independence; and (7) complete independence. FIM motor scores recorded at discharge from the long-term rehabilitative facilities were entered into the analytical database for the current study.
Statistics
First, we allocated the participating patients to either the model-development group or the c onfirmatory group in a 2:1 ratio according to a computer-generated schedule. To determine the relationships between NIHSS and FIM motor items, we then employed multivariate logistic modeling analyses for the model-development group. In the analyses, the NIHSS items were set as explanatory variables and the FIM motor items were set as target values. In an attempt to adjust the logistic models between NIHSS and FIM, we added demographic and clinical data such as age, gender, and mRS before the onset. To ensure the dataset was fit for logistic modeling, we organized our raw data as follows.
For explanatory values, ordinal variables such as NIHSS items and mRS were converted into multiple categorical dichotomous variables [9]. The method used to generate multiple categorical dichotomous variables depended on the number of classification levels (2 to 5 levels) for the items. Therefore, we set four levels of classification for the 5-level assessment of upper extremity and lower extremity functions (Fig. 1). The nominal variables of the explanatory variables such as gender and lesion laterality were converted to a dichotomous variable (man=1; woman=0; right=1; left=0).

Method of changing ordinary variables of the National Institutes of Health Stroke Scale (NIHSS) item into multiple dichotomous variables.
For target values, we converted the outcome variables of each FIM item to dichotomous variables, such as ‘independence’ or ‘dependence’. Previous FIM studies [5,10] defined FIM values greater than 5 as the patient not requiring any help, implying ‘independence’, while a value equal to or less than 5 implies ‘dependence’. According to the previous literature, the level of independence in bathing, shower transfer, and stairs climb have been shown to be more difficult than other items [10,11]. Taking this into consideration, retaining the supervision level (FIM 5) is a realistic goal for MCA infarct patients for these difficult items. Accordingly, for the two FIM items of ‘dependence’ and ‘independence’, we defined FIM values equal to or greater than 5 (supervision) as ‘independence’ while FIM values less than 5 were defined as ‘dependence’.
Multiple logistic analyses were performed as follows. Variables showing a value of p<0.20 in the forward selection method were included in the multivariate model, provided that only one variable of each NIHSS item was selected. For example, even if the probability of the 2nd affected lower extremity is under 0.20, it was not considered when the 1st affected lower extremity had already been entered into the model. Statistically useless variables such as those that showed a 95% confidence of unit odds ratio interval including 1 were also excluded. A multivariate logistic model with p<0.05 was considered as statistically significant. Additionally, we assessed the regression coefficient of the predictive model obtained from each multivariate logistic regression equation.
Finally, we confirmed the predictive accuracy of the obtained logistic models by applying them to the confirmatory group. We used the proportion by chance accuracy criteria, whereby the accuracy rates were sufficiently high when the models showed 25% higher accuracy than the chance rate [12]. In a dichotomous logistic regression, this rate of chance, which occurs accidentally, can be calculated by squaring and summing the proportion of two real FIM outcome variables such as independence and dependence. For example, in the case of 70% independence and 30% dependence, the chance accuracy rate can be calculated as 0.72+0.32=0.49+0.09=0.58. This shows that this prediction meets accidentally with a probability of 58%. Therefore, we can judge this regression equation as excellent when the accuracy rate is higher than 72.5%, calculated as 0.58×1.25=0.725.
All statistical analyses in the present study were performed using the JMP software version 10.0.2 (SAS Institute Inc., Cary, NC, USA).
RESULTS
Fig. 2 presents the flow diagram of patients. Of the total 118 patients, 79 MCA region infarcted patients fulfilled the criteria, while 29 were excluded due to comorbidities or complications, 2 were excluded due to rehabilitation refusal, and 8 were excluded due to missing information. Hence, we allocated these 79 patients into two groups at a 2:1 ratio (53 in the model-development group and 26 in the confirmatory group). Table 1 shows the demographic profiles of these two groups. No statistically significant differences were found in age, gender, mRS, lesion laterality, DWI-ASPECTS+W, infarct type, contents of infarct therapy, length of stay of acute and rehabilitation facilities, and hospital day when the rehabilitative treatment began. Fig. 3 presents the characteristics of the 53 patients of the model-development group. The scatter diagrams show the relevance between the total score of NIHSS and the independence/dependence of each motor item of FIM.

Scatter diagrams showing the total score of the National Institutes of Health Stroke Scale on the x-axis, and independence or dependence of Functional Independence Measure defined in the text on the y-axis in 53 patients of the model-development group (1=independence, 0=dependence).
Tables 2 and 3 indicate the results obtained from the multiple logistic regression analyses performed in the model-development group. A statistically significant correlation was found for at least one single NIHSS item for each FIM motor item. Of the NIHSS items, the most commonly involved factor was the affected lower extremity item. Among the 13 FIM motor items, affected lower extremity item contributed to 11 regression equations, but did not contribute to the eating and shower transfer items, indicating the importance of the lower extremity function of the affected side for the long-term ADL outcome. The second commonly involved NIHSS item was the affected upper extremity item, which accounted for 7 regression equations for the items of eating, grooming, bathing, toileting, bed transfer, toilet transfer, and shower transfer.
To adjust the correlation analyses between the NIHSS and FIM motor items, we added parameters from demographic and clinical data. Of these items, in combination with several NIHSS items, age showed statistically significant relationships for six items including grooming, toileting, bladder management, bed transfer, toilet transfer, and shower transfer. For example, the result for the FIM item for bed transfer produces the prediction equation of 19.63-(0.20×Age)-(3.39×Affected upper extremity 3rd)-(3.91×Affected lower extremity 2nd) (Table 2). Fig. 4 shows the logistic curve obtained from this formula. When the value of the affected upper extremity is under 3 and that of the affected lower extremity is under 2, these values can be converted to 0 (referring to Fig. 1). The positive number of this equation indicates independence:

Example of logistic curve obtained from multivariate logistic model (bed transfer). The model equation is as follows: 19.63-(0.20×Age)-(3.39×Affected Upper Extremity 3rd)-(3.91×Affected Lower Extremity 2nd). Zero in the horizontal axis indicates a logistic probability 0.50. The curve showed the probability of bed transfer independence. The distance from the bottom to the top of the graph curve is the probability of independence.
Table 4 presents the accuracy rates of the model-development and confirmatory groups.
We employed the criteria using an accuracy rates 25% higher than the value based on the chance rate. According to that, our confirmatory group items were excellent except a stairs climb item. Thus, the prediction models derived from the multiple logistic models were confirmed for within-institutional validity for FIM motor items except stairs climb.
DISCUSSION
By using multivariate logistic regression statistics employing NIHSS assessed within a few days after stroke and adjusting factors such as age and pre-stroke independence level, we were able to develop prediction models for the long-term outcomes of FIM motor items. At least one single NIHSS item correlated with each FIM motor item, implying the applicability of acute phase NIHSS for the long-term outcome prediction in terms of disability. The accuracy rates in the confirmatory group were as high as those for the model-development group.
Of all NIHSS items, the degrees of paralysis in the affected upper and lower extremities most evidently affected the long-term FIM outcomes. In particular, the score for affected lower extremity was predictive for the FIM motor items, except for eating and shower transfer, implying that gross assessment of hemiparesis may be predictive for long-term ADL outcomes. In the daily clinical practice for stroke treatment, clinicians often use the manual muscle test (MMT/MRC) [13,14] to assess the gross levels of hemiparesis in the upper extremity and lower extremity. This method may be more widely used than NIHSS because NIHSS is an evaluation used specifically by stroke specialists. In reality, some stroke patients who are treated by general physicians are unfamiliar with NIHSS. The present findings suggest that the gross assessment of hemiparesis such as MMT/MRC in the acute stage may be partially predictive for long-term ADL.
In addition to NIHSS, age was shown to be a statistically significant contributing factor for the prediction of the long-term outcome assessed by FIM motor items. The previous studies indicated a correlation of age with general independence at a few months after the onset [15,16] and with walking independence at 6 months [17]. In this study, among the explanatory variables, statistics revealed that age had the greatest effect on the outcomes. However, age is only one explanatory variable that was assessed on an interval scale. Such an aspect might contribute to the greatest predictive power. Careful consideration should be given to the difference of the scales (nominal, ordinal, or interval) when the relative importance among explanatory variables is to be discussed.
In contrast to the previous studies on this topic [18,19], we included several patients who were not fully independent before the onset. Indeed, some patients in our database were recurrent stroke cases who were affected by previous episodes. To address this concern, in this study, we assessed ADL before the onset by using mRS. Analysis results showed that ADL status before stroke was also a powerful predictive factor for the long-term outcomes assessed by FIM motor items. In actual clinics, stroke cases often show recurrence and are accompanied with disability in ADL. The methodology in the present study may be more practical than that used in the previous studies on stroke outcome, in which only data on firstever stroke cases who were fully independent before the onset were collected [20-22].
In this study, to assess the within-institutional validity, we employed the confirmatory group. The results obtained from the confirmatory group were very similar to those obtained from the model-development group (Table 4), indicating the obtained prediction models were sufficient. However, the results for stairs climb were negative. Previous studies indicated that the stairs climb item is the most difficult among the FIM motor items [10,11]. The negative finding for this item could be partially attributed to the ceiling effect, under which most of patients can gain a goal for its easiness. In addition, cognitive factors, one of which is considered to be falling risks [23], may influence the lower accuracy rate of stairs climb because NIHSS is not sufficient for the assessment of cognitive functions in terms of ADL [24].
This study has several limitations. First, the sample size was small, with only 53 cases in the model-development group and 26 cases in the confirmatory group. However, we detected statistically significant models for all 13 FIM motor items in the model-development group, and the validity of the success of all models except stair climb was confirmed. Despite the small sample size, the results from our analyses were relatively positive. Second, due to the nature of our sample, the findings need careful consideration when applying the models to wider stroke populations. The study samples were collected from patients who were transferred to long-term rehabilitative facilities after acute medical services. Therefore, mild or severe cases were omitted in the study sample; mild cases are usually discharged because of their minimum impairment, and severe ones are transferred to nursing facilities. Third, inter-facility validation was not assessed. For the study, to avoid variability of the treatment methodology during the acute medical service, we collected patients who were treated in a single acute hospital. The obtained results were positive. To further confirm the validity of the present study, a well-designed study for inter-facility validation is needed. Fourth, in this study, to simplify our analytical procedures, we defined ‘independence’ for the bathing, shower transfer, and stairs climb items as including supervision levels (FIM 5). Original FIM terminology does not include supervision as independence. However, as the patients with MCA infarct often suffer from severe hemiparesis, retaining supervision level (FIM 5) could be a realistic goal for these difficult items. We therefore employed a modified terminology for this study.
Notes
No potential conflict of interest relevant to this article was reported.