Patient Reported Outcome Measure (PROM) which is used as the basis for a Patient-Reported Outcome Performance Measure (PRO-PM)
Functional status change for patients with Hip impairments
Brief description of measure:
A self-report measure of change in functional status for patients 14 years+ with hip impairments. The change in functional status assessed using FOTO’s (hip ) PROM is adjusted to patient characteristics known to be associated with functional status outcomes (risk adjusted) and used as a performance measure at the patient level, at the individual clinician, and at the clinic level to assess quality.
The outcome being measured is the change in functional status on three levels:
- Patient Level: The residual functional status score for the individual patient (residual scores are the actual change scores - predicted change after risk adjustment
- Individual Clinician Level: The average residuals in functional status scores in patients who were treated by a clinician in a 12 month time period for hip impairment.
- Clinic Level: The average residuals in functional status scores in patients who were treated by a clinic in a 12 month time period for hip impairment.
Time Period for Data:
Both Numerator and denominator aggregate the past 12 months of data
- Patient Level: The residual score for the individual patients with hip impairments is derived by applying the statistical risk adjustment model described below and applying steps 1-5 as described below. The risk-adjusted scores can be applied to evaluate performance at the patient level using the methods described below.
- Individual Clinician Level: The average residuals in scores in patients who were treated by a clinician in a 12 month time period for hip impairment. Average scores are calculated for all clinicians, however, performance is evaluated only for those clinicians that had a minimum of 10 patients in the previous 12 months to maximize stability of the benchmarking estimates. In 2011-2013, FOTO used a standard threshold of 40 patients/clinician regardless of clinic size, but has recently changed its procedure to enable participation by clinicians that do not have a sufficient volume of patients. The score is derived by applying steps 1-6 as described below
- Clinic Level: The average residuals functional status scores in patients who were treated within a clinic in a 12 month time period for hip impairment. Average scores are calculated for all clinics, however performance is evaluated only for large clinics (5 or more clinicians) that had a minimum of 40 patients, and small clinics (1-4 clinicians) that had a minimum of 10 patients per clinician, in the previous 12 months to maximize stability of the benchmarking estimates. In 2011-2013, FOTO used a standard threshold of 40 patients/clinics regardless of clinic size, but has recently changed its procedure to enable participation by smaller clinics that do not have a sufficient volume of patients. The score is derived by applying steps 1-6 as described below.
Both comparative benchmark reports (i.e., scale ranging from 0 to 100 with higher scores meaning higher functional abilities) at the clinician or clinic level include patients with hip impairments, who were treated in therapy and had their functional status assessed at admission and at the end of their episode of therapy and were discharged from therapy.
All patients 14 years and older with hip impairments who have initiated rehabilitation treatment and complete the FOTO hip FS PROM at admission and discharge.
The established ICD-9-CM codes for the hip include:
Diagnoses specific to the hip:
715.05, 715.15, 715.25, 715.35, 715.95, 716.05, 716.15, 716.25, 716.35, 716.45, 716.55, 716.65, 716.85, 716.95, 718.05, 718.15, 718.25, 718.35, 718.45, 718.55, 718.65, 718.75, 718.85, 718.95, 719.05, 719.15, 719.25, 719.35, 719.45, 719.55, 719.65, 719.75, 719.85, 719.95, 726.5, 730.05, 730.15, 730.25, 730.35, 730.75, 730.85, 730.95, 733.98, *736.3, 738.6, 739.4, 739.5, *754.3, 755.63, *808, *821, *835, *843, *846, 847.3, 847.4, 848.5, *924.0, *928.0, V54.13, V54.23, V57.1.
* Use of an asterisk is to include all codes in the category
Diagnoses not specific to the hip, but affect the function of the hip:
*355, 710.05, 710.3, 710.4, 710.8710.9, 711.99, 714.31, 714.4, 715.09, 715.80, 715.89, 715.98, 716.09, 716.19, 719.29, 716.39, 716.49, 716.59, 716.89, 716.99, 718.09, 718.19, 718.29, 718.39, 718.49, 718.59, 718.79, 718.89, 718.99, 719.09, 719.19, 719.29, 719.39, 719.49, 719.59, 719.69, 719.89, 719.99, 725, 726.8, 726.90, 727.09, 727.3, *724.4, 727.50, 728.3, 718.4, 728.0, *728.1, 728.2, 728.5, *728.8, 728.9, 729.0, 729.1, 729.2, 729.5, *729.8, *729.9, 730.09, 730.19, 730.29, 730.39, 730.79, 730.89, 730.99, 732.1, 732.2, 732.9, *733.0, 733.15, 733.19, 733.29, 733.40, 733.42, *733.8, 733.90, 733.91, 733.96, 733.97, 780.79, 780.96, 781.2, 792.3, *827, 848.8, 848.9, *897, 922.31, 922.32, 928.8, *956, 959.6, *996.4, 996.70, 996.77, V54.81, V54.89, V58.78
* Use of an asterisk is to include all codes in the category
- Patients who are not being treated for a hip impairment
- Age under 14 years of age
Risk Adjustment Type, model method and variables:
The change in functional status assessed using FOTO (hip) PROM is risk adjusted using a multivariate linear regression model that includes the following independent variables: intake functional status, age, symptom acuity, surgical Hip history, payer source, gender, fear-avoidance beliefs of physical activities and number of functional comorbidities. The public domain short form and internet CAT produce a measure that can be risk adjusted.
Detailed risk model specifications:
The coefficients for risk adjustment are available at the link Hip Ankle Data Coefficients
Type of score:
Interpretation of Score:
Better quality (higher effectiveness) = higher score
Calculation Algorithm/Measure Logic:
(Describe the calculation of the measure score as an ordered sequence of steps including identifying the target population; exclusions; cases meeting the target process, condition, event, or outcome; aggregating data; risk adjustment; etc.)
STEPS TAKEN TO PRODUCE THIS MEASURE:
Patient’s Functional Status Score. A functional status score is produced when the patient completes the FOTO (hip) PROM administered by internet or paper and pencil. The functional status score is continuous and linear. Scores range from 0 (low function) to 100 (high function). The survey is standardized, and the scores are validated for the measurement of function for this population.
Patient’s Functional Status Change Score. A functional status change score is calculated by subtracting the Patient’s Functional Status Score at Admission from the Patient’s Functional Status Score at Discharge.
Predicted Functional Status Change Score. Functional Status Change Scores for patients are risk adjusted using multiple linear regression methods that include the following independent variables: Patient’s Functional Status Score at Admission, patient age, symptom acuity, surgical history, gender, number of co morbidities, payer type, and level of fear-avoidance. The Patient’s Functional Status Change Score is the dependent variable. The statistical regression produces a Risk-Adjusted Predicted Functional Status Change Score.
Risk-adjusted Functional Status Change Residual Score. The difference between the actual change and the predicted change scores (after risk adjustment) is the residual score and should be interpreted as the unit of functional status change different than predicted given the risk-adjustment variables of the patient being treated. As such, the risk-adjusted residual change score represents risk-adjusted change corrected for patient characteristics. Risk-adjusted residual change scores of zero (0) or greater (>0) should be interpreted as functional status change scores that were predicted or better than predicted, respectively, given the risk-adjustment variables of the patient. Risk-adjusted residual change scores less than zero (<0) should be interpreted as functional status change scores that were less than predicted given the risk-adjustment variables of the patient.
Aggregated risk-adjusted residual scores: The average of residual scores of functional status (actual change - predicted change after risk adjustment) from a provider (clinician or clinic). The aggregated scores are used to make comparisons between clinicians or clinics.
First, the patient completes FOTO’s functional status survey for the Hip at Admission, which generates the Patient’s Functional Status Score at Admission
Second, patient completes FOTO’s functional status survey at or near Discharge, which generates the Patient’s Functional Status Score at Discharge
Third, the Patient’s Functional Status Change Score (raw, non-risk-adjusted) is generated
Fourth, a Risk-adjusted Predicted Functional Status Change Score is generated using a regression equation
Fifth, a Risk-adjusted Functional Status Change Residual Score is generated for each patient.
Sixth, the average residual scores per clinician and/or clinic are calculated, and scores for all clinicians/clinics in the database are ranked. The quality score is the percentile of the clinician and/or clinic ranking. The quality scores and its 95% CI can be compared to the benchmark (a score of zero) to determine if the performance is below, at, or above the predicted average. FOTO recommends that clinicians have a minimum of 10 patients/year and clinics have a minimum of 10 patients/therapist per year for small clinics or 40 patients per year for larger clinics (5 or more clinicians) in order to obtain stable estimates of provider performance.