Visual Acuity as an Outcome Measure in Clinical Trials of Retinal Diseases

      Purpose

      Visual acuity (VA) is the primary outcome measure in many studies involving eye diseases. A standard statistical approach for comparing a continuous measurement such as a VA letter score between 2 treatment groups is to perform a t test comparing the means. However, frequently a binary variable is created from the continuous VA letter score based on whether or not there has been a worsening (or gain) of ≥15 letters (equivalent to ≥3 lines), and a chi square or similar statistical test is performed to compare the proportions of success (or failure) between groups. The purpose of this article is to contrast these 2 approaches.

      Methods

      Clinical trial reports of retinal disorders were used to compare results using mean change in the VA letter score versus binary proportions created from the VA letter score. Additionally, analyses were performed using generated data to gain a perspective on the magnitude of differences that might be expected between the 2 methods.

      Results

      Studies from the literature showed that differences of 6% to 15% in ≥15-letter worsening corresponded to mean differences in letter scores between groups of 3.0 to 7.0 (approximately 0.6 to 1.4 lines). Analyses using generated data demonstrated that a mean improvement in the VA letter score of 5 corresponded to a doubling of the proportion of eyes with ≥15-letter improvement and a 28% relative reduction in the proportion of eyes with ≥15-letter worsening.

      Conclusions

      How VA data should be analyzed in a clinical trial depends to large extent on the research question. The frequently used outcome of ≥15-letter change has several drawbacks, including loss of efficiency (need for a larger sample), misclassification of the outcome, and potential for a ceiling or floor effect. Therefore, for most clinical trials we believe that the primary outcome analysis should be a comparison of changes in the VA letter score, and created binary variables should be reported as secondary outcomes. This approach maximizes the information gained from the data and accommodates both improvement and worsening of acuity.
      To read this article in full you will need to make a payment
      Subscribe to Ophthalmology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Ferris III, F.L.
        • Kassoff A.
        • Bresnick G.H.
        • Bailey I.
        New visual acuity charts for clinical research.
        Am J Ophthalmol. 1982; 94: 91-96
        • Beck R.W.
        • Moke P.S.
        • Turpin A.H.
        • et al.
        A computerized method of visual acuity testing: adaptation of the Early Treatment of Diabetic Retinopathy Study testing protocol.
        Am J Ophthalmol. 2003; 135: 194-205
        • Blackhurst D.W.
        • Maguire M.G.
        • Macular Photocoagulation Study Group
        Reproducibility of refraction and visual acuity measurement under a standard protocol.
        Retina. 1989; 9: 163-169
        • Brown D.M.
        • Kaiser P.K.
        • Michels M.
        • et al.
        Ranibizumab versus verteporfin for neovascular age-related macular degeneration.
        N Engl J Med. 2006; 355: 1432-1444
        • Early Treatment Diabetic Retinopathy Study Research Group
        Photocoagulation for diabetic macular edema: Early Treatment Diabetic Retinopathy Study report number 1.
        Arch Ophthalmol. 1985; 103: 1796-1806
        • Gragoudas E.S.
        • Adamis A.P.
        • Cunningham Jr, E.T.
        • et al.
        Pegaptanib for neovascular age-related macular degeneration.
        N Engl J Med. 2004; 351: 2805-2816
        • Rosenfeld P.J.
        • Brown D.M.
        • Heier J.S.
        • et al.
        Ranibizumab for neovascular age-related macular degeneration.
        N Engl J Med. 2006; 355: 1419-1431
        • Treatment of Age-Related Macular Degeneration with Photodynamic Therapy (TAP) Study Group
        Photodynamic therapy of subfoveal choroidal neovascularization in age-related macular degeneration with verteporfin: two-year results of 2 randomized clinical trials—TAP report 2.
        Arch Ophthalmol. 2001; 199: 198-207
        • Verteporfin in Photodynamic Therapy Study Group
        Verteporfin therapy of subfoveal choroidal neovascularization in age-related macular degeneration: two-year results of a randomized clinical trial including lesions with occult with no classic choroidal neovascularization—Verteporfin in Photodynamic Therapy report 2.
        Am J Ophthalmol. 2001; 131: 541-560
      1. Argon laser photocoagulation for senile macular degeneration: results of a randomized clinical trial.
        Arch Ophthalmol. 1982; 100: 912-918
        • Sullivan L.M.
        • D’Agostino R.B.
        Robustness of the t-test applied to data distorted from normality by floor effects.
        J Dent Res. 1992; 71: 1938-1943