Systematic Client Feedback: A naturalistic pilot study

  1. Alberto Gimeno-Peón
  2. Javier Prado-Abril
  3. Felix Inchausti
  4. Anxo Barrio-Nespereira
  5. María Teresa Álvarez-Casariego
  6. Barry L. Duncan
Journal:
Ansiedad y estrés

ISSN: 1134-7937

Year of publication: 2019

Volume: 25

Issue: 2-3

Pages: 132-137

Type: Article

DOI: 10.1016/J.ANYES.2019.04.005 DIALNET GOOGLE SCHOLAR lock_openOpen access editor

More publications in: Ansiedad y estrés

Abstract

Routine outcome monitoring or systematic client feedback (SCF) continues to garner empirical support. The Partners for Change Outcome Management System (PCOMS) is one application of SCF with significant research support but no studies have been conducted in Spain. This investigation describes the effects of PCOMS in routine practice via a comparison to published PCOMS studies. n a retrospective observational study, PCOMS was implemented with 42 clients treated in routine psychotherapy. Outcomes were measured by the Outcome Rating Scale (ORS) and descriptively compared to PCOMS studies included in a meta-analysis and a PCOMS benchmarking study regarding reliable and/or clinically significant change, no change, and deterioration. The current study achieved similar rates of reliable and clinically significant change (73.8%) to the benchmarking study (65.6%) and the RCTs (67.5%). Regarding no change rates, the current study (23.8%) mirrored results of the RCTs (25.6%) and was better than the benchmarking study (35.4%). The current study incurred a low 2.4% deterioration rate compared to a 10.7% and 7.0% rate of the benchmarking study and RCTs, respectively. While not without flaws, this pilot study offers some evidence that the improved outcomes associated with PCOMS may also occur in psychotherapy settings in Spain.

Bibliographic References

  • Anker, M. G., Duncan, B. L., & Sparks, J. A. (2009). Using client feedback to improve couple therapy outcomes: A randomized clinical trial in a naturalistic setting. Journal of Consulting and Clinical Psychology, 77(4), 693-704. doi:10.1037/a0016062
  • Bauer, S., Lambert, M. J., & Nielsen, S. L. (2004). Clinical significance methods: A comparison of statistical techniques. Journal of Personality Assessment, 82(1), 60-70. doi:10.1207/s15327752jpa8201_11
  • Bordin, E. S. (1979). The generalizability of the psychoanalytic concept of the working alliance. Psychotherapy: Theory, Research and Practice, 16, 252-260. Retrieved from www.scopus.com
  • Brattland, H., Koksvik, J. M., Burkeland, O., Gråwe, R. W., Klöckner, C., Linaker, O. M., . . . Iversen, V. C. (2018). The effects of routine outcome monitoring (ROM) on therapy outcomes in the course of an implementation process: A randomized clinical trial. Journal of Counseling Psychology, 65(5), 641-652. doi:10.1037/cou0000286
  • Castonguay, L. G., Barkham, M., Lutz, W., & McAleavey, A. A. (2013). Practice-oriented research: Approaches and applications. Bergin and Garfield's Handbook of Psychotherapy and Behavior Change, , 85-133. Retrieved from www.scopus.com
  • Cuijpers, P., Reijnders, M., Karyotaki, E., de Wit, L., & Ebert, D. D. (2018). Negative effects of psychotherapies for adult depression: A meta-analysis of deterioration rates. Journal of Affective Disorders, 239, 138-145. doi:10.1016/j.jad.2018.05.050
  • Delgadillo, J., de Jong, K., Lucock, M., Lutz, W., Rubel, J., Gilbody, S., . . . McMillan, D. (2018). Feedback-informed treatment versus usual psychological treatment for depression and anxiety: A multisite, open-label, cluster randomised controlled trial. The Lancet Psychiatry, 5(7), 564-572. doi:10.1016/S2215-0366(18)30162-7
  • Delgadillo, J., Overend, K., Lucock, M., Groom, M., Kirby, N., McMillan, D., . . . de Jong, K. (2017). Improving the efficiency of psychological treatment using outcome feedback technology. Behaviour Research and Therapy, 99, 89-97. doi:10.1016/j.brat.2017.09.011
  • Duncan, B., & Sparks, J. (2010). Heroic Clients, Heroic Agencies: Partners for Change, Retrieved from www.scopus.com
  • Duncan, B. L. (2010). On Becoming a Better Therapist, Retrieved from www.scopus.com
  • Duncan, B. L., & Miller, S. D. (2000). The Heroic Client: Doing Client-Directed, Outcome-Informed Therapy, Retrieved from www.scopus.com
  • Duncan, B. L., Miller, S. D., Sparks, J. A., Claud, D. A., Reynolds, L. R., Brown, J., & Johnson, L. D. (2003). The session rating scale: Preliminary psychometric properties of a "working" alliance measure. Journal of Brief Therapy, 3(1), 3-12. Retrieved from www.scopus.com
  • Duncan, B. L., & Reese, R. J. (2015). The partners for change outcome management system (PCOMS) revisiting the client's frame of reference. Psychotherapy, 52(4), 391-401. doi:10.1037/pst0000026
  • Duncan, B. L., Solovey, A. D., & Rusk, G. S. (1992). Changing the rules: A client-directed approach to therapy. Changing the Rules: A Client-Directed Approach to Therapy, Retrieved from www.scopus.com
  • Duncan, B. L., & Sparks, J. A. (2018). The partners for change outcomes management system: An integrated eLearning manual for everything PCOMS. The Partners for Change Outcome Management System: An Integrated Elearning Manual for Everything PCOMS, Retrieved from www.scopus.com
  • Fernández-Alvarez, H., & Castonguay, L. G. (2018). Investigación orientada por la práctica: Avances en colaboraciones entre clínicos e investigadores. introducción. Revista Argentina De Clinica Psicologica, 27(2), 107-110. doi:10.24205/03276716.2018.1069
  • Gimeno-Peón, A., Barrio-Nespereira, A., & Prado-Abril, J. (2018). Routine outcome monitoring and feedback in psychotherapy. Papeles Del Psicologo, 39(3), 174-182. doi:10.23923/pap.psicol2018.2872
  • González-Blanch, C., Umaran-Alfageme, O., Cordero-Andrés, P., Muñoz-Navarro, R., Ruiz-Rodríguez, P., Medrano, L. A., . . . Grupo de Investigacion PsicAP. (2018). Psychological treatment of emotional disorders in primary care: The transdiagnostic treatment manual of the PsicAP study. [Tratamiento psicológico de los trastornos emocionales en Atención Primaria: el manual de tratamiento transdiagnóstico del estudio PsicAP] Ansiedad y Estres, 24(1), 1-11. doi:10.1016/j.anyes.2017.10.005
  • Goodheart, C. D., Levant, R. F., Barlow, D. H., Carter, J., Davidson, K. W., Hagglund, K. J., . . . Bullock, M. (2006). Evidence-based practice in psychology. American Psychologist, 61(4), 271-285. doi:10.1037/0003-066X.61.4.271
  • Hansen, N. B., Lambert, M. J., & Forman, E. M. (2002). The psychotherapy dose-response effect and its implications for treatment delivery services. Clinical Psychology: Science and Practice, 9(3), 329-343. doi:10.1093/clipsy/9.3.329
  • Inchausti, F., Prado-Abril, J., Sánchez-Reales, S., Vilagrà-Ruiz, R., & Fonseca-Pedrero, E. (2018). The avoidant personality disorder: A proposal for specialized treatment in the spanish national health system. [El trastorno de personalidad por evitación: una propuesta de tratamiento especializado en la sanidad pública española] Ansiedad y Estres, 24(2-3), 144-153. doi:10.1016/j.anyes.2018.05.002
  • Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology, 59(1), 12-19. doi:10.1037/0022-006X.59.1.12
  • Kendrick, T., Moore, M., Gilbody, S., Churchill, R., Stuart, B., & El-Gohary, M. (2014). Routine use of patient reported outcome measures (PROMs) for improving treatment of common mental health disorders in adults. Cochrane Database of Systematic Reviews, 2014(6) doi:10.1002/14651858.CD011119
  • Lambert, M. J. (1986). Implications of psychotherapy outcome research for eclectic psychotherapy. Handbook of Eclectic Psychotherapy, , 436-462. Retrieved from www.scopus.com
  • Lambert, M. J. (2015). Progress feedback and the OQ-system: The past and the future. Psychotherapy, 52(4), 381-390. doi:10.1037/pst0000027
  • Lambert, M. J., & Shimokawa, K. (2011). Collecting client feedback. Psychotherapy, 48(1), 72-79. doi:10.1037/a0022238
  • Miller, S. D., & Duncan, B. L. (2000). The outcome rating scale. The Outcome Rating Scale, Retrieved from www.scopus.com
  • Miller, S. D., Duncan, B. L., Brown, J., Sparks, J. A., & Claud, D. A. (2003). The outcome rating scale: A preliminary study of the reliability, validity, and feasibility of a brief visual analog measure. Journal of Brief Therapy, 2(2), 91-100. Retrieved from www.scopus.com
  • Miller, S. D., Duncan, B. L., & Johnson, L. D. (2000). The Session Rating Scale 3.0, Retrieved from www.scopus.com
  • Moggia, D., Niño-Robles, N., Feixas, G., & Miller, S. D. (2017). Psychometric properties of the outcome rating scale (ORS) and session rating scale 3.0 (SRS 3.0) in a spanish clinical sample. Conference Presented at 4th Joint Conference Society for Psychotherapy Research UK & European Chapters, Oxford, UK, Retrieved from www.scopus.com
  • Moggia, D., Niño-Robles, N., Miller, S. D., & Feixas, G. (2018). Psychometric properties of the outcome rating scale (ORS) in a spanish clinical sample. The Spanish Journal of Psychology, 21, E30. doi:10.1017/sjp.2018.32
  • Prado-Abril, J. (2016). Facilitadores y obstáculos de una intervención psicoterapéutica asistida por ordenador para la depresión en atención primaria: Un estudio cualitativo. Facilitadores Y Obstáculos De Una Intervención Psicoterapéutica Asistida Por Ordenador Para La Depresión En Atención Primaria: Un Estudio Cualitativo, Retrieved from www.scopus.com
  • Prado-Abril, J., Sánchez-Reales, S., & Inchausti, F. (2017). Searching for our best version: Expertise and excellence in clinical psychology. [En busca de nuestra mejor versión: pericia y excelencia en psicología clínica] Ansiedad y Estres, 23(2-3), 110-117. doi:10.1016/j.anyes.2017.06.001
  • Reese, R. J., Duncan, B. L., Bohanske, R. T., Owen, J. J., & Minami, T. (2014). Benchmarking outcomes in a public behavioral health setting: Feedback as a quality improvement strategy. Journal of Consulting and Clinical Psychology, 82(4), 731-742. doi:10.1037/a0036915
  • Reese, R. J., Duncan, B. L., Kodet, J., Brown, H. M., Meiller, C., Farook, M. W., . . . Bohanske, R. T. (2018). Patient feedback as a quality improvement strategy in an acute care, inpatient unit: An investigation of outcome and readmission rates. Psychological Services, 15(4), 470-476. doi:10.1037/ser0000163
  • Reese, R. J., Norsworthy, L. A., & Rowlands, S. R. (2009). Does a continuous feedback system improve psychotherapy outcome? Psychotherapy, 46(4), 418-431. doi:10.1037/a0017901
  • Reese, R. J., Toland, M. D., Slone, N. C., & Norsworthy, L. A. (2010). Effect of client feedback on couple psychotherapy outcomes. Psychotherapy, 47(4), 616-630. doi:10.1037/a0021182
  • Schuman, D. L., Slone, N. C., Reese, R. J., & Duncan, B. (2015). Efficacy of client feedback in group psychotherapy with soldiers referred for substance abuse treatment. Psychotherapy Research, 25(4), 396-407. doi:10.1080/10503307.2014.900875
  • She, Z., Duncan, B. L., Reese, R. J., Sun, Q., Shi, Y., Jiang, G., . . . Clements, A. L. (2018). Client feedback in china: A randomized clinical trial in a college counseling center. Journal of Counseling Psychology, 65(6), 727-737. doi:10.1037/cou0000300
  • Slone, N. C., Reese, R. J., Mathews-Duvall, S., & Kodet, J. (2015). Evaluating the efficacy of client feedback in group psychotherapy. Group Dynamics, 19(2), 122-136. doi:10.1037/gdn0000026
  • Sparks, J. A., & Duncan, B. L. (2018). The partners for change outcome management system: A Both/And system for collaborative practice. Family Process, 57(3), 800-816. doi:10.1111/famp.12345
  • Swift, J. K., & Greenberg, R. P. (2012). Premature discontinuation in adult psychotherapy: A meta-analysis. Journal of Consulting and Clinical Psychology, 80(4), 547-559. doi:10.1037/a0028226
  • Tracey, T. J., & Kokotovic, A. M. (1989). Factor structure of the working alliance inventory. Psychological Assessment, 1(3), 207-210. doi:10.1037/1040-3590.1.3.207
  • Weinfurt, K. P., Hernandez, A. F., Coronado, G. D., DeBar, L. L., Dember, L. M., Green, B. B., . . . Curtis, L. H. (2017). Pragmatic clinical trials embedded in healthcare systems: Generalizable lessons from the NIH collaboratory. BMC Medical Research Methodology, 17(1) doi:10.1186/s12874-017-0420-7
Data source: Dialnet