How Evidence-Based Quality Assurance Maintains MST Fidelity

Posted by MST Services

Nov 6, 2024 11:06:26 AM

undefined-Nov-01-2024-07-56-12-7520-PM

Multisystemic Therapy (MST) is a highly effective, evidence-based intervention that addresses adverse behaviors in young people, particularly those exhibiting delinquent behavior. 

Grounded in principles that target various systems in a young person's life—such as family, school, peers, and community—MST provides a comprehensive approach to treatment, focusing on long-term behavioral change. Maintaining fidelity ensures that MST consistently delivers positive outcomes across these diverse systems and settings. 

Without a structured system of fidelity, even the most promising programs can see reduced effectiveness. Evidence-based quality assurance mitigates this risk by helping therapists, supervisors, and community agencies maintain the high standards necessary to achieve positive outcomes for young people and their families. 

The Importance of Fidelity in MST

Fidelity, in the context of MST, refers to strict adherence to the evidence-based adherence measures and principles that define the program. It ensures that every aspect of the therapy, whether delivered by therapists, supervisors, or program leaders, stays true to the established MST treatment model. 

Maintaining fidelity preserves the integrity of the intervention and maximizes its effectiveness. For example, young people receiving MST treatment with strong adherence experience a notable reduction in criminal charges, underscoring the importance of not deviating from the proven MST Analytical Process and Treatment Principles. 

Ensuring fidelity in evidence-based programs like MST is not just about consistency; it is about delivering the full potential of the intervention to create lasting change in a young person’s life. 

Understanding Evidence-Based Quality Assurance and Improvement in MST 

MST's evidence-based quality assurance framework provides continuous oversight, ensuring therapists, supervisors and expert consultants adhere to the program's proven process to assess, conceptualize, and intervene to address problems.  This system operates through a data-driven approach, collecting valuable feedback from therapists, families, and supervisors to monitor adherence and make informed adjustments when necessary. Key metrics, such as adherence scores and client outcomes, are regularly reviewed to identify areas for improvement and maintain the integrity of the program. This commitment to evidence-based quality assurance and improvement helps sustain high-fidelity implementation and supports positive outcomes for the youth and families involved in MST. 

By combining oversight with real-time data analysis, evidence-based quality assurance ensures that every intervention remains true to its evidence-based foundation, maximizing the potential for successful results. 

Essential Elements of the MST Quality Assurance and Improvement Process 

Regular supervision, ongoing training, and standardized assessment tools also play a critical role in supporting the consistent delivery of MST across various sites. 

Regular supervision is essential in guiding therapists, ensuring they follow MST's evidence-based model. Supervisors are equipped with the tools and feedback they need to monitor performance and provide meaningful guidance. Ongoing training further strengthens this process, offering therapists and supervisors opportunities to continuously improve their skills and stay aligned with (and committed to) MST’s Analytic Process and Treatment Principles. 

Central to the quality assurance and improvement framework are the standardized assessment tools used to track adherence to the MST model. The Therapist Adherence Measure, Supervisor Adherence Measure, and Consultant Adherence Measure are vital instruments that evaluate how closely therapists, supervisors, and consultants are following MST's guidelines​. The Program Implementation Review adds another layer of assessment, conducted bi-annually, to evaluate the overall performance of each MST team​. 

  • Therapist Adherence Measure-Revised (TAM-R) is a 28-item measure evaluating a therapist’s adherence to the MST Model. Any trained agency staff, apart from the clinician working with the family, can administer it, collecting information from primary caregivers. Results are collected within the first two weeks and then every four weeks thereafter throughout the course of MST treatment. 
  • Supervisor Adherence Measure (SAM) is a 36-item measure administered every two months after the program begins that evaluates MST supervisor adherence, as reported by MST therapists.  
  • Consultant Adherence Measure (CAM) is a 23-item measure evaluating MST Expert or Consultant adherence, completed by MST therapists and supervisors. It is collected every two months, starting from the second month of an MST program start. 
  • Program Implementation Review (PIR) is a biannual report completed by the supervisor and MST expert to assess program strengths, challenges, and areas for improvement. It reviews operational, adherence, and case closure data, as well as the status of any previous recommendations and plans.  

By leveraging these tools, organizations can ensure a data-driven decision-making process that enhances program fidelity and outcomes. Regular feedback from TAM-R, SAM, CAM, and PIR allows MST teams to adjust and improve their approach in real-time.  

Through this comprehensive approach to evidence-based quality assurance and improvement, you can maximize the impact of implementing MST, delivering transformative results for at-risk young people and their families while maintaining the integrity of the MST model. 

The Role of Feedback Loops in Identifying Improvement Areas

Continuous feedback loops are a cornerstone of the MST evidence-based quality assurance and improvement process. By regularly gathering input from families, therapists, and supervisors, agencies can maintain high fidelity to MST's evidence-based model. As mentioned, these feedback mechanisms allow for real-time monitoring of the program's implementation, ensuring that every aspect of the therapy stays aligned with MST's core principles. 

For instance, families provide insights through tools like the Therapist Adherence Measure, which evaluates how well therapists adhere to the MST model. Supervisors and therapists also contribute feedback via the Supervisor Adherence Measure and Consultant Adherence Measure, ensuring that oversight remains thorough and supportive to the teams delivering care. This layered approach to feedback helps identify improvement areas across all service delivery levels. MST therapists, supervisors, and expert consultants utilize the data to create development plans for a never-ending process to address and target any identified need areas while also building on successes. 

What makes this system so effective is the ability to make informed adjustments based on the data received. These continuous feedback loops allow MST teams to quickly address any deviations from the model, which enhances fidelity in evidence-based programs.  

This dynamic process of evidence-based quality assurance and improvement is critical to ensuring that MST remains a highly effective intervention. By integrating evidence-based quality assurance practices, agencies employing MST can deliver ongoing, high-quality care that evolves in response to the needs of its clients. 

Fidelity and Successful Treatment Outcomes 

When therapists adhere closely to the core principles of MST, the impact on young people and families is significant. Studies show that high adherence leads to a 36% reduction in criminal charges among participating youth, demonstrating the powerful effect high fidelity can have on evidence-based interventions like MST. 

One key example of this comes from research on the experience of community programs that maintain strong oversight through MST’s evidence-based quality assurance processes. These programs have consistently seen better outcomes, with fewer young people re-offending or engaging in harmful behaviors. In contrast, this research shows that when agencies lack the proper support or deviate from the MST model, the effectiveness of the intervention diminishes. 

Additional research comparing programs with and without MST oversight revealed that only those with structured fidelity practices experienced significant reductions in court charges​. 

The risks of deviating from the MST model are clear: without evidence-based quality assurance measures in place, the potential for successful outcomes decreases, and families may not experience the intervention’s full benefits.  

Maintaining high fidelity ensures that the therapy remains true to its proven methods, delivering consistent, life-changing results for at-risk youth. 

The Power of Evidence-Based Quality and Assurance and Improvement in MST 

The Multisystemic Therapy quality assurance and improvement framework plays a vital role in maintaining fidelity to the program and ensuring positive outcomes for young people and their families. Through rigorous evidence-based quality assurance measures, MST consistently delivers effective outcomes that transform lives. 

By combining high adherence with continuous feedback and improvement, agencies implementing MST can provide a flexible yet structured approach to therapeutic intervention across diverse contexts. 

Through the MST Quality Assurance and Quality Improvement model, MST Services helps agencies ensure their teams deliver interventions with high fidelity to produce consistent and successful treatment outcomes that change the lives of those they serve. 

Get Started With MST Today!

MST is an evidence-based alternative to incarceration or severe system consequences due to serious externalizing, anti-social, and criminal behaviors. MST effectively treats young people and their families by utilizing a built-in suite of interventions within the home, school, and community settings. Treatment is tailored to the family and their individual strengths and needs, which could include but is not limited to the following types of therapies: Family Therapy, Cognitive Behavioral Therapy, Drug and Alcohol Treatment, Mental Health Services, Peer Ecology Assessment and Intervention, Trauma-informed treatment, and Educational/ Vocational Support. If you or someone you know is interested in learning more about Multisystemic Therapy, contact us here. 


Topics: Juvenile Justice Reform, Multisystemic Therapy, Child Welfare, evidence-based, Parents, Agencies and Administrators, Juvenile Justice