100% New Mexico Initiative

100% POWER HOUR

SEVEN: EVALUATING CHANGE

PLEASE NOTE: This page contains supplemental information for attendees of the 7-part 100% New Mexico initiative power hours. Attendance is free, but registration is required. Please register here.

slide 1

We are providing the slides and narrative text used in the 100% Power Hour: Evaluating Change being offered quarterly by the Anna, Age Eight Institute. The 7-part webinar series is designed to give 100% New Mexico initiative members an overview of key concepts and issues related to implementing the initiative in their county. Currently nine counties are engaged in the initiative.

Power Hour participants are encouraged to use this page for local presentations in order to increase public awareness of adverse childhood experiences (ACEs), trauma, social adversity and the data-driven prevention strategies.

slide 2

Before we begin our presentation, we want to allow for a moment of quiet reflection. Please take a minute to perform the self-care of your choice.

slide 3

PART ONE: HOW DO WE MAKE MEASURABLE PROGRESS?

The 100% New Mexico initiative, like many health initiatives across the country, has many moving parts. It also has a book to guide all initiative participants, a framework for change and one very clear vision: 100% of families and communities can thrive with access to the ten vital services for surviving and thriving.

This presentation will provide an overview of how we are evaluating all aspects of the county-based initiative to achieve the goal of every community within a county’s borders being truly family-friendly.

slide 4

The 100% New Mexico initiative is the centerpiece of the Anna, Age Eight Institute’s programming. It was developed by institute co-directors Katherine Ortega Courtney, PhD and Dominic Cappello who are the co-authors of Anna, Age Eight and 100% Community.

Anna, Age Eight: The data-driven prevention of childhood trauma and maltreatment guides communities in addressing epidemic rates of adverse childhood experiences (ACEs) that occur in the home and social adversity that families face outside their door.

slide 5

100% Community: Ensuring 10 vital services for surviving and thriving is the blueprint that 100% New Mexico initiative participants are using to assess barriers to vital services and build a countywide system of care that includes timely access to vital services. The book details how we collaborate to build the services in each county.

slide 6

The 100% Power Hour 7-part webinar series was developed to provide initiative participants with an overview of key concepts that guide the initiative. This includes the detailed initiative programming to empower local county and city stakeholders as they address challenges through the process of continuous quality improvement: assess, plan, act and evaluate. Today we focus on evaluating progress.

slide 7

As we begin, we wish to point out three of the most common comments we hear as we discuss the initiative. Some local government representatives will say, “We haven’t gotten around to evaluation.” Our response is, “How can we support you with that?” Local agency representatives might say, “We don't track supply and demand yet.” We respond, “How can we help you?” And some change agents might say, “We meet a lot but I’m not sure about results.” We respond, “First, meeting and networking is valuable. Second, moving from talking to action is key. How do we support that vital move to achieve results?”

slide 8

One common response from the Anna, Age Eight Institute when people look at the data on health challenges and barriers to vital service and ask, “Is this initiative really needed?”

“If not 100% New Mexico, what’s your plan B?”

slide 9

The goal of the data-driven, county-based and technology-fueled initiative is to empower local stakeholders in ensuring ten vital services for surviving and thriving, all key components of a county and city committed to health equity and racial justice.

slide 10

Our goal is to take data-driven action in order to address adverse childhood experiences (ACEs) and work to prevent the ten forms of adversity that include abuse, neglect and living in homes where adults have substance use disorders, engage in violence and have untreated mental health challenges. We are evaluating our capacity to prevent ACEs across a county.

slide 11

We are also evaluating our capacity to end the social adversity our children, students, parents and caregiving grandparents are facing. Our initiative can ensure health equity and social justice, but only if we evaluate progress.

slide 12

The learning objectives of 100% Power Hour #7: Evaluating Change are participants completing the webinar will be able to describe an overview of: the definition of evaluation, the goals of evaluation, the countywide survey, evaluating health indicators, evaluating the initiative, measuring support and buy-in, and building in evaluation to the county initiative.

slide 13

The 100% Power Hour process is designed to create a vehicle for building awareness of the initiative and serve as a catalyst for ongoing local community dialogue. The presentation design follows the “teach the teacher” format, developed to allow participants to provide the presentation to their initiative members and local stakeholders. To create an environment for community dialogue, we offer simple guidelines.

slide 14

We acknowledge the contribution of all initiative members across the state who have been part of the iterative process of developing the initiative to meet the unique needs of rural and urban families, as well as those serving culturally and economically diverse populations in the south and west. We also are grateful to the state and local lawmakers who have supported the initiative.

slide 15

This presentation takes place amid the COVID-19 pandemic and we pause to present an update on progress made with the vaccine implementation and delivery of medical care services for individuals and families across all 33 counties.

slide 16

REFLECTION QUESTION: What does the term “evaluate” mean to you?

slide 17

PART TWO: WHEN, HOW AND WHY DO WE MEASURE OUR WORK?

There are important questions to ask, within the context of the 100% New Mexico initiative. One simple one is, “What difference are we making with our meetings and activities?” The answer might be that we are building a network and sharing ideas and concerns. These are valuable activities if they move from convening to planning and action focused on developing projects to remove service barriers. Another equally important question is, “How empowered do initiative members feel?” We ask this because the success of the local initiative is dependent on members feeling respected, heard, and supported in learning new skills. It is the evaluation phase where the county-based initiative’s ten action teams reflect on what they have accomplished as project developers.

slide 18

Part Two Part Two begins with a definition of evaluation: A systematic determination of a subject’s merit, worth and significance using criteria governed by a set of standards. By “subject” we mean the initiative and its many projects focused on ending barriers to improve health outcomes for families.

slide 19

The 100% New Mexico initiative evaluation process starts with a county initiative’s goals. Evaluation will review not only project development and member satisfaction, but what impact projects have on the many consequences of ACEs. Evaluation looks at the entire county and all the communities within to ask, “As a result of our work, are things better for families?”

slide 20

With the evaluation process we can better understand if the county’s residents are trapped in the “old normal”, the pre-pandemic phase when ACEs and social adversity were the norm. Or is the initiative able to build public awareness of a “new normal” when all families can thrive with access to ten vital service? Evaluation, in the form of asking families how they are doing, awaits.

slide 21

Evaluation helps initiative change agents who are working on our three key strategies: 1) creating a central hub for services, 2) making every school a service hub, and 3) ensuring internet access across the county to make web-based services a reality.

slide 22

The entire initiative follows the continuous quality improvement process, moving from assessment to planning to action to evaluation. In the evaluation phase projects are reviewed. It is there we can identify how we support action teams as they face challenges developing projects. We identify the roadblocks so we can remove them. We fully understand that many of our projects are long-term, requiring significant local funding. This takes time and we can acknowledge that in our evaluation of project development in all ten sectors.

slide 23

With an eye on our families across the county, action teams are supported in moving diligently to develop projects moving from assessing to planning to action. We can use the evaluation process to troubleshoot in any of the CQI phases.

slide 24

Ten action teams never lose sight of the data from the countywide survey that illustrates the barriers reported by families. Evaluators also look at the barriers in order to better understand how local projects can reduce them. Repeating the survey over time will reveal to what degree barriers are being reduced. If barriers are not being reduced an initiative will need to rethink it’s strategies, priorities and capacity.

slide 25

Evaluation is an ongoing process built into the initiative, a way of measuring the health of our children and families each year.

slide 26

REFLECTION QUESTION: What would build the capacity of your initiative to evaluate its work?

slide 27

PART THREE: HOW DOES EVALUATION STRENGTHEN THE INITIATIVE?

The Anna, Age Eight Institute provides to our county partners the tools to evaluate every aspect of the initiative, from member satisfaction to project development in ten sectors and the capacity to build the infrastructure to become sustainable for the long term work ahead.

slide 28

Evaluation has the power to improve the effectiveness of the initiative and support its members. We can measure a variety of components including: level of participation in the initiative, number of action team members who can work on the projects weekly as part of their job, how many projects focused on ending barriers have started, and the capacity to raise funds for projects. We can also measure changes in public awareness of ACEs and social adversity.

slide 29

We can measure each year progress made toward three goals: 1) creating a one-stop service hub in the main population center of a county, 2) transforming schools into community schools that serve as service hubs, and 3) ending the digital divide so all families can access web-based services, support and education.

slide 30

At the end of the day we ask, “As a result of our efforts, are our children, students, families and communities healthier, safer and empowered to thrive?”

slide 31

The 100% New Mexico initiative is supported in raising funds to support its many projects. Evaluation can identify how successful the local initiative was in securing funding from city government, county government, state entities and philanthropy. We can learn what the challenges are in raising funds and how to improve the process.

slide 32

The evaluation process can measure the support that is offered by a variety of partners on the state, county and city levels. The partners are key to securing funding and support for local 100% New Mexico projects.

slide 33

REFLECTION QUESTION: What support would help you in evaluating your local process?

slide 34

PART FOUR: HOW DO WE BUILD EVALUATION INTO THE ENTIRE LOCAL INITIATIVE?

The continuous quality improvement process can focus on the entire county initiative. To do this requires an evaluation plan and internal buy-in for the process.

slide 35

In our “Framework for Change” evaluation is the “D” part of the four-phase continuous quality improvement process. Evaluation is all part of the change process that leads us to “E” and engagement. This means leadership and a local movement committed to our desired result: 100% of our kids and families thrive. From there we move to “F” and measurable outcomes.

slide 36

Some outcomes might take one to ten years or more. It all depends on county stakeholder’s capacity to move from the world of “no, we can’t” to the world of “yes, we can.”

slide 37

REFLECTION QUESTION: Who in your county has experience with evaluation?

slide 38

What we are doing with the 100% New Mexico initiative has never been done before in the United States. We are ending barriers to vital services to create a countywide seamless system of care, safety, empowerment. We are building the capacity of each county and city to build the ten services that allow all residents to endure public health crises and economic disruptions.

We are committed to a New Mexico where 100% can thrive.

BONUS QUESTION: How has the 100% Power Hour series impacted you?

slide 39

NEXT STEPS: Reflect on the presentation and your notes. Review the books and links to research provided. Reach out to colleagues, friends, family, neighbors and local elected leaders to discuss the 100% New Mexico initiative. We have designed this presentation so that it can be used with local elected officials within city and county government and school board members, agency leaders (representing the ten vital services), representatives from local higher education, faith-based and community-based organizations and your neighbors and friends.

slide 40

The next 100% Power Hour series will be presented next quarter. We hope you will invite your colleagues, neighbors and elected officials to participate. see you there. For any questions about the 7-part webiness series, the initiative, research guiding the process or practical steps in starting the initiative, please contact us annaageeight@nmsu.edu.

Additional Resources

Download

slide 33

Access the Powerpoint for presentations
(via Google Slides)