Video transcript · 11 min · 1,800 words
Understanding the DPRP Evaluation Report webinar: transcript
A CDC webinar explains the evaluation report sent to CDC-recognized National DPP Lifestyle Change Program organizations after their six-month data submissions. Using a fictional organization, it walks through the organization profile, the full evaluation against requirements 5 to 9, and the sections for ongoing and new participants.
Key points
- Organizations submit data every six months, but evaluation only happens once participants have had 12 months since their first session; otherwise a progress report is sent.
- All evaluations use the current version of the standards, whatever version the organization was approved under.
- The Participant Summary shows how many participants were excluded for BMI, eligibility or attendance, and at least 5 evaluated participants are needed.
- Requirement 5 needs 60% attending at least 9 sessions in months 1-6 and 60% attending at least 3 in months 7-12.
- Other requirements cover weight documented at 80% of sessions, activity minutes at 60%, average weight loss of at least 5%, and at least 35% eligible by blood test or GDM history.
- Ongoing and new participant sections show who will be evaluated next, and organizations should keep monitoring their eligibility.
Chapters
Full transcript
0:00Welcome to the National Diabetes Prevention Program, Understanding the DPRP Evaluation Report webinar, brought to you by the Centers for Disease Control and Prevention's Diabetes Prevention Recognition Program, DPRP. Your organization is required to make a data submission every six months, starting six months after your effective date. Evaluations for preliminary and full recognition are not performed until participants who start in the six-month evaluation period have had 12 months lapse since their first session date.
0:34Therefore, your data submission will not always result in an evaluation. We will send you a progress report which simply gives feedback on what we are seeing in the participants you've submitted data on until the time when evaluation can be performed. We will perform an evaluation and send you an evaluation report once you do have complete data on these participants. This report will show the outcome measures that were calculated using the evaluated participants' data. You will be able to see which requirements are met and which ones are not met.
1:06This report also gives you feedback on the ongoing participants, those who will be evaluated at your next six-month submission, and the new participants, those who will be evaluated a year from the current submission, in addition to the full evaluation on your complete cohort. Please remember that no matter which version of the standards your organization was approved under, all evaluations are performed under the current version of the standards. Let's walk through the different parts of the report using data from a fictional organization. The first section is the organization profile. Here you see your organization's org code, the date your organization was approved, your effective date, the current evaluation sequence number, the number associated with the six month period you are submitting data for, the date of your last evaluation, the outcome of your last evaluation, and the outcome of this current evaluation.
1:58In this example, we see that this organization is achieving full recognition based on this current evaluation. The Summary and Recommendations section provides notes specific to your organization's outcomes. These include a summary of which requirements were missed in the full evaluation, a list of strategies for meeting the various requirements, and DPRP contact information. The full evaluation consists of two parts, the Participant Summary and the Evaluation Summary.
2:30The Participant Summary starts by showing the total number of participants who attended their first session during the sequence being evaluated. In this example, that number is 100. After that, the number excluded for not meeting the body mass index requirement, shown here as 5, and the number of participants excluded for not entering the program based on the results of a blood test, a history of gestational diabetes mellitus or the score on a risk test, shown here as 2, is shown, resulting in the number of participants who meet the eligibility requirement, 93.
3:05After this, the number of participants excluded from the evaluation because they did not attend at least three sessions in the first six months, or because their time from first session to last session was not at least nine full months, is given. Please refer to the 2018 DPRP Standards for a full explanation of eligibility requirements. The table shown gives information on when participants left the program and consists of two columns. The left column depicts the length of the program, 12 months.
3:36The right column shows the number of eligible participants who left the program prior to completing 12 months. For example, the second month shows that five eligible participants left the program. The number deemed ineligible for evaluation for the reasons just detailed are shown in the table up through month 9. Any participants shown as leaving in months 10, 11, or 12 are still included in the evaluation. The evaluation summary begins by showing the number of participants who met the criteria for evaluation.
4:08In order to be evaluated for preliminary or full recognition, this number must be at least 5. In this case, that number is 73. Now that it has been established how many participants are included in the evaluation, the report goes through each of the requirements for preliminary and full recognition, 5 through 9, and indicates which are being met. Requirement 5 states that a year-long cohort must have at least 60% of its evaluated participants attending at least 9 sessions during months 1 through 6, and at least 60% of its participants attending at least 3 sessions in months 7 through 12.
4:46Both parts of this requirement must be met. In this example, it is shown that 80% of evaluated participants attended at least 9 sessions sessions in months 1 through 6, and 75% attended at least 3 sessions in months 7 through 12, indicating that requirement 5 is met. Because this is a requirement for preliminary recognition, the organization has at least achieved preliminary. In order to achieve full recognition, the remaining requirements must also be met.
5:17Requirement 6 states that a year-long cohort of evaluated participants must have body weight documented during at least 80% of the session. The result here shows that among sessions attended by the 73 evaluated participants, weight was documented at 96% of them. The requirement is met. Requirement 7, that a year-long cohort of evaluated participants must have physical activity minutes documented during at least 60% of the sessions, is calculated in a similar way to Requirement 6.
5:48This example shows that 62% of sessions attended by evaluated participants had documented physical activity minutes. This requirement is met. Requirement 8 states that the average weight loss across all evaluated participants in the year-long cohort must be a minimum of 5% of starting body weight. In this example, the average weight loss was calculated to be 7.5%, indicating that the weight loss requirement is met. The final requirement pertains to program eligibility. Requirement 9 states that a minimum of 35% of all evaluated participants in a year-long cohort must be eligible for the lifestyle change program based on either a blood test indicating prediabetes or a history of GDM. This example shows a calculation of 50% which means this organization has all of the requirements for full recognition.
6:45The next section of the report looks at the participants who will be evaluated at the next submission. They are referred to as the ongoing participants. If the organization did not start a class during this sequence, then this section will not be displayed in the report. Please note that the ongoing participants are the participants who began the program in the sequence that is one higher than the sequence that was evaluated earlier in the report. In this example, the full evaluation was performed on the sequence one participants.
7:15The ongoing participants began in sequence two. This section gives the dates for the six-month period when the participants began, as well as the sequence number and the date when this group will be evaluated. The total number of participants who began during this sequence is given, followed by the number who are ineligible based on their BMI, and the percent of people currently eligible based on the results of a blood test or who have a history of GDM. In this example, there are 50 participants who began during sequence 2.
7:47None of them are excluded based on their BMI, but only 30% are eligible based on the results of a blood test or on a history of GDM. Because these people are not done with the program yet, the organization still has time to encourage the remaining 70% or at least an additional 5% to obtain a blood test before their final data are submitted. The table shown is designed to show the number of months the ongoing participants have completed as of the current date of submission. The table consists of two columns. The left column depicts the total program months completed, 1 up to 12 months. The right column shows the number of ongoing participants. These numbers can represent a couple of different things. In this example, if all 50 participants started on the same date, then the table would be indicating that 25 people dropped out after month 9.
8:40However, if the participants started on different dates, then you are simply seeing how the different cohorts are moving through the program. In this example, let's assume that there were two cohorts that started in sequence 2. Each cohort had 25 participants, and they started one month apart. Under this scenario, the table is showing that the first cohort of 25 participants is in month 10 of the program, while the second cohort of participants is in month 9. Of course, the table could be showing a combination of the two above scenarios, multiple cohorts as well as participants leaving the program early.
9:15It is up to the organization to make this determination. The new participant section is similar to the ongoing participant section. The same information is given, this time for the participants who began in the six months leading up to the current submission. In this example, these would be the participants who began in sequence 3. Of the 75 people who began their sessions in this sequence, 5 did not meet the BMI requirement. Because BMI is calculated using the person's height and their first recorded weight, there will be no opportunity for the eligibility of these participants to change.
9:52They will not be included in the evaluation that will be performed in January 2020. Of the remaining 70 who have met the BMI requirement, 50% are currently enrolled based on the results of a blood test or on a history of GDM. Because some of these participants may leave the program early and not be included in the evaluation, it is the responsibility of the organization to continue monitoring the eligibility of these participants. Like the table we showed in the ongoing participant section, this table shown gives information on progress of new participants and consists of two columns.
10:30The left column depicts the total program months completed, the right column shows the number of participants. If the participants all started on the same date, you can see how many participants are dropping out each month or simply not attending sessions during a certain month. If participants are starting on different dates, you will see where the various cohorts are in the program. In this example, we can assume that the 70 eligible participants all began on the same date and are currently in month 2 of the program.
11:02This concludes the webinar. Please visit the National DPP Customer Service Center at nationaldppcsc.cdc.gov for more resources and to submit any questions that you may have. Thank you for joining with us to help prevent type 2 diabetes in the U.S.
Source and licence
Recording: File:Webinar- Understanding the DPRP Evaluation Report.webm by Centers for Disease Control and Prevention (2019-07-23), via Wikimedia Commons. Licence: Public domain.
The transcript is machine speech-to-text by the TidyTools Audio & video transcriber; the summary, key points and chapters were written by Claude from that transcript. Both may contain errors: check the recording before quoting it.