The following information provides additional detail and/or examples of some of the approaches to target setting discussed in the general guidance section.
Percent or Percentage Point Improvement
Percent or percentage point improvement are common methods for setting targets. There are several different ways to determine and apply these changes over time to target setting methods.Read More +
Average year-over-year growth/change. Using historical data, calculate the average growth/change from year to year. This change can be calculated as a percent improvement or a percentage point improvement. For example, if the average growth is 0.8 percentage points, add that amount to the current data for each year.
Table: Percentage Points (using child outcomes data)
|Average actual growth = 0.8|
Overall growth/change. Calculate the overall growth from two historical points in time, e.g., from year 1 to year 5, using either percent or percentage point improvement. Increase the end target for five years out by that total growth. For example, if the total growth from 2015 to 2020 is 4 percentage points, add that to the end target five years out. Decide if the targets for each intervening year should increase incrementally by .80 percentage points (4 divided by 5 years) or in other increments, depending on state circumstances, e.g., the status of improvement initiatives.
Table: Percentage Points (using child outcomes data)
|Overall difference from 2015 to 2020 = 4.0|
Moving (rolling) average. If the historical data are not stable, a moving average can be calculated and added to each of the future years. The moving average may be based on a period of two, three, or four years, depending on the number of years of historical data available. Rolling averages need to total numerators and denominators separately first and then calculate percentages.
New baseline (or no historical data). If historical data are not available or if a new baseline has been established, e.g., due to changes in data collection methods, start with the new baseline (or most recent year of actual data) and increase that by a certain percentage or number of percentage points each year. For a percent improvement, the baseline is multiplied by a specific percentage, and the resulting value is added to or subtracted from the baseline. For a percentage point improvement, the baseline, itself a percentage, is improved by adding or subtracting a specific value, also known as a percentage point.
Start with the End Goal
One approach to setting the end goal is to determine a meaningful/statistically different value from baseline or current data. The Child Outcomes Year-to-Year Meaningful Differences Calculator for States can be used for the C3/B7 indicators on child outcomes. The meaningful difference calculator uses an accepted formula to determine whether the difference between two percentages is statistically significant (or meaningful). Statistical tests of significance can be used to determine meaningful differences for other indicators. Once the end goal is set, determine the incremental targets for the intervening years.
Trend Analysis and Forecasting
A trendline, also referred to as a line of best fit, is a straight or curved line in a chart that shows the general pattern or overall direction of the data. A trendline is most often used to show data movements over time, particularly to provide a basis for estimating data in future years. An important consideration in trend analysis is how far back to go, that is, when to start the trendline.Read More +
Tools, like Excel, can be used to add a trendline to a chart and extend the trendline to future years (forecast). Excel provides different options for trend analysis and forecasts, depending on the type of data you have.
- Linear. A linear trendline is used with simple linear data sets; that is, the pattern in the data points resembles a line. A linear trendline usually shows that something is increasing or decreasing at a steady rate.
- Moving average. A moving average trendline smooths out fluctuations in the data to show a pattern or trend more clearly. A moving average trendline uses a specific number of data points, averages them, and uses the average value as a point in the trendline. You can determine the number of data points to use in the moving average, e.g., two, three, or four.
- Logarithmic. A logarithmic trendline is a best-fit curved line that is most useful when the rate of change in the data increases or decreases quickly and then levels out.
Linear data typically require fewer data points for projections than other options. Excel can also create confidence intervals and display the R-squared value of a trendline, which is a number that indicates how well your trendline fits your data. The closer the R-squared value is to 1, the better the fit of the trendline.
Statistical analysis can be used to help predict future results—targets—using additional data such as population data, regional data, or outliers. For example, a state could stratify its data by the size of the local program/district and weight those data accordingly, or it could look at the change in the results of local programs/districts that have implemented improvement initiatives versus those that have not, and set targets based on scale-up plans.