Internet Explorer 11 is not supported

For optimal browsing, we recommend Chrome, Firefox or Safari browsers.

6 Tips for Piloting New Programs

Small test-runs can help an entity avoid big mistakes, but there's an art to getting meaningful results.

pilot-programs-tips
Tallahassee is piloting electric scooters for a three month trial period.
(Shutterstock)
Pilot programs are a terrific way for states and localities to test-run new or experimental programs before implementing them entity-wide. But there's one caveat: If the pilot isn't set up right, the results, as we explored in another column, may be skewed, or even worse, misleading.

To make sure it's done right, we compiled six time-tested precepts that will guarantee the pilot produces useful results.

 

Avoid the Piecemeal

Each individual component of a system -- particularly a technology system -- may get through a pilot OK, but if the individual pieces don't work well together, then you could still have a failure on your hands.

For example, about a decade ago, Minnesota embarked on a $100 million license and registration system. Joel Alter, a director in the state's legislative auditor office, reports that although each component of the system was tested independently, "you have to do end-to-end testing to make sure they work together. That wasn't done."

Unfortunately, the system as a whole failed. The state is continuing to use the previous system while it begins work on an alternative. It has little to show for the $100 million spent.

 
Keep an Eye on the Big Picture
Pilot programs can be used to help begin major initiatives with minimal expense. Public administrators can be risk adverse, notes Bill Leighty, former chief of staff to Gov. Mark Warner. Pilots, he says, allow incremental "decision-making, which can be far more appealing to decision-makers, as they are far less risky to their careers than big bold programs."

 

Spread the Wealth.

Pilots should be staged so that they are reflect all the populations and regions that might use the program.

While a pilot program limited to Utah's densely populated Salt Lake City area may prove to be successful, for instance, there's no reason to have confidence that it will work well in sparsely populated portions of the state if it isn't piloted there as well. "Pilots fail because they fail to take into account the differentiation between where the pilot was done and full application," says Leighty.

A subsection of this point has to do with who is chosen to run the pilot. One particular hazard is that the departments or the communities that are used for pilots may simply be the first ones to raise their hands. As a result, they may not have the infrastructure or environment in place to give the pilot a fair chance, and so a perfectly good notion is discarded.

 

Get Buy-In from Lawmakers.

If legislators aren't informed and onboard before the test run, a pilot's findings can be overwhelmed by political considerations. "The analysis doesn't always carry the day at the legislature," says Larry Jacobs, director for the Study of Politics and Governance at the University of Minnesota.

This point isn't a surprise to us, given the frequency with which good solid information doesn't go far to inform policy decisions. This is especially true when the program or policy may be politically unpopular.

 

Be Scalable.

Those in charge of running the pilot need to make sure that -- if it works well -- the project can grow to cover the entirety of an entity. That is, if you just have a pilot without a plan for scaling it, the program is unlikely to be widely utilized.

 

Go With Piloting Experience.

Several experts we talked to told us that sometimes the people who are running the pilot haven't done so before. There is a science to it. Although individuals may be well-intentioned, they may be unqualified to run a pilot effectively.

Government management experts. Their website is greenebarrett.com.
Special Projects
Sponsored Stories
Sponsored
In this episode, Marianne Steger explains why health care for Pre-Medicare retirees and active employees just got easier.
Sponsored
Government organizations around the world are experiencing the consequences of plagiarism firsthand. A simple mistake can lead to loss of reputation, loss of trust and even lawsuits. It’s important to avoid plagiarism at all costs, and government organizations are held to a particularly high standard. Fortunately, technological solutions such as iThenticate allow government organizations to avoid instances of text plagiarism in an efficient manner.
Sponsored
Creating meaningful citizen experiences in a post-COVID world requires embracing digital initiatives like secure and ethical data sharing, artificial intelligence and more.
Sponsored
GHD identified four themes critical for municipalities to address to reach net-zero by 2050. Will you be ready?
Sponsored
As more state and local jurisdictions have placed a priority on creating sustainable and resilient communities, many have set strong targets to reduce the energy use and greenhouse gases (GHGs) associated with commercial and residential buildings.
Sponsored
As more people get vaccinated and states begin to roll back some of the restrictions put in place due to the COVID-19 pandemic — schools, agencies and workplaces are working on a plan on how to safely return to normal.
Sponsored
The solutions will be a permanent part of government even after the pandemic is over.
Sponsored
See simple ways agencies can improve the citizen engagement experience and make online work environments safer without busting the budget.
Sponsored
Whether your agency is already a well-oiled DevOps machine, or whether you’re just in the beginning stages of adopting a new software development methodology, one thing is certain: The security of your product is a top-of-mind concern.