Some of you may be aware that last spring I requested and received a large amount of data under the Freedom of Information Act from NYSERDA regarding your HPwES projects. I now have blower door numbers for all of your projects for the past two years through November. Test in, projected, and test out. Below is a representation of how well you have done against yourselves, and against your peers.
You also may recall that I feel this program needs to move toward a new competitive metric - one of published ability to deliver savings projected. This will do for our industry what MPG ratings and JD Power did to the auto industry, it will create incentive to excel around a metric that benefits the consumer and adds credibility to our promises. It will allow us to market based upon truth and accountability, not smoke, mirrors and hope. Sell to reason, not fickle emotion.A program that can deliver TRUTH is unique in today's marketplace. This could elevate our profession immeasurably! We may have to go through slight discomfort to get to a better place.
Tracking before and after energy would be ideal, but right now there is an access problem to energy consumption data "after" improvements. Until we can solve this, do we have anything that might indicate what results to expect by contractor? Proxy for energy projection accuracy? Well, besides "reported energy use before" and "modeled energy use before," we have blower door leakage, projected leakage reduction, and actual leakage reduction.
In my last e-mail I discussed the importance of accuracy of modeling energy input, and provided an image of roughly where you stand against your peers with respect to energy truing accuracy. The images below/attached show were you stand against your peers with respect to blower door projection accuracy. Below is PROJECTED reduction, ACTUAL reduction, and Percentage of promise delivered. In other words, how good are you at projecting? How good are you at tightening? And do you sand bag, nail it, or over promise? (1300 sf house with 10k test in, 9k promise, 3k test out, really?)
There are a lot of ways these early numbers might misrepresent actual work performed. For example; exaggeration of test in leakage (probably to obtain SIR) could make some look like they are doing more than they are. (No regression analysis was performed to determine if/which Test In numbers were exaggerated, but I know for a fact people are doing this and suggest that practice stop immediately.)
The intent of this is to inform not embarrass, so inaccuracy of these numbers helps as they can only help inform, not be used to judge. But good data matters so going forward there is no amnesty for ANYONE around the data.
REVIEW: THESE NUMBERS ARE ALL OVER THE PLACE!!
We all know there is a direct and significant correlation between energy consumption and air leakage. So it is reasonable to assume leakage reduction has direct and significant correlation to energy SAVINGS. Accuracy in your blower door projections will show up in your ability to accurately project savings.
I know these numbers - like the ones I sent last time - may be new to many of you. What they mean may take a little time to sink in. But please get your heads around this if you wish to avoid looking incompetent when compared to your peers once this registry goes live! Again, forewarned is forearmed. After today, claims of ignorance of harm will not be a compelling defense. (I keep being asked for names. The media loves nothing more than to go after contractors taking advantage of "defenseless consumers".)
Question - What happens when customers you've projected $800 annual savings call you saying they only saw $150? What happens if your model for them is full of inaccuracies? Over 10 years that's $6500 short. Let's head that problem off before we get there?
We need good inputs to prove Residential Investment Grade Energy Modeling is achievable! Then we can move to PERFORMANCE BASED INCENTIVES, and ultimately away from the need for any incentives to drive Comprehensive Home Performance. How nice would it be to show inaccuracy and scatter is caused by poorly designed process and corrupting program incentives rather than by contractors or software?
It is a forgone conclusion that you will be measured against your peers upon your ability to accurately project savings:
(to see these larger go here: http://bit.ly/BDprojpercent, http://bit.ly/bdactualpercent, and http://bit.ly/bdvariancepercent)
Do YOU Deliver On Promise? If you want to be at the top of the "delivers on promise" list for energy savings (closest to 100%), make sure your inputs are accurate! A rising tide raises all boats, except the ones with huge holes. If you have big holes, plug them now because the tide is coming in. It appears some people are definitely on the right track, and bravo to you!
Apply pressure on CSG and NYSERDA to help you improve air sealing, and prediction. Make them accountable for helping you succeed. Position yourself to take advantage of transparency.
Remember, progress will be a strong defense to poor performance, so let's start tightening things up BEFORE we have tools that expose this work to public scrutiny. I believe NYSERDA intends to improve reporting. Demand this so you will not be caught unaware of your numbers in the future.
Do you really want ME to have your numbers before YOU have them?
I propose a competition for accuracy, which in turn will drive AND REWARD excellence. It will allow HPwES contractors to TRULY differentiate from Joe Six Pack.
I hope this expresses the importance of blower door input accuracy, and how allowing inaccuracy to go unchecked will be a big problem for YOU when we achieve tracking of savings realization.
This goal of tracking realization, BTW, may not be far away. NYSERDA now has direct access to energy consumption whereas before they apparently had to hire 3rd parties to access bills and perform analysis.
This email will be posted to my blog as was the last one. You can see those conversations here: http://bit.ly/HEREARESOMENUMBERS
AND NOW - HOW DO YOU COMPARE TO YOUR COMPETITORS?...
| update subscription preferences