• How Accurate is Your HVAC Field Testing?

    July 13, 2018
    As many groups look to the future, decisions are being made based on their opinions that field personnel can test and diagnose HVAC systems.

    In honor of Throwback Thursday on a Friday, here is one of Rob 'Doc' Falke's most popular items of 2018:

    During the 2018 AHR Expo and ASHRAE Winter Meeting in Chicago, there was much discussion about the accuracy of technician HVAC field testing. Let’s take a look at the pros and cons discussed and what industry literature has to say about this subject.

    It was clear this subject is on the minds of many industry leaders. As many groups look to the future, decisions are being made based on their opinions that field personnel can test and diagnose HVAC systems.

    Groups with an interest in accurate HVAC system performance want to know: Will the folks in the field step up their skills to match the new technology and tools we send to the market?
    Groups wrestling with these questions include equipment and control manufacturers, standards and industry trade organizations, facility maintenance organizations, utilities, and government. The primary question they ask is: “Will the folks in the field step up their skills to match the new technology and tools we send to the market?” 

    Technician Field Testing Pros
    In these conversations, you, the field technician, had many champions sharing their assurance that you have what it takes to meet these challenges.

    One of the best statements in support of the technician was a laboratory testing engineer for a utility company. He described the rapidly increasing skill level in his area of the country. He told how he had witnessed an increasing competency in field testing over the last few years.

    On the other hand, he said most utility programs in his marketplace spend nearly all their training funds teaching technicians how to fill out rebate forms. Many spend little, if any, time training participating contractors and technicians how to accurately test and develop skill and judgment.
     
    He then described how he saw technicians being trained to test, diagnose, repair, and verify improvement in system performance. Real measurable increases were documented. The difference, he said, were programs of the past only assumed the work was completed in a satisfactory manner.

    Much of the credit was given to technicians mastering skills using new and affordable HVAC test Instruments. This has resulted in increased speed and accuracy of the testing.

    Manufacturers commented on how a segment of the industry seems to be pulling away from the pack of traditional contractors. As contractor’s abilities to test, diagnose, and prescribe solutions increase, the manufacturers say they are tracking warranty cost reductions up to 75% compared to the average dealer.

    Finally, there is a segment of our industry called Energy Measurement and Verification (EM&V) professionals. They are field measurement experts who verify and document the work and accuracy of HVAC professionals on installed systems in the field.

    Surprisingly, this group expressed a hope that one day soon, HVAC contractors, technicians, and EM&V professionals will each test using the same procedures and calculation methods to verify installed HVAC system performance. One member of the EM&V group shared a story about what he had recently learned from field technicians. This is a huge shift in this community’s culture compared to just five years ago. 

    Technician Field Testing Cons
    Most of the negative comments about HVAC technician field testing accuracy came from those claiming that such testing is only credible in a laboratory setting. Several individuals saw field testing as coarse and raw and considered HVAC technicians incapable of accurate measurements.

    In truth, most of this community had little or no interaction with HVAC professionals in the field. Many believed the HVAC industry incapable of reliable field testing because of previous evaluations they published years ago.
    Given their experience, this opinion is convenient. A closer look at these studies reveal the methods used to evaluate technicians’ field testing abilities followed a dissimilar set of testing protocols using different test instruments. How could this ever stand up under scientific scrutiny?

    Industry Literature Findings
    Many studies and papers discuss the accuracy of field testing. One study discussed how control system accuracy is entirely dependent on sensor placement in the system. The same is true of field testing.
    A technician’s ability to measure accurately depends on several variables:

    • Choice and application of test instruments
    • Selection of proper test locations
    • Use of appropriate test procedures for the test
    • Recording and interpreting test results.

    How do you rate your ability to accurately test the HVAC systems you sell, install, and service? Are you a student of your profession?
    Very few of these industry studies and papers considered the above-mentioned factors. An informal study of trained and certified field technicians using live in-field quality assurance and verification concluded the following increases in accuracy:

    Rate Your Testing Ability
    The real question is, how do you rate your ability to accurately test the HVAC systems you sell, install, and service? Are you a student of your profession? Do you seek to improve yourself and increase your ability to serve customers? If you do, welcome to the small, but growing segment of professionals who are raising the bar in the HVAC contracting universe. You ARE well ahead of the pack and can be assured you live with purpose and satisfaction in your work.

    Rob “Doc” Falke serves the industry as president of National Comfort Institute, Inc. (NCI), an HVAC-based training company and membership organization. If you're an HVAC contractor or technician interested in a free test procedure describing simple testing you can do on a sales visit, contact Doc at [email protected] or call him at 800-633-7058. Go to NCI’s website at nationalcomfortinstitute.com for free information, articles, and downloads. And visit the HVACToday.com website for the latest on Performance-Based Contracting™.