Showing posts with label FOIA. Show all posts
Showing posts with label FOIA. Show all posts

Thursday, August 29, 2019

Records reveal successes and challenges in laboratory wood heater testing

Stove and boiler regulations appear to have survived Trump’s first term 

As the wood stove industry nears the May 15, 2020 deadline for meeting stricter emission standards, EPA records show a steady stream of stoves being certified but do not show which models, if any, failed. Manufacturers are required to notify the EPA of stoves they are testing 30 days in advance of the test and to report results after 60 days. Labs are also required to provide emission data to the EPA within 60 days, even if a test is suspended.
Percent of certification tests
scheduled for larger EPA-
approved test labs.  

Data from stove certification tests is a core resource for understanding and improving the effectiveness of regulations. A trove of documents just became available that helps us better understand how stove testing works and how a declining number of EPA staff is trying to oversee detailed regulations that partially rely on an honor system within the industry they are regulating.
Data recently released by EPA shows the pipeline of what is being tested by which lab, what has not been certified and other trends. The 2015 performance standards for residential wood heaters require manufacturers to notify the EPA at least 30 days in advance of the model’s certification test in an EPA-approved laboratory.

The EPA does not maintain a public database of 30-day notices, but the Northeastern interstate air quality organization NESCAUM requested copies of these reports through the Freedom of Information Act (FOIA). The main function of the 30-day notice is to enable the EPA and other agencies to witness testing, which otherwise occurs behind closed doors.

There is nothing proprietary in the 30-day notices and the EPA has no grounds to keep them confidential. Once anyone files a FOIA, the information is made public on the US government FOIA online site. To find the underlying data from these requests, type in “NESCAUM” in the FOIA online site or use these record locators: EPA-HQ-2019-006560, EPA-HQ-2019-000324 and EPA-HQ-2018-006770.

The EPA provided 30-day notices filed between 2015 and 2019 for 143 distinct heaters and 41 duplicate notices.  Matching the 30-day notices to the end result on the EPA's certified heater database indicates that approximately two-thirds of them are certified to 2020 standards.

We could not tell, for example, if crib tested stoves had a higher or lower passage rate then cordwood tested stoves, or which fuel led to more suspensions. The rapid rise in popularity of the cordwood test may indicate the stove manufacturer community’s confidence that they will not be more likely to suspend or fail a test.

More than 10 stoves or central heaters may have been certified since 2015 but only achieved Step 1 standards. The reason for this is unclear. It could be that these stoves already had Step 1 status but failed to achieve Step 2 emission limits. It may also indicate that manufacturers thought the EPA regulations would be struck down or EPA would grant a sell-through, neither of which appear to be happening at this point.

The EPA’s inaction to date on revising  2015 NSPS, and HPBA's strategy to seek repeated delays in their litigation, means that Step 1 stoves will likely be illegal to sell in the US after May 15, 2020. For companies that certified to Step 1 standards since May 2015, the expenses of testing the stove, and potentially modifying it, resulted in a stove that can only be sold for 2 – 4 years on the US market.

Approximately twenty-three stoves with 30-day notices do not appear on the EPA database of certified heaters. It is possible that some of the unlisted stoves have been tested very recently and are still in the certification process, while others might have failed certification testing, did not make it to market for a separate reason, or were discontinued by the manufacturer. 

Test labs

Two labs, Polytest and Omni, test a majority of stoves for the American market. Polytest is based in Montreal and Omni in Portland, Oregon. PFS acquired Dirigo, so it is now one lab, also based in Portland Oregon. Dirigo used to qualify or certify many outdoor wood boilers. Myren Labs is now only an R&D shop and no longer conducts certification tests, but EPA-approved labs can certify at Myren's lab. Two relatively new European EPA labs – RISE (formally SP) in Sweden and the Danish Technology Institute (DTI) have done a few certification tests.  Only the SZU lab in Czech Republic has apparently not yet done certification testing for any heaters for the US.
Four labs account for the great
majority of certification testing.

Polytest and Omni are also the labs that certify the most stoves with the ASTM cordwood protocol, though all labs now have experience with cordwood for either stoves or boilers.

Many stoves certification tests are done in manufacturers’ or R&D labs by EPA-approved lab technicians who travel there to undertake the testing. Using the same lab that the stove was developed in may be one way to enhance the repeatability of emissions testing and help ensure the stoves passes.

Stoves vs. boilers, crib vs. cordwood

Currently, there are 130 appliances on the EPA's central heater database, however we only have 14 30-day notices in for central heaters (boilers and furnaces), indicating a drastic cut back on testing central heaters to 2020 standards since 2015. Moreover, the testing of those units only resulted in 3 certified heaters: 2 European pellet boilers and 1 domestic cordwood furnace. Possibly the most notable manufacturer that does not have a 2020 certified unit is Central Boiler, who led the charge to stave off the EPA’s 2020 emission standards (litigation still outstanding). Omni labs filed a notice to test a new Central Boiler unit in the winter of 2017, but as this unit does not appear on the EPA list, it is unclear if the testing was suspended or what the results were.

The majority of the 30-day notices obtained were for stoves or room heaters, a category which includes wood, pellet, and multi-fuel stoves. Of these 129 unique room heaters, 36% listed crib wood, 33% pellets, 25% cord wood, and 2% coal/wood and >1% densified logs as the test fuel on the notice. A few 30-day notices did not have a fuel type selected. Twenty-two heaters were listed as having a catalyst, and at least five stoves were single burn rate stoves, a feature that is sometimes not advertised to consumers.

Posting non-confidential lab reports


A new provision of the 2015 EPA stove regulations requires manufacturers to publish their certification testing reports. These lab reports include all emission data, efficiency, grams per hour for each test run and the averaged final numbers. They also include photos of the stove and the crib loads, how the stove was loaded and other data once routinely kept private by manufacturers. These lab reports are usually too technical for the average consumer, but often read by other manufacturers, regulators, retailers and stove hobbyists.

However, these reports are sometimes hard to find on company websites and sometimes appear not to be posted at all by a few smaller manufacturers. After extensive searching, AGH was able to find more than 90% of the 2020 certified heaters’ certification reports online, as well as most Step 1 reports. To be listed as a certified heater by the EPA, manufacturers must provide the EPA with a link to their online report.  While major manufacturers are posting their reports, some remain hidden or difficult to find. And, since most stoves were grandfathered into the 2015 Step emission category, many lab reports detail the original certification testing which happened 15 – 30 years ago. (Once a stove was certified, it received a 5-year certificate of certification, which could be renewed without any additional testing every five years. Some currently certified stoves models are using tests conducting in the early 1990s, having received 5 EPA renewal approvals.)

Lab reports are often more than 200 pages long, but some companies limit what they disclose. Some are only 20 pages, and black out things such as the name of the company representative who witnessed the test. One very old report, from 1992, was only 2 pages long. Manufacturers are only required to post test reports for units tested after 2015, but the overwhelming majority posted test reports for all their certified units, providing testing transparency for the first time and access to third-party efficiency data, which consumers did not have access to before.  A few companies, including Central Boiler, only make reports public for tests done after 2015 and not for all of its certified units. (Those tests reports could likely be obtained through a FOIA request.)

Most companies maintain a single, centralized page for all their lab reports, making it easy to find them with a single click. They are called a variety for names from test report, to EPA data to website report, to certification certificate. Innovative Hearth Products that owns Astria, Ironstrike and Superior have some of the hardest pages to find as they are simply titled “Wood Heaters” and tech support told us that the company did not post those reports. Other manufacturers have the lab test report on the individual product page. At least 4 companies fixed broken links and reposted their test reports after we contacted them, notifying them that we could not locate them.

Links to non-CBI test lab reports

This is not an exhaustive list of manufacturers but includes most of the larger stove companies. (We will periodically update these links.)

Lab reports on central page: 509 Fabrications, Arada Stoves, Astria, Blaze King, Buck Stoves, Central Boiler, DroletEnerzone, Enerco Group (Mr. Heater), England's Stove Works, Enviro, Fire Chief Industries, Foyers Supreme, FPI Regency, Harman, Hearthstone, Iron Strike, JA Roby, Kuma, Morso, Napoleon, Osburn, Pacific Energy, Quadrafire, Regency, STUV, Superior, Travis/Lopi, US Stove, Vermont Castings, Woodstock Soapstone.

Lab reports on individual product pages: Froling, Jotul, MF Fire, RSF, Sierra Products, Thelin, Thermorossi, Timberwolf, Wittus (links go to a sample report).

Lab reports not found: Invicta, Laminox (we sent multiple emails and will post links if we get responses.)

Suspension of certification tests

From a review of 30-day notices of lab tests, and resulting certification, it would appear that virtually no stove fails a certification test. That is because if initial test runs are not going well, the certification test is suspended. There is no point continuing costly tests if the average grams per hour for all the tests is not going to be below 2 or 2.5 grams an hour. However, the EPA’s 2015 stove heater regulators require labs to “agree to immediately notify the Administrator of any suspended tests through email and in writing, giving the date suspended, the reason(s) why, and the projected date for restarting. The laboratory must submit the operation and test data obtained, even if the test is not completed.”

This data enables the EPA, state regulators and industry experts to understand how rigorous – or easy – a test protocol is for stoves of various firebox sizes and designs depending on whether crib or cordwood is used, for example.

In addition, the 2015 wood heater regulations stipulates, “Within 60 days after the date of completing each performance test, e.g., initial certification test, tests conducted for quality assurance, and tests for renewal or recertification, each manufacturer must submit the performance test data” to the EPA. Thus whether the tests resulted in certification, or were suspended or failed, the data still goes to the EPA and becomes part of the public record.

However, most labs appear to not always comply with this part of the NSPS and the EPA appears to not be strictly enforcing compliance (NESCAUM as submitted a FOIA request (EPA-HQ-2019-008306) for suspended test reports). This undermines the process of developing better test methods that could result in genuinely cleaner stoves.  In an unusual move, the EPA made a memo to test labs public that detailed lapses in lab test reports.  Filing reports from suspended tests was not among the issues the EPA raised to labs.

The high certification success rate of stoves scheduled to be tested may appear to undermine industry claims that the 2020 standards are impossible or crippling. However, stoves are intensively tested in private or internal labs before they are scheduled for expensive certification testing, as manufacturers need to know that they have a high chance of success to justify the expense. Manufacturers need to be able to repeat the prescribed test protocol relatively consistently to avoid a level of randomness between practice tests and certification tests that could result in repeatedly suspending certification tests. This issue of repeatability is at the core of the entire concept that wood heater testing is a valid and useful way to tell which heater is clean enough to put into homes and communities across America.


The fact that a very high percentage of certification tests are successful may undermine some industry claims that the variability of testing stoves under 2 grams an hour is far too high to render the test useful. Manufacturers have reams of data from in-house testing that could show how close their certification test results were to their practice tests. Some communities, often outside of the HPBA core, are far more transparent in sharing testing data, such as the Masonry Heater Association and various parts of the international cook stove community.

It is unclear if all manufacturers are following the same guidance about filing 30-day notices, as the EPA has become laxer about when wood heaters can be tested. Heaters often face delays in testing due to a variety of reasons, technically requiring a new 30-day notice. One stove AGH found has seven 30-days notices filed for it. Others had only one, but they may have delayed the test multiple times.

Conflicts of interest

An equally thorny issue is the conflict-ridden economic relationship between the labs and manufacturers. Labs want their clients to have confidence that they can get their stoves or boilers to pass the certification test. There is a process leading up to a certification test where labs come to know the strengths and weaknesses of a heater and match those with the areas of flexibility in a test protocol.

Labs guard their privacy and confidentiality on behalf of their clients. Curtains are often used to ensure that visitors cannot see whose heaters are being tested, and when and how. The 30-day notification rule was supposed to enable state or federal regulators to periodically witness certification - announced or unannounced. Witnessing testing allows regulators to understand the complexities, nuances and loopholes involved. Without that understanding, regulators cannot gain the level of expertise necessary to enforce existing rules, much less write better ones.

But here is the rub: AGH is not aware of any federal or state regulator who has witnessed a certification test in the last 5 years.  Rod Tinnemore, a Washington State regulator was one of the few who did witness tests and he gained the expertise, trust and respect of many stakeholders.  After his retirement, Washington appears to have backed off its multifaceted wood heater roles. Certification tests often last 4 – 7 days and can be very boring. Labs exist in only a few states and agencies do not have the time, resources – and sometimes even the authority – to witness testing. Most regulators do not even have the expertise to fully understand what they are witnessing and what nuanced lab practices are allowed or not allowed. The result is nearly a classic catch-22.

Conflicts are also potentially abundant in stove testing protocols like the ASTM E3053-17, which was developed and paid for by many of the same industry players whose stoves will be certified by those methods. Developing a protocol is an expensive and lengthy process, and there is no guarantee that it will be approved for use by the EPA and the EPA can unilaterally modify its use for certification testing. The EPA, however, may not have the resources and data to fully understand the nuances of a new alternative protocol until years later, when enough stoves have used the method. Further handicapping their oversight role is not consistently getting data from manufacturers for suspended tests.

Ultimately, audit testing of stoves in the same and different labs that certification testing was performing will likely be needed to bring attention and clarity that many of these issues deserve.  Audit testing by the EPA and/or states may help all labs ensure that testing parameters are consistently applied.

Similar, but more entrenched conflicts of interest in the European community stove testing community have led to what many experts regard as weak and ineffectual testing regimes. Some fear a convergence of cultures in US and European test labs if the EPA loses more staff and resources, or has its hands tied by appointed officials who favor industry concerns.

Future Challenges

Corporate, religious and educational institutions across America are coming to terms with legacies where people felt they had conflicts of interest and didn’t speak up about infractions and abuses. The VW auto testing scandal is a perfect example because it was in plain sight all along but everyone involved kept quiet. The issues and the stakes appear to be far smaller in the wood heater community, but we are dealing with devices that combust at extraordinarily hot temperatures in our living rooms and basements. When those temperatures are not present, the chimney may be emitting excessive particulates into our neighborhoods. Like the European auto testing community, the wood heater industry is also a relatively small group of seasoned experts, many of whom are older, known each for decades and abide by spoken and unspoken agreements not to publicly criticize others by name or expose issues to authorities.

In the 1970s, many industry insiders had a compelling mission - helping hundreds of thousands of families avoid incredibly high prices and live a simpler life that was more connected to nature and their own hard work. That mission is still a prominent driver for much of the wood heater industry, but instead of struggling to weld together enduring, affordable stoves, they are now filing 30-day notices, 60-day notices and a dizzying array of other paperwork.

One result is consolidation and a banding together to fend off stricter regulations and more oversight. Many manufacturers feel that they need to keep as much data as possible away from the government to survive. When outdoor wood boilers took off, just like when sales volumes of exempt single burn rate stoves soared, most industry insiders stayed quiet publicly, even when they privately fumed over the damage that these unregulated devices were causing to airsheds and the industry’s reputation. Top industry leaders also stayed quiet while highly exaggerated efficiency values proliferated and deployed their lawyers to ensure all stoves could be treated as 75% efficient or higher for IRS purposes.

Issues surrounding 30-day notices and suspension reports are not at the core of the struggle for the future of how well wood heaters work in the hands of homeowners, but they illuminate a slice of the struggles facing industry, EPA, state regulators and the air quality community as our country decides which renewable technologies will power our future. Once represented by the Washington DC based trade group “Wood Heat Alliance” in the 1980s, wood heaters are now represented by the HPBA that also represents more profitable gas and propane appliances and struggles to fit in to the renewable sector that thrives on greater transparency.

Recommendations

1. The 30-day notifications sent to the EPA are currently only being made through a Freedom of Information Act request, rendering them far less useful than if the EPA maintained a publicly available database. This could also provide transparency of key information that is not available elsewhere.

2. If state regulators who have labs in their state visited labs periodically to witness even part of a certification test, it could provide valuable insight and potentially oversight into the nature of testing procedures for states, the EPA and others.

· Oregon is by far the most important state since Omni and PFS-TECO are located there, and has a unique and longstanding role in stove regulation that predates the EPA’s role. The state also has areas where excessive wintertime wood smoke is a serious problem.

· NESCAUM has risen to become the most active and informed entity in the wood heating testing community. Its staff and member states can use their expertise to put pressure on the EPA and assist them in developing future test methods.

· California often plays a large role in national air quality policy, the state has taken a back seat for stationary wood heaters so far. Their engagement could help.

3. Manufacturers should start to routinely comply with the rule that they send a report with data on suspended tests within the required 60-day period. EPA also needs to enforce this regulation and clarify what those reports should look like. HPBA could take a leadership role in highlighting this regulation for labs and manufacturers.

4. The EPA and/or states should start conducting audit testing of stoves to better understand the application of crib and cordwood test methods.  This would assist all stakeholders to focus on vital issues about lab testing during a time when wood and pellet heating is under public scrutiny as a renewable energy solution.

Wednesday, October 5, 2016

HHT and Ravelli agree to release efficiency for 5 stoves

In response to a Freedom of Information Act request filed by the Alliance for Green Heat, Hearth & Home Technologies (HHT) and Ravelli released actual efficiency numbers for several of their popular pellet stove models.  Efficiencies ranged from 56% to 76%.

Wood and pellet stoves certified after May 2015 must test for and disclose their efficiency to consumers, as required by new EPA regulations. Prior to these regulations, stove manufacturers claimed that any available efficiency data was confidential and they generally did not provide it to consumers.  However, many companies provided the efficiency data to the EPA as part of the certification process. 

The Alliance for Green Heat, based on its legal counsel, argued that the EPA could not keep efficiency data it collected prior to May 2015 confidential because it was based on emission data, and emissions data cannot be confidential.  In July 2015 the EPA declined to release the efficiencies to the Alliance, in keeping with its longstanding practice that they would keep all data confidential if it was submitted as Confidential Business Information (CBI).  

Originally, the Alliance had asked for the weighted average efficiency as well as the efficiency from each of the four burn rates that labs use to test stoves.  The Alliance agreed to drop the request for the individual burn rate efficiencies and only request the average.  Based on that change, HHT and Ravelli agreed to allow the EPA to release their efficiency numbers to the Alliance with some conditions.

The EPA provided a final response with a data sheet (pdf) attached.  The efficiency numbers (HHV based on B415.1) from that data sheet are:

Company        Model                         Efficiency
HHT                Accentra 52i insert    76%
HHT                Mt Vernon E2            75%
HHT                Mt Vernon AE           71%
Ravelli             RV100                       70%
Ravelli             RV80                         56%

The Alliance requested efficiency information for these particular models, along with several others, because we were in the process of independently testing a selection of pellet stoves.  The Alliance was also attempting to convince the EPA to change their policy and disclose all efficiency data, even if that efficiency data had been marked as Confidential Business Information.  The Alliance argued   
The Ravelli RV80 Ceramica
is far cleaner than the original
RV80. The new, improved
efficiency is not yet posted on
the EPA list.
that efficiency was of such basic importance to consumers and that keeping it confidential served no useful purpose. That attempt was unsuccessful.  The Alliance is not appealing.


The five newly released actual efficiency numbers are not included on the EPA’s list of certified stoves, where about 25% of the stoves have actual efficiencies listed.  Except for one of the Ravelli’s, these five stoves all have around average or above average efficiencies.   The Ravelli RV80 was only 56% efficient, but  Ravelli has a updated version of this stove, the RV80 Ceramica, that has much lower grams per hour. (In response to this post, the EPA found that they had mistakenly omitted posting the efficiency of the RV80 Ceramica and said they would post it soon.)  Virtually all stoves claim to be 75% efficient to be eligible for the $300 federal tax credit, and EPA listing or disclosure that reveals the stove is not even 60% efficient does not appear to deter manufacturers from continuing to claim eligibility for the tax credit.   

Note: A representative of Ravelli replied to this blog saying that the RV80 is now out of production.   The Ravelli representative said that the updated RV80 Ceramica has an efficiency "over 75%." We asked Ravelli to support the "over 75%" figure with a lab report.  EPA regulations require companies to post lab report on their website for any stove tested under the 2015 NSPS.  Some companies comply, and others resist this level of transparency.

Friday, July 17, 2015

EPA Declines to Release Efficiency Data on Wood Pellet Stoves

In July 2015, the EPA said it could not release efficiency data on pellet stoves, since manufacturers of the stoves claimed that it was "Confidential Business Information." The EPA is required to disclose emissions, but it does not necessarily consider efficiency close enough to emissions.

Pellet stoves are one of the most popular renewable energy technologies in American homes.  About one million homes use pellet stoves in the United States, yet none of the major stove manufacturers were disclosing the tested efficiency of their products. 

The EPA recently set stricter emission standards for wood and pellet stoves, but did not require the disclosure of efficiencies of stoves currently on the market.

The Alliance for Green Heat filed a Freedom of Information Act (FOIA) request with the EPA on June 3, 2015 urging the agency to release stove emission and efficiency information.  In their response letter, the EPA released detailed emission test results and other data, but issued a partial denial on efficiency information until it contacts manufacturers to see if they agree their efficiency values can be released.  To date, consumers have been left in the dark as to whether they own a 50% efficient stove or an 80% efficient stove.  

The Alliance for Green Heat filed the Freedom of Information Act Request to get more data on the certification test, the moisture content of the pellets used in the test and because of a longstanding problem with stove manufacturers advertising misleading and exaggerated efficiency claims.  The EPA has made efforts to reduce misleading efficiency claims by outdoor boiler manufacturers but not by wood or pellet stove manufacturers.  

In response to the request, the EPA released 42 pages of documents showing how 7 popular North American pellet stoves and 3 European pellet stoves were tested and at which burn rates they are cleanest.  One of the stoves was tested with pellets with only 2.3% moisture content, where most others used pellets with 5 - 7% moisture content.  Most commercially available pellets have 5-8% moisture content.  The EPA declined to provide the brand name of pellets used in testing.

Wood pellets for heating are usually
made from dry sawdust or wood chips
that are specially dried and ground up.
No federal or state agency requires manufacturers to use a common method of reporting stove efficiency in their promotional materials.  Most households use pellet stoves because they can save $500 to more than $2,000 per year instead of oil, propane or electricity.  However, the potential savings fluctuate widely based on the efficiency of the stove.

The EPA said they could not release the efficiency data because companies may consider it a trade secret and commercial or financial information that is exempt from being released by the EPA to the public.  Stove manufacturers claim that their efficiency information, along with almost all other data obtained from the certification testing is “confidential business information.” 

Testing for efficiency has not even been required by the EPA prior to 2015. The initial information released by the EPA indicates that it does have efficiency values for some stoves.

However, the EPA left open the possibility that it might release the efficiency values if the Alliance for Green Heat wants to receive a “final confidentiality determination” that would involve giving manufacturers an opportunity to substantiate their confidentiality claims.  If the EPA informs manufacturers that it agrees that efficiency information should be public, manufacturers would have to challenge the EPA in court to prevent the EPA from releasing that information.

John Ackerly, President of the Alliance for Green Heat said that the organization intends to seek a final determination from the EPA.  “Cars, furnaces and large appliances all have to report their efficiency and energy use to the public and this is a critical part of helping consumers save money and help the environment.  Why should there be a special exemption for pellet stoves?” Ackerly asked. 

“The lack of transparency on efficiency is holding back this sector, as other forms of renewable energy are quickly gaining traction,” Ackerly noted. 

The new EPA wood heater regulations will require manufacturers to disclosure the efficiency of new wood and pellet stoves tested after May 15, 2015.  However, stoves that are already on the market will not need to be tested for another 4-5 years and will not be required to disclose their efficiency until this time.  Many manufacturers obtain efficiency data during their EPA certification tests and include them in their test reports to the EPA, although they do not release them to the public.  The FOIA was an attempt to get the EPA to release this information that it already has in its files.

Pellet stoves have a very wide range of efficiencies and manufacturers may claim that if they released the actual efficiency of their stoves it cold cause substantial harm to their competitive position, which is one of the reasons the EPA withholds business information.

Stove manufacturers are also hesitant to disclose efficiency information to their consumers because if their efficiencies are under 75%, their product would not be eligible for a federal tax credit that has often been retroactively renewed and requires a 75% minimum efficiency.  Since neither Congress, nor the IRS, nor EPA requires any standardized measure of efficiency, stove manufacturers can claim that nearly 100% of stoves on the market are 75% efficient.  If the EPA were to disclose actual efficiencies, it would make it harder for manufacturers to convince consumers that all their stoves were over 75% efficient.

The number of U.S. homes with pellet stoves far outnumber those with residential solar panels by a ratio of about 2:1.  Pellet stoves typically cost $1,100-$3,500, and have a payback period of 3-7 years depending on such factors as the price of the fossil fuel being displaced, the frequency the stove is used – and its efficiency.