The Short Answer

Hard water contains dissolved calcium and magnesium that slowly deposit as scale inside your water heater. Over time, that scale insulates the heat source from the water, forces the unit to run longer and hotter, wears out heating elements and burner components faster, and can cut your water heater's lifespan nearly in half. About 85% of US homes have hard water to some degree, and most homeowners don't realize it's happening until something breaks.

The good news: it's manageable. Regular flushing, anode rod maintenance, and (for severely hard water) a softener or scale inhibitor can protect your unit and keep it running efficiently for its full service life.

What Is Hard Water?

Water hardness measures the concentration of dissolved minerals, primarily calcium carbonate and magnesium, picked up as groundwater passes through rock and soil. It's measured in grains per gallon (GPG) or milligrams per liter (mg/L):

Soft: 0–3.5 GPG (0–60 mg/L)
Moderately hard: 3.5–7 GPG (60–120 mg/L)
Hard: 7–10.5 GPG (120–180 mg/L)
Very hard: Over 10.5 GPG (180+ mg/L)

Hard water is most prevalent in the Midwest, Southwest, and Mountain West, where limestone geology is common. The Pacific Northwest and New England tend to have softer water. The US Geological Survey has mapped hardness data by region; your local water utility is required to publish annual water quality reports that include hardness levels.

Soft water isn't automatically problem-free for water heaters; it's actually more corrosive to metal, which affects anode rod consumption. But the scale damage from hard water is far more common and typically more severe.

How Hard Water Damages Your Water Heater

Scale Buildup in Tank Water Heaters

When hard water is heated, dissolved minerals precipitate out of solution and deposit as a hard, chalky layer called limescale on whatever surface the water touches. In a tank water heater, that means the bottom of the tank and the heating surfaces.

In a gas water heater, scale accumulates on the tank floor, directly above the burner. That inch or two of mineral crust acts as an insulating layer between the flame and the water. The burner has to work harder and longer to heat the same amount of water, increasing gas consumption and heat stress on the tank bottom. This is what causes the popping and rumbling sounds many homeowners notice as their water heater ages. Water trapped beneath the scale layer superheats and forces its way through.

In an electric water heater, the lower heating element sits in direct contact with the water. Scale coats the element itself, insulating it from the water it's supposed to heat. The element overheats trying to compensate, which dramatically accelerates element failure. A water heater in very hard water may need element replacement every 2–3 years instead of every 8–10.

What Hard Water Does to Tankless Water Heaters

Tankless units are more vulnerable to hard water than tank heaters, not less. Here's why: a tank heater has a large surface area where scale can spread out. A tankless unit pushes water through a compact heat exchanger with small-diameter passages. Scale narrows those passages quickly, restricting flow, cutting heating capacity, and eventually blocking sections of the exchanger entirely.

A tankless water heater in moderately hard water without descaling maintenance can fail in as few as 5–7 years, well short of its 15–20 year potential lifespan. Most manufacturers require annual descaling to maintain warranty coverage. If you're considering a tankless unit and you have hard water, read our guide on tankless water heater pros and cons. Hard water maintenance requirements are one of the genuine drawbacks to weigh.

What Hard Water Does to the Anode Rod

The anode rod is a sacrificial magnesium or aluminum rod that corrodes in place of the tank lining, protecting the steel tank from rusting out. In hard water, the rod depletes faster for two reasons: the higher mineral content is more chemically active, and scale coating the rod can interfere with its protective function. A rod that should last 4–6 years may need replacement in 2–3 in very hard water.

Once the anode rod is fully depleted, the tank wall has no protection. The tank starts corroding from the inside, and once that process is underway, there's no fix. The tank needs replacement.

The Efficiency Cost

The US Department of Energy estimates that just ¼ inch of scale on a water heater's heating surface can increase energy consumption by 40%. At 1 inch of scale (not unusual in hard water areas with no maintenance), you're burning significantly more fuel or electricity to get the same amount of hot water. Hard water turns an energy-efficient appliance into an inefficient one gradually, so the change is easy to miss until you compare utility bills year over year.

Signs You Have a Hard Water Problem in Your Water Heater

Your water heater will usually tell you something is wrong before it fails, if you know what to listen and look for:

Popping, rumbling, or knocking sounds during heating cycles: the classic sign of sediment buildup on a gas unit's tank floor
Hot water runs out faster than it used to: scale reduces the effective capacity of your tank and forces the heater to work harder
Higher energy bills without a change in usage patterns
White or yellowish crusty deposits around the pressure relief valve, pipe connections, or drain valve
Discolored water: scale can break loose in chunks and mix with the water supply
Water heater runs constantly: the unit can't reach temperature efficiently and keeps cycling

For a full checklist of sediment warning signs, see our article on water heater sediment buildup signs.

How to Check Your Water Hardness

You have a few options, from free to definitive:

Your water utility's annual report: Required by law to be published each year; search "[your city] water quality report" or look on your utility's website. It will include hardness in GPG or mg/L.
Home test strip kit: Available at hardware stores for $10–20. Dip a strip in a glass of tap water and compare colors to the chart. Fast and accurate enough for practical purposes.
Lab test: For well water especially, a full water test through a certified lab ($30–100) gives precise mineral content and identifies other issues like iron or pH that interact with water heater performance.
Informal signs: If soap doesn't lather well, you see white film on dishes and faucets, or your shower tiles have a persistent crusty residue. You almost certainly have hard water, no testing needed.

4 Ways to Protect Your Water Heater from Hard Water

1. Flush the Tank Regularly

Flushing your water heater drains accumulated sediment from the bottom of the tank before it hardens into scale. In areas with moderate hard water, annual flushing is sufficient. In hard or very hard water areas, flushing every 6 months makes a meaningful difference.

Flushing is straightforward: connect a garden hose to the drain valve, open it, and let the tank empty completely. Our step-by-step guide on how often to flush a water heater covers the full procedure including what to do if the drain valve is stuck or corroded. See also our complete guide on how to drain a water heater.

Important caveat: if your water heater is more than 10 years old and hasn't been flushed in years, flushing can occasionally disturb scale that was keeping a corroded drain valve sealed. On a very old unit, the safer call may be replacement, not flushing.

2. Inspect and Replace the Anode Rod More Frequently

In hard water areas, check your anode rod every 2–3 years instead of the standard 4–5. If the rod is less than half an inch thick or heavily coated in white calcium deposits, replace it. A new rod costs $20–40 and the swap takes about 30 minutes. Far cheaper than a new tank.

Some homeowners in very hard water areas switch to a magnesium anode rod with a zinc core, which also helps control the sulfur smell (rotten egg odor) that hard water can cause in water heaters. See our related article on water heater rotten egg smells if that's also a problem.

3. Install a Water Softener

An ion-exchange water softener is the most effective long-term solution for hard water. It replaces calcium and magnesium ions with sodium (salt-based) or potassium ions, producing water that doesn't form scale.

The trade-off: softened water is slightly more corrosive to metal, meaning it'll consume your anode rod faster. You still need to maintain the anode rod after installing a softener, just for a different reason. Some manufacturers also slightly reduce warranty coverage for water heaters used with softened water; check your manual.

Salt-free "water conditioners" are marketed as an alternative. These don't technically soften the water; they alter the form of the minerals so they're less likely to adhere to surfaces. Independent testing on their effectiveness is mixed, but some homeowners in moderately hard water areas report good results as a lower-maintenance option.

4. Use a Scale-Inhibiting Pre-Filter (Especially for Tankless Units)

A polyphosphate or template-assisted crystallization (TAC) cartridge filter installed on the cold water inlet keeps minerals suspended in solution rather than letting them precipitate as scale. These filters are especially effective for tankless water heaters, where protecting the heat exchanger is critical.

Cartridges cost $20–50 and need replacement every 6–12 months depending on water hardness and flow volume. It's a modest ongoing cost compared to heat exchanger replacement ($300–600).

Descaling: How to Remove Buildup That's Already There

If scale has already accumulated, flushing alone won't remove it. Descaling uses a mild acid solution to dissolve mineral deposits.

Tank Water Heaters

For moderate scale buildup, a white vinegar flush is a reasonable DIY approach:

Turn off the gas or power to the unit.
Shut off the cold water supply.
Connect a hose to the drain valve and drain the tank completely.
Disconnect the cold water inlet line at the top of the unit.
Use a funnel to pour 3–4 gallons of undiluted white vinegar into the tank through the inlet.
Let it sit for 6 hours (overnight is fine).
Reconnect the inlet, open the cold supply, and let the tank fill while the drain valve is still open; this flushes the dissolved scale out through the drain.
Close the drain valve, let the tank fill completely, then run hot water at a faucet until it flows clear.

For heavy scale (the rumbling, popping kind), professional descaling with citric acid solution or a commercial descaler may be more effective. A plumber can also assess whether the scale has caused damage that warrants replacement rather than cleaning.

Tankless Water Heaters

Descaling a tankless unit requires a submersible pump, a bucket, hoses, and a food-grade descaling solution (citric acid-based products like Rydlyme or CLR are common). The process circulates the solution through the heat exchanger for 45–90 minutes, dissolving scale from the inside out.

Most manufacturers publish the descaling procedure in their installation manual. It's also a service most plumbers offer, typically running $100–200 and taking about an hour. In hard water areas, annual descaling is the single most important maintenance step for a tankless unit.

When the Damage Is Too Far Gone

Some signs point to hard water damage that's beyond what maintenance can reverse:

The tank is leaking. Scale can pit through the tank wall over time, and once it does, the tank can't be repaired.
Water is consistently discolored or rusty, a sign the interior has started corroding
The unit has lost significant heating capacity and professional descaling hasn't helped
The drain valve is seized and the unit has never been flushed. In older units, sediment hardens to the point where disturbing it can crack the valve or fitting.

If any of these apply, use our repair-or-replace guide to decide your next step, and review typical water heater lifespans by type to set your expectations. Hard water can cut a tank heater's expected 10–12 year lifespan to 6–8 years without maintenance, and extend it to 15+ years with consistent care.

How Old Is Your Water Heater?

Hard water damage is cumulative. A unit that's been sitting in hard water for 8 years without a flush is in far worse shape than a 3-year-old unit. Age is one of the most important factors in the repair-vs.-replace decision, and it's also the hardest number to know if you didn't install the unit yourself.

The manufacture date is buried in the serial number, but the format varies by brand and isn't designed to be human-readable. Use our free Water Heater Age Checker to decode it instantly. Enter your brand and serial number and we'll tell you exactly when your unit was made.

Hard Water and Your Water Heater: Effects, Prevention, and Fixes