This is a reasonable position, if you are solely concerned about property losses resulting from a flood event (FEMA perspective). Will you allow me to describe a property loss scenario that is not based on a rainfall/flood event? Just as a thought....if the road to the house you described is at elevation 6 and the existing mean sea level is 1.5 with tides rising and falling 2 feet above/below the mean. Is the house still viable if MSL rises to 4 or 4.5 and tides are running up to 6.5/7? ? In that instance the house is high and dry, but the road to the house is inundated a couple of times a day and much longer during king tides. In that case, if the owner tries to sell, will anybody buy it? Will a bank provide a mortgage? Can the owner get it insured? Will FEMA reimburse the owner (not a rain based flood event) for an undamaged house that is not readily accessible? Maybe the local government raises the road...but the driveway and property itself remain at elevation 5 or 6. To me, this scenario is highly realistic and raises some very problematic issues when multiplied by the millions of properties located at low elevation all over the country. Then add in the businesses, the military bases, the landfills, etc. etc. etc.
I am not suggesting we need to be panicking this minute, but I do suggest that we can't just pretend sea level rise (from both land subsidence and water level rise) is not a threat to the long-term economy of our country.