Jump to content
  • Member Statistics

    17,611
    Total Members
    7,904
    Most Online
    NH8550
    Newest Member
    NH8550
    Joined

July 2022


bluewave
 Share

Recommended Posts

5 minutes ago, bluewave said:

While it took some time to find, this paper explains why the MADIS range test that the Gladstone site uses is so flawed. 

http://www.thinkmind.org/articles/geoprocessing_2019_1_10_30010.pdf

Range tests are not perfect. The record high United States temperature would fail MADIS’s range test, although it would pass MesoW- est’s test. Both MADIS and MesoWest further employ a suite of tests that go beyond their simple range tests. “Bud- dy” tests compare an observation to neighboring observa- tions. MADIS uses Optimal Interpolation in conjunction with cross-validation to measure the conformity of an ob- servation to its neighbors [2]. MesoWest estimates observa- tions using multivariate linear regression [5]. A real obser- vation is compared to the estimate, and if the deviation is high, then the real observation is flagged as questionable.
These approaches are flawed in that they do not account for bad metadata, such as incorrect timestamps or incorrect locations. They do not account for chronically bad sites which produce bad data including data that may sometimes appear correct. Of even greater concern, they may not do a good job in assessing accuracy and may be incorrectly la- beling bad data as good and good data as bad.
The consequences of ignoring data quality are great. How can we trust our applications and models if the inputs are bad? In turn, how can we better assess data for quality so that we can be confident in its use?
In this paper, we present new evaluation results for our previously-published method including evaluation with several new data sets. These results are significant in that they demonstrate the challenges of evaluation of methods for data quality assessment of spatio-temporal weather sen- sor data. The rest of this paper is organized as follows: Sec- tion II presents relevant literature, Section III identifies general challenges, Section IV defines our approach,

 

I've always thought that the gladestone quality checking isn't really correct/ done the best in some occasions.  For example,  my nearest is usually the station at Grabreski , which temps etc can vary fairly drastically at times versus mine.  

Link to comment
Share on other sites

On 7/11/2022 at 6:44 AM, the_other_guy said:

But isnt it noteworthy that this summer:

-Is fairly normal temp wise

-Has low humidity

-Has cool overnight temps?

If the Abnormal Extreme has become expected, isnt its absence noteworthy? 

Im certainly talking about it thus far!

65F this morning in Westchester.

The summer of yesteryear continues…:)

 

 

:wub:

  • Haha 1
Link to comment
Share on other sites

11AM 

EWR: 93
ACY: 93
BLM: 92
ISP: 92
New Brnswck:  92
TTN: 91
PHL: 91
JFK: 90
TEB: 90
LGA: 90

 

vs Yesterday Saturday

11 AM Bakeoff

ACY: 93
BLM: 92
JFK: 92
EWR: 92
PHL: 92
New Brnswck: 91
TTN: 90
TEB: 90
LGA: 89
ISP: 88
NYC: 86

Link to comment
Share on other sites

Noon Round up

Becoming mostly sunny now after some high thin clouds were providing a it of a filter

EWR: 95
New Brnswck: 95
ACY: 95
BLM: 94
TTN: 93
JFK: 93
PHL: 93
LGA: 93
ISP: 92
NYC: 91
TEB: 90

 

vs Yesterday at noon

Hot High Noon 

 

New Brnswck: 95
ACY: 94
EWR: 94
PHL: 94
JFK: 93
BLM: 93
NYC:  89
TEB: 92
TTN: 92
ISP: 91
LGA: 90

  • Thanks 1
Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share

  • Recently Browsing   0 members

    • No registered users viewing this page.
×
×
  • Create New...