date: Wed Mar  3 10:51:07 2004
from: Phil Jones <p.jones@uea.ac.uk>
subject: Re: CET daily data for DOE renewal
to: Andrew Robertson <awr@iri.columbia.edu>

    Andy,
       Attached is the daily CET series from 1772 to 2003. Format should be pretty clear.
    Each year is a block, days down, months along. Units are degC*10 and -999 is missing.
    Missing only occurs on non-existent days in the 12 by 31 matrix for a year.
       I can also send max and min daily temps for 1878-2003. The file  have sent is mean
    daily temps (based from 1878 on the average of max and min). The CET series is
    discussed in Parker et al. (1992) in IJC and is corrected for a slight urban warming
    effect.  For 1772-1973 the monthly average should equal the numbers in Manley (1974).
    I'm hopeful of sometime going back and redoing the whole Manley thing. The HC will
    have a load of daily digitised series for different parts of the UK in the next year or
   so,
    and we'll be able to check what he did - or try and figure out what he might have done.
    Bottom line is that he got it right most of the time, but not always. He has Oxford and
    Cambridge data in at times and Oxford has a slight urban warming bias for some decades
    between 1881 and 1940. No-one knows how Manley did it or what series he used. Just
    documenting it all for posterity would be good !
        If you look at Climatic Change (2002) Vol 53 1-3, you'll see a special issue on the
    EU-funded IMPROVE project.  I can send these daily series - back to late 18th century
    for Padua, Milan, Stockholm, Uppsala, Cadiz, Brussells if you want.  These are temperature
    and MSLP.  All similar format to CET, but some have some real missing data.
       As for rain, there is a long daily series for Armagh (back to 1840) on the Armagh
   Observatory
    web site.  We have some others here but I'm not supposed to pass them on. Also look
    at the European Climate Assessment project on the KNMI web site - daily series
    for Europe from 1901 onwards. Downloading them is a pain - one by one - so go to the
    CRU site, then projects, then STARDEX and get them all in one go with a link. There are
    papers on analyses of these in IJC and J. Climate in the last year or two.
       Don't bother with BADC - it is a pain.
       I'm on a different timetable to you with DoE. I've just heard I'm being renewed. Need
   to send
    a revised budget.
    Cheers
    Phil
      I
   At 17:08 02/03/2004 -0500, you wrote:

     Hi Phil,
     I'm looking for long daily datasets to propose using as part of our DOE renewal
     proposal! The idea is to use probabilistic network modes (HMMs) of the sort we've been
     developing under our previous DOE support, to look at non-stationarity in daily weather
     statistics. (This would NOT be the "terascale" part of our proposal!!)
     Would the daily CET record be available to use? I thought it would be an excellent
     candidate. I started to apply for it, to gauge how much missing data there is. I
     downloaded the BADC form, but got scared by the "Excess Charges" bit right at the end,
     though I guess this is harmless. Should I just sign & return?
     Do you happen to know of any long rainfall datasets?
     cheers, Andy
     .. and good luck with your own proposal, if you're submitting!
     **************************************************************
     Dr. Andrew W. Robertson
     International Research Institute for Climate Prediction (IRI)
     The Earth Institute at Columbia University
     230 Monell Building, 61 Route 9W
     Palisades, NY 10964-8000, USA
     Tel: +1.845.680.4491 Fax: +1.845.680.4865
     awr@iri.columbia.edu  [1]http://iri.columbia.edu/~awr
     **************************************************************

   Prof. Phil Jones
   Climatic Research Unit        Telephone +44 (0) 1603 592090
   School of Environmental Sciences    Fax +44 (0) 1603 507784
   University of East Anglia
   Norwich                          Email    p.jones@uea.ac.uk
   NR4 7TJ
   UK
   ----------------------------------------------------------------------------

