date: Tue, 20 Feb 2007 10:30:56 +0000
from: jen.hardwick@metoffice.gov.uk
subject: Re: HadCRUT
to: Phil Jones <p.jones@uea.ac.uk>

Hello Phil,

We have already archived January data. Dave Croxall is still adding in
more historical data and a few more stations for December 2006, so I
suspect the update will be done at the end of March.

I haven't seen ClimateAudit before ; there is a lot about HadCRUT3
there. It seems very like other climate message boards though in that it
is more of a blog space for the user's particular issues rather than a
open discussion forum. It does need a 'good' troll to direct readers to
paper.

Jen

On Tue, 2007-02-20 at 09:08 +0000, Phil Jones wrote:
>   Jen,
>      I assume this means that you'll use the file I sent when you do
>   January updates?  Let me know when done and I'll collect files
>   next week.
> 
>      FYI - there is a lot on the Climate Audit site. 
> http://www.climateaudit.org/
> 
>    This stems from work at NCDC where they have made some mods to
>   US HCN and also according to Tom Peterson to their global and
>   hemispheric data as well - partly with adjustments to marine data to 
> account for
>   the greater numbers of buoy obs now. Tom says they have papers
>   nearly complete and ready to go - as I would expect. I'm just surprised
>   they would results on the web site before they have been reviewed.
> 
>     If only these people would just read the papers - especially Brohan et al.,
>   rather than assume what we've done. One blogger (called Lee) tried to
>   defend us but even he began to misinterpret later.
> 
>   Cheers
>   Phil
> 
> 
>   Cheers
>   Phil
> 
> 
> At 08:50 20/02/2007, jen.hardwick@metoffice.gov.uk wrote:
> >Hello all,
> >
> >Phil is right the code can handle extracting early data. I suggest that
> >we do it as part of a complete monthly run through. When Dave fills in
> >the last historical gap, we update the CRUTEM3, then the HadCRUT3 series
> >with the early data and the anders file at the end of the month; when we
> >would usually do the update. We can archive all data prior to that point
> >and check the new monthly data files to see how the data has changed. I
> >suspect that there may only be some regional differences, but we may
> >need to put out a note on the webpages to let users know,
> >
> >
> >
> >Cheers
> >Jen
> >
> >
> >On Fri, 2007-02-16 at 09:02 +0000, Phil Jones wrote:
> > >   Mark,
> > >     It should be possible to rerun the software for the last
> > >   few months even couple of years. As I understand it Philip
> > >   set up the system to run the whole lot so if some
> > >   files are updated then you'll get any extra data included.
> > >    If you're going to do this, then here's the update of the
> > >   file called the 'anders' file for the period from 1991 onwards.
> > >
> > >     I updated this file with all MCDW data we have through Nov06, the
> > >   CLIMAT through Dec06. This also has all the additional and
> > >   altered data for Australian and NZ stations and all the manual updates
> > >   for Antarctic stations. On the latter, I've just added a few more for
> > >   some of the Antarctic sites from the BAS web site.
> > >
> > >      The file has a line of missing data for 2007, but the South Pole
> > >   value is there as that has already come through.
> > >
> > >   Cheers
> > >   Phil
> > >
> > >
> > > At 08:25 16/02/2007, mark.mccarthy@metoffice.gov.uk wrote:
> > > >Actually Dave has been looking at data gaps much earlier than the 2-3
> > > >month lag of MCDW, which we also routinely add. He has been getting data
> > > >from a number of sources (e.g. Maldives paper reports from our own
> > > >library). This does not affect the routine CLIMAT messages files, but
> > > >supplements our decoded database. My question was whether it would be
> > > >possible to re-run the HadCRUT software to include new data for the last
> > > >X years (Dave can advise on how far back this should go).
> > > >
> > > >Cheers,
> > > >Mark
> > > >
> > > >On Thu, 2007-02-15 at 18:02 +0000, Phil Jones wrote:
> > > > >   Mark,
> > > > >     Point taken. We are adding in MCDW data - with a 2-3 month lag 
> > time -
> > > > >   so this will pick up most of the back data issues.
> > > > >     However, will the file with the uncoded monthly CLIMAT
> > > > >   messages still be produced? And will the software that runs
> > > > >   HadCRUT3 and CRUTEM3 still run at your end each month?
> > > > >
> > > > >   Cheers
> > > > >   Phil
> > > > >
> > > > >
> > > > > At 11:11 15/02/2007, mark.mccarthy@metoffice.gov.uk wrote:
> > > > > >Jen, Phil,
> > > > > >
> > > > > >   Over the last few years Dave Croxall has been actively filling 
> > in gaps
> > > > > >in the historical CLIMAT archive. He is reaching the end of this work.
> > > > > >Therefore, once Dave has finished, it might be an opportune moment to
> > > > > >reprocess the HadCRUT dataset to bring in these additional data.
> > > > > >
> > > > > >Cheers,
> > > > > >Mark
> > > > > >
> > > > > >
> > > > > >--
> > > > > >Mark McCarthy   Climate Research Scientist
> > > > > >Met Office   Hadley Centre   Fitzroy Road   Exeter   EX1 3PB
> > > > > >Tel: +44 (0)1392 884672   Fax: +44 (0)1392 885681
> > > > > >Email: mark.mccarthy@metoffice.gov.uk   http://www.metoffice.gov.uk
> > > > > >For Hadley Centre climate data visit http://www.hadobs.org
> > > > >
> > > > > Prof. Phil Jones
> > > > > Climatic Research Unit        Telephone +44 (0) 1603 592090
> > > > > School of Environmental Sciences    Fax +44 (0) 1603 507784
> > > > > University of East Anglia
> > > > > Norwich                          Email    p.jones@uea.ac.uk
> > > > > NR4 7TJ
> > > > > UK
> > > > >
> > > > 
> > ----------------------------------------------------------------------------
> > > >
> > > >--
> > > >Mark McCarthy   Climate Research Scientist
> > > >Met Office   Hadley Centre   Fitzroy Road   Exeter   EX1 3PB
> > > >Tel: +44 (0)1392 884672   Fax: +44 (0)1392 885681
> > > >Email: mark.mccarthy@metoffice.gov.uk   http://www.metoffice.gov.uk
> > > >For Hadley Centre climate data visit http://www.hadobs.org
> > >
> > > Prof. Phil Jones
> > > Climatic Research Unit        Telephone +44 (0) 1603 592090
> > > School of Environmental Sciences    Fax +44 (0) 1603 507784
> > > University of East Anglia
> > > Norwich                          Email    p.jones@uea.ac.uk
> > > NR4 7TJ
> > > UK
> > > 
> > ---------------------------------------------------------------------------- 
> >
> >--
> >Jen Hardwick,  Climate Information Scientist
> >Met Office   Hadley Centre for Climate Prediction and Research
> >Hours: Tuesday, Wednesday and Thursday Morning
> >Tel: +44 (0)1392 884288    Fax: +44 (0)1392 885681
> >jen.hardwick@metoffice.gov.uk  http://www.metoffice.gov.uk
> >Data available from http://www.hadobs.org
> 
> Prof. Phil Jones
> Climatic Research Unit        Telephone +44 (0) 1603 592090
> School of Environmental Sciences    Fax +44 (0) 1603 507784
> University of East Anglia
> Norwich                          Email    p.jones@uea.ac.uk
> NR4 7TJ
> UK 
> ----------------------------------------------------------------------------                                                                                 
-- 
Jen Hardwick,  Climate Information Scientist
Met Office   Hadley Centre for Climate Prediction and Research      
Hours: Tuesday, Wednesday and Thursday Morning
Tel: +44 (0)1392 884288    Fax: +44 (0)1392 885681
jen.hardwick@metoffice.gov.uk  http://www.metoffice.gov.uk 
Data available from http://www.hadobs.org
