Task 11585253

Name	hadam3p_musi_1990_2_006141740_6
Workunit	6407797
Created	21 Jun 2010, 20:21:20 UTC
Sent	21 Jun 2010, 20:59:47 UTC
Report deadline	4 Jun 2011, 2:19:47 UTC
Received	29 Sep 2010, 17:24:14 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	972343
Run time	15 days 14 hours 8 min 7 sec
CPU time	12 days 4 hours 48 min 35 sec
Validate state	Workunit error - check skipped
Credit	2,081.77
Device peak FLOPS	2.01 GFLOPS
Application version	UK Met Office HADAM3P v6.14 windows_intelx86
Stderr	<core_client_version>6.10.56</core_client_version> <![CDATA[ <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: Signal 11 received, exiting... 15:40:58 (3144): called boinc_finish CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=664, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 09:22:51 (3488): No heartbeat from core client for 30 sec - exiting 09:22:52 (3488): No heartbeat from core client for 30 sec - exiting 09:22:53 (3488): No heartbeat from core client for 30 sec - exiting 09:22:54 (3488): No heartbeat from core client for 30 sec - exiting 09:22:55 (3488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:22:56 (3488): No heartbeat from core client for 30 sec - exiting 09:22:57 (3488): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: Signal 11 received, exiting... 16:36:44 (3100): called boinc_finish CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2088, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:44:56 (684): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 23:11:01 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:11:03 (3604): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: Signal 11 received, exiting... 21:42:07 (1456): called boinc_finish CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2056, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: C I/O Error feof - Unit 62 - Return code = 16 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 Already a netcdf file. Skip conversion dataout/musima.paj0dec.nc Already a netcdf file. Skip conversion dataout/musima.paj1apr.nc Already a netcdf file. Skip conversion dataout/musima.paj1aug.nc Already a netcdf file. Skip conversion dataout/musima.paj1dec.nc Already a netcdf file. Skip conversion dataout/musima.paj1feb.nc Already a netcdf file. Skip conversion dataout/musima.paj1jan.nc Already a netcdf file. Skip conversion dataout/musima.paj1jul.nc Already a netcdf file. Skip conversion dataout/musima.paj1jun.nc Already a netcdf file. Skip conversion dataout/musima.paj1mar.nc Already a netcdf file. Skip conversion dataout/musima.paj1may.nc Already a netcdf file. Skip conversion dataout/musima.paj1nov.nc Already a netcdf file. Skip conversion dataout/musima.paj1oct.nc Already a netcdf file. Skip conversion dataout/musima.paj1sep.nc Already a netcdf file. Skip conversion dataout/musima.paj2apr.nc Already a netcdf file. Skip conversion dataout/musima.paj2aug.nc Already a netcdf file. Skip conversion dataout/musima.paj2dec.nc Already a netcdf file. Skip conversion dataout/musima.paj2feb.nc Already a netcdf file. Skip conversion dataout/musima.paj2jan.nc Already a netcdf file. Skip conversion dataout/musima.paj2jul.nc Already a netcdf file. Skip conversion dataout/musima.paj2jun.nc Already a netcdf file. Skip conversion dataout/musima.paj2mar.nc Already a netcdf file. Skip conversion dataout/musima.paj2may.nc Already a netcdf file. Skip conversion dataout/musima.paj2nov.nc Already a netcdf file. Skip conversion dataout/musima.paj2oct.nc Already a netcdf file. Skip conversion dataout/musima.paj2sep.nc Already a netcdf file. Skip conversion dataout/musima.pbj0dec.nc Already a netcdf file. Skip conversion dataout/musima.pbj1apr.nc Already a netcdf file. Skip conversion dataout/musima.pbj1aug.nc Already a netcdf file. Skip conversion dataout/musima.pbj1dec.nc Already a netcdf file. Skip conversion dataout/musima.pbj1feb.nc Already a netcdf file. Skip conversion dataout/musima.pbj1jan.nc Already a netcdf file. Skip conversion dataout/musima.pbj1jul.nc Already a netcdf file. Skip conversion dataout/musima.pbj1jun.nc Already a netcdf file. Skip conversion dataout/musima.pbj1mar.nc Already a netcdf file. Skip conversion dataout/musima.pbj1may.nc Already a netcdf file. Skip conversion dataout/musima.pbj1nov.nc Already a netcdf file. Skip conversion dataout/musima.pbj1oct.nc Already a netcdf file. Skip conversion dataout/musima.pbj1sep.nc Already a netcdf file. Skip conversion dataout/musima.pbj2apr.nc Already a netcdf file. Skip conversion dataout/musima.pbj2aug.nc Already a netcdf file. Skip conversion dataout/musima.pbj2dec.nc Already a netcdf file. Skip conversion dataout/musima.pbj2feb.nc Already a netcdf file. Skip conversion dataout/musima.pbj2jan.nc Already a netcdf file. Skip conversion dataout/musima.pbj2jul.nc Already a netcdf file. Skip conversion dataout/musima.pbj2jun.nc Already a netcdf file. Skip conversion dataout/musima.pbj2mar.nc Already a netcdf file. Skip conversion dataout/musima.pbj2may.nc Already a netcdf file. Skip conversion dataout/musima.pbj2nov.nc Already a netcdf file. Skip conversion dataout/musima.pbj2oct.nc Already a netcdf file. Skip conversion dataout/musima.pbj2sep.nc Already a netcdf file. Skip conversion dataout/musima.pcj0dec.nc Already a netcdf file. Skip conversion dataout/musima.pcj1apr.nc Already a netcdf file. Skip conversion dataout/musima.pcj1aug.nc Already a netcdf file. Skip conversion dataout/musima.pcj1dec.nc Already a netcdf file. Skip conversion dataout/musima.pcj1feb.nc Already a netcdf file. Skip conversion dataout/musima.pcj1jan.nc Already a netcdf file. Skip conversion dataout/musima.pcj1jul.nc Already a netcdf file. Skip conversion dataout/musima.pcj1jun.nc Already a netcdf file. Skip conversion dataout/musima.pcj1mar.nc Already a netcdf file. Skip conversion dataout/musima.pcj1may.nc Already a netcdf file. Skip conversion dataout/musima.pcj1nov.nc Already a netcdf file. Skip conversion dataout/musima.pcj1oct.nc Already a netcdf file. Skip conversion dataout/musima.pcj1sep.nc Already a netcdf file. Skip conversion dataout/musima.pcj2apr.nc Already a netcdf file. Skip conversion dataout/musima.pcj2aug.nc Already a netcdf file. Skip conversion dataout/musima.pcj2dec.nc Already a netcdf file. Skip conversion dataout/musima.pcj2feb.nc Already a netcdf file. Skip conversion dataout/musima.pcj2jan.nc Already a netcdf file. Skip conversion dataout/musima.pcj2jul.nc Already a netcdf file. Skip conversion dataout/musima.pcj2jun.nc Already a netcdf file. Skip conversion dataout/musima.pcj2mar.nc Already a netcdf file. Skip conversion dataout/musima.pcj2may.nc Already a netcdf file. Skip conversion dataout/musima.pcj2nov.nc Already a netcdf file. Skip conversion dataout/musima.pcj2oct.nc Already a netcdf file. Skip conversion dataout/musima.pcj2sep.nc Already a netcdf file. Skip conversion dataout/musima.pdj3121.nc BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: C I/O Error feof - Unit 62 - Return code = 16 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 Already a netcdf file. Skip conversion dataout/musima.paj0dec.nc Already a netcdf file. Skip conversion dataout/musima.paj1apr.nc Already a netcdf file. Skip conversion dataout/musima.paj1aug.nc Already a netcdf file. Skip conversion dataout/musima.paj1dec.nc Already a netcdf file. Skip conversion dataout/musima.paj1feb.nc Already a netcdf file. Skip conversion dataout/musima.paj1jan.nc Already a netcdf file. Skip conversion dataout/musima.paj1jul.nc Already a netcdf file. Skip conversion dataout/musima.paj1jun.nc Already a netcdf file. Skip conversion dataout/musima.paj1mar.nc Already a netcdf file. Skip conversion dataout/musima.paj1may.nc Already a netcdf file. Skip conversion dataout/musima.paj1nov.nc Already a netcdf file. Skip conversion dataout/musima.paj1oct.nc Already a netcdf file. Skip conversion dataout/musima.paj1sep.nc Already a netcdf file. Skip conversion dataout/musima.paj2apr.nc Already a netcdf file. Skip conversion dataout/musima.paj2aug.nc Already a netcdf file. Skip conversion dataout/musima.paj2dec.nc Already a netcdf file. Skip conversion dataout/musima.paj2feb.nc Already a netcdf file. Skip conversion dataout/musima.paj2jan.nc Already a netcdf file. Skip conversion dataout/musima.paj2jul.nc Already a netcdf file. Skip conversion dataout/musima.paj2jun.nc Already a netcdf file. Skip conversion dataout/musima.paj2mar.nc Already a netcdf file. Skip conversion dataout/musima.paj2may.nc Already a netcdf file. Skip conversion dataout/musima.paj2nov.nc Already a netcdf file. Skip conversion dataout/musima.paj2oct.nc Already a netcdf file. Skip conversion dataout/musima.paj2sep.nc Already a netcdf file. Skip conversion dataout/musima.pbj0dec.nc Already a netcdf file. Skip conversion dataout/musima.pbj1apr.nc Already a netcdf file. Skip conversion dataout/musima.pbj1aug.nc Already a netcdf file. Skip conversion dataout/musima.pbj1dec.nc Already a netcdf file. Skip conversion dataout/musima.pbj1feb.nc Already a netcdf file. Skip conversion dataout/musima.pbj1jan.nc Already a netcdf file. Skip conversion dataout/musima.pbj1jul.nc Already a netcdf file. Skip conversion dataout/musima.pbj1jun.nc Already a netcdf file. Skip conversion dataout/musima.pbj1mar.nc Already a netcdf file. Skip conversion dataout/musima.pbj1may.nc Already a netcdf file. Skip conversion dataout/musima.pbj1nov.nc Already a netcdf file. Skip conversion dataout/musima.pbj1oct.nc Already a netcdf file. Skip conversion dataout/musima.pbj1sep.nc Already a netcdf file. Skip conversion dataout/musima.pbj2apr.nc Already a netcdf file. Skip conversion dataout/musima.pbj2aug.nc Already a netcdf file. Skip conversion dataout/musima.pbj2dec.nc Already a netcdf file. Skip conversion dataout/musima.pbj2feb.nc Already a netcdf file. Skip conversion dataout/musima.pbj2jan.nc Already a netcdf file. Skip conversion dataout/musima.pbj2jul.nc Already a netcdf file. Skip conversion dataout/musima.pbj2jun.nc Already a netcdf file. Skip conversion dataout/musima.pbj2mar.nc Already a netcdf file. Skip conversion dataout/musima.pbj2may.nc Already a netcdf file. Skip conversion dataout/musima.pbj2nov.nc Already a netcdf file. Skip conversion dataout/musima.pbj2oct.nc Already a netcdf file. Skip conversion dataout/musima.pbj2sep.nc Already a netcdf file. Skip conversion dataout/musima.pcj0dec.nc Already a netcdf file. Skip conversion dataout/musima.pcj1apr.nc Already a netcdf file. Skip conversion dataout/musima.pcj1aug.nc Already a netcdf file. Skip conversion dataout/musima.pcj1dec.nc Already a netcdf file. Skip conversion dataout/musima.pcj1feb.nc Already a netcdf file. Skip conversion dataout/musima.pcj1jan.nc Already a netcdf file. Skip conversion dataout/musima.pcj1jul.nc Already a netcdf file. Skip conversion dataout/musima.pcj1jun.nc Already a netcdf file. Skip conversion dataout/musima.pcj1mar.nc Already a netcdf file. Skip conversion dataout/musima.pcj1may.nc Already a netcdf file. Skip conversion dataout/musima.pcj1nov.nc Already a netcdf file. Skip conversion dataout/musima.pcj1oct.nc Already a netcdf file. Skip conversion dataout/musima.pcj1sep.nc Already a netcdf file. Skip conversion dataout/musima.pcj2apr.nc Already a netcdf file. Skip conversion dataout/musima.pcj2aug.nc Already a netcdf file. Skip conversion dataout/musima.pcj2dec.nc Already a netcdf file. Skip conversion dataout/musima.pcj2feb.nc Already a netcdf file. Skip conversion dataout/musima.pcj2jan.nc Already a netcdf file. Skip conversion dataout/musima.pcj2jul.nc Already a netcdf file. Skip conversion dataout/musima.pcj2jun.nc Already a netcdf file. Skip conversion dataout/musima.pcj2mar.nc Already a netcdf file. Skip conversion dataout/musima.pcj2may.nc Already a netcdf file. Skip conversion dataout/musima.pcj2nov.nc Already a netcdf file. Skip conversion dataout/musima.pcj2oct.nc Already a netcdf file. Skip conversion dataout/musima.pcj2sep.nc Already a netcdf file. Skip conversion dataout/musima.pdj3121.nc BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: C I/O Error feof - Unit 62 - Return code = 16 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: Signal 11 received, exiting... 09:40:49 (468): called boinc_finish CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3508, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN process is not running, exiting, bRetVal = 1, checkPID=3672, selfPID=3672, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: Signal 11 received, exiting... 08:45:16 (464): called boinc_finish CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3104, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 13:02:45 (1116): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CNo Process Handle CPDN process is not running, exiting, bRetVal = 1, checkPID=1148, selfPID=1148, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Already a netcdf file. Skip conversion dataout/musima.paj0dec.nc Already a netcdf file. Skip conversion dataout/musima.paj1apr.nc Already a netcdf file. Skip conversion dataout/musima.paj1aug.nc Already a netcdf file. Skip conversion dataout/musima.paj1dec.nc Already a netcdf file. Skip conversion dataout/musima.paj1feb.nc Already a netcdf file. Skip conversion dataout/musima.paj1jan.nc Already a netcdf file. Skip conversion dataout/musima.paj1jul.nc Already a netcdf file. Skip conversion dataout/musima.paj1jun.nc Already a netcdf file. Skip conversion dataout/musima.paj1mar.nc Already a netcdf file. Skip conversion dataout/musima.paj1may.nc Already a netcdf file. Skip conversion dataout/musima.paj1nov.nc Already a netcdf file. Skip conversion dataout/musima.paj1oct.nc Already a netcdf file. Skip conversion dataout/musima.paj1sep.nc Already a netcdf file. Skip conversion dataout/musima.paj2apr.nc Already a netcdf file. Skip conversion dataout/musima.paj2aug.nc Already a netcdf file. Skip conversion dataout/musima.paj2dec.nc Already a netcdf file. Skip conversion dataout/musima.paj2feb.nc Already a netcdf file. Skip conversion dataout/musima.paj2jan.nc Already a netcdf file. Skip conversion dataout/musima.paj2jul.nc Already a netcdf file. Skip conversion dataout/musima.paj2jun.nc Already a netcdf file. Skip conversion dataout/musima.paj2mar.nc Already a netcdf file. Skip conversion dataout/musima.paj2may.nc Already a netcdf file. Skip conversion dataout/musima.paj2nov.nc Already a netcdf file. Skip conversion dataout/musima.paj2oct.nc Already a netcdf file. Skip conversion dataout/musima.paj2sep.nc Already a netcdf file. Skip conversion dataout/musima.pbj0dec.nc Already a netcdf file. Skip conversion dataout/musima.pbj1apr.nc Already a netcdf file. Skip conversion dataout/musima.pbj1aug.nc Already a netcdf file. Skip conversion dataout/musima.pbj1dec.nc Already a netcdf file. Skip conversion dataout/musima.pbj1feb.nc Already a netcdf file. Skip conversion dataout/musima.pbj1jan.nc Already a netcdf file. Skip conversion dataout/musima.pbj1jul.nc Already a netcdf file. Skip conversion dataout/musima.pbj1jun.nc Already a netcdf file. Skip conversion dataout/musima.pbj1mar.nc Already a netcdf file. Skip conversion dataout/musima.pbj1may.nc Already a netcdf file. Skip conversion dataout/musima.pbj1nov.nc Already a netcdf file. Skip conversion dataout/musima.pbj1oct.nc Already a netcdf file. Skip conversion dataout/musima.pbj1sep.nc Already a netcdf file. Skip conversion dataout/musima.pbj2apr.nc Already a netcdf file. Skip conversion dataout/musima.pbj2aug.nc Already a netcdf file. Skip conversion dataout/musima.pbj2dec.nc Already a netcdf file. Skip conversion dataout/musima.pbj2feb.nc Already a netcdf file. Skip conversion dataout/musima.pbj2jan.nc Already a netcdf file. Skip conversion dataout/musima.pbj2jul.nc Already a netcdf file. Skip conversion dataout/musima.pbj2jun.nc Already a netcdf file. Skip conversion dataout/musima.pbj2mar.nc Already a netcdf file. Skip conversion dataout/musima.pbj2may.nc Already a netcdf file. Skip conversion dataout/musima.pbj2nov.nc Already a netcdf file. Skip conversion dataout/musima.pbj2oct.nc Already a netcdf file. Skip conversion dataout/musima.pbj2sep.nc Already a netcdf file. Skip conversion dataout/musima.pcj0dec.nc Already a netcdf file. Skip conversion dataout/musima.pcj1apr.nc Already a netcdf file. Skip conversion dataout/musima.pcj1aug.nc Already a netcdf file. Skip conversion dataout/musima.pcj1dec.nc Already a netcdf file. Skip conversion dataout/musima.pcj1feb.nc Already a netcdf file. Skip conversion dataout/musima.pcj1jan.nc Already a netcdf file. Skip conversion dataout/musima.pcj1jul.nc Already a netcdf file. Skip conversion dataout/musima.pcj1jun.nc Already a netcdf file. Skip conversion dataout/musima.pcj1mar.nc Already a netcdf file. Skip conversion dataout/musima.pcj1may.nc Already a netcdf file. Skip conversion dataout/musima.pcj1nov.nc Already a netcdf file. Skip conversion dataout/musima.pcj1oct.nc Already a netcdf file. Skip conversion dataout/musima.pcj1sep.nc Already a netcdf file. Skip conversion dataout/musima.pcj2apr.nc Already a netcdf file. Skip conversion dataout/musima.pcj2aug.nc Already a netcdf file. Skip conversion dataout/musima.pcj2dec.nc Already a netcdf file. Skip conversion dataout/musima.pcj2feb.nc Already a netcdf file. Skip conversion dataout/musima.pcj2jan.nc Already a netcdf file. Skip conversion dataout/musima.pcj2jul.nc Already a netcdf file. Skip conversion dataout/musima.pcj2jun.nc Already a netcdf file. Skip conversion dataout/musima.pcj2mar.nc Already a netcdf file. Skip conversion dataout/musima.pcj2may.nc Already a netcdf file. Skip conversion dataout/musima.pcj2nov.nc Already a netcdf file. Skip conversion dataout/musima.pcj2oct.nc Already a netcdf file. Skip conversion dataout/musima.pcj2sep.nc Already a netcdf file. Skip conversion dataout/musima.pdj3121.nc BUFFIN: C I/O Error feof - Unit 60 - Return code = 16 BUFFIN: C I/O Error feof - Unit 61 - Return code = 16 BUFFIN: C I/O Error feof - Unit 62 - Return code = 16 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 Already a netcdf file. Skip conversion dataout/musima.paj0dec.nc Already a netcdf file. Skip conversion dataout/musima.paj1apr.nc Already a netcdf file. Skip conversion dataout/musima.paj1aug.nc Already a netcdf file. Skip conversion dataout/musima.paj1dec.nc Already a netcdf file. Skip conversion dataout/musima.paj1feb.nc Already a netcdf file. Skip conversion dataout/musima.paj1jan.nc Already a netcdf file. Skip conversion dataout/musima.paj1jul.nc Already a netcdf file. Skip conversion dataout/musima.paj1jun.nc Already a netcdf file. Skip conversion dataout/musima.paj1mar.nc Already a netcdf file. Skip conversion dataout/musima.paj1may.nc Already a netcdf file. Skip conversion dataout/musima.paj1nov.nc Already a netcdf file. Skip conversion dataout/musima.paj1oct.nc Already a netcdf file. Skip conversion dataout/musima.paj1sep.nc Already a netcdf file. Skip conversion dataout/musima.paj2apr.nc Already a netcdf file. Skip conversion dataout/musima.paj2aug.nc Already a netcdf file. Skip conversion dataout/musima.paj2dec.nc Already a netcdf file. Skip conversion dataout/musima.paj2feb.nc Already a netcdf file. Skip conversion dataout/musima.paj2jan.nc Already a netcdf file. Skip conversion dataout/musima.paj2jul.nc Already a netcdf file. Skip conversion dataout/musima.paj2jun.nc Already a netcdf file. Skip conversion dataout/musima.paj2mar.nc Already a netcdf file. Skip conversion dataout/musima.paj2may.nc Already a netcdf file. Skip conversion dataout/musima.paj2nov.nc Already a netcdf file. Skip conversion dataout/musima.paj2oct.nc Already a netcdf file. Skip conversion dataout/musima.paj2sep.nc Already a netcdf file. Skip conversion dataout/musima.pbj0dec.nc Already a netcdf file. Skip conversion dataout/musima.pbj1apr.nc Already a netcdf file. Skip conversion dataout/musima.pbj1aug.nc Already a netcdf file. Skip conversion dataout/musima.pbj1dec.nc Already a netcdf file. Skip conversion dataout/musima.pbj1feb.nc Already a netcdf file. Skip conversion dataout/musima.pbj1jan.nc Already a netcdf file. Skip conversion dataout/musima.pbj1jul.nc Already a netcdf file. Skip conversion dataout/musima.pbj1jun.nc Already a netcdf file. Skip conversion dataout/musima.pbj1mar.nc Already a netcdf file. Skip conversion dataout/musima.pbj1may.nc Already a netcdf file. Skip conversion dataout/musima.pbj1nov.nc Already a netcdf file. Skip conversion dataout/musima.pbj1oct.nc Already a netcdf file. Skip conversion dataout/musima.pbj1sep.nc Already a netcdf file. Skip conversion dataout/musima.pbj2apr.nc Already a netcdf file. Skip conversion dataout/musima.pbj2aug.nc Already a netcdf file. Skip conversion dataout/musima.pbj2dec.nc Already a netcdf file. Skip conversion dataout/musima.pbj2feb.nc Already a netcdf file. Skip conversion dataout/musima.pbj2jan.nc Already a netcdf file. Skip conversion dataout/musima.pbj2jul.nc Already a netcdf file. Skip conversion dataout/musima.pbj2jun.nc Already a netcdf file. Skip conversion dataout/musima.pbj2mar.nc Already a netcdf file. Skip conversion dataout/musima.pbj2may.nc Already a netcdf file. Skip conversion dataout/musima.pbj2nov.nc Already a netcdf file. Skip conversion dataout/musima.pbj2oct.nc Already a netcdf file. Skip conversion dataout/musima.pbj2sep.nc Already a netcdf file. Skip conversion dataout/musima.pcj0dec.nc Already a netcdf file. Skip conversion dataout/musima.pcj1apr.nc Already a netcdf file. Skip conversion dataout/musima.pcj1aug.nc Already a netcdf file. Skip conversion dataout/musima.pcj1dec.nc Already a netcdf file. Skip conversion dataout/musima.pcj1feb.nc Already a netcdf file. Skip conversion dataout/musima.pcj1jan.nc Already a netcdf file. Skip conversion dataout/musima.pcj1jul.nc Already a netcdf file. Skip conversion dataout/musima.pcj1jun.nc Already a netcdf file. Skip conversion dataout/musima.pcj1mar.nc Already a netcdf file. Skip conversion dataout/musima.pcj1may.nc Already a netcdf file. Skip conversion dataout/musima.pcj1nov.nc Already a netcdf file. Skip conversion dataout/musima.pcj1oct.nc Already a netcdf file. Skip conversion dataout/musima.pcj1sep.nc Already a netcdf file. Skip conversion dataout/musima.pcj2apr.nc Already a netcdf file. Skip conversion dataout/musima.pcj2aug.nc Already a netcdf file. Skip conversion dataout/musima.pcj2dec.nc Already a netcdf file. Skip conversion dataout/musima.pcj2feb.nc Already a netcdf file. Skip conversion dataout/musima.pcj2jan.nc Already a netcdf file. Skip conversion dataout/musima.pcj2jul.nc Already a netcdf file. Skip conversion dataout/musima.pcj2jun.nc Already a netcdf file. Skip conversion dataout/musima.pcj2mar.nc Already a netcdf file. Skip conversion dataout/musima.pcj2may.nc Already a netcdf file. Skip conversion dataout/musima.pcj2nov.nc Already a netcdf file. Skip conversion dataout/musima.pcj2oct.nc Already a netcdf file. Skip conversion dataout/musima.pcj2sep.nc Already a netcdf file. Skip conversion dataout/musima.pdj3121.nc 10:39:06 (1160): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Aug 2010 14:01:14	972343	11585253	hadam3p_musi_1990_2_006141740_6	72,096	524,891	7.2804
10 Aug 2010 13:40:24	972343	11585253	hadam3p_musi_1990_2_006141740_6	72,000	524,198	7.2805
07 Aug 2010 16:20:11	972343	11585253	hadam3p_musi_1990_2_006141740_6	69,120	503,072	7.2782
06 Aug 2010 12:31:34	972343	11585253	hadam3p_musi_1990_2_006141740_6	66,240	482,213	7.2798
04 Aug 2010 18:00:32	972343	11585253	hadam3p_musi_1990_2_006141740_6	63,360	461,497	7.2837
02 Aug 2010 17:55:13	972343	11585253	hadam3p_musi_1990_2_006141740_6	60,480	440,394	7.2816
01 Aug 2010 09:27:32	972343	11585253	hadam3p_musi_1990_2_006141740_6	57,600	419,677	7.2861
29 Jul 2010 16:44:52	972343	11585253	hadam3p_musi_1990_2_006141740_6	54,720	399,127	7.2940
27 Jul 2010 21:10:51	972343	11585253	hadam3p_musi_1990_2_006141740_6	51,840	378,136	7.2943
27 Jul 2010 09:48:25	972343	11585253	hadam3p_musi_1990_2_006141740_6	48,960	356,251	7.2764
24 Jul 2010 21:21:39	972343	11585253	hadam3p_musi_1990_2_006141740_6	46,080	336,020	7.2921
21 Jul 2010 13:13:45	972343	11585253	hadam3p_musi_1990_2_006141740_6	43,200	314,724	7.2853
20 Jul 2010 10:35:48	972343	11585253	hadam3p_musi_1990_2_006141740_6	40,320	292,819	7.2624
19 Jul 2010 07:11:00	972343	11585253	hadam3p_musi_1990_2_006141740_6	37,440	272,250	7.2716
17 Jul 2010 08:18:42	972343	11585253	hadam3p_musi_1990_2_006141740_6	34,560	251,246	7.2698
14 Jul 2010 18:21:06	972343	11585253	hadam3p_musi_1990_2_006141740_6	31,680	231,198	7.2979
13 Jul 2010 12:30:40	972343	11585253	hadam3p_musi_1990_2_006141740_6	28,800	210,488	7.3086
11 Jul 2010 10:18:46	972343	11585253	hadam3p_musi_1990_2_006141740_6	25,920	189,146	7.2973
07 Jul 2010 09:45:31	972343	11585253	hadam3p_musi_1990_2_006141740_6	23,040	168,138	7.2977
05 Jul 2010 07:19:31	972343	11585253	hadam3p_musi_1990_2_006141740_6	20,160	147,519	7.3174