climateprediction.net home page
Task 12372980

Task 12372980

Name famous_v8rf_1799_200_006697121_5
Workunit 6900374
Created 8 Dec 2010, 18:33:53 UTC
Sent 8 Dec 2010, 18:41:16 UTC
Report deadline 10 Mar 2011, 2:08:27 UTC
Received 10 Dec 2010, 22:54:12 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 922557
Run time
CPU time 11 hours 48 min 19 sec
Validate state Invalid
Credit 154.49
Device peak FLOPS 1.71 GFLOPS
Application version UK Met Office FAMOUS v6.11
i686-pc-linux-gnu
Stderr
<core_client_version>5.10.45</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Starting work on result famous_v8rf_1799_200_006697121_5...
Starting model in /home/jsc/BOINC/projects/climateprediction.net...
Unzipping global model data file...
Unzipping workunit data file...
Created shared memory region key = 136145 of size 743572 bytes (version 608)
Copying files for startup...
In pre_initialise_phase (part 1 of 3)
In initialise_phase (part 2 of 3)
In startup_phase (part 3 of 3)
Copying model control files...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 6517
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0000001 A - 01/12/1799 01:00 - H:M:S=0000:00:00 AVG= 0.00 DLT= 0.00
famous_v8rf_1799_200_006697121 - PH 1 TS 0000391 A - 16/12/1799 01:00 - H:M:S=0000:04:28 AVG= 0.69 DLT= 1.79
famous_v8rf_1799_200_006697121 - PH 1 TS 0000781 A - 01/01/1800 01:00 - H:M:S=0000:08:55 AVG= 0.69 DLT= 1.89
famous_v8rf_1799_200_006697121 - PH 1 TS 0001171 A - 16/01/1800 01:00 - H:M:S=0000:13:26 AVG= 0.69 DLT= 1.27
famous_v8rf_1799_200_006697121 - PH 1 TS 0001561 A - 01/02/1800 01:00 - H:M:S=0000:18:02 AVG= 0.69 DLT= 1.35
famous_v8rf_1799_200_006697121 - PH 1 TS 0001951 A - 16/02/1800 01:00 - H:M:S=0000:22:39 AVG= 0.70 DLT= 1.53
famous_v8rf_1799_200_006697121 - PH 1 TS 0002341 A - 01/03/1800 01:00 - H:M:S=0000:27:14 AVG= 0.70 DLT= 1.85
famous_v8rf_1799_200_006697121 - PH 1 TS 0002731 A - 16/03/1800 01:00 - H:M:S=0000:31:49 AVG= 0.70 DLT= 1.55
famous_v8rf_1799_200_006697121 - PH 1 TS 0003121 A - 01/04/1800 01:00 - H:M:S=0000:36:24 AVG= 0.70 DLT= 1.67

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 8242
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0003511 A - 16/04/1800 01:00 - H:M:S=0000:43:07 AVG= 0.74 DLT= 1.59
famous_v8rf_1799_200_006697121 - PH 1 TS 0003901 A - 01/05/1800 01:00 - H:M:S=0000:47:44 AVG= 0.73 DLT= 1.62

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Program launched with process id # 8912
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 8939
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 3...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 9124
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0004291 A - 16/05/1800 01:00 - H:M:S=0000:57:06 AVG= 0.80 DLT= 1.17
famous_v8rf_1799_200_006697121 - PH 1 TS 0004681 A - 01/06/1800 01:00 - H:M:S=0001:01:48 AVG= 0.79 DLT= 1.97

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Program launched with process id # 9998
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
famous_v8rf_1799_200_006697121 - PH 1 TS 0005071 A - 16/06/1800 01:00 - H:M:S=0001:09:05 AVG= 0.82 DLT= 1.24
famous_v8rf_1799_200_006697121 - PH 1 TS 0005461 A - 01/07/1800 01:00 - H:M:S=0001:13:36 AVG= 0.81 DLT= 1.77
famous_v8rf_1799_200_006697121 - PH 1 TS 0005851 A - 16/07/1800 01:00 - H:M:S=0001:18:05 AVG= 0.80 DLT= 1.42

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Program launched with process id # 10651
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
famous_v8rf_1799_200_006697121 - PH 1 TS 0006241 A - 01/08/1800 01:00 - H:M:S=0001:24:45 AVG= 0.81 DLT= 1.79
famous_v8rf_1799_200_006697121 - PH 1 TS 0006631 A - 16/08/1800 01:00 - H:M:S=0001:29:18 AVG= 0.81 DLT= 1.27
famous_v8rf_1799_200_006697121 - PH 1 TS 0007021 A - 01/09/1800 01:00 - H:M:S=0001:33:56 AVG= 0.80 DLT= 1.25
famous_v8rf_1799_200_006697121 - PH 1 TS 0007411 A - 16/09/1800 01:00 - H:M:S=0001:38:34 AVG= 0.80 DLT= 1.40

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 11740
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0007801 A - 01/10/1800 01:00 - H:M:S=0001:47:02 AVG= 0.82 DLT= 1.25

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 11948
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0008191 A - 16/10/1800 01:00 - H:M:S=0001:55:29 AVG= 0.85 DLT= 1.52
famous_v8rf_1799_200_006697121 - PH 1 TS 0008581 A - 01/11/1800 01:00 - H:M:S=0002:00:03 AVG= 0.84 DLT= 1.65
famous_v8rf_1799_200_006697121 - PH 1 TS 0008971 A - 16/11/1800 01:00 - H:M:S=0002:04:36 AVG= 0.83 DLT= 1.60
Trickling yearly means for 1800
Building file list for 1800 in dataout -- 4 entries
Creating trickle file trickle_famous_v8rf_1799_200_006697121_5_1800.zip for upload...
famous_v8rf_1799_200_006697121 - PH 1 TS 0009361 A - 01/12/1800 01:00 - H:M:S=0002:09:06 AVG= 0.83 DLT= 1.57
famous_v8rf_1799_200_006697121 - PH 1 TS 0009751 A - 16/12/1800 01:00 - H:M:S=0002:13:35 AVG= 0.82 DLT= 1.59
famous_v8rf_1799_200_006697121 - PH 1 TS 0010141 A - 01/01/1801 01:00 - H:M:S=0002:18:03 AVG= 0.82 DLT= 1.70
famous_v8rf_1799_200_006697121 - PH 1 TS 0010531 A - 16/01/1801 01:00 - H:M:S=0002:22:31 AVG= 0.81 DLT= 1.64
famous_v8rf_1799_200_006697121 - PH 1 TS 0010921 A - 01/02/1801 01:00 - H:M:S=0002:27:04 AVG= 0.81 DLT= 1.84
famous_v8rf_1799_200_006697121 - PH 1 TS 0011311 A - 16/02/1801 01:00 - H:M:S=0002:31:36 AVG= 0.80 DLT= 1.47
famous_v8rf_1799_200_006697121 - PH 1 TS 0011701 A - 01/03/1801 01:00 - H:M:S=0002:36:06 AVG= 0.80 DLT= 1.55

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 13807
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0012091 A - 16/03/1801 01:00 - H:M:S=0002:41:15 AVG= 0.80 DLT= 1.58
famous_v8rf_1799_200_006697121 - PH 1 TS 0012481 A - 01/04/1801 01:00 - H:M:S=0002:45:47 AVG= 0.80 DLT= 1.08
famous_v8rf_1799_200_006697121 - PH 1 TS 0012871 A - 16/04/1801 01:00 - H:M:S=0002:50:18 AVG= 0.79 DLT= 1.83
famous_v8rf_1799_200_006697121 - PH 1 TS 0013261 A - 01/05/1801 01:00 - H:M:S=0002:54:51 AVG= 0.79 DLT= 1.12
famous_v8rf_1799_200_006697121 - PH 1 TS 0013651 A - 16/05/1801 01:00 - H:M:S=0002:59:23 AVG= 0.79 DLT= 1.29
famous_v8rf_1799_200_006697121 - PH 1 TS 0014041 A - 01/06/1801 01:00 - H:M:S=0003:03:52 AVG= 0.79 DLT= 1.52
famous_v8rf_1799_200_006697121 - PH 1 TS 0014431 A - 16/06/1801 01:00 - H:M:S=0003:08:22 AVG= 0.78 DLT= 1.57
famous_v8rf_1799_200_006697121 - PH 1 TS 0014821 A - 01/07/1801 01:00 - H:M:S=0003:12:53 AVG= 0.78 DLT= 1.23
famous_v8rf_1799_200_006697121 - PH 1 TS 0015211 A - 16/07/1801 01:00 - H:M:S=0003:17:21 AVG= 0.78 DLT= 1.69
famous_v8rf_1799_200_006697121 - PH 1 TS 0015601 A - 01/08/1801 01:00 - H:M:S=0003:21:54 AVG= 0.78 DLT= 1.13
famous_v8rf_1799_200_006697121 - PH 1 TS 0015991 A - 16/08/1801 01:00 - H:M:S=0003:26:22 AVG= 0.77 DLT= 1.87
famous_v8rf_1799_200_006697121 - PH 1 TS 0016381 A - 01/09/1801 01:00 - H:M:S=0003:30:52 AVG= 0.77 DLT= 1.76
famous_v8rf_1799_200_006697121 - PH 1 TS 0016771 A - 16/09/1801 01:00 - H:M:S=0003:35:24 AVG= 0.77 DLT= 1.21
famous_v8rf_1799_200_006697121 - PH 1 TS 0017161 A - 01/10/1801 01:00 - H:M:S=0003:39:56 AVG= 0.77 DLT= 1.36
famous_v8rf_1799_200_006697121 - PH 1 TS 0017551 A - 16/10/1801 01:00 - H:M:S=0003:44:27 AVG= 0.77 DLT= 1.23
famous_v8rf_1799_200_006697121 - PH 1 TS 0017941 A - 01/11/1801 01:00 - H:M:S=0003:48:58 AVG= 0.77 DLT= 1.20
famous_v8rf_1799_200_006697121 - PH 1 TS 0018331 A - 16/11/1801 01:00 - H:M:S=0003:53:27 AVG= 0.76 DLT= 1.18
Trickling yearly means for 1801
Building file list for 1801 in dataout -- 4 entries
Creating trickle file trickle_famous_v8rf_1799_200_006697121_5_1801.zip for upload...
famous_v8rf_1799_200_006697121 - PH 1 TS 0018721 A - 01/12/1801 01:00 - H:M:S=0003:57:59 AVG= 0.76 DLT= 1.71
famous_v8rf_1799_200_006697121 - PH 1 TS 0019111 A - 16/12/1801 01:00 - H:M:S=0004:02:31 AVG= 0.76 DLT= 1.84

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 16551
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 16627
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0019501 A - 01/01/1802 01:00 - H:M:S=0004:13:42 AVG= 0.78 DLT= 1.60
famous_v8rf_1799_200_006697121 - PH 1 TS 0019891 A - 16/01/1802 01:00 - H:M:S=0004:18:11 AVG= 0.78 DLT= 1.80
famous_v8rf_1799_200_006697121 - PH 1 TS 0020281 A - 01/02/1802 01:00 - H:M:S=0004:22:37 AVG= 0.78 DLT= 1.97

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Program launched with process id # 17156
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
famous_v8rf_1799_200_006697121 - PH 1 TS 0020671 A - 16/02/1802 01:00 - H:M:S=0004:30:59 AVG= 0.79 DLT= 1.34
famous_v8rf_1799_200_006697121 - PH 1 TS 0021061 A - 01/03/1802 01:00 - H:M:S=0004:35:30 AVG= 0.78 DLT= 1.09
famous_v8rf_1799_200_006697121 - PH 1 TS 0021451 A - 16/03/1802 01:00 - H:M:S=0004:40:05 AVG= 0.78 DLT= 1.38
famous_v8rf_1799_200_006697121 - PH 1 TS 0021841 A - 01/04/1802 01:00 - H:M:S=0004:44:34 AVG= 0.78 DLT= 1.30
famous_v8rf_1799_200_006697121 - PH 1 TS 0022231 A - 16/04/1802 01:00 - H:M:S=0004:49:07 AVG= 0.78 DLT= 1.92
famous_v8rf_1799_200_006697121 - PH 1 TS 0022621 A - 01/05/1802 01:00 - H:M:S=0004:53:37 AVG= 0.78 DLT= 1.27
famous_v8rf_1799_200_006697121 - PH 1 TS 0023011 A - 16/05/1802 01:00 - H:M:S=0004:58:10 AVG= 0.78 DLT= 1.56

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 18300
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0023401 A - 01/06/1802 01:00 - H:M:S=0005:05:29 AVG= 0.78 DLT= 1.57
famous_v8rf_1799_200_006697121 - PH 1 TS 0023791 A - 16/06/1802 01:00 - H:M:S=0005:10:00 AVG= 0.78 DLT= 1.55
famous_v8rf_1799_200_006697121 - PH 1 TS 0024181 A - 01/07/1802 01:00 - H:M:S=0005:14:34 AVG= 0.78 DLT= 1.73
famous_v8rf_1799_200_006697121 - PH 1 TS 0024571 A - 16/07/1802 01:00 - H:M:S=0005:19:06 AVG= 0.78 DLT= 1.58
CPDN Monitor - Quit request from BOINC...
Detaching shared memory...
Starting work on result famous_v8rf_1799_200_006697121_5...
Starting model in /home/jsc/BOINC/projects/climateprediction.net...
Trying to kill old process # 6515
Trying to kill old process # 18300
Created shared memory region key = 136145 of size 743572 bytes (version 608)
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 21319
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0024571 A - 16/07/1802 01:00 - H:M:S=0005:19:06 AVG= 0.78 DLT= 0.00
famous_v8rf_1799_200_006697121 - PH 1 TS 0024961 A - 01/08/1802 01:00 - H:M:S=0005:23:46 AVG= 0.78 DLT= 1.22
famous_v8rf_1799_200_006697121 - PH 1 TS 0025351 A - 16/08/1802 01:00 - H:M:S=0005:28:24 AVG= 0.78 DLT= 1.13
famous_v8rf_1799_200_006697121 - PH 1 TS 0025741 A - 01/09/1802 01:00 - H:M:S=0005:33:01 AVG= 0.78 DLT= 1.49
famous_v8rf_1799_200_006697121 - PH 1 TS 0026131 A - 16/09/1802 01:00 - H:M:S=0005:37:37 AVG= 0.78 DLT= 1.73
famous_v8rf_1799_200_006697121 - PH 1 TS 0026521 A - 01/10/1802 01:00 - H:M:S=0005:42:21 AVG= 0.77 DLT= 1.68

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 22713
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0026911 A - 16/10/1802 01:00 - H:M:S=0005:50:34 AVG= 0.78 DLT= 1.66
CPDN Monitor - Quit request from BOINC...
Detaching shared memory...
Starting work on result famous_v8rf_1799_200_006697121_5...
Starting model in /home/jsc/BOINC/projects/climateprediction.net...
Trying to kill old process # 21317
Trying to kill old process # 22713
Created shared memory region key = 136145 of size 743572 bytes (version 608)
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 24090
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0026911 A - 16/10/1802 01:00 - H:M:S=0005:50:34 AVG= 0.78 DLT= 0.00

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 24134
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0027301 A - 01/11/1802 01:00 - H:M:S=0005:56:20 AVG= 0.78 DLT= 1.26
famous_v8rf_1799_200_006697121 - PH 1 TS 0027691 A - 16/11/1802 01:00 - H:M:S=0006:00:54 AVG= 0.78 DLT= 1.14
Trickling yearly means for 1802
Building file list for 1802 in dataout -- 4 entries
Creating trickle file trickle_famous_v8rf_1799_200_006697121_5_1802.zip for upload...
famous_v8rf_1799_200_006697121 - PH 1 TS 0028081 A - 01/12/1802 01:00 - H:M:S=0006:05:29 AVG= 0.78 DLT= 1.81
famous_v8rf_1799_200_006697121 - PH 1 TS 0028471 A - 16/12/1802 01:00 - H:M:S=0006:10:00 AVG= 0.78 DLT= 1.20
famous_v8rf_1799_200_006697121 - PH 1 TS 0028861 A - 01/01/1803 01:00 - H:M:S=0006:14:32 AVG= 0.78 DLT= 1.59
famous_v8rf_1799_200_006697121 - PH 1 TS 0029251 A - 16/01/1803 01:00 - H:M:S=0006:19:05 AVG= 0.78 DLT= 1.52
famous_v8rf_1799_200_006697121 - PH 1 TS 0029641 A - 01/02/1803 01:00 - H:M:S=0006:23:38 AVG= 0.78 DLT= 1.50
CPDN Monitor - Quit request from BOINC...
Detaching shared memory...
Starting work on result famous_v8rf_1799_200_006697121_5...
Starting model in /home/jsc/BOINC/projects/climateprediction.net...
Trying to kill old process # 24088
Trying to kill old process # 24134
Created shared memory region key = 136145 of size 743572 bytes (version 608)
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 26702
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0029641 A - 01/02/1803 01:00 - H:M:S=0006:23:38 AVG= 0.78 DLT= 0.00
famous_v8rf_1799_200_006697121 - PH 1 TS 0030031 A - 16/02/1803 01:00 - H:M:S=0006:28:14 AVG= 0.78 DLT= 1.50
famous_v8rf_1799_200_006697121 - PH 1 TS 0030421 A - 01/03/1803 01:00 - H:M:S=0006:32:45 AVG= 0.77 DLT= 1.17

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 27116
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0030811 A - 16/03/1803 01:00 - H:M:S=0006:38:17 AVG= 0.78 DLT= 1.53
famous_v8rf_1799_200_006697121 - PH 1 TS 0031201 A - 01/04/1803 01:00 - H:M:S=0006:42:50 AVG= 0.77 DLT= 1.22

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 27616
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0031591 A - 16/04/1803 01:00 - H:M:S=0006:50:21 AVG= 0.78 DLT= 1.57
famous_v8rf_1799_200_006697121 - PH 1 TS 0031981 A - 01/05/1803 01:00 - H:M:S=0006:54:58 AVG= 0.78 DLT= 1.65

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 28272
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0031981 A - 01/05/1803 01:00 - H:M:S=0006:55:01 AVG= 0.78 DLT= 0.00
famous_v8rf_1799_200_006697121 - PH 1 TS 0032371 A - 16/05/1803 01:00 - H:M:S=0006:59:35 AVG= 0.78 DLT= 1.73

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Program launched with process id # 28621
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
famous_v8rf_1799_200_006697121 - PH 1 TS 0032761 A - 01/06/1803 01:00 - H:M:S=0007:08:38 AVG= 0.79 DLT= 1.19
famous_v8rf_1799_200_006697121 - PH 1 TS 0033151 A - 16/06/1803 01:00 - H:M:S=0007:13:17 AVG= 0.78 DLT= 1.19

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 29099
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0033541 A - 01/07/1803 01:00 - H:M:S=0007:19:44 AVG= 0.79 DLT= 1.48

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Program launched with process id # 29446
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
famous_v8rf_1799_200_006697121 - PH 1 TS 0033931 A - 16/07/1803 01:00 - H:M:S=0007:28:03 AVG= 0.79 DLT= 1.68
famous_v8rf_1799_200_006697121 - PH 1 TS 0034321 A - 01/08/1803 01:00 - H:M:S=0007:32:38 AVG= 0.79 DLT= 2.08
famous_v8rf_1799_200_006697121 - PH 1 TS 0034711 A - 16/08/1803 01:00 - H:M:S=0007:37:11 AVG= 0.79 DLT= 1.80
famous_v8rf_1799_200_006697121 - PH 1 TS 0035101 A - 01/09/1803 01:00 - H:M:S=0007:41:46 AVG= 0.79 DLT= 1.28

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 30218
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0035491 A - 16/09/1803 01:00 - H:M:S=0007:47:31 AVG= 0.79 DLT= 1.27
famous_v8rf_1799_200_006697121 - PH 1 TS 0035881 A - 01/10/1803 01:00 - H:M:S=0007:52:07 AVG= 0.79 DLT= 1.51
famous_v8rf_1799_200_006697121 - PH 1 TS 0036271 A - 16/10/1803 01:00 - H:M:S=0007:56:43 AVG= 0.79 DLT= 1.20
famous_v8rf_1799_200_006697121 - PH 1 TS 0036661 A - 01/11/1803 01:00 - H:M:S=0008:01:20 AVG= 0.79 DLT= 1.14
famous_v8rf_1799_200_006697121 - PH 1 TS 0037051 A - 16/11/1803 01:00 - H:M:S=0008:05:54 AVG= 0.79 DLT= 1.47
Trickling yearly means for 1803
Building file list for 1803 in dataout -- 4 entries
Creating trickle file trickle_famous_v8rf_1799_200_006697121_5_1803.zip for upload...
famous_v8rf_1799_200_006697121 - PH 1 TS 0037441 A - 01/12/1803 01:00 - H:M:S=0008:10:26 AVG= 0.79 DLT= 1.44
famous_v8rf_1799_200_006697121 - PH 1 TS 0037831 A - 16/12/1803 01:00 - H:M:S=0008:15:02 AVG= 0.79 DLT= 1.36
famous_v8rf_1799_200_006697121 - PH 1 TS 0038221 A - 01/01/1804 01:00 - H:M:S=0008:19:36 AVG= 0.78 DLT= 1.55

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 31805
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0038611 A - 16/01/1804 01:00 - H:M:S=0008:25:34 AVG= 0.79 DLT= 1.45

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 32035
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0039001 A - 01/02/1804 01:00 - H:M:S=0008:31:42 AVG= 0.79 DLT= 1.52
famous_v8rf_1799_200_006697121 - PH 1 TS 0039391 A - 16/02/1804 01:00 - H:M:S=0008:36:14 AVG= 0.79 DLT= 1.62

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 32527
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0039781 A - 01/03/1804 01:00 - H:M:S=0008:42:54 AVG= 0.79 DLT= 1.85
famous_v8rf_1799_200_006697121 - PH 1 TS 0040171 A - 16/03/1804 01:00 - H:M:S=0008:47:26 AVG= 0.79 DLT= 1.29
famous_v8rf_1799_200_006697121 - PH 1 TS 0040561 A - 01/04/1804 01:00 - H:M:S=0008:52:01 AVG= 0.79 DLT= 1.79
famous_v8rf_1799_200_006697121 - PH 1 TS 0040951 A - 16/04/1804 01:00 - H:M:S=0008:56:35 AVG= 0.79 DLT= 1.23
famous_v8rf_1799_200_006697121 - PH 1 TS 0041341 A - 01/05/1804 01:00 - H:M:S=0009:01:05 AVG= 0.79 DLT= 1.43

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 1029
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0041731 A - 16/05/1804 01:00 - H:M:S=0009:07:00 AVG= 0.79 DLT= 1.58
famous_v8rf_1799_200_006697121 - PH 1 TS 0042121 A - 01/06/1804 01:00 - H:M:S=0009:11:35 AVG= 0.79 DLT= 1.35
famous_v8rf_1799_200_006697121 - PH 1 TS 0042511 A - 16/06/1804 01:00 - H:M:S=0009:16:11 AVG= 0.79 DLT= 1.65

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 1720
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0042901 A - 01/07/1804 01:00 - H:M:S=0009:22:54 AVG= 0.79 DLT= 1.28

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 2154
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0043291 A - 16/07/1804 01:00 - H:M:S=0009:31:54 AVG= 0.79 DLT= 1.74
famous_v8rf_1799_200_006697121 - PH 1 TS 0043681 A - 01/08/1804 01:00 - H:M:S=0009:36:29 AVG= 0.79 DLT= 1.49
famous_v8rf_1799_200_006697121 - PH 1 TS 0044071 A - 16/08/1804 01:00 - H:M:S=0009:41:06 AVG= 0.79 DLT= 1.16
famous_v8rf_1799_200_006697121 - PH 1 TS 0044461 A - 01/09/1804 01:00 - H:M:S=0009:45:44 AVG= 0.79 DLT= 1.11

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 3118
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0044851 A - 16/09/1804 01:00 - H:M:S=0009:54:24 AVG= 0.80 DLT= 1.62
famous_v8rf_1799_200_006697121 - PH 1 TS 0045241 A - 01/10/1804 01:00 - H:M:S=0009:58:59 AVG= 0.79 DLT= 1.66
famous_v8rf_1799_200_006697121 - PH 1 TS 0045631 A - 16/10/1804 01:00 - H:M:S=0010:03:34 AVG= 0.79 DLT= 1.32
famous_v8rf_1799_200_006697121 - PH 1 TS 0046021 A - 01/11/1804 01:00 - H:M:S=0010:08:08 AVG= 0.79 DLT= 1.35

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 4077
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 4320
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0046411 A - 16/11/1804 01:00 - H:M:S=0010:18:49 AVG= 0.80 DLT= 1.34
Trickling yearly means for 1804
Building file list for 1804 in dataout -- 4 entries
Creating trickle file trickle_famous_v8rf_1799_200_006697121_5_1804.zip for upload...
famous_v8rf_1799_200_006697121 - PH 1 TS 0046801 A - 01/12/1804 01:00 - H:M:S=0010:23:24 AVG= 0.80 DLT= 1.80

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 5026
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 5030
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
famous_v8rf_1799_200_006697121 - PH 1 TS 0047191 A - 16/12/1804 01:00 - H:M:S=0010:29:09 AVG= 0.80 DLT= 1.12

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 6031
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0047581 A - 01/01/1805 01:00 - H:M:S=0010:35:03 AVG= 0.80 DLT= 1.97

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 6356
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0047971 A - 16/01/1805 01:00 - H:M:S=0010:41:51 AVG= 0.80 DLT= 1.53
famous_v8rf_1799_200_006697121 - PH 1 TS 0048361 A - 01/02/1805 01:00 - H:M:S=0010:46:24 AVG= 0.80 DLT= 1.47

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 6885
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0048751 A - 16/02/1805 01:00 - H:M:S=0010:51:33 AVG= 0.80 DLT= 1.50
famous_v8rf_1799_200_006697121 - PH 1 TS 0049141 A - 01/03/1805 01:00 - H:M:S=0010:56:08 AVG= 0.80 DLT= 1.14
famous_v8rf_1799_200_006697121 - PH 1 TS 0049531 A - 16/03/1805 01:00 - H:M:S=0011:00:42 AVG= 0.80 DLT= 1.42
famous_v8rf_1799_200_006697121 - PH 1 TS 0049921 A - 01/04/1805 01:00 - H:M:S=0011:05:22 AVG= 0.80 DLT= 1.54

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 8081
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0050311 A - 16/04/1805 01:00 - H:M:S=0011:11:48 AVG= 0.80 DLT= 1.17

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 8458
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 8576
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0050701 A - 01/05/1805 01:00 - H:M:S=0011:20:46 AVG= 0.81 DLT= 1.59

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 9207
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v8rf_1799_200_006697121 - PH 1 TS 0051091 A - 16/05/1805 01:00 - H:M:S=0011:27:49 AVG= 0.81 DLT= 1.43
famous_v8rf_1799_200_006697121 - PH 1 TS 0051481 A - 01/06/1805 01:00 - H:M:S=0011:32:21 AVG= 0.81 DLT= 1.78

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 10467
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 10593
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 3...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 10765
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 4...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 10901
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 5...
Starting model ID famous_v8rf_1799_200_006697121   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 136145 /home/jsc/BOINC/slots/0
Program launched with process id # 11319
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Sorry, too many model crashes! :-(
Model restart required...
Sorry, too many model crashes! :-(
Cleaning up from the run...
 (26700): called boinc_finish
Detaching shared memory...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 Dec 2010 18:29:00 922557 12372980 famous_v8rf_1799_200_006697121_5 46,826 37,404 0.7988
09 Dec 2010 13:56:25 922557 12372980 famous_v8rf_1799_200_006697121_5 37,466 29,426 0.7854
09 Dec 2010 08:58:51 922557 12372980 famous_v8rf_1799_200_006697121_5 28,106 21,929 0.7802
09 Dec 2010 08:58:51 922557 12372980 famous_v8rf_1799_200_006697121_5 18,746 14,279 0.7617
08 Dec 2010 22:53:16 922557 12372980 famous_v8rf_1799_200_006697121_5 9,386 7,746 0.8253


©2024 cpdn.org