climateprediction.net home page
Task 11718065

Task 11718065

Name famous_v4jp_1799_200_006691659_1
Workunit 6894912
Created 26 Aug 2010, 15:57:21 UTC
Sent 7 Sep 2010, 21:59:00 UTC
Report deadline 8 Dec 2010, 5:26:11 UTC
Received 10 Sep 2010, 8:02:24 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 922557
Run time
CPU time 1 days 13 hours 14 min 37 sec
Validate state Invalid
Credit 525.07
Device peak FLOPS 1.69 GFLOPS
Application version UK Met Office FAMOUS v6.11
i686-pc-linux-gnu
Stderr
<core_client_version>5.10.45</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
S 0092821 A - 01/11/1809 01:00 - H:M:S=0020:52:14 AVG= 0.81 DLT= 1.97
famous_v4jp_1799_200_006691659 - PH 1 TS 0093211 A - 16/11/1809 01:00 - H:M:S=0020:57:04 AVG= 0.81 DLT= 1.50
Trickling yearly means for 1809
Building file list for 1809 in dataout -- 4 entries
Creating trickle file trickle_famous_v4jp_1799_200_006691659_1_1809.zip for upload...
Processing decadal means for 1800 through 1809
Queuing intermediate upload for CPDN/BOINC: cpdnout1.zip
famous_v4jp_1799_200_006691659 - PH 1 TS 0093991 A - 16/12/1809 01:00 - H:M:S=0021:06:40 AVG= 0.81 DLT= 1.35
famous_v4jp_1799_200_006691659 - PH 1 TS 0094381 A - 01/01/1810 01:00 - H:M:S=0021:11:28 AVG= 0.81 DLT= 1.55
famous_v4jp_1799_200_006691659 - PH 1 TS 0094771 A - 16/01/1810 01:00 - H:M:S=0021:16:06 AVG= 0.81 DLT= 1.11
famous_v4jp_1799_200_006691659 - PH 1 TS 0095161 A - 01/02/1810 01:00 - H:M:S=0021:20:50 AVG= 0.81 DLT= 1.16
famous_v4jp_1799_200_006691659 - PH 1 TS 0095551 A - 16/02/1810 01:00 - H:M:S=0021:25:31 AVG= 0.81 DLT= 1.43
famous_v4jp_1799_200_006691659 - PH 1 TS 0095941 A - 01/03/1810 01:00 - H:M:S=0021:30:15 AVG= 0.81 DLT= 1.81
famous_v4jp_1799_200_006691659 - PH 1 TS 0096331 A - 16/03/1810 01:00 - H:M:S=0021:35:02 AVG= 0.81 DLT= 1.89

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Program launched with process id # 32130
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 32198
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v4jp_1799_200_006691659 - PH 1 TS 0096721 A - 01/04/1810 01:00 - H:M:S=0021:44:45 AVG= 0.81 DLT= 1.59
famous_v4jp_1799_200_006691659 - PH 1 TS 0097111 A - 16/04/1810 01:00 - H:M:S=0021:49:34 AVG= 0.81 DLT= 1.60

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Program launched with process id # 32341
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
famous_v4jp_1799_200_006691659 - PH 1 TS 0097501 A - 01/05/1810 01:00 - H:M:S=0021:58:56 AVG= 0.81 DLT= 1.52
famous_v4jp_1799_200_006691659 - PH 1 TS 0097891 A - 16/05/1810 01:00 - H:M:S=0022:03:42 AVG= 0.81 DLT= 1.25
famous_v4jp_1799_200_006691659 - PH 1 TS 0098281 A - 01/06/1810 01:00 - H:M:S=0022:08:34 AVG= 0.81 DLT= 1.75
famous_v4jp_1799_200_006691659 - PH 1 TS 0098671 A - 16/06/1810 01:00 - H:M:S=0022:13:27 AVG= 0.81 DLT= 1.51
famous_v4jp_1799_200_006691659 - PH 1 TS 0099061 A - 01/07/1810 01:00 - H:M:S=0022:18:09 AVG= 0.81 DLT= 1.23
famous_v4jp_1799_200_006691659 - PH 1 TS 0099451 A - 16/07/1810 01:00 - H:M:S=0022:22:55 AVG= 0.81 DLT= 1.54
famous_v4jp_1799_200_006691659 - PH 1 TS 0099841 A - 01/08/1810 01:00 - H:M:S=0022:27:37 AVG= 0.81 DLT= 1.74
famous_v4jp_1799_200_006691659 - PH 1 TS 0100231 A - 16/08/1810 01:00 - H:M:S=0022:32:20 AVG= 0.81 DLT= 1.77
famous_v4jp_1799_200_006691659 - PH 1 TS 0100621 A - 01/09/1810 01:00 - H:M:S=0022:37:03 AVG= 0.81 DLT= 1.58
famous_v4jp_1799_200_006691659 - PH 1 TS 0101011 A - 16/09/1810 01:00 - H:M:S=0022:41:47 AVG= 0.81 DLT= 1.45
famous_v4jp_1799_200_006691659 - PH 1 TS 0101401 A - 01/10/1810 01:00 - H:M:S=0022:46:29 AVG= 0.81 DLT= 1.25
famous_v4jp_1799_200_006691659 - PH 1 TS 0101791 A - 16/10/1810 01:00 - H:M:S=0022:51:12 AVG= 0.81 DLT= 1.40
famous_v4jp_1799_200_006691659 - PH 1 TS 0102181 A - 01/11/1810 01:00 - H:M:S=0022:55:50 AVG= 0.81 DLT= 1.64
famous_v4jp_1799_200_006691659 - PH 1 TS 0102571 A - 16/11/1810 01:00 - H:M:S=0023:00:27 AVG= 0.81 DLT= 1.24
Trickling yearly means for 1810
Building file list for 1810 in dataout -- 4 entries
Creating trickle file trickle_famous_v4jp_1799_200_006691659_1_1810.zip for upload...
famous_v4jp_1799_200_006691659 - PH 1 TS 0102961 A - 01/12/1810 01:00 - H:M:S=0023:05:03 AVG= 0.81 DLT= 1.68
famous_v4jp_1799_200_006691659 - PH 1 TS 0103351 A - 16/12/1810 01:00 - H:M:S=0023:09:41 AVG= 0.81 DLT= 1.24
famous_v4jp_1799_200_006691659 - PH 1 TS 0103741 A - 01/01/1811 01:00 - H:M:S=0023:14:17 AVG= 0.81 DLT= 1.70
famous_v4jp_1799_200_006691659 - PH 1 TS 0104131 A - 16/01/1811 01:00 - H:M:S=0023:18:48 AVG= 0.81 DLT= 1.19
famous_v4jp_1799_200_006691659 - PH 1 TS 0104521 A - 01/02/1811 01:00 - H:M:S=0023:23:24 AVG= 0.81 DLT= 1.96

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 981
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v4jp_1799_200_006691659 - PH 1 TS 0104911 A - 16/02/1811 01:00 - H:M:S=0023:29:06 AVG= 0.81 DLT= 1.65
famous_v4jp_1799_200_006691659 - PH 1 TS 0105301 A - 01/03/1811 01:00 - H:M:S=0023:33:48 AVG= 0.81 DLT= 1.42

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Program launched with process id # 1069
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
famous_v4jp_1799_200_006691659 - PH 1 TS 0105691 A - 16/03/1811 01:00 - H:M:S=0023:40:06 AVG= 0.81 DLT= 1.60
famous_v4jp_1799_200_006691659 - PH 1 TS 0106081 A - 01/04/1811 01:00 - H:M:S=0023:44:42 AVG= 0.81 DLT= 1.33
famous_v4jp_1799_200_006691659 - PH 1 TS 0106471 A - 16/04/1811 01:00 - H:M:S=0023:49:21 AVG= 0.81 DLT= 1.57
famous_v4jp_1799_200_006691659 - PH 1 TS 0106861 A - 01/05/1811 01:00 - H:M:S=0023:53:58 AVG= 0.81 DLT= 1.31

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 1200
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v4jp_1799_200_006691659 - PH 1 TS 0107251 A - 16/05/1811 01:00 - H:M:S=0024:00:09 AVG= 0.81 DLT= 1.69
famous_v4jp_1799_200_006691659 - PH 1 TS 0107641 A - 01/06/1811 01:00 - H:M:S=0024:04:55 AVG= 0.81 DLT= 1.70
famous_v4jp_1799_200_006691659 - PH 1 TS 0108031 A - 16/06/1811 01:00 - H:M:S=0024:09:46 AVG= 0.81 DLT= 1.25
famous_v4jp_1799_200_006691659 - PH 1 TS 0108421 A - 01/07/1811 01:00 - H:M:S=0024:14:37 AVG= 0.80 DLT= 1.73
famous_v4jp_1799_200_006691659 - PH 1 TS 0108811 A - 16/07/1811 01:00 - H:M:S=0024:19:30 AVG= 0.80 DLT= 1.53
famous_v4jp_1799_200_006691659 - PH 1 TS 0109201 A - 01/08/1811 01:00 - H:M:S=0024:24:23 AVG= 0.80 DLT= 2.20
famous_v4jp_1799_200_006691659 - PH 1 TS 0109591 A - 16/08/1811 01:00 - H:M:S=0024:29:10 AVG= 0.80 DLT= 1.21
famous_v4jp_1799_200_006691659 - PH 1 TS 0109981 A - 01/09/1811 01:00 - H:M:S=0024:34:02 AVG= 0.80 DLT= 1.63
famous_v4jp_1799_200_006691659 - PH 1 TS 0110371 A - 16/09/1811 01:00 - H:M:S=0024:38:54 AVG= 0.80 DLT= 1.42
famous_v4jp_1799_200_006691659 - PH 1 TS 0110761 A - 01/10/1811 01:00 - H:M:S=0024:43:57 AVG= 0.80 DLT= 1.77
famous_v4jp_1799_200_006691659 - PH 1 TS 0111151 A - 16/10/1811 01:00 - H:M:S=0024:48:49 AVG= 0.80 DLT= 1.15
famous_v4jp_1799_200_006691659 - PH 1 TS 0111541 A - 01/11/1811 01:00 - H:M:S=0024:53:34 AVG= 0.80 DLT= 1.75
famous_v4jp_1799_200_006691659 - PH 1 TS 0111931 A - 16/11/1811 01:00 - H:M:S=0024:58:18 AVG= 0.80 DLT= 1.18
Trickling yearly means for 1811
Building file list for 1811 in dataout -- 4 entries
Creating trickle file trickle_famous_v4jp_1799_200_006691659_1_1811.zip for upload...
famous_v4jp_1799_200_006691659 - PH 1 TS 0112321 A - 01/12/1811 01:00 - H:M:S=0025:03:07 AVG= 0.80 DLT= 1.86

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 2348
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
famous_v4jp_1799_200_006691659 - PH 1 TS 0112711 A - 16/12/1811 01:00 - H:M:S=0025:11:28 AVG= 0.80 DLT= 1.71
famous_v4jp_1799_200_006691659 - PH 1 TS 0113101 A - 01/01/1812 01:00 - H:M:S=0025:16:09 AVG= 0.80 DLT= 2.02
famous_v4jp_1799_200_006691659 - PH 1 TS 0113491 A - 16/01/1812 01:00 - H:M:S=0025:20:47 AVG= 0.80 DLT= 1.78
famous_v4jp_1799_200_006691659 - PH 1 TS 0113881 A - 01/02/1812 01:00 - H:M:S=0025:25:26 AVG= 0.80 DLT= 1.36
famous_v4jp_1799_200_006691659 - PH 1 TS 0114271 A - 16/02/1812 01:00 - H:M:S=0025:30:11 AVG= 0.80 DLT= 1.72
famous_v4jp_1799_200_006691659 - PH 1 TS 0114661 A - 01/03/1812 01:00 - H:M:S=0025:34:57 AVG= 0.80 DLT= 1.46

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Program launched with process id # 2830
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
famous_v4jp_1799_200_006691659 - PH 1 TS 0115051 A - 16/03/1812 01:00 - H:M:S=0025:43:57 AVG= 0.81 DLT= 1.20
famous_v4jp_1799_200_006691659 - PH 1 TS 0115441 A - 01/04/1812 01:00 - H:M:S=0025:48:45 AVG= 0.80 DLT= 1.63
famous_v4jp_1799_200_006691659 - PH 1 TS 0115831 A - 16/04/1812 01:00 - H:M:S=0025:53:33 AVG= 0.80 DLT= 1.94
famous_v4jp_1799_200_006691659 - PH 1 TS 0116221 A - 01/05/1812 01:00 - H:M:S=0025:58:20 AVG= 0.80 DLT= 1.39
famous_v4jp_1799_200_006691659 - PH 1 TS 0116611 A - 16/05/1812 01:00 - H:M:S=0026:03:09 AVG= 0.80 DLT= 1.38
famous_v4jp_1799_200_006691659 - PH 1 TS 0117001 A - 01/06/1812 01:00 - H:M:S=0026:07:55 AVG= 0.80 DLT= 1.47
famous_v4jp_1799_200_006691659 - PH 1 TS 0117391 A - 16/06/1812 01:00 - H:M:S=0026:12:41 AVG= 0.80 DLT= 1.91
famous_v4jp_1799_200_006691659 - PH 1 TS 0117781 A - 01/07/1812 01:00 - H:M:S=0026:17:30 AVG= 0.80 DLT= 1.69

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Program launched with process id # 3620
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
famous_v4jp_1799_200_006691659 - PH 1 TS 0118171 A - 16/07/1812 01:00 - H:M:S=0026:26:31 AVG= 0.81 DLT= 1.67
famous_v4jp_1799_200_006691659 - PH 1 TS 0118561 A - 01/08/1812 01:00 - H:M:S=0026:31:17 AVG= 0.81 DLT= 1.87
famous_v4jp_1799_200_006691659 - PH 1 TS 0118951 A - 16/08/1812 01:00 - H:M:S=0026:36:08 AVG= 0.81 DLT= 1.29
famous_v4jp_1799_200_006691659 - PH 1 TS 0119341 A - 01/09/1812 01:00 - H:M:S=0026:40:58 AVG= 0.80 DLT= 1.32

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Program launched with process id # 4107
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
famous_v4jp_1799_200_006691659 - PH 1 TS 0119731 A - 16/09/1812 01:00 - H:M:S=0026:50:31 AVG= 0.81 DLT= 1.76
famous_v4jp_1799_200_006691659 - PH 1 TS 0120121 A - 01/10/1812 01:00 - H:M:S=0026:55:20 AVG= 0.81 DLT= 1.50
famous_v4jp_1799_200_006691659 - PH 1 TS 0120511 A - 16/10/1812 01:00 - H:M:S=0027:00:13 AVG= 0.81 DLT= 1.58
famous_v4jp_1799_200_006691659 - PH 1 TS 0120901 A - 01/11/1812 01:00 - H:M:S=0027:04:59 AVG= 0.81 DLT= 2.09
famous_v4jp_1799_200_006691659 - PH 1 TS 0121291 A - 16/11/1812 01:00 - H:M:S=0027:09:45 AVG= 0.81 DLT= 1.67
Trickling yearly means for 1812
Building file list for 1812 in dataout -- 4 entries
Creating trickle file trickle_famous_v4jp_1799_200_006691659_1_1812.zip for upload...
famous_v4jp_1799_200_006691659 - PH 1 TS 0121681 A - 01/12/1812 01:00 - H:M:S=0027:14:29 AVG= 0.81 DLT= 1.69
famous_v4jp_1799_200_006691659 - PH 1 TS 0122071 A - 16/12/1812 01:00 - H:M:S=0027:19:13 AVG= 0.81 DLT= 1.56
famous_v4jp_1799_200_006691659 - PH 1 TS 0122461 A - 01/01/1813 01:00 - H:M:S=0027:23:57 AVG= 0.81 DLT= 1.42
famous_v4jp_1799_200_006691659 - PH 1 TS 0122851 A - 16/01/1813 01:00 - H:M:S=0027:28:39 AVG= 0.81 DLT= 1.71

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 4919
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v4jp_1799_200_006691659 - PH 1 TS 0123241 A - 01/02/1813 01:00 - H:M:S=0027:35:50 AVG= 0.81 DLT= 1.62
famous_v4jp_1799_200_006691659 - PH 1 TS 0123631 A - 16/02/1813 01:00 - H:M:S=0027:40:36 AVG= 0.81 DLT= 1.85

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Program launched with process id # 5187
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
famous_v4jp_1799_200_006691659 - PH 1 TS 0124021 A - 01/03/1813 01:00 - H:M:S=0027:48:33 AVG= 0.81 DLT= 1.35

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Program launched with process id # 5275
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
famous_v4jp_1799_200_006691659 - PH 1 TS 0124411 A - 16/03/1813 01:00 - H:M:S=0027:54:17 AVG= 0.81 DLT= 1.88
famous_v4jp_1799_200_006691659 - PH 1 TS 0124801 A - 01/04/1813 01:00 - H:M:S=0027:59:00 AVG= 0.81 DLT= 1.64
famous_v4jp_1799_200_006691659 - PH 1 TS 0125191 A - 16/04/1813 01:00 - H:M:S=0028:03:49 AVG= 0.81 DLT= 2.22
famous_v4jp_1799_200_006691659 - PH 1 TS 0125581 A - 01/05/1813 01:00 - H:M:S=0028:08:35 AVG= 0.81 DLT= 1.20

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 5648
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v4jp_1799_200_006691659 - PH 1 TS 0125971 A - 16/05/1813 01:00 - H:M:S=0028:13:46 AVG= 0.81 DLT= 1.29
famous_v4jp_1799_200_006691659 - PH 1 TS 0126361 A - 01/06/1813 01:00 - H:M:S=0028:18:35 AVG= 0.81 DLT= 1.68
famous_v4jp_1799_200_006691659 - PH 1 TS 0126751 A - 16/06/1813 01:00 - H:M:S=0028:23:21 AVG= 0.81 DLT= 1.86
famous_v4jp_1799_200_006691659 - PH 1 TS 0127141 A - 01/07/1813 01:00 - H:M:S=0028:28:00 AVG= 0.81 DLT= 1.60
famous_v4jp_1799_200_006691659 - PH 1 TS 0127531 A - 16/07/1813 01:00 - H:M:S=0028:32:50 AVG= 0.81 DLT= 1.28
famous_v4jp_1799_200_006691659 - PH 1 TS 0127921 A - 01/08/1813 01:00 - H:M:S=0028:37:34 AVG= 0.81 DLT= 1.48
famous_v4jp_1799_200_006691659 - PH 1 TS 0128311 A - 16/08/1813 01:00 - H:M:S=0028:42:22 AVG= 0.81 DLT= 1.56
famous_v4jp_1799_200_006691659 - PH 1 TS 0128701 A - 01/09/1813 01:00 - H:M:S=0028:47:11 AVG= 0.81 DLT= 1.87
famous_v4jp_1799_200_006691659 - PH 1 TS 0129091 A - 16/09/1813 01:00 - H:M:S=0028:51:58 AVG= 0.81 DLT= 1.86

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Program launched with process id # 6846
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
famous_v4jp_1799_200_006691659 - PH 1 TS 0129481 A - 01/10/1813 01:00 - H:M:S=0029:01:10 AVG= 0.81 DLT= 1.24
famous_v4jp_1799_200_006691659 - PH 1 TS 0129871 A - 16/10/1813 01:00 - H:M:S=0029:05:56 AVG= 0.81 DLT= 1.18
famous_v4jp_1799_200_006691659 - PH 1 TS 0130261 A - 01/11/1813 01:00 - H:M:S=0029:10:45 AVG= 0.81 DLT= 1.35
famous_v4jp_1799_200_006691659 - PH 1 TS 0130651 A - 16/11/1813 01:00 - H:M:S=0029:15:33 AVG= 0.81 DLT= 2.01

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 7230
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Trickling yearly means for 1813
Building file list for 1813 in dataout -- 4 entries
Creating trickle file trickle_famous_v4jp_1799_200_006691659_1_1813.zip for upload...
famous_v4jp_1799_200_006691659 - PH 1 TS 0131041 A - 01/12/1813 01:00 - H:M:S=0029:21:37 AVG= 0.81 DLT= 1.72
famous_v4jp_1799_200_006691659 - PH 1 TS 0131431 A - 16/12/1813 01:00 - H:M:S=0029:26:20 AVG= 0.81 DLT= 1.36
famous_v4jp_1799_200_006691659 - PH 1 TS 0131821 A - 01/01/1814 01:00 - H:M:S=0029:31:02 AVG= 0.81 DLT= 1.63
famous_v4jp_1799_200_006691659 - PH 1 TS 0132211 A - 16/01/1814 01:00 - H:M:S=0029:35:39 AVG= 0.81 DLT= 1.86
famous_v4jp_1799_200_006691659 - PH 1 TS 0132601 A - 01/02/1814 01:00 - H:M:S=0029:40:20 AVG= 0.81 DLT= 1.80
famous_v4jp_1799_200_006691659 - PH 1 TS 0132991 A - 16/02/1814 01:00 - H:M:S=0029:45:04 AVG= 0.81 DLT= 1.37
famous_v4jp_1799_200_006691659 - PH 1 TS 0133381 A - 01/03/1814 01:00 - H:M:S=0029:49:50 AVG= 0.81 DLT= 1.60
famous_v4jp_1799_200_006691659 - PH 1 TS 0133771 A - 16/03/1814 01:00 - H:M:S=0029:54:36 AVG= 0.80 DLT= 1.77
famous_v4jp_1799_200_006691659 - PH 1 TS 0134161 A - 01/04/1814 01:00 - H:M:S=0029:59:21 AVG= 0.80 DLT= 1.72

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 8264
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v4jp_1799_200_006691659 - PH 1 TS 0134551 A - 16/04/1814 01:00 - H:M:S=0030:06:54 AVG= 0.81 DLT= 1.30
famous_v4jp_1799_200_006691659 - PH 1 TS 0134941 A - 01/05/1814 01:00 - H:M:S=0030:11:42 AVG= 0.81 DLT= 1.93
famous_v4jp_1799_200_006691659 - PH 1 TS 0135331 A - 16/05/1814 01:00 - H:M:S=0030:16:33 AVG= 0.81 DLT= 1.32
famous_v4jp_1799_200_006691659 - PH 1 TS 0135721 A - 01/06/1814 01:00 - H:M:S=0030:21:19 AVG= 0.81 DLT= 1.66

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 8890
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v4jp_1799_200_006691659 - PH 1 TS 0136111 A - 16/06/1814 01:00 - H:M:S=0030:29:15 AVG= 0.81 DLT= 1.48
famous_v4jp_1799_200_006691659 - PH 1 TS 0136501 A - 01/07/1814 01:00 - H:M:S=0030:33:59 AVG= 0.81 DLT= 1.63
famous_v4jp_1799_200_006691659 - PH 1 TS 0136891 A - 16/07/1814 01:00 - H:M:S=0030:38:39 AVG= 0.81 DLT= 1.69
famous_v4jp_1799_200_006691659 - PH 1 TS 0137281 A - 01/08/1814 01:00 - H:M:S=0030:43:23 AVG= 0.81 DLT= 2.28
famous_v4jp_1799_200_006691659 - PH 1 TS 0137671 A - 16/08/1814 01:00 - H:M:S=0030:48:03 AVG= 0.81 DLT= 1.41
famous_v4jp_1799_200_006691659 - PH 1 TS 0138061 A - 01/09/1814 01:00 - H:M:S=0030:52:44 AVG= 0.81 DLT= 1.40
famous_v4jp_1799_200_006691659 - PH 1 TS 0138451 A - 16/09/1814 01:00 - H:M:S=0030:57:35 AVG= 0.81 DLT= 1.54
famous_v4jp_1799_200_006691659 - PH 1 TS 0138841 A - 01/10/1814 01:00 - H:M:S=0031:02:27 AVG= 0.80 DLT= 1.62

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Program launched with process id # 9536
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
famous_v4jp_1799_200_006691659 - PH 1 TS 0139231 A - 16/10/1814 01:00 - H:M:S=0031:09:19 AVG= 0.81 DLT= 1.33
famous_v4jp_1799_200_006691659 - PH 1 TS 0139621 A - 01/11/1814 01:00 - H:M:S=0031:14:06 AVG= 0.81 DLT= 1.23
famous_v4jp_1799_200_006691659 - PH 1 TS 0140011 A - 16/11/1814 01:00 - H:M:S=0031:18:56 AVG= 0.81 DLT= 1.35
Trickling yearly means for 1814
Building file list for 1814 in dataout -- 4 entries
Creating trickle file trickle_famous_v4jp_1799_200_006691659_1_1814.zip for upload...
famous_v4jp_1799_200_006691659 - PH 1 TS 0140791 A - 16/12/1814 01:00 - H:M:S=0031:28:27 AVG= 0.80 DLT= 1.34
famous_v4jp_1799_200_006691659 - PH 1 TS 0141181 A - 01/01/1815 01:00 - H:M:S=0031:33:09 AVG= 0.80 DLT= 2.05

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 10336
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v4jp_1799_200_006691659 - PH 1 TS 0141571 A - 16/01/1815 01:00 - H:M:S=0031:42:09 AVG= 0.81 DLT= 1.66
famous_v4jp_1799_200_006691659 - PH 1 TS 0141961 A - 01/02/1815 01:00 - H:M:S=0031:46:54 AVG= 0.81 DLT= 1.77
famous_v4jp_1799_200_006691659 - PH 1 TS 0142351 A - 16/02/1815 01:00 - H:M:S=0031:51:39 AVG= 0.81 DLT= 1.82

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 10769
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v4jp_1799_200_006691659 - PH 1 TS 0142741 A - 01/03/1815 01:00 - H:M:S=0032:00:59 AVG= 0.81 DLT= 1.86
famous_v4jp_1799_200_006691659 - PH 1 TS 0143131 A - 16/03/1815 01:00 - H:M:S=0032:05:45 AVG= 0.81 DLT= 2.11
famous_v4jp_1799_200_006691659 - PH 1 TS 0143521 A - 01/04/1815 01:00 - H:M:S=0032:10:32 AVG= 0.81 DLT= 1.90

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 11111
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 11134
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v4jp_1799_200_006691659 - PH 1 TS 0143911 A - 16/04/1815 01:00 - H:M:S=0032:20:48 AVG= 0.81 DLT= 1.15
famous_v4jp_1799_200_006691659 - PH 1 TS 0144301 A - 01/05/1815 01:00 - H:M:S=0032:25:31 AVG= 0.81 DLT= 1.59
famous_v4jp_1799_200_006691659 - PH 1 TS 0144691 A - 16/05/1815 01:00 - H:M:S=0032:30:16 AVG= 0.81 DLT= 1.24
famous_v4jp_1799_200_006691659 - PH 1 TS 0145081 A - 01/06/1815 01:00 - H:M:S=0032:35:02 AVG= 0.81 DLT= 1.24
famous_v4jp_1799_200_006691659 - PH 1 TS 0145471 A - 16/06/1815 01:00 - H:M:S=0032:39:49 AVG= 0.81 DLT= 2.06

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 11620
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v4jp_1799_200_006691659 - PH 1 TS 0145861 A - 01/07/1815 01:00 - H:M:S=0032:45:54 AVG= 0.81 DLT= 1.88

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 11737
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v4jp_1799_200_006691659 - PH 1 TS 0146251 A - 16/07/1815 01:00 - H:M:S=0032:52:50 AVG= 0.81 DLT= 1.40

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 11932
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 11968
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v4jp_1799_200_006691659 - PH 1 TS 0146641 A - 01/08/1815 01:00 - H:M:S=0033:04:54 AVG= 0.81 DLT= 1.64
famous_v4jp_1799_200_006691659 - PH 1 TS 0147031 A - 16/08/1815 01:00 - H:M:S=0033:09:40 AVG= 0.81 DLT= 1.56
famous_v4jp_1799_200_006691659 - PH 1 TS 0147421 A - 01/09/1815 01:00 - H:M:S=0033:14:31 AVG= 0.81 DLT= 1.91
famous_v4jp_1799_200_006691659 - PH 1 TS 0147811 A - 16/09/1815 01:00 - H:M:S=0033:19:20 AVG= 0.81 DLT= 1.70
famous_v4jp_1799_200_006691659 - PH 1 TS 0148201 A - 01/10/1815 01:00 - H:M:S=0033:24:07 AVG= 0.81 DLT= 1.88
famous_v4jp_1799_200_006691659 - PH 1 TS 0148591 A - 16/10/1815 01:00 - H:M:S=0033:28:55 AVG= 0.81 DLT= 1.60

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 12400
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v4jp_1799_200_006691659 - PH 1 TS 0148981 A - 01/11/1815 01:00 - H:M:S=0033:36:03 AVG= 0.81 DLT= 1.79
famous_v4jp_1799_200_006691659 - PH 1 TS 0149371 A - 16/11/1815 01:00 - H:M:S=0033:40:48 AVG= 0.81 DLT= 1.28
Trickling yearly means for 1815
Building file list for 1815 in dataout -- 4 entries
Creating trickle file trickle_famous_v4jp_1799_200_006691659_1_1815.zip for upload...
famous_v4jp_1799_200_006691659 - PH 1 TS 0149761 A - 01/12/1815 01:00 - H:M:S=0033:45:31 AVG= 0.81 DLT= 1.91
famous_v4jp_1799_200_006691659 - PH 1 TS 0150151 A - 16/12/1815 01:00 - H:M:S=0033:50:14 AVG= 0.81 DLT= 1.31
famous_v4jp_1799_200_006691659 - PH 1 TS 0150541 A - 01/01/1816 01:00 - H:M:S=0033:54:58 AVG= 0.81 DLT= 2.01
famous_v4jp_1799_200_006691659 - PH 1 TS 0150931 A - 16/01/1816 01:00 - H:M:S=0033:59:45 AVG= 0.81 DLT= 1.83
famous_v4jp_1799_200_006691659 - PH 1 TS 0151321 A - 01/02/1816 01:00 - H:M:S=0034:04:26 AVG= 0.81 DLT= 1.77
famous_v4jp_1799_200_006691659 - PH 1 TS 0151711 A - 16/02/1816 01:00 - H:M:S=0034:09:12 AVG= 0.81 DLT= 1.74
famous_v4jp_1799_200_006691659 - PH 1 TS 0152101 A - 01/03/1816 01:00 - H:M:S=0034:13:56 AVG= 0.81 DLT= 1.30
famous_v4jp_1799_200_006691659 - PH 1 TS 0152491 A - 16/03/1816 01:00 - H:M:S=0034:18:44 AVG= 0.81 DLT= 1.57
famous_v4jp_1799_200_006691659 - PH 1 TS 0152881 A - 01/04/1816 01:00 - H:M:S=0034:23:31 AVG= 0.81 DLT= 1.50
famous_v4jp_1799_200_006691659 - PH 1 TS 0153271 A - 16/04/1816 01:00 - H:M:S=0034:28:17 AVG= 0.81 DLT= 1.76
famous_v4jp_1799_200_006691659 - PH 1 TS 0153661 A - 01/05/1816 01:00 - H:M:S=0034:33:06 AVG= 0.81 DLT= 1.76
famous_v4jp_1799_200_006691659 - PH 1 TS 0154051 A - 16/05/1816 01:00 - H:M:S=0034:37:51 AVG= 0.81 DLT= 1.37

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Program launched with process id # 13414
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 13503
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v4jp_1799_200_006691659 - PH 1 TS 0154441 A - 01/06/1816 01:00 - H:M:S=0034:49:51 AVG= 0.81 DLT= 1.22
famous_v4jp_1799_200_006691659 - PH 1 TS 0154831 A - 16/06/1816 01:00 - H:M:S=0034:54:34 AVG= 0.81 DLT= 1.87
famous_v4jp_1799_200_006691659 - PH 1 TS 0155221 A - 01/07/1816 01:00 - H:M:S=0034:59:15 AVG= 0.81 DLT= 2.11
famous_v4jp_1799_200_006691659 - PH 1 TS 0155611 A - 16/07/1816 01:00 - H:M:S=0035:04:04 AVG= 0.81 DLT= 1.21
famous_v4jp_1799_200_006691659 - PH 1 TS 0156001 A - 01/08/1816 01:00 - H:M:S=0035:08:50 AVG= 0.81 DLT= 1.51
famous_v4jp_1799_200_006691659 - PH 1 TS 0156391 A - 16/08/1816 01:00 - H:M:S=0035:13:40 AVG= 0.81 DLT= 1.92
famous_v4jp_1799_200_006691659 - PH 1 TS 0156781 A - 01/09/1816 01:00 - H:M:S=0035:18:32 AVG= 0.81 DLT= 1.66
famous_v4jp_1799_200_006691659 - PH 1 TS 0157171 A - 16/09/1816 01:00 - H:M:S=0035:23:23 AVG= 0.81 DLT= 1.49
famous_v4jp_1799_200_006691659 - PH 1 TS 0157561 A - 01/10/1816 01:00 - H:M:S=0035:28:11 AVG= 0.81 DLT= 1.67
famous_v4jp_1799_200_006691659 - PH 1 TS 0157951 A - 16/10/1816 01:00 - H:M:S=0035:32:56 AVG= 0.81 DLT= 1.29
famous_v4jp_1799_200_006691659 - PH 1 TS 0158341 A - 01/11/1816 01:00 - H:M:S=0035:37:43 AVG= 0.81 DLT= 1.54
famous_v4jp_1799_200_006691659 - PH 1 TS 0158731 A - 16/11/1816 01:00 - H:M:S=0035:42:28 AVG= 0.81 DLT= 1.92
Trickling yearly means for 1816
Building file list for 1816 in dataout -- 4 entries
Creating trickle file trickle_famous_v4jp_1799_200_006691659_1_1816.zip for upload...
famous_v4jp_1799_200_006691659 - PH 1 TS 0159121 A - 01/12/1816 01:00 - H:M:S=0035:47:12 AVG= 0.81 DLT= 1.49

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Program launched with process id # 14502
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: No such file or directory
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Program launched with process id # 14551
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 3...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 14578
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

BUFFIN: Read Failed: Inappropriate ioctl for device
BUFFIN: C I/O Error feof - Unit 60 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 61 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 68 - Return code = 1

BUFFIN: Read Failed: Invalid argument
BUFFIN: C I/O Error feof - Unit 69 - Return code = 1
famous_v4jp_1799_200_006691659 - PH 1 TS 0159511 A - 16/12/1816 01:00 - H:M:S=0035:59:16 AVG= 0.81 DLT= 1.67

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 14656
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Program launched with process id # 14728
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
famous_v4jp_1799_200_006691659 - PH 1 TS 0159901 A - 01/01/1817 01:00 - H:M:S=0036:07:59 AVG= 0.81 DLT= 1.58

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Program launched with process id # 14821
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
famous_v4jp_1799_200_006691659 - PH 1 TS 0160291 A - 16/01/1817 01:00 - H:M:S=0036:15:36 AVG= 0.81 DLT= 1.84
famous_v4jp_1799_200_006691659 - PH 1 TS 0160681 A - 01/02/1817 01:00 - H:M:S=0036:20:17 AVG= 0.81 DLT= 1.91
famous_v4jp_1799_200_006691659 - PH 1 TS 0161071 A - 16/02/1817 01:00 - H:M:S=0036:24:58 AVG= 0.81 DLT= 1.53

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Program launched with process id # 15103
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
famous_v4jp_1799_200_006691659 - PH 1 TS 0161461 A - 01/03/1817 01:00 - H:M:S=0036:32:23 AVG= 0.81 DLT= 1.69
famous_v4jp_1799_200_006691659 - PH 1 TS 0161851 A - 16/03/1817 01:00 - H:M:S=0036:37:09 AVG= 0.81 DLT= 1.50
famous_v4jp_1799_200_006691659 - PH 1 TS 0162241 A - 01/04/1817 01:00 - H:M:S=0036:41:56 AVG= 0.81 DLT= 1.45
famous_v4jp_1799_200_006691659 - PH 1 TS 0162631 A - 16/04/1817 01:00 - H:M:S=0036:46:43 AVG= 0.81 DLT= 1.72
famous_v4jp_1799_200_006691659 - PH 1 TS 0163021 A - 01/05/1817 01:00 - H:M:S=0036:51:27 AVG= 0.81 DLT= 1.22
famous_v4jp_1799_200_006691659 - PH 1 TS 0163411 A - 16/05/1817 01:00 - H:M:S=0036:56:13 AVG= 0.81 DLT= 1.64
famous_v4jp_1799_200_006691659 - PH 1 TS 0163801 A - 01/06/1817 01:00 - H:M:S=0037:00:58 AVG= 0.81 DLT= 1.45

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 15713
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v4jp_1799_200_006691659 - PH 1 TS 0164191 A - 16/06/1817 01:00 - H:M:S=0037:09:42 AVG= 0.81 DLT= 1.33
famous_v4jp_1799_200_006691659 - PH 1 TS 0164581 A - 01/07/1817 01:00 - H:M:S=0037:14:27 AVG= 0.81 DLT= 1.19

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 1...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 15857
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v4jp_1799_200_006691659 - PH 1 TS 0164581 A - 01/07/1817 01:00 - H:M:S=0037:14:28 AVG= 0.81 DLT=-0.00

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 2...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 15862
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v4jp_1799_200_006691659 - PH 1 TS 0164581 A - 01/07/1817 01:00 - H:M:S=0037:14:31 AVG= 0.81 DLT= 0.00

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 3...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Program launched with process id # 15864
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
famous_v4jp_1799_200_006691659 - PH 1 TS 0164581 A - 01/07/1817 01:00 - H:M:S=0037:14:32 AVG= 0.81 DLT= 0.00

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 4...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 15866
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v4jp_1799_200_006691659 - PH 1 TS 0164581 A - 01/07/1817 01:00 - H:M:S=0037:14:34 AVG= 0.81 DLT= 0.00

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Model restart required...
Preparing for restart attempt # 5...
Starting model ID famous_v4jp_1799_200_006691659   Phase 1
Getting pthread attributes - retval=0
Setting pthread size (62914560 bytes) - retval=0
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu
Executing program /home/jsc/BOINC/projects/climateprediction.net/famous_um_6.11_i686-pc-linux-gnu 137600 /home/jsc/BOINC/slots/0
Program launched with process id # 15868
Climate model starting - use graphics to monitor progress.
Or visit the website to see the graphs for this run.
famous_v4jp_1799_200_006691659 - PH 1 TS 0164581 A - 01/07/1817 01:00 - H:M:S=0037:14:35 AVG= 0.81 DLT= 0.00

Model crashed: ATM_DYN : INVALID THETA DETECTED.                                                                                                                                                                                                                               tmp/pipe_dummy                                                                  
Sorry, too many model crashes! :-(
Model restart required...
Sorry, too many model crashes! :-(
Cleaning up from the run...
 (16559): called boinc_finish
Detaching shared memory...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
10 Sep 2010 02:43:27 922557 11718065 famous_v4jp_1799_200_006691659_1 159,146 128,832 0.8095
09 Sep 2010 23:46:22 922557 11718065 famous_v4jp_1799_200_006691659_1 149,786 121,531 0.8114
09 Sep 2010 20:04:00 922557 11718065 famous_v4jp_1799_200_006691659_1 140,426 113,023 0.8049
09 Sep 2010 16:53:54 922557 11718065 famous_v4jp_1799_200_006691659_1 131,066 105,697 0.8064
09 Sep 2010 13:51:42 922557 11718065 famous_v4jp_1799_200_006691659_1 121,706 98,069 0.8058
09 Sep 2010 10:41:16 922557 11718065 famous_v4jp_1799_200_006691659_1 112,346 90,187 0.8028
09 Sep 2010 07:55:48 922557 11718065 famous_v4jp_1799_200_006691659_1 102,986 83,103 0.8069
09 Sep 2010 04:54:53 922557 11718065 famous_v4jp_1799_200_006691659_1 93,626 75,717 0.8087
09 Sep 2010 01:39:42 922557 11718065 famous_v4jp_1799_200_006691659_1 84,266 67,990 0.8068
08 Sep 2010 22:01:22 922557 11718065 famous_v4jp_1799_200_006691659_1 74,906 59,249 0.7910
08 Sep 2010 18:57:13 922557 11718065 famous_v4jp_1799_200_006691659_1 65,546 52,019 0.7936
08 Sep 2010 15:56:45 922557 11718065 famous_v4jp_1799_200_006691659_1 56,186 44,914 0.7994
08 Sep 2010 12:34:42 922557 11718065 famous_v4jp_1799_200_006691659_1 46,826 36,349 0.7763
08 Sep 2010 09:38:25 922557 11718065 famous_v4jp_1799_200_006691659_1 37,466 29,035 0.7750
08 Sep 2010 06:37:41 922557 11718065 famous_v4jp_1799_200_006691659_1 28,106 21,371 0.7604
08 Sep 2010 03:54:42 922557 11718065 famous_v4jp_1799_200_006691659_1 18,746 14,533 0.7753
08 Sep 2010 01:08:49 922557 11718065 famous_v4jp_1799_200_006691659_1 9,386 7,544 0.8038


©2024 cpdn.org