climateprediction.net home page
Task 12745165

Task 12745165

Name hadcm3n_o54p_1900_40_007201980_0
Workunit 7400260
Created 28 Mar 2011, 14:12:36 UTC
Sent 30 Mar 2011, 0:01:12 UTC
Report deadline 29 Jun 2011, 7:28:23 UTC
Received 20 Apr 2011, 15:27:56 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1116505
Run time 15 days 6 hours 19 min 22 sec
CPU time 11 days 7 hours 2 min 58 sec
Validate state Invalid
Credit 5,598.72
Device peak FLOPS 2.46 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr 
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
22:07:21 (70145): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:07:22 (70145): No heartbeat from core client for 30 sec - exiting
22:07:23 (70145): No heartbeat from core client for 30 sec - exiting
22:07:24 (70145): No heartbeat from core client for 30 sec - exiting
22:07:25 (70145): No heartbeat from core client for 30 sec - exiting
22:07:26 (70145): No heartbeat from core client for 30 sec - exiting
SIGSEGV: segmentation violation
22:53:28 (46749): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
17:11:26 (47947): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
08:57:24 (382): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:57:25 (382): No heartbeat from core client for 30 sec - exiting
06:55:03 (8288): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:12:59 (17286): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:54:02 (30187): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:54:03 (30187): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
12:57:22 (52790): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
16:58:42 (37743): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.7 build 10J869
Thu Apr 14 16:58:54 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x92642156 __kill + 10
1   libSystem.B.dylib                   0x926d4899 raise + 26
2   libSystem.B.dylib                   0x926ea9b8 abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb _start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x925e11ae mach_wait_until + 10
1   libSystem.B.dylib                   0x92668809 nanosleep + 345
2   libSystem.B.dylib                   0x926686aa usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 boinc_sleep(double) + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e timer_thread(void*) + 78
5   libSystem.B.dylib                   0x9260e7fd _pthread_start + 345
6   libSystem.B.dylib                   0x9260e682 thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffca28 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x92484000 - 0x92487fff /usr/lib/system/libmathCommon.A.dylib
0x925e0000 - 0x92787fff /usr/lib/libSystem.B.dylib
0x984cb000 - 0x984d9fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=44010, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.7 build 10J869
Thu Apr 14 16:59:00 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x92642156 __kill + 10
1   libSystem.B.dylib                   0x926d4899 raise + 26
2   libSystem.B.dylib                   0x926ea9b8 abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb _start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x925e11ae mach_wait_until + 10
1   libSystem.B.dylib                   0x92668809 nanosleep + 345
2   libSystem.B.dylib                   0x926686aa usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 boinc_sleep(double) + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e timer_thread(void*) + 78
5   libSystem.B.dylib                   0x9260e7fd _pthread_start + 345
6   libSystem.B.dylib                   0x9260e682 thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffca28 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x92484000 - 0x92487fff /usr/lib/system/libmathCommon.A.dylib
0x925e0000 - 0x92787fff /usr/lib/libSystem.B.dylib
0x984cb000 - 0x984d9fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=44010, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.7 build 10J869
Thu Apr 14 16:59:03 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x92642156 __kill + 10
1   libSystem.B.dylib                   0x926d4899 raise + 26
2   libSystem.B.dylib                   0x926ea9b8 abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb _start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x925e11ae mach_wait_until + 10
1   libSystem.B.dylib                   0x92668809 nanosleep + 345
2   libSystem.B.dylib                   0x926686aa usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 boinc_sleep(double) + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e timer_thread(void*) + 78
5   libSystem.B.dylib                   0x9260e7fd _pthread_start + 345
6   libSystem.B.dylib                   0x9260e682 thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffca28 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x92484000 - 0x92487fff /usr/lib/system/libmathCommon.A.dylib
0x925e0000 - 0x92787fff /usr/lib/libSystem.B.dylib
0x984cb000 - 0x984d9fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=44010, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.7 build 10J869
Thu Apr 14 16:59:06 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x92642156 __kill + 10
1   libSystem.B.dylib                   0x926d4899 raise + 26
2   libSystem.B.dylib                   0x926ea9b8 abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb _start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x925e11ae mach_wait_until + 10
1   libSystem.B.dylib                   0x92668809 nanosleep + 345
2   libSystem.B.dylib                   0x926686aa usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 boinc_sleep(double) + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e timer_thread(void*) + 78
5   libSystem.B.dylib                   0x9260e7fd _pthread_start + 345
6   libSystem.B.dylib                   0x9260e682 thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffca28 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x92484000 - 0x92487fff /usr/lib/system/libmathCommon.A.dylib
0x925e0000 - 0x92787fff /usr/lib/libSystem.B.dylib
0x984cb000 - 0x984d9fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=44010, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.7 build 10J869
Thu Apr 14 16:59:09 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x92642156 __kill + 10
1   libSystem.B.dylib                   0x926d4899 raise + 26
2   libSystem.B.dylib                   0x926ea9b8 abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb _start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x925e11ae mach_wait_until + 10
1   libSystem.B.dylib                   0x92668809 nanosleep + 345
2   libSystem.B.dylib                   0x926686aa usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 boinc_sleep(double) + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e timer_thread(void*) + 78
5   libSystem.B.dylib                   0x9260e7fd _pthread_start + 345
6   libSystem.B.dylib                   0x9260e682 thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffca28 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x92484000 - 0x92487fff /usr/lib/system/libmathCommon.A.dylib
0x925e0000 - 0x92787fff /usr/lib/libSystem.B.dylib
0x984cb000 - 0x984d9fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=44010, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.7 build 10J869
Thu Apr 14 16:59:12 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x92642156 __kill + 10
1   libSystem.B.dylib                   0x926d4899 raise + 26
2   libSystem.B.dylib                   0x926ea9b8 abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb _start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x925e11ae mach_wait_until + 10
1   libSystem.B.dylib                   0x92668809 nanosleep + 345
2   libSystem.B.dylib                   0x926686aa usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 boinc_sleep(double) + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e timer_thread(void*) + 78
5   libSystem.B.dylib                   0x9260e7fd _pthread_start + 345
6   libSystem.B.dylib                   0x9260e682 thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffca28 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x92484000 - 0x92487fff /usr/lib/system/libmathCommon.A.dylib
0x925e0000 - 0x92787fff /usr/lib/libSystem.B.dylib
0x984cb000 - 0x984d9fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=44010, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
20 Apr 2011 18:21:26 1116505 12745165 hadcm3n_o54p_1900_40_007201980_0 466,560 967,698 2.0741
20 Apr 2011 18:21:26 1116505 12745165 hadcm3n_o54p_1900_40_007201980_0 440,640 918,914 2.0854
12 Apr 2011 22:15:44 1116505 12745165 hadcm3n_o54p_1900_40_007201980_0 414,720 870,035 2.0979
12 Apr 2011 09:07:47 1116505 12745165 hadcm3n_o54p_1900_40_007201980_0 388,800 819,566 2.1079
12 Apr 2011 09:06:16 1116505 12745165 hadcm3n_o54p_1900_40_007201980_0 362,880 768,209 2.1170
12 Apr 2011 09:05:26 1116505 12745165 hadcm3n_o54p_1900_40_007201980_0 336,960 714,333 2.1199
12 Apr 2011 09:04:45 1116505 12745165 hadcm3n_o54p_1900_40_007201980_0 311,040 660,809 2.1245
12 Apr 2011 09:04:08 1116505 12745165 hadcm3n_o54p_1900_40_007201980_0 285,120 606,362 2.1267
07 Apr 2011 21:04:11 1116505 12745165 hadcm3n_o54p_1900_40_007201980_0 259,200 552,414 2.1312
07 Apr 2011 03:51:56 1116505 12745165 hadcm3n_o54p_1900_40_007201980_0 233,280 498,191 2.1356
06 Apr 2011 10:31:07 1116505 12745165 hadcm3n_o54p_1900_40_007201980_0 207,360 443,982 2.1411
05 Apr 2011 17:43:32 1116505 12745165 hadcm3n_o54p_1900_40_007201980_0 181,440 389,925 2.1491
04 Apr 2011 14:28:08 1116505 12745165 hadcm3n_o54p_1900_40_007201980_0 155,520 335,614 2.1580
03 Apr 2011 15:46:12 1116505 12745165 hadcm3n_o54p_1900_40_007201980_0 129,600 280,183 2.1619
02 Apr 2011 18:38:55 1116505 12745165 hadcm3n_o54p_1900_40_007201980_0 103,680 224,528 2.1656
01 Apr 2011 17:44:24 1116505 12745165 hadcm3n_o54p_1900_40_007201980_0 77,760 168,251 2.1637
31 Mar 2011 21:33:56 1116505 12745165 hadcm3n_o54p_1900_40_007201980_0 51,840 112,389 2.1680
31 Mar 2011 02:47:58 1116505 12745165 hadcm3n_o54p_1900_40_007201980_0 25,920 56,012 2.1610


©2024 climateprediction.net