climateprediction.net home page
Task 16013408

Task 16013408

Name hadcm3n_7yo2_1980_40_008456213_2
Workunit 8607069
Created 12 Sep 2013, 13:52:02 UTC
Sent 12 Sep 2013, 14:39:51 UTC
Report deadline 12 Dec 2013, 22:07:02 UTC
Received 23 Sep 2013, 9:52:08 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1231328
Run time 5 days 6 hours 54 min 26 sec
CPU time 3 days 6 hours 20 min 5 sec
Validate state Invalid
Credit 1,866.24
Device peak FLOPS 3.01 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr 
<core_client_version>7.0.65</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
18:02:10 (51871): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:02:12 (51871): No heartbeat from core client for 30 sec - exiting
18:02:13 (51871): No heartbeat from core client for 30 sec - exiting
18:02:14 (51871): No heartbeat from core client for 30 sec - exiting
18:02:15 (51871): No heartbeat from core client for 30 sec - exiting
18:02:16 (51871): No heartbeat from core client for 30 sec - exiting
05:47:12 (51902): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:47:18 (51902): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
02:34:45 (61856): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:48:36 (65295): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:50:14 (65900): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
06:50:20 (65900): No heartbeat from core client for 30 sec - exiting
06:50:21 (65900): No heartbeat from core client for 30 sec - exiting
Atmos Hold Restart file rename failed on atmos_restart.hold
CPDN Monitor - Quit request from BOINC...
18:26:36 (71742): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
18:51:40 (71938): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:06:41 (72123): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:06:44 (72123): No heartbeat from core client for 30 sec - exiting
19:06:45 (72123): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
07:21:24 (81565): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
05:43:57 (91410): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
18:15:31 (1354): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:37:10 (1478): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:37:11 (1478): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
23:21:46 (12231): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
05:53:05 (22140): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
23:45:15 (32074): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
05:50:58 (34476): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
20:45:54 (42007): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:45:56 (42007): No heartbeat from core client for 30 sec - exiting
21:04:30 (43127): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K549
Sat Sep 21 21:04:46 2013

Thread 0 Crashed:
0   libSystem.B.dylib                   0x95089c5a __kill + 10
1   libSystem.B.dylib                   0x9511c5a5 raise + 26
2   libSystem.B.dylib                   0x951326e4 abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb _start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x95028c0e mach_wait_until + 10
1   libSystem.B.dylib                   0x950b0429 nanosleep + 345
2   libSystem.B.dylib                   0x950b02ca usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 boinc_sleep(double) + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e timer_thread(void*) + 78
5   libSystem.B.dylib                   0x95056259 _pthread_start + 345
6   libSystem.B.dylib                   0x950560de thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc958 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x9035a000 - 0x90368fff /usr/lib/libz.1.dylib
0x90d16000 - 0x90d19fff /usr/lib/system/libmathCommon.A.dylib
0x95028000 - 0x951cffff /usr/lib/libSystem.B.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=43262, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K549
Sat Sep 21 21:04:50 2013

Thread 0 Crashed:
06:13:57 (43262): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K549
Sun Sep 22 06:14:03 2013

Thread 0 Crashed:
0   libSystem.B.dylib                   0x95089c5a __kill + 10
1   libSystem.B.dylib                   0x9511c5a5 raise + 26
2   libSystem.B.dylib                   0x951326e4 abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb _start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x95028c0e mach_wait_until + 10
1   libSystem.B.dylib                   0x950b0429 nanosleep + 345
2   libSystem.B.dylib                   0x950b02ca usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 boinc_sleep(double) + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e timer_thread(void*) + 78
5   libSystem.B.dylib                   0x95056259 _pthread_start + 345
6   libSystem.B.dylib                   0x950560de thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc958 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x9035a000 - 0x90368fff /usr/lib/libz.1.dylib
0x90d16000 - 0x90d19fff /usr/lib/system/libmathCommon.A.dylib
0x95028000 - 0x951cffff /usr/lib/libSystem.B.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=47089, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K549
Sun Sep 22 06:14:05 2013

Thread 0 Crashed:
0   libSystem.B.dylib                   0x95089c5a __kill + 10
1   libSystem.B.dylib                   0x9511c5a5 raise + 26
2   libSystem.B.dylib                   0x951326e4 abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb _start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x95028c0e mach_wait_until + 10
1   libSystem.B.dylib                   0x950b0429 nanosleep + 345
2   libSystem.B.dylib                   0x950b02ca usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 boinc_sleep(double) + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e timer_thread(void*) + 78
5   libSystem.B.dylib                   0x95056259 _pthread_start + 345
6   libSystem.B.dylib                   0x950560de thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc958 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x9035a000 - 0x90368fff /usr/lib/libz.1.dylib
0x90d16000 - 0x90d19fff /usr/lib/system/libmathCommon.A.dylib
0x95028000 - 0x951cffff /usr/lib/libSystem.B.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=47089, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K549
Sun Sep 22 06:14:08 2013

Thread 0 Crashed:
0   libSystem.B.dylib                   0x95089c5a __kill + 10
1   libSystem.B.dylib                   0x9511c5a5 raise + 26
2   libSystem.B.dylib                   0x951326e4 abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb _start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x95028c0e mach_wait_until + 10
1   libSystem.B.dylib                   0x950b0429 nanosleep + 345
2   libSystem.B.dylib                   0x950b02ca usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 boinc_sleep(double) + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e timer_thread(void*) + 78
5   libSystem.B.dylib                   0x95056259 _pthread_start + 345
6   libSystem.B.dylib                   0x950560de thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc958 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x9035a000 - 0x90368fff /usr/lib/libz.1.dylib
0x90d16000 - 0x90d19fff /usr/lib/system/libmathCommon.A.dylib
0x95028000 - 0x951cffff /usr/lib/libSystem.B.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=47089, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K549
Sun Sep 22 06:14:11 2013

Thread 0 Crashed:
0   libSystem.B.dylib                   0x95089c5a __kill + 10
1   libSystem.B.dylib                   0x9511c5a5 raise + 26
2   libSystem.B.dylib                   0x951326e4 abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb _start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x95028c0e mach_wait_until + 10
1   libSystem.B.dylib                   0x950b0429 nanosleep + 345
2   libSystem.B.dylib                   0x950b02ca usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 boinc_sleep(double) + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e timer_thread(void*) + 78
5   libSystem.B.dylib                   0x95056259 _pthread_start + 345
6   libSystem.B.dylib                   0x950560de thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc958 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x9035a000 - 0x90368fff /usr/lib/libz.1.dylib
0x90d16000 - 0x90d19fff /usr/lib/system/libmathCommon.A.dylib
0x95028000 - 0x951cffff /usr/lib/libSystem.B.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=47089, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.8 build 10K549
Sun Sep 22 06:14:14 2013

Thread 0 Crashed:
0   libSystem.B.dylib                   0x95089c5a __kill + 10
1   libSystem.B.dylib                   0x9511c5a5 raise + 26
2   libSystem.B.dylib                   0x951326e4 abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb _start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x95028c0e mach_wait_until + 10
1   libSystem.B.dylib                   0x950b0429 nanosleep + 345
2   libSystem.B.dylib                   0x950b02ca usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 boinc_sleep(double) + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e timer_thread(void*) + 78
5   libSystem.B.dylib                   0x95056259 _pthread_start + 345
6   libSystem.B.dylib                   0x950560de thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc958 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x9035a000 - 0x90368fff /usr/lib/libz.1.dylib
0x90d16000 - 0x90d19fff /usr/lib/system/libmathCommon.A.dylib
0x95028000 - 0x951cffff /usr/lib/libSystem.B.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=47089, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
22 Sep 2013 02:18:36 1231328 16013408 hadcm3n_7yo2_1980_40_008456213_2 155,520 278,299 1.7895
20 Sep 2013 08:49:17 1231328 16013408 hadcm3n_7yo2_1980_40_008456213_2 129,600 231,232 1.7842
19 Sep 2013 06:26:46 1231328 16013408 hadcm3n_7yo2_1980_40_008456213_2 103,680 189,239 1.8252
17 Sep 2013 14:22:53 1231328 16013408 hadcm3n_7yo2_1980_40_008456213_2 77,760 144,740 1.8614
16 Sep 2013 05:30:25 1231328 16013408 hadcm3n_7yo2_1980_40_008456213_2 51,840 96,543 1.8623
14 Sep 2013 10:53:36 1231328 16013408 hadcm3n_7yo2_1980_40_008456213_2 25,920 48,434 1.8686


©2024 climateprediction.net