climateprediction.net home page
Task 12820805

Task 12820805

Name hadcm3n_p27d_1900_40_007220441_1
Workunit 7418681
Created 26 Apr 2011, 15:20:15 UTC
Sent 2 May 2011, 23:04:47 UTC
Report deadline 2 Aug 2011, 6:31:58 UTC
Received 20 May 2011, 14:40:57 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1147179
Run time 3 days 12 hours 38 min 36 sec
CPU time 3 days 1 hours 15 min 26 sec
Validate state Invalid
Credit 2,177.28
Device peak FLOPS 3.25 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
21:40:46 (40255): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:40:47 (40255): No heartbeat from core client for 30 sec - exiting
21:40:48 (40255): No heartbeat from core client for 30 sec - exiting
21:40:49 (40255): No heartbeat from core client for 30 sec - exiting
21:40:50 (40255): No heartbeat from core client for 30 sec - exiting
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.7 build 10J869
Wed May 18 21:40:55 2011

Thread 0 Crashed:
CPDN Monitor - Quit request from BOINC...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.7 build 10J869
Wed May 18 22:42:54 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x91b0d156 ___kill + 10
1   libSystem.B.dylib                   0x91b9f899 _raise + 26
2   libSystem.B.dylib                   0x91bb59b8 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x91aac1ae _mach_wait_until + 10
1   libSystem.B.dylib                   0x91b33809 _nanosleep + 345
2   libSystem.B.dylib                   0x91b336aa _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x91ad97fd __pthread_start + 345
6   libSystem.B.dylib                   0x91ad9682 _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffca18 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x91276000 - 0x91279fff /usr/lib/system/libmathCommon.A.dylib
0x91aab000 - 0x91c52fff /usr/lib/libSystem.B.dylib
0x92c12000 - 0x92c20fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=44616, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.7 build 10J869
Wed May 18 22:42:57 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x91b0d156 ___kill + 10
1   libSystem.B.dylib                   0x91b9f899 _raise + 26
2   libSystem.B.dylib                   0x91bb59b8 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x91aac1ae _mach_wait_until + 10
1   libSystem.B.dylib                   0x91b33809 _nanosleep + 345
2   libSystem.B.dylib                   0x91b336aa _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x91ad97fd __pthread_start + 345
6   libSystem.B.dylib                   0x91ad9682 _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffca18 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x91276000 - 0x91279fff /usr/lib/system/libmathCommon.A.dylib
0x91aab000 - 0x91c52fff /usr/lib/libSystem.B.dylib
0x92c12000 - 0x92c20fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=44616, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.7 build 10J869
Wed May 18 22:42:59 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x91b0d156 ___kill + 10
1   libSystem.B.dylib                   0x91b9f899 _raise + 26
2   libSystem.B.dylib                   0x91bb59b8 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x91aac1ae _mach_wait_until + 10
1   libSystem.B.dylib                   0x91b33809 _nanosleep + 345
2   libSystem.B.dylib                   0x91b336aa _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x91ad97fd __pthread_start + 345
6   libSystem.B.dylib                   0x91ad9682 _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffca18 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x91276000 - 0x91279fff /usr/lib/system/libmathCommon.A.dylib
0x91aab000 - 0x91c52fff /usr/lib/libSystem.B.dylib
0x92c12000 - 0x92c20fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=44616, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.7 build 10J869
Wed May 18 22:43:02 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x91b0d156 ___kill + 10
1   libSystem.B.dylib                   0x91b9f899 _raise + 26
2   libSystem.B.dylib                   0x91bb59b8 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x91aac1ae _mach_wait_until + 10
1   libSystem.B.dylib                   0x91b33809 _nanosleep + 345
2   libSystem.B.dylib                   0x91b336aa _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x91ad97fd __pthread_start + 345
6   libSystem.B.dylib                   0x91ad9682 _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffca18 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x91276000 - 0x91279fff /usr/lib/system/libmathCommon.A.dylib
0x91aab000 - 0x91c52fff /usr/lib/libSystem.B.dylib
0x92c12000 - 0x92c20fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=44616, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.7 build 10J869
Wed May 18 22:43:05 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x91b0d156 ___kill + 10
1   libSystem.B.dylib                   0x91b9f899 _raise + 26
2   libSystem.B.dylib                   0x91bb59b8 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x91aac1ae _mach_wait_until + 10
1   libSystem.B.dylib                   0x91b33809 _nanosleep + 345
2   libSystem.B.dylib                   0x91b336aa _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x91ad97fd __pthread_start + 345
6   libSystem.B.dylib                   0x91ad9682 _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffca18 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x91276000 - 0x91279fff /usr/lib/system/libmathCommon.A.dylib
0x91aab000 - 0x91c52fff /usr/lib/libSystem.B.dylib
0x92c12000 - 0x92c20fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=44616, iMonCtr=1
Model crash detected, will try to restart...
SIGABRT: abort called

Crashed executable name: hadcm3n_um_6.07_i686-apple-darwin
built using BOINC library version 6.13.0
Machine type Intel 80486 (32-bit executable)
System version: Macintosh OS 10.6.7 build 10J869
Wed May 18 22:43:08 2011

Thread 0 Crashed:
0   libSystem.B.dylib                   0x91b0d156 ___kill + 10
1   libSystem.B.dylib                   0x91b9f899 _raise + 26
2   libSystem.B.dylib                   0x91bb59b8 _abort + 93
3   hadcm3n_um_6.07_i686-apple-darwin   0x00336cff _um_setup + 127
4   hadcm3n_um_6.07_i686-apple-darwin   0x00389b71 _um_shell + 3953
5   hadcm3n_um_6.07_i686-apple-darwin   0x000048e1 _main + 1153
6   hadcm3n_um_6.07_i686-apple-darwin   0x000027fb __start + 209
7   hadcm3n_um_6.07_i686-apple-darwin   0x00002729 start + 41

Thread 1:
0   libSystem.B.dylib                   0x91aac1ae _mach_wait_until + 10
1   libSystem.B.dylib                   0x91b33809 _nanosleep + 345
2   libSystem.B.dylib                   0x91b336aa _usleep + 61
3   hadcm3n_um_6.07_i686-apple-darwin   0x00442ec0 __Z11boinc_sleepd + 188
4   hadcm3n_um_6.07_i686-apple-darwin   0x0043865e __Z12timer_threadPv + 78
5   libSystem.B.dylib                   0x91ad97fd __pthread_start + 345
6   libSystem.B.dylib                   0x91ad9682 _thread_start + 34

Thread 0 crashed with X86 Thread State (32-bit):
  eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000
  edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffca18 esp: 0x00000000
   ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2  cs: 0x00000000
   ds: 0x00000000  es: 0x00000000  fs: 0x00000000  gs: 0x00000000

Binary Images Description:
    0x1000 -   0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin
0x91276000 - 0x91279fff /usr/lib/system/libmathCommon.A.dylib
0x91aab000 - 0x91c52fff /usr/lib/libSystem.B.dylib
0x92c12000 - 0x92c20fff /usr/lib/libz.1.dylib


Exiting...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=44616, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
18 May 2011 22:34:31 1147179 12820805 hadcm3n_p27d_1900_40_007220441_1 181,440 244,324 1.3466
17 May 2011 22:01:49 1147179 12820805 hadcm3n_p27d_1900_40_007220441_1 155,520 209,071 1.3443
13 May 2011 04:51:54 1147179 12820805 hadcm3n_p27d_1900_40_007220441_1 129,600 174,137 1.3436
12 May 2011 03:48:46 1147179 12820805 hadcm3n_p27d_1900_40_007220441_1 103,680 139,313 1.3437
10 May 2011 04:48:24 1147179 12820805 hadcm3n_p27d_1900_40_007220441_1 77,760 104,609 1.3453
09 May 2011 17:39:57 1147179 12820805 hadcm3n_p27d_1900_40_007220441_1 51,840 69,661 1.3438
06 May 2011 06:37:18 1147179 12820805 hadcm3n_p27d_1900_40_007220441_1 25,920 35,137 1.3556


©2024 climateprediction.net