Task 15722649

Name	hadcm3n_48il_1940_40_008312846_2
Workunit	8463981
Created	12 Apr 2013, 14:38:16 UTC
Sent	12 Apr 2013, 14:38:20 UTC
Report deadline	12 Jul 2013, 22:05:31 UTC
Received	17 Apr 2013, 20:32:18 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1253297
Run time	3 days 1 hours 9 min 59 sec
CPU time	2 days 18 hours 33 min 6 sec
Validate state	Invalid
Credit	1,555.20
Device peak FLOPS	2.90 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... OPEN: File Creation Failed: Too many open files in system OPEN: Unable to Open File dataout/48ilka.dae69r0 for Read/Write Model crashed: DUMPCTL : Fail to open output dump - may already exist tmp/pipe_dummy 2048 Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=39726, iMonCtr=1 Model crash detected, will try to restart... SIGBUS: bus error built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) Mon Apr 15 19:16:56 2013 Thread 0 Crashed: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc538 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x904f0000 - 0x904f7fff /usr/lib/system/libsystem_dnssd.dylib 0x90544000 - 0x90549fff /usr/lib/system/libmacho.dylib 0x912e2000 - 0x912e3fff /usr/lib/system/libremovefile.dylib 0x913ed000 - 0x913f1fff /usr/lib/system/libcache.dylib 0x914a9000 - 0x91574fff /usr/lib/system/libsystem_c.dylib 0x91a7b000 - 0x91a7cfff /usr/lib/system/libsystem_sandbox.dylib 0x923c8000 - 0x923d6fff /usr/lib/libz.1.dylib 0x923ed000 - 0x923fbfff /usr/lib/system/libdispatch.dylib 0x9306d000 - 0x9309cfff /usr/lib/system/libsystem_info.dylib 0x93100000 - 0x93100fff /usr/lib/system/libkeymgr.dylib 0x9310c000 - 0x9310ffff /usr/lib/system/libmathCommon.A.dylib 0x931d5000 - 0x931ddfff /usr/lib/system/liblaunch.dylib 0x9346e000 - 0x93472fff /usr/lib/system/libsystem_network.dylib 0x95831000 - 0x95839fff /usr/lib/system/libcopyfile.dylib 0x95b9a000 - 0x95bddfff /usr/lib/system/libcommonCrypto.dylib 0x95e6f000 - 0x95e77fff /usr/lib/system/libunwind.dylib 0x95eda000 - 0x95ee1fff /usr/lib/system/libsystem_notify.dylib 0x97bbb000 - 0x97bd1fff /usr/lib/system/libxpc.dylib 0x9813c000 - 0x9813dfff /usr/lib/system/libquarantine.dylib 0x98277000 - 0x98278fff /usr/lib/system/libunc.dylib 0x985aa000 - 0x985abfff /usr/lib/system/libsystem_blocks.dylib 0x985b4000 - 0x985b6fff /usr/lib/system/libdyld.dylib 0x99754000 - 0x99782fff /usr/lib/libSystem.B.dylib 0x99838000 - 0x9983bfff /usr/lib/system/libcompiler_rt.dylib 0x99d01000 - 0x99d1ffff /usr/lib/system/libsystem_kernel.dylib 0x9a05b000 - 0x9a05bfff /usr/lib/system/libdnsinfo.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=39726, iMonCtr=1 Model crash detected, will try to restart... Model crashed: jobs/climate.cpdc Model crashed: jobs/climate.cpdc OPEN: File Open Failed: Too many open files in system OPEN: Unable to Open File datain/ancil/SPARC_O3_rebuild_1900 for Reading Model crashed: INANCLA: Error opening file tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
17 Apr 2013 20:33:05	1253297	15722649	hadcm3n_48il_1940_40_008312846_2	129,600	205,853	1.5884
17 Apr 2013 20:33:05	1253297	15722649	hadcm3n_48il_1940_40_008312846_2	103,680	164,732	1.5889
17 Apr 2013 20:33:05	1253297	15722649	hadcm3n_48il_1940_40_008312846_2	77,760	123,516	1.5884
17 Apr 2013 20:33:05	1253297	15722649	hadcm3n_48il_1940_40_008312846_2	51,840	82,366	1.5889
13 Apr 2013 04:11:57	1253297	15722649	hadcm3n_48il_1940_40_008312846_2	25,920	41,217	1.5902