Task 13769825

Name	hadcm3n_o0kk_1940_40_007451144_3
Workunit	7648647
Created	12 Dec 2011, 18:49:11 UTC
Sent	13 Dec 2011, 13:18:42 UTC
Report deadline	13 Mar 2012, 20:45:53 UTC
Received	28 Dec 2011, 14:15:09 UTC
Server state	Over
Outcome	Success
Client state	Done
Exit status	0 (0x00000000)
Computer ID	1183755
Run time	14 days 0 hours 51 min 41 sec
CPU time	10 days 13 hours 46 min 34 sec
Validate state	Valid
Credit	12,441.60
Device peak FLOPS	3.54 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin
Stderr	<core_client_version>6.12.35</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... OPEN: File Creation Failed: Too many open files in system OPEN: Unable to Open File dataout/o0kkko.dae23i0 for Read/Write Model crashed: DUMPCTL : Fail to open output dump - may already exist tmp/pipe_dummy 2048 Suspended CPDN Monitor - Suspend request from BOINC... SIGBUS: bus error built using BOINC library version 6.13.0 Machine type Intel 80486 (32-bit executable) Wed Dec 14 05:59:51 2011 Thread 0 Crashed: Thread 0 crashed with X86 Thread State (32-bit): eax: 0x00000000 ebx: 0x00000000 ecx: 0x00000000 edx: 0x00000000 edi: 0x00000000 esi: 0x00000000 ebp: 0xbfffc588 esp: 0x00000000 ss: 0x00000000 efl: 0x00000000 eip: 0x00447dc2 cs: 0x00000000 ds: 0x00000000 es: 0x00000000 fs: 0x00000000 gs: 0x00000000 Binary Images Description: 0x1000 - 0x4cbfff /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_um_6.07_i686-apple-darwin 0x902cb000 - 0x90396fff /usr/lib/system/libsystem_c.dylib 0x906b5000 - 0x906e4fff /usr/lib/system/libsystem_info.dylib 0x90c2d000 - 0x90c70fff /usr/lib/system/libcommonCrypto.dylib 0x9103f000 - 0x91042fff /usr/lib/system/libcompiler_rt.dylib 0x91a07000 - 0x91a1dfff /usr/lib/system/libxpc.dylib 0x91d65000 - 0x91d93fff /usr/lib/libSystem.B.dylib 0x924be000 - 0x924c5fff /usr/lib/system/libsystem_notify.dylib 0x9376c000 - 0x9376dfff /usr/lib/system/libquarantine.dylib 0x9376e000 - 0x93770fff /usr/lib/system/libdyld.dylib 0x939c4000 - 0x939c4fff /usr/lib/system/libdnsinfo.dylib 0x95654000 - 0x95662fff /usr/lib/system/libdispatch.dylib 0x96917000 - 0x9691ffff /usr/lib/system/liblaunch.dylib 0x96d61000 - 0x96d69fff /usr/lib/system/libunwind.dylib 0x97779000 - 0x97781fff /usr/lib/system/libcopyfile.dylib 0x9790e000 - 0x9790ffff /usr/lib/system/libunc.dylib 0x97b15000 - 0x97b15fff /usr/lib/system/libkeymgr.dylib 0x97b16000 - 0x97b17fff /usr/lib/system/libsystem_blocks.dylib 0x982ef000 - 0x9830dfff /usr/lib/system/libsystem_kernel.dylib 0x98e1e000 - 0x98e22fff /usr/lib/system/libcache.dylib 0x9a068000 - 0x9a06cfff /usr/lib/system/libsystem_network.dylib 0x9a082000 - 0x9a087fff /usr/lib/system/libmacho.dylib 0x9beb4000 - 0x9beb5fff /usr/lib/system/libsystem_sandbox.dylib 0x9bec1000 - 0x9bec8fff /usr/lib/system/libsystem_dnssd.dylib 0x9bf91000 - 0x9bf92fff /usr/lib/system/libremovefile.dylib 0x9c591000 - 0x9c594fff /usr/lib/system/libmathCommon.A.dylib 0x9ca98000 - 0x9caa6fff /usr/lib/libz.1.dylib Exiting... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=76313, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
28 Dec 2011 14:16:07	1183755	13769825	hadcm3n_o0kk_1940_40_007451144_3	1,036,800	913,222	0.8808
28 Dec 2011 04:18:51	1183755	13769825	hadcm3n_o0kk_1940_40_007451144_3	1,010,880	889,409	0.8798
27 Dec 2011 20:16:30	1183755	13769825	hadcm3n_o0kk_1940_40_007451144_3	984,960	866,071	0.8793
27 Dec 2011 11:33:10	1183755	13769825	hadcm3n_o0kk_1940_40_007451144_3	959,040	842,563	0.8785
27 Dec 2011 02:56:07	1183755	13769825	hadcm3n_o0kk_1940_40_007451144_3	933,120	819,274	0.8780
26 Dec 2011 18:53:47	1183755	13769825	hadcm3n_o0kk_1940_40_007451144_3	907,200	795,502	0.8769
26 Dec 2011 10:00:25	1183755	13769825	hadcm3n_o0kk_1940_40_007451144_3	881,280	772,007	0.8760
26 Dec 2011 01:33:46	1183755	13769825	hadcm3n_o0kk_1940_40_007451144_3	855,360	748,505	0.8751
25 Dec 2011 18:23:00	1183755	13769825	hadcm3n_o0kk_1940_40_007451144_3	829,440	724,992	0.8741
25 Dec 2011 08:28:53	1183755	13769825	hadcm3n_o0kk_1940_40_007451144_3	803,520	701,518	0.8731
25 Dec 2011 00:16:41	1183755	13769825	hadcm3n_o0kk_1940_40_007451144_3	777,600	678,004	0.8719
24 Dec 2011 16:11:20	1183755	13769825	hadcm3n_o0kk_1940_40_007451144_3	751,680	654,458	0.8707
24 Dec 2011 07:34:43	1183755	13769825	hadcm3n_o0kk_1940_40_007451144_3	725,760	630,945	0.8694
24 Dec 2011 00:03:14	1183755	13769825	hadcm3n_o0kk_1940_40_007451144_3	699,840	607,463	0.8680
23 Dec 2011 14:47:34	1183755	13769825	hadcm3n_o0kk_1940_40_007451144_3	673,920	583,941	0.8665
23 Dec 2011 06:40:45	1183755	13769825	hadcm3n_o0kk_1940_40_007451144_3	648,000	560,416	0.8648
22 Dec 2011 21:42:51	1183755	13769825	hadcm3n_o0kk_1940_40_007451144_3	622,080	536,871	0.8630
22 Dec 2011 13:24:43	1183755	13769825	hadcm3n_o0kk_1940_40_007451144_3	596,160	513,348	0.8611
22 Dec 2011 05:57:35	1183755	13769825	hadcm3n_o0kk_1940_40_007451144_3	570,240	489,830	0.8590
21 Dec 2011 20:39:15	1183755	13769825	hadcm3n_o0kk_1940_40_007451144_3	544,320	466,198	0.8565