Task 15484953

Name	hadcm3n_39ot_1940_40_008257549_0
Workunit	8412673
Created	20 Dec 2012, 7:42:07 UTC
Sent	20 Dec 2012, 7:42:13 UTC
Report deadline	21 Mar 2013, 15:09:24 UTC
Received	14 Mar 2013, 1:48:53 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1118964
Run time	10 days 9 hours 57 min 25 sec
CPU time	9 days 10 hours 57 min 42 sec
Validate state	Invalid
Credit	4,665.60
Device peak FLOPS	2.18 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.24</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 10:30:14 (1630): No heartbeat from core client for 30 sec - exiting 10:30:18 (1630): No heartbeat from core client for 30 sec - exiting 10:30:19 (1630): No heartbeat from core client for 30 sec - exiting 10:30:23 (1630): No heartbeat from core client for 30 sec - exiting 10:30:24 (1630): No heartbeat from core client for 30 sec - exiting 10:30:25 (1630): No heartbeat from core client for 30 sec - exiting 10:30:26 (1630): No heartbeat from core client for 30 sec - exiting 10:30:27 (1630): No heartbeat from core client for 30 sec - exiting 10:30:28 (1630): No heartbeat from core client for 30 sec - exiting 10:30:29 (1630): No heartbeat from core client for 30 sec - exiting 10:30:30 (1630): No heartbeat from core client for 30 sec - exiting 10:30:31 (1630): No heartbeat from core client for 30 sec - exiting 10:30:32 (1630): No heartbeat from core client for 30 sec - exiting 10:30:33 (1630): No heartbeat from core client for 30 sec - exiting 10:30:34 (1630): No heartbeat from core client for 30 sec - exiting 10:30:35 (1630): No heartbeat from core client for 30 sec - exiting 10:30:36 (1630): No heartbeat from core client for 30 sec - exiting 10:30:37 (1630): No heartbeat from core client for 30 sec - exiting 10:30:38 (1630): No heartbeat from core client for 30 sec - exiting 10:30:39 (1630): No heartbeat from core client for 30 sec - exiting 10:30:40 (1630): No heartbeat from core client for 30 sec - exiting 10:30:41 (1630): No heartbeat from core client for 30 sec - exiting 10:30:42 (1630): No heartbeat from core client for 30 sec - exiting 10:30:43 (1630): No heartbeat from core client for 30 sec - exiting 10:30:44 (1630): No heartbeat from core client for 30 sec - exiting 10:30:45 (1630): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 63 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 65 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1531, selfPID=1531, iMonCtr=1 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 3 received, exiting... Called boinc_finish SIGSEGV: segmentation violation Stack trace (10 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0x9f5400] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804e73f] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804e767] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804e921] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8052eb0] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050763] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8051127] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/i386-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x3164d3] Exiting... </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
13 Mar 2013 04:13:46	1118964	15484953	hadcm3n_39ot_1940_40_008257549_0	388,800	798,246	2.0531
08 Mar 2013 07:26:02	1118964	15484953	hadcm3n_39ot_1940_40_008257549_0	362,880	750,497	2.0682
06 Mar 2013 03:19:34	1118964	15484953	hadcm3n_39ot_1940_40_008257549_0	336,960	703,138	2.0867
15 Feb 2013 07:31:54	1118964	15484953	hadcm3n_39ot_1940_40_008257549_0	311,040	654,012	2.1027
12 Feb 2013 08:39:35	1118964	15484953	hadcm3n_39ot_1940_40_008257549_0	285,120	598,566	2.0993
06 Feb 2013 08:48:10	1118964	15484953	hadcm3n_39ot_1940_40_008257549_0	259,200	543,366	2.0963
04 Feb 2013 02:06:14	1118964	15484953	hadcm3n_39ot_1940_40_008257549_0	233,280	489,938	2.1002
30 Jan 2013 02:22:18	1118964	15484953	hadcm3n_39ot_1940_40_008257549_0	207,360	435,820	2.1018
24 Jan 2013 08:16:02	1118964	15484953	hadcm3n_39ot_1940_40_008257549_0	181,440	382,428	2.1077
21 Jan 2013 08:46:13	1118964	15484953	hadcm3n_39ot_1940_40_008257549_0	155,520	328,338	2.1112
17 Jan 2013 04:13:39	1118964	15484953	hadcm3n_39ot_1940_40_008257549_0	129,600	274,259	2.1162
14 Jan 2013 03:57:33	1118964	15484953	hadcm3n_39ot_1940_40_008257549_0	103,680	219,950	2.1214
08 Jan 2013 02:25:41	1118964	15484953	hadcm3n_39ot_1940_40_008257549_0	77,760	165,462	2.1279
03 Jan 2013 05:00:08	1118964	15484953	hadcm3n_39ot_1940_40_008257549_0	51,840	110,575	2.1330
28 Dec 2012 01:52:59	1118964	15484953	hadcm3n_39ot_1940_40_008257549_0	25,920	55,456	2.1395