Task 15442609

Name	hadcm3n_zin9_1880_40_008246536_0
Workunit	8401660
Created	21 Nov 2012, 1:57:36 UTC
Sent	21 Nov 2012, 1:57:38 UTC
Report deadline	20 Feb 2013, 9:24:49 UTC
Received	6 Dec 2012, 13:06:01 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1241743
Run time	12 days 13 hours 6 min 17 sec
CPU time	9 days 15 hours 7 min 22 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	1.17 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 13:00:12 (23667): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish SETPOS: Seek Failed: Invalid argument SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 SETPOS: Seek Failed: Invalid argument SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 SETPOS: Seek Failed: Invalid argument SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 SETPOS: Seek Failed: Invalid argument SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 SETPOS: Seek Failed: Invalid argument SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 SETPOS: Seek Failed: Invalid argument SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 63 to Word Address -198 Failed with Error Code -1 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 Dec 2012 09:29:35	1241743	15442609	hadcm3n_zin9_1880_40_008246536_0	518,400	793,418	1.5305
04 Dec 2012 16:59:02	1241743	15442609	hadcm3n_zin9_1880_40_008246536_0	492,480	753,582	1.5302
04 Dec 2012 00:55:27	1241743	15442609	hadcm3n_zin9_1880_40_008246536_0	466,560	714,778	1.5320
03 Dec 2012 11:59:59	1241743	15442609	hadcm3n_zin9_1880_40_008246536_0	440,640	677,129	1.5367
02 Dec 2012 18:59:40	1241743	15442609	hadcm3n_zin9_1880_40_008246536_0	414,720	639,814	1.5428
02 Dec 2012 03:22:37	1241743	15442609	hadcm3n_zin9_1880_40_008246536_0	388,800	601,957	1.5482
01 Dec 2012 15:27:45	1241743	15442609	hadcm3n_zin9_1880_40_008246536_0	362,880	564,104	1.5545
30 Nov 2012 23:34:11	1241743	15442609	hadcm3n_zin9_1880_40_008246536_0	336,960	525,925	1.5608
30 Nov 2012 07:56:38	1241743	15442609	hadcm3n_zin9_1880_40_008246536_0	311,040	487,951	1.5688
29 Nov 2012 17:34:08	1241743	15442609	hadcm3n_zin9_1880_40_008246536_0	285,120	446,462	1.5659
28 Nov 2012 23:35:33	1241743	15442609	hadcm3n_zin9_1880_40_008246536_0	259,200	404,759	1.5616
28 Nov 2012 08:56:51	1241743	15442609	hadcm3n_zin9_1880_40_008246536_0	233,280	366,483	1.5710
27 Nov 2012 16:40:21	1241743	15442609	hadcm3n_zin9_1880_40_008246536_0	207,360	326,839	1.5762
27 Nov 2012 00:01:48	1241743	15442609	hadcm3n_zin9_1880_40_008246536_0	181,440	287,563	1.5849
26 Nov 2012 03:08:56	1241743	15442609	hadcm3n_zin9_1880_40_008246536_0	155,520	249,244	1.6026
25 Nov 2012 14:41:39	1241743	15442609	hadcm3n_zin9_1880_40_008246536_0	129,600	209,487	1.6164
24 Nov 2012 14:49:41	1241743	15442609	hadcm3n_zin9_1880_40_008246536_0	103,680	168,235	1.6226
23 Nov 2012 18:05:11	1241743	15442609	hadcm3n_zin9_1880_40_008246536_0	77,760	126,173	1.6226
23 Nov 2012 00:28:43	1241743	15442609	hadcm3n_zin9_1880_40_008246536_0	51,840	83,807	1.6166
21 Nov 2012 23:55:55	1241743	15442609	hadcm3n_zin9_1880_40_008246536_0	25,920	38,991	1.5043