Task 15720060

Name	hadcm3n_3gtb_1940_40_008262977_3
Workunit	8418101
Created	10 Apr 2013, 10:54:07 UTC
Sent	10 Apr 2013, 10:54:27 UTC
Report deadline	10 Jul 2013, 18:21:38 UTC
Received	28 May 2013, 4:26:26 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1278132
Run time	23 days 13 hours 15 min 16 sec
CPU time	18 days 22 hours 55 min 6 sec
Validate state	Invalid
Credit	11,508.48
Device peak FLOPS	3.11 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu
Stderr	<core_client_version>6.12.34</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish 19:27:24 (1205): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish 22:00:34 (1205): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:05:54 (2195): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:18:47 (3997): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish CPDN Monitor - Quit request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1224, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 2 received, exiting... Called boinc_finish Signal 15 received, exiting... Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Signal 15 received, exiting... Called boinc_finish Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Model crashed: ATM_DYN : INVALID THETA DETECTED. tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
24 May 2013 11:23:45	1278132	15720060	hadcm3n_3gtb_1940_40_008262977_3	959,040	1,618,791	1.6879
24 May 2013 11:23:45	1278132	15720060	hadcm3n_3gtb_1940_40_008262977_3	933,120	1,570,841	1.6834
24 May 2013 11:23:45	1278132	15720060	hadcm3n_3gtb_1940_40_008262977_3	907,200	1,523,668	1.6795
16 May 2013 22:51:12	1278132	15720060	hadcm3n_3gtb_1940_40_008262977_3	881,280	1,476,396	1.6753
15 May 2013 23:38:44	1278132	15720060	hadcm3n_3gtb_1940_40_008262977_3	855,360	1,429,110	1.6708
15 May 2013 14:17:27	1278132	15720060	hadcm3n_3gtb_1940_40_008262977_3	829,440	1,384,354	1.6690
15 May 2013 14:17:27	1278132	15720060	hadcm3n_3gtb_1940_40_008262977_3	803,520	1,347,296	1.6767
15 May 2013 14:17:27	1278132	15720060	hadcm3n_3gtb_1940_40_008262977_3	777,600	1,307,760	1.6818
15 May 2013 14:17:27	1278132	15720060	hadcm3n_3gtb_1940_40_008262977_3	751,680	1,266,703	1.6852
15 May 2013 14:17:27	1278132	15720060	hadcm3n_3gtb_1940_40_008262977_3	725,760	1,229,932	1.6947
15 May 2013 14:17:27	1278132	15720060	hadcm3n_3gtb_1940_40_008262977_3	699,840	1,185,102	1.6934
15 May 2013 14:17:27	1278132	15720060	hadcm3n_3gtb_1940_40_008262977_3	673,920	1,140,743	1.6927
15 May 2013 14:17:27	1278132	15720060	hadcm3n_3gtb_1940_40_008262977_3	648,000	1,095,752	1.6910
15 May 2013 14:17:27	1278132	15720060	hadcm3n_3gtb_1940_40_008262977_3	622,080	1,050,922	1.6894
15 May 2013 14:17:27	1278132	15720060	hadcm3n_3gtb_1940_40_008262977_3	596,160	1,012,003	1.6975
10 May 2013 11:27:18	1278132	15720060	hadcm3n_3gtb_1940_40_008262977_3	570,240	971,221	1.7032
10 May 2013 11:27:18	1278132	15720060	hadcm3n_3gtb_1940_40_008262977_3	544,320	936,405	1.7203
10 May 2013 11:27:18	1278132	15720060	hadcm3n_3gtb_1940_40_008262977_3	518,400	890,719	1.7182
10 May 2013 11:27:18	1278132	15720060	hadcm3n_3gtb_1940_40_008262977_3	492,480	844,449	1.7147
10 May 2013 11:27:18	1278132	15720060	hadcm3n_3gtb_1940_40_008262977_3	466,560	797,890	1.7102