Task 15505454

Name	hadcm3n_zm38_1880_40_008250295_3
Workunit	8405419
Created	24 Dec 2012, 11:15:45 UTC
Sent	27 Dec 2012, 22:28:06 UTC
Report deadline	29 Mar 2013, 5:55:17 UTC
Received	21 Apr 2013, 11:13:41 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	193 (0x000000C1) EXIT_SIGNAL
Computer ID	1180411
Run time	10 days 16 hours 21 min 48 sec
CPU time	9 days 23 hours 35 min 42 sec
Validate state	Invalid
Credit	6,220.80
Device peak FLOPS	2.85 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>7.0.28</core_client_version> <![CDATA[ <message> - exit code 193 (0xc1) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4336, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=18360, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6204, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5768, iMonCtr=1 Model crash detected, will try to restart... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5916, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5460, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 21:30:57 (5940): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:13:39 (6108): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5604, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5604, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3064, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6052, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6344, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=8128, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=660, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5228, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5792, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2712, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7568, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5032, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 19:50:29 (6588): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7272, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:52:57 (5468): Can't set up shared mem: -1. Will run in standalone mode. 20:53:38 (7256): Can't set up shared mem: -1. Will run in standalone mode. 20:54:55 (6920): Can't acquire lockfile (32) - waiting 35s 20:55:30 (6920): Can't acquire lockfile (32) - exiting 20:55:30 (6920): Error: Der Prozess kann nicht auf die Datei zugreifen, da sie von einem anderen Prozess verwendet wird. (0x20) 21:37:46 (8436): Can't acquire lockfile (32) - waiting 35s 21:38:21 (8436): Can't acquire lockfile (32) - exiting 21:38:21 (8436): Error: Der Prozess kann nicht auf die Datei zugreifen, da sie von einem anderen Prozess verwendet wird. (0x20) 21:48:53 (6156): Can't acquire lockfile (32) - waiting 35s 21:49:28 (6156): Can't acquire lockfile (32) - exiting 21:49:28 (6156): Error: Der Prozess kann nicht auf die Datei zugreifen, da sie von einem anderen Prozess verwendet wird. (0x20) CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5576, iMonCtr=1 Model crash detected, will try to restart... CCPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5096, iMonCtr=1 Model crash detected, will try to restart... Signal 11 received, exiting... Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
20 Apr 2013 10:39:30	1180411	15505454	hadcm3n_zm38_1880_40_008250295_3	518,400	862,527	1.6638
07 Apr 2013 17:11:24	1180411	15505454	hadcm3n_zm38_1880_40_008250295_3	492,480	814,991	1.6549
31 Mar 2013 19:48:10	1180411	15505454	hadcm3n_zm38_1880_40_008250295_3	466,560	773,411	1.6577
30 Mar 2013 10:19:53	1180411	15505454	hadcm3n_zm38_1880_40_008250295_3	440,640	730,042	1.6568
25 Mar 2013 19:08:03	1180411	15505454	hadcm3n_zm38_1880_40_008250295_3	414,720	692,712	1.6703
23 Mar 2013 16:15:52	1180411	15505454	hadcm3n_zm38_1880_40_008250295_3	388,800	648,970	1.6692
17 Mar 2013 16:45:48	1180411	15505454	hadcm3n_zm38_1880_40_008250295_3	362,880	606,522	1.6714
07 Mar 2013 19:09:02	1180411	15505454	hadcm3n_zm38_1880_40_008250295_3	336,960	562,459	1.6692
01 Mar 2013 23:09:00	1180411	15505454	hadcm3n_zm38_1880_40_008250295_3	311,040	518,833	1.6681
14 Feb 2013 20:43:23	1180411	15505454	hadcm3n_zm38_1880_40_008250295_3	285,120	470,711	1.6509
10 Feb 2013 22:53:48	1180411	15505454	hadcm3n_zm38_1880_40_008250295_3	259,200	428,297	1.6524
03 Feb 2013 11:48:32	1180411	15505454	hadcm3n_zm38_1880_40_008250295_3	233,280	383,726	1.6449
30 Jan 2013 18:06:05	1180411	15505454	hadcm3n_zm38_1880_40_008250295_3	207,360	340,602	1.6426
19 Jan 2013 17:21:12	1180411	15505454	hadcm3n_zm38_1880_40_008250295_3	181,440	298,322	1.6442
16 Jan 2013 00:35:30	1180411	15505454	hadcm3n_zm38_1880_40_008250295_3	155,520	256,885	1.6518
12 Jan 2013 19:00:19	1180411	15505454	hadcm3n_zm38_1880_40_008250295_3	129,600	214,187	1.6527
10 Jan 2013 22:02:12	1180411	15505454	hadcm3n_zm38_1880_40_008250295_3	103,680	171,289	1.6521
07 Jan 2013 21:23:52	1180411	15505454	hadcm3n_zm38_1880_40_008250295_3	77,760	128,431	1.6516
31 Dec 2012 11:55:03	1180411	15505454	hadcm3n_zm38_1880_40_008250295_3	51,840	85,743	1.6540
29 Dec 2012 12:30:55	1180411	15505454	hadcm3n_zm38_1880_40_008250295_3	25,920	43,368	1.6731