Task 15720036

Name	hadcm3n_3k3n_1980_40_008340486_3
Workunit	8491347
Created	10 Apr 2013, 10:28:01 UTC
Sent	10 Apr 2013, 10:28:05 UTC
Report deadline	10 Jul 2013, 17:55:16 UTC
Received	6 May 2013, 15:33:43 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	957844
Run time	14 days 4 hours 57 min 21 sec
CPU time	14 days 4 hours 57 min 21 sec
Validate state	Invalid
Credit	10,575.36
Device peak FLOPS	2.76 GFLOPS
Application version	UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86
Stderr	<core_client_version>6.4.7</core_client_version> <![CDATA[ <message> Het apparaat herkent de opdracht niet. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1248, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1248, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Model crashed: P_TH_ADJ : NEGATIVE PRESSURE VALUE CREATED. tmp/pipe_dummy 2048 17:20:16 (4172): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 17:54:52 (4844): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 13:12:48 (5860): No heartbeat from core client for 30 sec - exiting 13:12:49 (5860): No heartbeat from core client for 30 sec - exiting 13:12:50 (5860): No heartbeat from core client for 30 sec - exiting 13:12:51 (5860): No heartbeat from core client for 30 sec - exiting 13:12:52 (5860): No heartbeat from core client for 30 sec - exiting 13:12:54 (5860): No heartbeat from core client for 30 sec - exiting 13:12:55 (5860): No heartbeat from core client for 30 sec - exiting 13:12:56 (5860): No heartbeat from core client for 30 sec - exiting 13:12:57 (5860): No heartbeat from core client for 30 sec - exiting 13:12:58 (5860): No heartbeat from core client for 30 sec - exiting 13:12:59 (5860): No heartbeat from core client for 30 sec - exiting 13:13:00 (5860): No heartbeat from core client for 30 sec - exiting 13:13:01 (5860): No heartbeat from core client for 30 sec - exiting 13:13:02 (5860): No heartbeat from core client for 30 sec - exiting 13:13:03 (5860): No heartbeat from core client for 30 sec - exiting 13:13:04 (5860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5272, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5556, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... C12:22:03 (4536): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5600, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4608, iMonCtr=1 Model crash detected, will try to restart... 09:24:50 (5056): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... 16:35:13 (5508): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4944, iMonCtr=1 Model crash detected, will try to restart... 17:02:39 (5164): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:02:40 (5164): No heartbeat from core client for 30 sec - exiting 17:02:41 (5164): No heartbeat from core client for 30 sec - exiting 17:02:42 (5164): No heartbeat from core client for 30 sec - exiting 17:02:43 (5164): No heartbeat from core client for 30 sec - exiting 17:02:44 (5164): No heartbeat from core client for 30 sec - exiting 17:02:46 (5164): No heartbeat from core client for 30 sec - exiting 17:02:47 (5164): No heartbeat from core client for 30 sec - exiting 17:02:48 (5164): No heartbeat from core client for 30 sec - exiting 17:02:49 (5164): No heartbeat from core client for 30 sec - exiting 17:02:50 (5164): No heartbeat from core client for 30 sec - exiting 23:38:31 (4388): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:20:40 (5444): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Model crashed: TRANSO2A: Missing data in ocean UV fields tmp/pipe_dummy 2048 Model crashed: TRANSO2A: Missing data in ocean UV fields tmp/pipe_dummy 2048 Model crashed: TRANSO2A: Missing data in ocean UV fields tmp/pipe_dummy 2048 Model crashed: TRANSO2A: Missing data in ocean UV fields tmp/pipe_dummy 2048 Model crashed: TRANSO2A: Missing data in ocean UV fields tmp/pipe_dummy 2048 Model crashed: TRANSO2A: Missing data in ocean UV fields tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
05 May 2013 23:00:38	957844	15720036	hadcm3n_3k3n_1980_40_008340486_3	881,280	1,215,785	1.3796
04 May 2013 23:37:21	957844	15720036	hadcm3n_3k3n_1980_40_008340486_3	855,360	1,178,511	1.3778
04 May 2013 01:09:08	957844	15720036	hadcm3n_3k3n_1980_40_008340486_3	829,440	1,143,221	1.3783
03 May 2013 06:02:50	957844	15720036	hadcm3n_3k3n_1980_40_008340486_3	803,520	1,106,412	1.3770
02 May 2013 15:25:39	957844	15720036	hadcm3n_3k3n_1980_40_008340486_3	777,600	1,071,309	1.3777
01 May 2013 20:41:15	957844	15720036	hadcm3n_3k3n_1980_40_008340486_3	751,680	1,034,899	1.3768
30 Apr 2013 12:31:36	957844	15720036	hadcm3n_3k3n_1980_40_008340486_3	725,760	996,486	1.3730
29 Apr 2013 17:38:15	957844	15720036	hadcm3n_3k3n_1980_40_008340486_3	699,840	959,153	1.3705
29 Apr 2013 02:45:54	957844	15720036	hadcm3n_3k3n_1980_40_008340486_3	673,920	922,653	1.3691
28 Apr 2013 15:55:59	957844	15720036	hadcm3n_3k3n_1980_40_008340486_3	648,000	885,942	1.3672
27 Apr 2013 17:47:39	957844	15720036	hadcm3n_3k3n_1980_40_008340486_3	622,080	849,856	1.3662
27 Apr 2013 00:50:35	957844	15720036	hadcm3n_3k3n_1980_40_008340486_3	596,160	813,607	1.3647
26 Apr 2013 03:21:11	957844	15720036	hadcm3n_3k3n_1980_40_008340486_3	570,240	776,318	1.3614
25 Apr 2013 01:59:43	957844	15720036	hadcm3n_3k3n_1980_40_008340486_3	544,320	739,560	1.3587
24 Apr 2013 09:45:28	957844	15720036	hadcm3n_3k3n_1980_40_008340486_3	518,400	704,128	1.3583
23 Apr 2013 04:57:46	957844	15720036	hadcm3n_3k3n_1980_40_008340486_3	492,480	667,142	1.3547
22 Apr 2013 10:09:22	957844	15720036	hadcm3n_3k3n_1980_40_008340486_3	466,560	630,656	1.3517
21 Apr 2013 20:38:35	957844	15720036	hadcm3n_3k3n_1980_40_008340486_3	440,640	595,164	1.3507
21 Apr 2013 04:50:59	957844	15720036	hadcm3n_3k3n_1980_40_008340486_3	414,720	559,728	1.3497
20 Apr 2013 11:39:49	957844	15720036	hadcm3n_3k3n_1980_40_008340486_3	388,800	523,488	1.3464