climateprediction.net home page
Task 13351661

Task 13351661

Name hadcm3n_o5vt_1940_40_007443895_4
Workunit 7641398
Created 9 Sep 2011, 3:30:48 UTC
Sent 9 Sep 2011, 3:38:52 UTC
Report deadline 9 Dec 2011, 11:06:03 UTC
Received 8 Nov 2011, 4:32:14 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -1073741819 (0xC0000005) STATUS_ACCESS_VIOLATION
Computer ID 1167468
Run time 19 days 16 hours 35 min 26 sec
CPU time 18 days 18 hours 57 min 32 sec
Validate state Invalid
Credit 12,441.60
Device peak FLOPS 3.16 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr
<core_client_version>6.12.34</core_client_version>
<![CDATA[
<message>
 - exit code -1073741819 (0xc0000005)
</message>
<stderr_txt>
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
18:43:07 (5468): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
02:26:45 (2228): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5952, iMonCtr=1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
10:24:37 (4812): No heartbeat from core client for 30 sec - exiting
10:24:38 (4812): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:25:14 (1500): Can't acquire lockfile (32) - waiting 35s
10:25:19 (6132): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error converting file to netcdf: dataout/o5vtko.pjf1c10
Error converting file to netcdf: dataout/o5vtko.pif1c10
Error converting file to netcdf: dataout/o5vtko.pff1c10
Error converting file to netcdf: dataout/o5vtka.phf1c10
Error converting file to netcdf: dataout/o5vtka.pgf1c10
Error converting file to netcdf: dataout/o5vtka.pef1c10
Error converting file to netcdf: dataout/o5vtka.pdf1c10
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
18:59:19 (7340): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
17:03:16 (7108): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
17:34:02 (7284): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
17:44:24 (6260): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
02:17:43 (1720): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
19:29:08 (5092): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
16:59:06 (2108): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
09:17:17 (6092): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
11:44:35 (4972): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...


Unhandled Exception Detected...

- Unhandled Exception Record -
Reason: Access Violation (0xc0000005) at address 0x77DA3A93 read attempt to address 0x408E2324

Engaging BOINC Windows Runtime Debugger...

20:22:52 (7656): Can't acquire lockfile (32) - waiting 35s
20:23:08 (6712): Can't acquire lockfile (32) - waiting 35s
20:23:11 (3160): No heartbeat from core client for 30 sec - exiting
20:23:12 (3160): No heartbeat from core client for 30 sec - exiting
20:23:13 (3160): No heartbeat from core client for 30 sec - exiting
20:23:14 (3160): No heartbeat from core client for 30 sec - exiting
20:23:15 (3160): No heartbeat from core client for 30 sec - exiting
20:23:16 (3160): No heartbeat from core client for 30 sec - exiting
20:23:17 (3160): No heartbeat from core client for 30 sec - exiting
20:23:18 (3160): No heartbeat from core client for 30 sec - exiting
20:23:19 (3160): No heartbeat from core client for 30 sec - exiting
20:23:20 (3160): No heartbeat from core client for 30 sec - exiting
20:23:21 (3160): No heartbeat from core client for 30 sec - exiting
20:23:22 (3160): No heartbeat from core client for 30 sec - exiting
20:23:23 (3160): No heartbeat from core client for 30 sec - exiting
20:23:24 (3160): No heartbeat from core client for 30 sec - exiting
20:23:25 (3160): No heartbeat from core client for 30 sec - exiting
20:23:26 (3160): No heartbeat from core client for 30 sec - exiting
20:23:27 (3160): No heartbeat from core client for 30 sec - exiting
20:23:27 (7656): Can't acquire lockfile (32) - exiting
20:23:27 (7656): Error: The process cannot access the file because it is being used by another process. (0x20)
20:23:28 (3160): No heartbeat from core client for 30 sec - exiting
20:23:29 (3160): No heartbeat from core client for 30 sec - exiting
20:23:30 (3160): No heartbeat from core client for 30 sec - exiting
20:23:31 (3160): No heartbeat from core client for 30 sec - exiting
20:23:32 (3160): No heartbeat from core client for 30 sec - exiting
20:23:33 (3160): No heartbeat from core client for 30 sec - exiting
20:23:34 (3160): No heartbeat from core client for 30 sec - exiting
20:23:35 (3160): No heartbeat from core client for 30 sec - exiting
20:23:36 (3160): No heartbeat from core client for 30 sec - exiting
20:23:37 (3160): No heartbeat from core client for 30 sec - exiting
20:23:38 (3160): No heartbeat from core client for 30 sec - exiting
20:23:39 (3160): No heartbeat from core client for 30 sec - exiting
20:23:41 (3160): No heartbeat from core client for 30 sec - exiting
20:23:42 (3160): No heartbeat from core client for 30 sec - exiting
20:23:43 (3160): No heartbeat from core client for 30 sec - exiting
20:23:43 (6712): Can't acquire lockfile (32) - exiting
20:23:43 (6712): Error: The process cannot access the file because it is being used by another process. (0x20)
20:23:44 (3160): No heartbeat from core client for 30 sec - exiting
20:23:45 (3160): No heartbeat from core client for 30 sec - exiting
20:23:46 (3160): No heartbeat from core client for 30 sec - exiting
20:23:47 (3160): No heartbeat from core client for 30 sec - exiting
20:23:48 (3160): No heartbeat from core client for 30 sec - exiting
20:23:49 (3160): No heartbeat from core client for 30 sec - exiting
20:23:50 (3160): No heartbeat from core client for 30 sec - exiting
20:23:51 (3160): No heartbeat from core client for 30 sec - exiting
20:23:52 (3160): No heartbeat from core client for 30 sec - exiting
20:23:53 (3160): No heartbeat from core client for 30 sec - exiting
20:23:54 (3160): No heartbeat from core client for 30 sec - exiting
20:23:55 (3160): No heartbeat from core client for 30 sec - exiting
20:23:56 (3160): No heartbeat from core client for 30 sec - exiting
20:23:57 (3160): No heartbeat from core client for 30 sec - exiting
20:23:58 (3160): No heartbeat from core client for 30 sec - exiting
20:23:59 (3160): No heartbeat from core client for 30 sec - exiting
20:24:00 (3160): No heartbeat from core client for 30 sec - exiting
20:24:01 (3160): No heartbeat from core client for 30 sec - exiting
20:24:02 (3160): No heartbeat from core client for 30 sec - exiting
20:24:03 (3160): No heartbeat from core client for 30 sec - exiting
20:24:04 (3160): No heartbeat from core client for 30 sec - exiting
20:24:05 (3160): No heartbeat from core client for 30 sec - exiting
20:24:06 (3160): No heartbeat from core client for 30 sec - exiting
20:24:07 (3160): No heartbeat from core client for 30 sec - exiting
20:24:08 (3160): No heartbeat from core client for 30 sec - exiting
20:24:09 (3160): No heartbeat from core client for 30 sec - exiting
20:24:10 (3160): No heartbeat from core client for 30 sec - exiting
20:24:11 (3160): No heartbeat from core client for 30 sec - exiting
20:24:12 (3160): No heartbeat from core client for 30 sec - exiting
20:24:13 (3160): No heartbeat from core client for 30 sec - exiting
20:24:14 (3160): No heartbeat from core client for 30 sec - exiting
20:24:15 (3160): No heartbeat from core client for 30 sec - exiting
20:24:16 (3160): No heartbeat from core client for 30 sec - exiting
20:24:17 (3160): No heartbeat from core client for 30 sec - exiting
20:24:18 (3160): No heartbeat from core client for 30 sec - exiting
20:24:19 (3160): No heartbeat from core client for 30 sec - exiting
20:24:20 (3160): No heartbeat from core client for 30 sec - exiting
20:24:21 (3160): No heartbeat from core client for 30 sec - exiting
20:24:22 (3160): No heartbeat from core client for 30 sec - exiting
20:24:23 (3160): No heartbeat from core client for 30 sec - exiting
20:24:24 (3160): No heartbeat from core client for 30 sec - exiting
20:24:25 (3160): No heartbeat from core client for 30 sec - exiting
20:24:26 (3160): No heartbeat from core client for 30 sec - exiting
20:24:27 (3160): No heartbeat from core client for 30 sec - exiting
20:24:28 (3160): No heartbeat from core client for 30 sec - exiting
20:24:29 (3160): No heartbeat from core client for 30 sec - exiting
20:24:30 (3160): No heartbeat from core client for 30 sec - exiting
20:24:31 (3160): No heartbeat from core client for 30 sec - exiting
20:24:32 (3160): No heartbeat from core client for 30 sec - exiting
20:24:33 (3160): No heartbeat from core client for 30 sec - exiting
20:24:34 (3160): No heartbeat from core client for 30 sec - exiting
20:24:35 (3160): No heartbeat from core client for 30 sec - exiting
20:24:36 (3160): No heartbeat from core client for 30 sec - exiting
20:24:37 (3160): No heartbeat from core client for 30 sec - exiting
20:24:38 (3160): No heartbeat from core client for 30 sec - exiting
20:24:39 (3160): No heartbeat from core client for 30 sec - exiting
20:24:40 (3160): No heartbeat from core client for 30 sec - exiting
20:24:41 (3160): No heartbeat from core client for 30 sec - exiting
20:24:42 (3160): No heartbeat from core client for 30 sec - exiting
20:24:43 (3160): No heartbeat from core client for 30 sec - exiting
20:24:44 (3160): No heartbeat from core client for 30 sec - exiting
20:24:45 (3160): No heartbeat from core client for 30 sec - exiting
20:24:46 (3160): No heartbeat from core client for 30 sec - exiting
20:24:47 (3160): No heartbeat from core client for 30 sec - exiting
20:24:48 (3160): No heartbeat from core client for 30 sec - exiting
20:24:49 (3160): No heartbeat from core client for 30 sec - exiting
20:24:50 (3160): No heartbeat from core client for 30 sec - exiting
20:24:51 (3160): No heartbeat from core client for 30 sec - exiting
20:24:52 (3160): No heartbeat from core client for 30 sec - exiting
20:24:53 (3160): No heartbeat from core client for 30 sec - exiting
20:24:54 (3160): No heartbeat from core client for 30 sec - exiting
20:24:55 (3160): No heartbeat from core client for 30 sec - exiting
20:24:56 (3160): No heartbeat from core client for 30 sec - exiting
20:24:57 (3160): No heartbeat from core client for 30 sec - exiting
20:24:58 (3160): No heartbeat from core client for 30 sec - exiting
20:24:59 (3160): No heartbeat from core client for 30 sec - exiting
20:25:00 (3160): No heartbeat from core client for 30 sec - exiting
20:25:01 (3160): No heartbeat from core client for 30 sec - exiting
20:25:02 (3160): No heartbeat from core client for 30 sec - exiting
20:25:03 (3160): No heartbeat from core client for 30 sec - exiting
20:25:04 (3160): No heartbeat from core client for 30 sec - exiting
20:25:05 (3160): No heartbeat from core client for 30 sec - exiting
20:25:06 (3160): No heartbeat from core client for 30 sec - exiting
20:25:07 (3160): No heartbeat from core client for 30 sec - exiting
20:25:08 (3160): No heartbeat from core client for 30 sec - exiting
20:25:09 (3160): No heartbeat from core client for 30 sec - exiting
20:25:10 (3160): No heartbeat from core client for 30 sec - exiting
20:25:11 (3160): No heartbeat from core client for 30 sec - exiting
20:25:12 (3160): No heartbeat from core client for 30 sec - exiting
20:25:13 (3160): No heartbeat from core client for 30 sec - exiting
20:25:14 (3160): No heartbeat from core client for 30 sec - exiting
20:25:15 (3160): No heartbeat from core client for 30 sec - exiting
20:25:16 (3160): No heartbeat from core client for 30 sec - exiting
20:25:17 (3160): No heartbeat from core client for 30 sec - exiting
20:25:18 (3160): No heartbeat from core client for 30 sec - exiting
20:25:19 (3160): No heartbeat from core client for 30 sec - exiting
20:25:20 (3160): No heartbeat from core client for 30 sec - exiting
20:25:21 (3160): No heartbeat from core client for 30 sec - exiting
20:25:22 (3160): No heartbeat from core client for 30 sec - exiting
20:25:23 (3160): No heartbeat from core client for 30 sec - exiting
20:25:24 (3160): No heartbeat from core client for 30 sec - exiting
20:25:25 (3160): No heartbeat from core client for 30 sec - exiting
20:25:26 (3160): No heartbeat from core client for 30 sec - exiting
20:25:27 (3160): No heartbeat from core client for 30 sec - exiting
20:25:28 (3160): No heartbeat from core client for 30 sec - exiting
20:25:29 (3160): No heartbeat from core client for 30 sec - exiting
20:25:30 (3160): No heartbeat from core client for 30 sec - exiting
20:25:31 (3160): No heartbeat from core client for 30 sec - exiting
20:25:32 (3160): No heartbeat from core client for 30 sec - exiting
20:25:33 (3160): No heartbeat from core client for 30 sec - exiting
20:25:34 (3160): No heartbeat from core client for 30 sec - exiting
20:25:35 (3160): No heartbeat from core client for 30 sec - exiting
20:25:36 (3160): No heartbeat from core client for 30 sec - exiting
20:25:37 (3160): No heartbeat from core client for 30 sec - exiting
20:25:38 (3160): No heartbeat from core client for 30 sec - exiting
20:25:39 (3160): No heartbeat from core client for 30 sec - exiting
20:25:40 (3160): No heartbeat from core client for 30 sec - exiting
20:25:41 (3160): No heartbeat from core client for 30 sec - exiting
20:25:42 (3160): No heartbeat from core client for 30 sec - exiting
20:25:43 (3160): No heartbeat from core client for 30 sec - exiting
20:25:44 (3160): No heartbeat from core client for 30 sec - exiting
20:25:45 (3160): No heartbeat from core client for 30 sec - exiting
20:25:46 (3160): No heartbeat from core client for 30 sec - exiting
20:25:47 (3160): No heartbeat from core client for 30 sec - exiting
20:25:48 (3160): No heartbeat from core client for 30 sec - exiting
20:25:49 (3160): No heartbeat from core client for 30 sec - exiting
20:25:50 (3160): No heartbeat from core client for 30 sec - exiting
20:25:51 (3160): No heartbeat from core client for 30 sec - exiting
20:25:52 (3160): No heartbeat from core client for 30 sec - exiting
20:25:53 (3160): No heartbeat from core client for 30 sec - exiting
20:25:54 (3160): No heartbeat from core client for 30 sec - exiting
20:25:55 (3160): No heartbeat from core client for 30 sec - exiting
20:25:56 (3160): No heartbeat from core client for 30 sec - exiting
20:25:57 (3160): No heartbeat from core client for 30 sec - exiting
20:25:58 (3160): No heartbeat from core client for 30 sec - exiting
20:25:59 (3160): No heartbeat from core client for 30 sec - exiting
20:26:00 (3160): No heartbeat from core client for 30 sec - exiting
20:26:01 (3160): No heartbeat from core client for 30 sec - exiting
20:26:02 (3160): No heartbeat from core client for 30 sec - exiting
20:26:03 (3160): No heartbeat from core client for 30 sec - exiting
20:26:04 (3160): No heartbeat from core client for 30 sec - exiting
20:26:05 (3160): No heartbeat from core client for 30 sec - exiting
20:26:06 (3160): No heartbeat from core client for 30 sec - exiting
20:26:07 (3160): No heartbeat from core client for 30 sec - exiting
20:26:08 (3160): No heartbeat from core client for 30 sec - exiting
20:26:09 (3160): No heartbeat from core client for 30 sec - exiting
20:26:10 (3160): No heartbeat from core client for 30 sec - exiting
20:26:11 (3160): No heartbeat from core client for 30 sec - exiting
20:26:12 (3160): No heartbeat from core client for 30 sec - exiting
20:26:13 (3160): No heartbeat from core client for 30 sec - exiting
20:26:14 (3160): No heartbeat from core client for 30 sec - exiting
20:26:15 (3160): No heartbeat from core client for 30 sec - exiting
20:26:16 (3160): No heartbeat from core client for 30 sec - exiting
20:26:17 (3160): No heartbeat from core client for 30 sec - exiting
20:26:18 (3160): No heartbeat from core client for 30 sec - exiting
20:26:19 (3160): No heartbeat from core client for 30 sec - exiting
20:26:20 (3160): No heartbeat from core client for 30 sec - exiting
20:26:21 (3160): No heartbeat from core client for 30 sec - exiting
20:26:22 (3160): No heartbeat from core client for 30 sec - exiting
20:26:23 (3160): No heartbeat from core client for 30 sec - exiting
20:26:24 (3160): No heartbeat from core client for 30 sec - exiting
20:26:25 (3160): No heartbeat from core client for 30 sec - exiting
20:26:26 (3160): No heartbeat from core client for 30 sec - exiting
20:26:27 (3160): No heartbeat from core client for 30 sec - exiting
20:26:28 (3160): No heartbeat from core client for 30 sec - exiting
20:26:29 (3160): No heartbeat from core client for 30 sec - exiting
20:26:30 (3160): No heartbeat from core client for 30 sec - exiting
20:26:31 (3160): No heartbeat from core client for 30 sec - exiting
20:26:32 (3160): No heartbeat from core client for 30 sec - exiting
20:26:33 (3160): No heartbeat from core client for 30 sec - exiting
20:26:34 (3160): No heartbeat from core client for 30 sec - exiting
20:26:35 (3160): No heartbeat from core client for 30 sec - exiting
20:26:36 (3160): No heartbeat from core client for 30 sec - exiting
20:26:37 (3160): No heartbeat from core client for 30 sec - exiting
20:26:38 (3160): No heartbeat from core client for 30 sec - exiting
20:26:39 (3160): No heartbeat from core client for 30 sec - exiting
20:26:40 (3160): No heartbeat from core client for 30 sec - exiting
20:26:41 (3160): No heartbeat from core client for 30 sec - exiting
20:26:42 (3160): No heartbeat from core client for 30 sec - exiting
20:26:43 (3160): No heartbeat from core client for 30 sec - exiting
20:26:44 (3160): No heartbeat from core client for 30 sec - exiting
20:26:45 (3160): No heartbeat from core client for 30 sec - exiting
20:26:46 (3160): No heartbeat from core client for 30 sec - exiting
20:26:47 (3160): No heartbeat from core client for 30 sec - exiting
20:26:48 (3160): No heartbeat from core client for 30 sec - exiting
20:26:49 (3160): No heartbeat from core client for 30 sec - exiting
20:26:50 (3160): No heartbeat from core client for 30 sec - exiting
20:26:51 (3160): No heartbeat from core client for 30 sec - exiting
20:26:52 (3160): No heartbeat from core client for 30 sec - exiting
20:26:53 (3160): No heartbeat from core client for 30 sec - exiting
20:26:54 (3160): No heartbeat from core client for 30 sec - exiting
20:26:55 (3160): No heartbeat from core client for 30 sec - exiting
20:26:56 (3160): No heartbeat from core client for 30 sec - exiting
20:26:57 (3160): No heartbeat from core client for 30 sec - exiting
20:26:58 (3160): No heartbeat from core client for 30 sec - exiting
20:26:59 (3160): No heartbeat from core client for 30 sec - exiting
20:27:00 (3160): No heartbeat from core client for 30 sec - exiting
20:27:01 (3160): No heartbeat from core client for 30 sec - exiting
20:27:02 (3160): No heartbeat from core client for 30 sec - exiting
20:27:03 (3160): No heartbeat from core client for 30 sec - exiting
20:27:04 (3160): No heartbeat from core client for 30 sec - exiting
20:27:05 (3160): No heartbeat from core client for 30 sec - exiting
20:27:06 (3160): No heartbeat from core client for 30 sec - exiting
20:27:07 (3160): No heartbeat from core client for 30 sec - exiting
20:27:08 (3160): No heartbeat from core client for 30 sec - exiting
20:27:09 (3160): No heartbeat from core client for 30 sec - exiting
20:27:10 (3160): No heartbeat from core client for 30 sec - exiting
20:27:11 (3160): No heartbeat from core client for 30 sec - exiting
20:27:12 (3160): No heartbeat from core client for 30 sec - exiting
20:27:13 (3160): No heartbeat from core client for 30 sec - exiting
20:27:14 (3160): No heartbeat from core client for 30 sec - exiting
20:27:15 (3160): No heartbeat from core client for 30 sec - exiting
20:27:16 (3160): No heartbeat from core client for 30 sec - exiting
20:27:17 (3160): No heartbeat from core client for 30 sec - exiting
20:27:18 (3160): No heartbeat from core client for 30 sec - exiting
20:27:19 (3160): No heartbeat from core client for 30 sec - exiting
20:27:20 (3160): No heartbeat from core client for 30 sec - exiting
20:27:21 (3160): No heartbeat from core client for 30 sec - exiting
20:27:22 (3160): No heartbeat from core client for 30 sec - exiting
20:27:23 (3160): No heartbeat from core client for 30 sec - exiting
20:27:24 (3160): No heartbeat from core client for 30 sec - exiting
20:27:25 (3160): No heartbeat from core client for 30 sec - exiting
20:27:26 (3160): No heartbeat from core client for 30 sec - exiting
20:27:27 (3160): No heartbeat from core client for 30 sec - exiting
20:27:28 (3160): No heartbeat from core client for 30 sec - exiting
20:27:29 (3160): No heartbeat from core client for 30 sec - exiting
20:27:30 (3160): No heartbeat from core client for 30 sec - exiting
20:27:31 (3160): No heartbeat from core client for 30 sec - exiting
20:27:32 (3160): No heartbeat from core client for 30 sec - exiting
20:27:33 (3160): No heartbeat from core client for 30 sec - exiting
20:27:34 (3160): No heartbeat from core client for 30 sec - exiting
20:27:35 (3160): No heartbeat from core client for 30 sec - exiting
20:27:36 (3160): No heartbeat from core client for 30 sec - exiting
20:27:37 (3160): No heartbeat from core client for 30 sec - exiting
20:27:38 (3160): No heartbeat from core client for 30 sec - exiting
20:27:39 (3160): No heartbeat from core client for 30 sec - exiting
20:27:40 (3160): No heartbeat from core client for 30 sec - exiting
20:27:41 (3160): No heartbeat from core client for 30 sec - exiting
20:27:42 (3160): No heartbeat from core client for 30 sec - exiting
20:27:43 (3160): No heartbeat from core client for 30 sec - exiting
20:27:44 (3160): No heartbeat from core client for 30 sec - exiting
20:27:45 (3160): No heartbeat from core client for 30 sec - exiting
20:27:46 (3160): No heartbeat from core client for 30 sec - exiting
20:27:47 (3160): No heartbeat from core client for 30 sec - exiting
20:27:48 (3160): No heartbeat from core client for 30 sec - exiting
20:27:49 (3160): No heartbeat from core client for 30 sec - exiting
20:27:50 (3160): No heartbeat from core client for 30 sec - exiting
20:27:51 (3160): No heartbeat from core client for 30 sec - exiting
20:27:52 (3160): No heartbeat from core client for 30 sec - exiting
20:27:53 (3160): No heartbeat from core client for 30 sec - exiting
20:27:54 (3160): No heartbeat from core client for 30 sec - exiting
20:27:55 (3160): No heartbeat from core client for 30 sec - exiting
20:27:56 (3160): No heartbeat from core client for 30 sec - exiting
20:27:57 (3160): No heartbeat from core client for 30 sec - exiting
20:27:58 (3160): No heartbeat from core client for 30 sec - exiting
20:27:59 (3160): No heartbeat from core client for 30 sec - exiting
20:28:00 (3160): No heartbeat from core client for 30 sec - exiting
20:28:01 (3160): No heartbeat from core client for 30 sec - exiting
20:28:02 (3160): No heartbeat from core client for 30 sec - exiting
20:28:03 (3160): No heartbeat from core client for 30 sec - exiting
20:28:04 (3160): No heartbeat from core client for 30 sec - exiting
20:28:05 (3160): No heartbeat from core client for 30 sec - exiting
20:28:06 (3160): No heartbeat from core client for 30 sec - exiting
20:28:07 (3160): No heartbeat from core client for 30 sec - exiting
20:28:08 (3160): No heartbeat from core client for 30 sec - exiting
20:28:09 (3160): No heartbeat from core client for 30 sec - exiting
20:28:10 (3160): No heartbeat from core client for 30 sec - exiting
20:28:11 (3160): No heartbeat from core client for 30 sec - exiting
20:28:12 (3160): No heartbeat from core client for 30 sec - exiting
20:28:13 (3160): No heartbeat from core client for 30 sec - exiting
20:28:14 (3160): No heartbeat from core client for 30 sec - exiting
20:28:15 (3160): No heartbeat from core client for 30 sec - exiting
20:28:16 (3160): No heartbeat from core client for 30 sec - exiting
20:28:17 (3160): No heartbeat from core client for 30 sec - exiting
20:28:18 (3160): No heartbeat from core client for 30 sec - exiting
20:28:19 (3160): No heartbeat from core client for 30 sec - exiting
20:28:20 (3160): No heartbeat from core client for 30 sec - exiting
20:28:21 (3160): No heartbeat from core client for 30 sec - exiting
20:28:22 (3160): No heartbeat from core client for 30 sec - exiting
20:28:23 (3160): No heartbeat from core client for 30 sec - exiting
20:28:24 (3160): No heartbeat from core client for 30 sec - exiting
20:28:25 (3160): No heartbeat from core client for 30 sec - exiting
20:28:26 (3160): No heartbeat from core client for 30 sec - exiting
20:28:27 (3160): No heartbeat from core client for 30 sec - exiting
20:28:28 (3160): No heartbeat from core client for 30 sec - exiting
20:28:29 (3160): No heartbeat from core client for 30 sec - exiting
20:28:30 (3160): No heartbeat from core client for 30 sec - exiting
20:28:31 (3160): No heartbeat from core client for 30 sec - exiting
20:28:32 (3160): No heartbeat from core client for 30 sec - exiting
20:28:33 (3160): No heartbeat from core client for 30 sec - exiting
20:28:34 (3160): No heartbeat from core client for 30 sec - exiting
20:28:35 (3160): No heartbeat from core client for 30 sec - exiting
20:28:36 (3160): No heartbeat from core client for 30 sec - exiting
20:28:37 (3160): No heartbeat from core client for 30 sec - exiting
20:28:38 (3160): No heartbeat from core client for 30 sec - exiting
20:28:39 (3160): No heartbeat from core client for 30 sec - exiting
20:28:40 (3160): No heartbeat from core client for 30 sec - exiting
20:28:41 (3160): No heartbeat from core client for 30 sec - exiting
20:28:42 (3160): No heartbeat from core client for 30 sec - exiting
20:28:43 (3160): No heartbeat from core client for 30 sec - exiting
20:28:44 (3160): No heartbeat from core client for 30 sec - exiting
20:28:45 (3160): No heartbeat from core client for 30 sec - exiting
20:28:46 (3160): No heartbeat from core client for 30 sec - exiting
20:28:47 (3160): No heartbeat from core client for 30 sec - exiting
20:28:48 (3160): No heartbeat from core client for 30 sec - exiting
20:28:49 (3160): No heartbeat from core client for 30 sec - exiting
20:28:50 (3160): No heartbeat from core client for 30 sec - exiting
20:28:51 (3160): No heartbeat from core client for 30 sec - exiting
20:28:52 (3160): No heartbeat from core client for 30 sec - exiting
20:28:53 (3160): No heartbeat from core client for 30 sec - exiting
20:28:54 (3160): No heartbeat from core client for 30 sec - exiting
20:28:55 (3160): No heartbeat from core client for 30 sec - exiting
20:28:56 (3160): No heartbeat from core client for 30 sec - exiting
20:28:57 (3160): No heartbeat from core client for 30 sec - exiting
20:28:58 (3160): No heartbeat from core client for 30 sec - exiting
20:28:59 (3160): No heartbeat from core client for 30 sec - exiting
20:29:00 (3160): No heartbeat from core client for 30 sec - exiting
20:29:01 (3160): No heartbeat from core client for 30 sec - exiting
20:29:02 (3160): No heartbeat from core client for 30 sec - exiting
20:29:03 (3160): No heartbeat from core client for 30 sec - exiting
20:29:04 (3160): No heartbeat from core client for 30 sec - exiting
20:29:05 (3160): No heartbeat from core client for 30 sec - exiting
20:29:06 (3160): No heartbeat from core client for 30 sec - exiting
20:29:07 (3160): No heartbeat from core client for 30 sec - exiting
20:29:08 (3160): No heartbeat from core client for 30 sec - exiting
20:29:09 (3160): No heartbeat from core client for 30 sec - exiting
20:29:10 (3160): No heartbeat from core client for 30 sec - exiting
20:29:11 (3160): No heartbeat from core client for 30 sec - exiting
20:29:12 (3160): No heartbeat from core client for 30 sec - exiting
20:29:13 (3160): No heartbeat from core client for 30 sec - exiting
20:29:14 (3160): No heartbeat from core client for 30 sec - exiting
20:29:15 (3160): No heartbeat from core client for 30 sec - exiting
20:29:16 (3160): No heartbeat from core client for 30 sec - exiting
20:29:17 (3160): No heartbeat from core client for 30 sec - exiting
20:29:18 (3160): No heartbeat from core client for 30 sec - exiting
20:29:19 (3160): No heartbeat from core client for 30 sec - exiting
20:29:20 (3160): No heartbeat from core client for 30 sec - exiting
20:29:21 (3160): No heartbeat from core client for 30 sec - exiting
20:29:22 (3160): No heartbeat from core client for 30 sec - exiting
20:29:23 (3160): No heartbeat from core client for 30 sec - exiting
20:29:24 (3160): No heartbeat from core client for 30 sec - exiting
20:29:25 (3160): No heartbeat from core client for 30 sec - exiting
20:29:26 (3160): No heartbeat from core client for 30 sec - exiting
20:29:27 (3160): No heartbeat from core client for 30 sec - exiting
20:29:28 (3160): No heartbeat from core client for 30 sec - exiting
20:29:29 (3160): No heartbeat from core client for 30 sec - exiting
20:29:30 (3160): No heartbeat from core client for 30 sec - exiting
20:29:31 (3160): No heartbeat from core client for 30 sec - exiting
20:29:32 (3160): No heartbeat from core client for 30 sec - exiting
20:29:33 (3160): No heartbeat from core client for 30 sec - exiting
20:29:34 (3160): No heartbeat from core client for 30 sec - exiting
20:29:35 (3160): No heartbeat from core client for 30 sec - exiting
20:29:36 (3160): No heartbeat from core client for 30 sec - exiting
20:29:37 (3160): No heartbeat from core client for 30 sec - exiting
20:29:38 (3160): No heartbeat from core client for 30 sec - exiting
20:29:40 (3160): No heartbeat from core client for 30 sec - exiting

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Nov 2011 03:21:01 1167468 13351661 hadcm3n_o5vt_1940_40_007443895_4 1,036,800 1,622,861 1.5653
07 Nov 2011 16:20:23 1167468 13351661 hadcm3n_o5vt_1940_40_007443895_4 1,010,880 1,584,967 1.5679
06 Nov 2011 16:43:40 1167468 13351661 hadcm3n_o5vt_1940_40_007443895_4 984,960 1,544,482 1.5681
06 Nov 2011 04:12:05 1167468 13351661 hadcm3n_o5vt_1940_40_007443895_4 959,040 1,505,491 1.5698
05 Nov 2011 16:00:33 1167468 13351661 hadcm3n_o5vt_1940_40_007443895_4 933,120 1,465,591 1.5706
05 Nov 2011 04:26:31 1167468 13351661 hadcm3n_o5vt_1940_40_007443895_4 907,200 1,425,969 1.5718
04 Nov 2011 21:18:54 1167468 13351661 hadcm3n_o5vt_1940_40_007443895_4 881,280 1,386,979 1.5738
04 Nov 2011 06:51:56 1167468 13351661 hadcm3n_o5vt_1940_40_007443895_4 855,360 1,350,221 1.5785
03 Nov 2011 20:46:18 1167468 13351661 hadcm3n_o5vt_1940_40_007443895_4 829,440 1,315,827 1.5864
03 Nov 2011 10:17:42 1167468 13351661 hadcm3n_o5vt_1940_40_007443895_4 803,520 1,280,723 1.5939
03 Nov 2011 00:14:28 1167468 13351661 hadcm3n_o5vt_1940_40_007443895_4 777,600 1,245,809 1.6021
02 Nov 2011 14:07:18 1167468 13351661 hadcm3n_o5vt_1940_40_007443895_4 751,680 1,210,633 1.6106
02 Nov 2011 04:20:30 1167468 13351661 hadcm3n_o5vt_1940_40_007443895_4 725,760 1,174,680 1.6186
01 Nov 2011 05:40:28 1167468 13351661 hadcm3n_o5vt_1940_40_007443895_4 699,840 1,136,628 1.6241
31 Oct 2011 19:44:33 1167468 13351661 hadcm3n_o5vt_1940_40_007443895_4 673,920 1,096,556 1.6271
31 Oct 2011 19:26:54 1167468 13351661 hadcm3n_o5vt_1940_40_007443895_4 648,000 1,057,691 1.6322
31 Oct 2011 18:42:26 1167468 13351661 hadcm3n_o5vt_1940_40_007443895_4 622,080 1,018,187 1.6367
31 Oct 2011 18:21:59 1167468 13351661 hadcm3n_o5vt_1940_40_007443895_4 596,160 977,638 1.6399
31 Oct 2011 17:34:03 1167468 13351661 hadcm3n_o5vt_1940_40_007443895_4 570,240 938,901 1.6465
31 Oct 2011 17:15:53 1167468 13351661 hadcm3n_o5vt_1940_40_007443895_4 544,320 898,512 1.6507


©2024 climateprediction.net