climateprediction.net home page
Task 15549213

Task 15549213

Name hadcm3n_n4ol_1880_40_008286330_0
Workunit 8437465
Created 17 Jan 2013, 19:24:02 UTC
Sent 17 Jan 2013, 19:24:16 UTC
Report deadline 19 Apr 2013, 2:51:27 UTC
Received 16 Feb 2013, 8:48:55 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1125151
Run time 12 days 4 hours 11 min 6 sec
CPU time 12 days 1 hours 6 min 43 sec
Validate state Invalid
Credit 5,598.72
Device peak FLOPS 2.91 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
windows_intelx86
Stderr 
<core_client_version>6.12.34</core_client_version>
<![CDATA[
<message>
Het apparaat herkent de opdracht niet. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
20:29:25 (4868): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
20:29:26 (4868): No heartbeat from core client for 30 sec - exiting
20:29:27 (4868): No heartbeat from core client for 30 sec - exiting
20:29:28 (4868): No heartbeat from core client for 30 sec - exiting
20:29:29 (4868): No heartbeat from core client for 30 sec - exiting
20:29:30 (4868): No heartbeat from core client for 30 sec - exiting
20:29:31 (4868): No heartbeat from core client for 30 sec - exiting
20:29:32 (4868): No heartbeat from core client for 30 sec - exiting
20:29:33 (4868): No heartbeat from core client for 30 sec - exiting
22:44:01 (2176): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:44:03 (2176): No heartbeat from core client for 30 sec - exiting
22:44:04 (2176): No heartbeat from core client for 30 sec - exiting
22:46:21 (4084): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:53:39 (4776): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:53:40 (4776): No heartbeat from core client for 30 sec - exiting
04:58:21 (1540): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:58:22 (1540): No heartbeat from core client for 30 sec - exiting
08:04:02 (2984): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
08:04:04 (2984): No heartbeat from core client for 30 sec - exiting
08:04:05 (2984): No heartbeat from core client for 30 sec - exiting
10:44:57 (3716): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:44:59 (3716): No heartbeat from core client for 30 sec - exiting
10:45:00 (3716): No heartbeat from core client for 30 sec - exiting
10:45:01 (3716): No heartbeat from core client for 30 sec - exiting
10:45:02 (3716): No heartbeat from core client for 30 sec - exiting
11:06:31 (4896): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:06:32 (4896): No heartbeat from core client for 30 sec - exiting
11:06:33 (4896): No heartbeat from core client for 30 sec - exiting
14:12:43 (4648): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
14:12:44 (4648): No heartbeat from core client for 30 sec - exiting
14:12:45 (4648): No heartbeat from core client for 30 sec - exiting
14:12:46 (4648): No heartbeat from core client for 30 sec - exiting
14:12:47 (4648): No heartbeat from core client for 30 sec - exiting
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
22:46:19 (4228): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:47:47 (2316): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:48:50 (6100): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4592, iMonCtr=1
Model crash detected, will try to restart...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
00:46:50 (4684): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:19:43 (4592): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:22:10 (4312): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:21:40 (924): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:21:42 (924): No heartbeat from core client for 30 sec - exiting
01:21:43 (924): No heartbeat from core client for 30 sec - exiting
01:21:44 (924): No heartbeat from core client for 30 sec - exiting
01:21:45 (924): No heartbeat from core client for 30 sec - exiting
01:21:46 (924): No heartbeat from core client for 30 sec - exiting
07:04:09 (4348): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:04:12 (4348): No heartbeat from core client for 30 sec - exiting
07:04:13 (4348): No heartbeat from core client for 30 sec - exiting
07:04:14 (4348): No heartbeat from core client for 30 sec - exiting
07:04:15 (4348): No heartbeat from core client for 30 sec - exiting
07:06:12 (4724): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:23:36 (3716): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:23:38 (3716): No heartbeat from core client for 30 sec - exiting
21:23:39 (3716): No heartbeat from core client for 30 sec - exiting
21:25:32 (3720): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:46:44 (4904): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
10:46:46 (4904): No heartbeat from core client for 30 sec - exiting
11:27:50 (3716): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:27:53 (3716): No heartbeat from core client for 30 sec - exiting
11:33:04 (1600): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:33:07 (1600): No heartbeat from core client for 30 sec - exiting
11:47:53 (4684): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
11:47:54 (4684): No heartbeat from core client for 30 sec - exiting
12:17:46 (3732): No heartbeat from core client for 30 sec - exiting
12:17:49 (3732): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:03:39 (4184): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:03:40 (4184): No heartbeat from core client for 30 sec - exiting
13:03:41 (4184): No heartbeat from core client for 30 sec - exiting
13:46:05 (3132): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:46:08 (3132): No heartbeat from core client for 30 sec - exiting
13:46:09 (3132): No heartbeat from core client for 30 sec - exiting
13:46:10 (3132): No heartbeat from core client for 30 sec - exiting
15:24:11 (3388): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:24:13 (3388): No heartbeat from core client for 30 sec - exiting
15:24:14 (3388): No heartbeat from core client for 30 sec - exiting
15:24:15 (3388): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - Quit request from BOINC...
21:24:11 (884): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:24:13 (884): No heartbeat from core client for 30 sec - exiting
21:24:14 (884): No heartbeat from core client for 30 sec - exiting
21:24:15 (884): No heartbeat from core client for 30 sec - exiting
23:20:17 (448): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
23:20:18 (448): No heartbeat from core client for 30 sec - exiting
03:23:05 (452): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:23:06 (452): No heartbeat from core client for 30 sec - exiting
09:25:45 (3028): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:25:47 (3028): No heartbeat from core client for 30 sec - exiting
09:42:54 (2020): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:42:56 (2020): No heartbeat from core client for 30 sec - exiting
09:48:04 (832): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:26:14 (3532): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:26:15 (3532): No heartbeat from core client for 30 sec - exiting
15:24:44 (1428): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:24:46 (1428): No heartbeat from core client for 30 sec - exiting
15:24:47 (1428): No heartbeat from core client for 30 sec - exiting
21:24:51 (1668): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:24:53 (1668): No heartbeat from core client for 30 sec - exiting
21:24:54 (1668): No heartbeat from core client for 30 sec - exiting
21:24:55 (1668): No heartbeat from core client for 30 sec - exiting
03:46:22 (1136): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:46:24 (1136): No heartbeat from core client for 30 sec - exiting
09:26:18 (4760): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:26:20 (4760): No heartbeat from core client for 30 sec - exiting
21:27:01 (2100): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:27:04 (2100): No heartbeat from core client for 30 sec - exiting
21:27:05 (2100): No heartbeat from core client for 30 sec - exiting
21:27:06 (2100): No heartbeat from core client for 30 sec - exiting
21:27:07 (2100): No heartbeat from core client for 30 sec - exiting
01:48:26 (1560): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
01:48:28 (1560): No heartbeat from core client for 30 sec - exiting
01:48:29 (1560): No heartbeat from core client for 30 sec - exiting
01:48:30 (1560): No heartbeat from core client for 30 sec - exiting
01:54:26 (3604): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:16:00 (3388): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
07:16:01 (3388): No heartbeat from core client for 30 sec - exiting
07:16:02 (3388): No heartbeat from core client for 30 sec - exiting
08:28:50 (3204): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN Monitor - Quit request from BOINC...
15:26:55 (3784): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
15:26:57 (3784): No heartbeat from core client for 30 sec - exiting
19:08:28 (1272): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
19:08:29 (1272): No heartbeat from core client for 30 sec - exiting
21:04:46 (1028): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:04:48 (1028): No heartbeat from core client for 30 sec - exiting
21:04:49 (1028): No heartbeat from core client for 30 sec - exiting
21:04:50 (1028): No heartbeat from core client for 30 sec - exiting
21:37:07 (3380): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:37:08 (3380): No heartbeat from core client for 30 sec - exiting
21:37:09 (3380): No heartbeat from core client for 30 sec - exiting
21:40:56 (2148): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:01:45 (4436): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
22:01:47 (4436): No heartbeat from core client for 30 sec - exiting
22:01:48 (4436): No heartbeat from core client for 30 sec - exiting
03:02:06 (2828): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:02:07 (2828): No heartbeat from core client for 30 sec - exiting
03:07:07 (3332): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:11:54 (2148): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:16:29 (4232): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:16:30 (4232): No heartbeat from core client for 30 sec - exiting
03:19:25 (692): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:25:16 (5056): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:25:18 (5056): No heartbeat from core client for 30 sec - exiting
03:27:53 (3792): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:30:27 (4196): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:50:57 (2288): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:50:59 (2288): No heartbeat from core client for 30 sec - exiting
03:51:00 (2288): No heartbeat from core client for 30 sec - exiting
03:58:07 (796): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
03:58:08 (796): No heartbeat from core client for 30 sec - exiting
03:58:09 (796): No heartbeat from core client for 30 sec - exiting
04:01:54 (4836): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:06:13 (4028): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:06:14 (4028): No heartbeat from core client for 30 sec - exiting
04:12:30 (924): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:12:31 (924): No heartbeat from core client for 30 sec - exiting
04:24:03 (5024): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:27:13 (3932): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:28:55 (1244): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
04:30:43 (4436): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:26:05 (1836): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:26:07 (1836): No heartbeat from core client for 30 sec - exiting
09:26:08 (1836): No heartbeat from core client for 30 sec - exiting
12:09:07 (4148): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
12:09:08 (4148): No heartbeat from core client for 30 sec - exiting
12:09:09 (4148): No heartbeat from core client for 30 sec - exiting
13:41:32 (4060): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
13:41:39 (4060): No heartbeat from core client for 30 sec - exiting
13:41:40 (4060): No heartbeat from core client for 30 sec - exiting
13:41:41 (4060): No heartbeat from core client for 30 sec - exiting
13:41:42 (4060): No heartbeat from core client for 30 sec - exiting
13:41:43 (4060): No heartbeat from core client for 30 sec - exiting
13:41:44 (4060): No heartbeat from core client for 30 sec - exiting
13:41:45 (4060): No heartbeat from core client for 30 sec - exiting
13:41:46 (4060): No heartbeat from core client for 30 sec - exiting
13:41:47 (4060): No heartbeat from core client for 30 sec - exiting
09:26:41 (4384): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
09:26:42 (4384): No heartbeat from core client for 30 sec - exiting
09:26:43 (4384): No heartbeat from core client for 30 sec - exiting
09:26:44 (4384): No heartbeat from core client for 30 sec - exiting
21:27:43 (3820): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:27:46 (3820): No heartbeat from core client for 30 sec - exiting
21:27:47 (3820): No heartbeat from core client for 30 sec - exiting
21:27:48 (3820): No heartbeat from core client for 30 sec - exiting
21:27:49 (3820): No heartbeat from core client for 30 sec - exiting
21:27:50 (3820): No heartbeat from core client for 30 sec - exiting
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=984, iMonCtr=1
Model crash detected, will try to restart...
21:59:32 (984): No heartbeat from core client for 30 sec - exiting
21:59:33 (984): No heartbeat from core client for 30 sec - exiting
21:59:34 (984): No heartbeat from core client for 30 sec - exiting
21:59:35 (984): No heartbeat from core client for 30 sec - exiting
21:59:36 (984): No heartbeat from core client for 30 sec - exiting
21:59:37 (984): No heartbeat from core client for 30 sec - exiting
21:59:38 (984): No heartbeat from core client for 30 sec - exiting
21:59:39 (984): No heartbeat from core client for 30 sec - exiting
21:59:40 (984): No heartbeat from core client for 30 sec - exiting
21:59:41 (984): No heartbeat from core client for 30 sec - exiting
21:59:42 (984): No heartbeat from core client for 30 sec - exiting
21:59:43 (984): No heartbeat from core client for 30 sec - exiting
21:59:44 (984): No heartbeat from core client for 30 sec - exiting
21:59:45 (984): No heartbeat from core client for 30 sec - exiting
21:59:46 (984): No heartbeat from core client for 30 sec - exiting
21:59:47 (984): No heartbeat from core client for 30 sec - exiting
21:59:48 (984): No heartbeat from core client for 30 sec - exiting
21:59:49 (984): No heartbeat from core client for 30 sec - exiting
21:59:50 (984): No heartbeat from core client for 30 sec - exiting
21:59:51 (984): No heartbeat from core client for 30 sec - exiting
21:59:52 (984): No heartbeat from core client for 30 sec - exiting
21:59:53 (984): No heartbeat from core client for 30 sec - exiting
21:59:54 (984): No heartbeat from core client for 30 sec - exiting
21:59:55 (984): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
21:59:56 (984): No heartbeat from core client for 30 sec - exiting
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3800, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3800, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3800, iMonCtr=1
Model crash detected, will try to restart...
22:02:59 (3800): No heartbeat from core client for 30 sec - exiting
22:03:00 (3800): No heartbeat from core client for 30 sec - exiting
22:03:03 (3800): No heartbeat from core client for 30 sec - exiting
22:03:04 (3800): No heartbeat from core client for 30 sec - exiting
22:03:05 (3800): No heartbeat from core client for 30 sec - exiting
22:03:06 (3800): No heartbeat from core client for 30 sec - exiting
22:03:07 (3800): No heartbeat from core client for 30 sec - exiting
22:03:08 (3800): No heartbeat from core client for 30 sec - exiting
22:03:09 (3800): No heartbeat from core client for 30 sec - exiting
22:03:10 (3800): No heartbeat from core client for 30 sec - exiting
22:03:11 (3800): No heartbeat from core client for 30 sec - exiting
22:03:12 (3800): No heartbeat from core client for 30 sec - exiting
22:03:13 (3800): No heartbeat from core client for 30 sec - exiting
22:03:14 (3800): No heartbeat from core client for 30 sec - exiting
22:03:15 (3800): No heartbeat from core client for 30 sec - exiting
22:03:16 (3800): No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3092, iMonCtr=1
Model crash detected, will try to restart...
Signal 22 received, exiting...
Called boinc_finish
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3092, iMonCtr=1
Model crash detected, will try to restart...
Sorry, too many model crashes! :-(
Called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
14 Feb 2013 10:46:08 1125151 15549213 hadcm3n_n4ol_1880_40_008286330_0 466,560 1,033,887 2.2160
13 Feb 2013 09:41:32 1125151 15549213 hadcm3n_n4ol_1880_40_008286330_0 440,640 958,050 2.1742
12 Feb 2013 11:05:08 1125151 15549213 hadcm3n_n4ol_1880_40_008286330_0 414,720 877,853 2.1167
11 Feb 2013 12:30:01 1125151 15549213 hadcm3n_n4ol_1880_40_008286330_0 388,800 799,541 2.0564
10 Feb 2013 12:45:05 1125151 15549213 hadcm3n_n4ol_1880_40_008286330_0 362,880 720,522 1.9856
09 Feb 2013 18:11:41 1125151 15549213 hadcm3n_n4ol_1880_40_008286330_0 336,960 656,069 1.9470
08 Feb 2013 23:19:21 1125151 15549213 hadcm3n_n4ol_1880_40_008286330_0 311,040 589,431 1.8950
03 Feb 2013 10:08:06 1125151 15549213 hadcm3n_n4ol_1880_40_008286330_0 285,120 546,632 1.9172
02 Feb 2013 21:54:21 1125151 15549213 hadcm3n_n4ol_1880_40_008286330_0 259,200 505,012 1.9483
26 Jan 2013 10:05:06 1125151 15549213 hadcm3n_n4ol_1880_40_008286330_0 233,280 460,974 1.9761
25 Jan 2013 20:11:02 1125151 15549213 hadcm3n_n4ol_1880_40_008286330_0 207,360 413,619 1.9947
25 Jan 2013 07:55:10 1125151 15549213 hadcm3n_n4ol_1880_40_008286330_0 181,440 369,781 2.0380
24 Jan 2013 19:40:43 1125151 15549213 hadcm3n_n4ol_1880_40_008286330_0 155,520 325,745 2.0946
24 Jan 2013 07:55:59 1125151 15549213 hadcm3n_n4ol_1880_40_008286330_0 129,600 281,367 2.1710
20 Jan 2013 14:20:38 1125151 15549213 hadcm3n_n4ol_1880_40_008286330_0 103,680 230,072 2.2191
19 Jan 2013 21:06:36 1125151 15549213 hadcm3n_n4ol_1880_40_008286330_0 77,760 174,548 2.2447
19 Jan 2013 06:24:40 1125151 15549213 hadcm3n_n4ol_1880_40_008286330_0 51,840 120,871 2.3316
18 Jan 2013 15:21:34 1125151 15549213 hadcm3n_n4ol_1880_40_008286330_0 25,920 65,937 2.5439


©2024 cpdn.org