Name | hadcm3n_o13g_2060_40_007958002_0 |
Workunit | 8113114 |
Created | 9 May 2012, 16:51:21 UTC |
Sent | 9 May 2012, 17:08:23 UTC |
Report deadline | 9 Aug 2012, 0:35:34 UTC |
Received | 19 Jun 2012, 17:03:36 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 1057729 |
Run time | 8 days 21 hours 51 min 2 sec |
CPU time | 8 days 11 hours 23 min 15 sec |
Validate state | Invalid |
Credit | 4,976.64 |
Device peak FLOPS | 2.52 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 windows_intelx86 |
Stderr | <core_client_version>7.0.25</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4380, iMonCtr=1 Model crash detected, will try to restart... 18:46:56 (4744): No heartbeat from core client for 30 sec - exiting 18:46:58 (4744): No heartbeat from core client for 30 sec - exiting 18:46:59 (4744): No heartbeat from core client for 30 sec - exiting 18:47:00 (4744): No heartbeat from core client for 30 sec - exiting 18:47:01 (4744): No heartbeat from core client for 30 sec - exiting 18:47:02 (4744): No heartbeat from core client for 30 sec - exiting 18:47:03 (4744): No heartbeat from core client for 30 sec - exiting 18:47:04 (4744): No heartbeat from core client for 30 sec - exiting 18:47:05 (4744): No heartbeat from core client for 30 sec - exiting 18:47:06 (4744): No heartbeat from core client for 30 sec - exiting 18:47:07 (4744): No heartbeat from core client for 30 sec - exiting 18:47:08 (4744): No heartbeat from core client for 30 sec - exiting 18:47:10 (4744): No heartbeat from core client for 30 sec - exiting 18:47:11 (4744): No heartbeat from core client for 30 sec - exiting 18:47:12 (4744): No heartbeat from core client for 30 sec - exiting 18:47:13 (4744): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5632, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... 10:11:27 (5240): No heartbeat from core client for 30 sec - exiting 10:11:28 (5240): No heartbeat from core client for 30 sec - exiting 10:11:29 (5240): No heartbeat from core client for 30 sec - exiting 10:11:31 (5240): No heartbeat from core client for 30 sec - exiting 10:11:32 (5240): No heartbeat from core client for 30 sec - exiting 10:11:33 (5240): No heartbeat from core client for 30 sec - exiting 10:11:34 (5240): No heartbeat from core client for 30 sec - exiting 10:11:35 (5240): No heartbeat from core client for 30 sec - exiting 10:11:36 (5240): No heartbeat from core client for 30 sec - exiting 10:11:37 (5240): No heartbeat from core client for 30 sec - exiting 10:11:38 (5240): No heartbeat from core client for 30 sec - exiting 10:11:39 (5240): No heartbeat from core client for 30 sec - exiting 10:11:40 (5240): No heartbeat from core client for 30 sec - exiting 10:11:41 (5240): No heartbeat from core client for 30 sec - exiting 10:11:43 (5240): No heartbeat from core client for 30 sec - exiting 10:11:44 (5240): No heartbeat from core client for 30 sec - exiting 10:11:45 (5240): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 15:13:37 (3496): No heartbeat from core client for 30 sec - exiting 15:13:38 (3496): No heartbeat from core client for 30 sec - exiting 15:13:39 (3496): No heartbeat from core client for 30 sec - exiting 15:13:40 (3496): No heartbeat from core client for 30 sec - exiting 15:13:41 (3496): No heartbeat from core client for 30 sec - exiting 15:13:42 (3496): No heartbeat from core client for 30 sec - exiting 15:13:44 (3496): No heartbeat from core client for 30 sec - exiting 15:13:45 (3496): No heartbeat from core client for 30 sec - exiting 15:13:46 (3496): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5764, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5764, iMonCtr=1 Model crash detected, will try to restart... 14:20:50 (5708): No heartbeat from core client for 30 sec - exiting 14:20:51 (5708): No heartbeat from core client for 30 sec - exiting 14:20:52 (5708): No heartbeat from core client for 30 sec - exiting 14:20:53 (5708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 21:13:22 (5692): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:14:11 (1132): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4128, iMonCtr=1 Model crash detected, will try to restart... 14:47:27 (6416): No heartbeat from core client for 30 sec - exiting 14:47:28 (6416): No heartbeat from core client for 30 sec - exiting 14:47:29 (6416): No heartbeat from core client for 30 sec - exiting 14:47:30 (6416): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4628, iMonCtr=1 Model crash detected, will try to restart... 14:57:06 (6652): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:30:40 (5092): No heartbeat from core client for 30 sec - exiting 08:30:41 (5092): No heartbeat from core client for 30 sec - exiting 08:30:42 (5092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:30:43 (5092): No heartbeat from core client for 30 sec - exiting CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 20:02:40 (5924): No heartbeat from core client for 30 sec - exiting 20:02:41 (5924): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3748, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5944, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5944, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5944, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5944, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5944, iMonCtr=1 Model crash detected, will try to restart... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=5944, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/ocean_restart.day after 11 attempts Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4540, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/ocean_restart.day after 11 attempts Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4540, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/ocean_restart.day after 11 attempts Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4540, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/ocean_restart.day after 11 attempts Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4540, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/ocean_restart.day after 11 attempts Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4540, iMonCtr=1 Model crash detected, will try to restart... cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file C:\ProgramData\BOINC/projects/climateprediction.net/hadcm3n_o13g_2060_40_007958002/dataout/ocean_restart.day after 11 attempts Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4540, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
15 Jun 2012 16:17:13 | 1057729 | 14650465 | hadcm3n_o13g_2060_40_007958002_0 | 414,720 | 695,310 | 1.6766 |
11 Jun 2012 15:27:03 | 1057729 | 14650465 | hadcm3n_o13g_2060_40_007958002_0 | 388,800 | 648,870 | 1.6689 |
09 Jun 2012 10:33:33 | 1057729 | 14650465 | hadcm3n_o13g_2060_40_007958002_0 | 362,880 | 601,706 | 1.6581 |
07 Jun 2012 07:48:20 | 1057729 | 14650465 | hadcm3n_o13g_2060_40_007958002_0 | 336,960 | 552,561 | 1.6398 |
05 Jun 2012 21:11:41 | 1057729 | 14650465 | hadcm3n_o13g_2060_40_007958002_0 | 311,040 | 504,024 | 1.6204 |
31 May 2012 17:26:21 | 1057729 | 14650465 | hadcm3n_o13g_2060_40_007958002_0 | 285,120 | 460,169 | 1.6139 |
28 May 2012 21:34:52 | 1057729 | 14650465 | hadcm3n_o13g_2060_40_007958002_0 | 259,200 | 419,977 | 1.6203 |
28 May 2012 12:44:35 | 1057729 | 14650465 | hadcm3n_o13g_2060_40_007958002_0 | 233,280 | 386,069 | 1.6550 |
27 May 2012 17:47:59 | 1057729 | 14650465 | hadcm3n_o13g_2060_40_007958002_0 | 207,360 | 353,836 | 1.7064 |
24 May 2012 18:41:50 | 1057729 | 14650465 | hadcm3n_o13g_2060_40_007958002_0 | 181,440 | 317,439 | 1.7496 |
22 May 2012 19:13:45 | 1057729 | 14650465 | hadcm3n_o13g_2060_40_007958002_0 | 155,520 | 276,963 | 1.7809 |
20 May 2012 19:18:09 | 1057729 | 14650465 | hadcm3n_o13g_2060_40_007958002_0 | 129,600 | 231,450 | 1.7859 |
19 May 2012 14:31:29 | 1057729 | 14650465 | hadcm3n_o13g_2060_40_007958002_0 | 103,680 | 185,527 | 1.7894 |
18 May 2012 20:03:20 | 1057729 | 14650465 | hadcm3n_o13g_2060_40_007958002_0 | 77,760 | 139,324 | 1.7917 |
17 May 2012 15:34:39 | 1057729 | 14650465 | hadcm3n_o13g_2060_40_007958002_0 | 51,840 | 93,007 | 1.7941 |
12 May 2012 20:52:26 | 1057729 | 14650465 | hadcm3n_o13g_2060_40_007958002_0 | 25,920 | 46,445 | 1.7919 |
©2024 cpdn.org