Name | hadcm3n_xaii_198012_480_010220796_0 |
Workunit | 10220796 |
Created | 4 Dec 2015, 14:58:46 UTC |
Sent | 4 Dec 2015, 16:50:22 UTC |
Report deadline | 15 Nov 2016, 22:10:22 UTC |
Received | 17 Mar 2016, 13:14:50 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 1318502 |
Run time | 8 days 0 hours 39 min 36 sec |
CPU time | 6 days 1 hours 0 min 21 sec |
Validate state | Invalid |
Credit | 6,220.80 |
Device peak FLOPS | 4.27 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin |
Stderr | <core_client_version>7.6.22</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 12:05:32 (16017): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 15:37:02 (20229): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 17:26:39 (74576): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:58:21 (1642): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:58:23 (1642): No heartbeat from core client for 30 sec - exiting 04:58:24 (1642): No heartbeat from core client for 30 sec - exiting 04:58:25 (1642): No heartbeat from core client for 30 sec - exiting 04:58:26 (1642): No heartbeat from core client for 30 sec - exiting 04:58:27 (1642): No heartbeat from core client for 30 sec - exiting 04:58:28 (1642): No heartbeat from core client for 30 sec - exiting 04:58:29 (1642): No heartbeat from core client for 30 sec - exiting 04:58:30 (1642): No heartbeat from core client for 30 sec - exiting 04:58:31 (1642): No heartbeat from core client for 30 sec - exiting 04:58:32 (1642): No heartbeat from core client for 30 sec - exiting 04:58:33 (1642): No heartbeat from core client for 30 sec - exiting 04:58:34 (1642): No heartbeat from core client for 30 sec - exiting 04:58:35 (1642): No heartbeat from core client for 30 sec - exiting 04:58:37 (1642): No heartbeat from core client for 30 sec - exiting 04:58:38 (1642): No heartbeat from core client for 30 sec - exiting 04:58:39 (1642): No heartbeat from core client for 30 sec - exiting 04:58:40 (1642): No heartbeat from core client for 30 sec - exiting 04:58:41 (1642): No heartbeat from core client for 30 sec - exiting 04:58:42 (1642): No heartbeat from core client for 30 sec - exiting 04:58:43 (1642): No heartbeat from core client for 30 sec - exiting 04:58:44 (1642): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 14:37:57 (4005): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(80417,0xa36b5000) malloc: *** error for object 0x801c04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(80417,0xa36b5000) malloc: *** error for object 0x801c00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(80417,0xa36b5000) malloc: *** error for object 0x2002204: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(80417,0xa36b5000) malloc: *** error for object 0x2002200: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(80417,0xa36b5000) malloc: *** error for object 0x2002204: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(80417,0xa36b5000) malloc: *** error for object 0x2002200: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(80417,0xa36b5000) malloc: *** error for object 0x2002204: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(80417,0xa36b5000) malloc: *** error for object 0x2002200: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(80417,0xa36b5000) malloc: *** error for object 0x2002204: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(80417,0xa36b5000) malloc: *** error for object 0x2002200: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(80417,0xa36b5000) malloc: *** error for object 0x2002204: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(80417,0xa36b5000) malloc: *** error for object 0x2002200: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug CPDN Monitor - Quit request from BOINC... cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_xaii_198012_480_010220796/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_xaii_198012_480_010220796/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_xaii_198012_480_010220796/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_xaii_198012_480_010220796/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_xaii_198012_480_010220796/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_xaii_198012_480_010220796/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_xaii_198012_480_010220796/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_xaii_198012_480_010220796/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_xaii_198012_480_010220796/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_xaii_198012_480_010220796/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_xaii_198012_480_010220796/dataout/atmos_restart.day after 11 attempts cpdnmonitor: cannot open input file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_xaii_198012_480_010220796/dataout/ocean_restart.day after 11 attempts Model crashed: READ_FLH: I/O error tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
17 Mar 2016 12:42:46 | 1318502 | 19131810 | hadcm3n_xaii_198012_480_010220796_0 | 518,400 | 521,996 | 1.0069 |
15 Mar 2016 11:04:10 | 1318502 | 19131810 | hadcm3n_xaii_198012_480_010220796_0 | 492,480 | 496,324 | 1.0078 |
14 Mar 2016 16:12:13 | 1318502 | 19131810 | hadcm3n_xaii_198012_480_010220796_0 | 466,560 | 470,031 | 1.0074 |
14 Mar 2016 16:12:13 | 1318502 | 19131810 | hadcm3n_xaii_198012_480_010220796_0 | 440,640 | 443,705 | 1.0070 |
09 Mar 2016 13:49:00 | 1318502 | 19131810 | hadcm3n_xaii_198012_480_010220796_0 | 414,720 | 417,310 | 1.0062 |
08 Mar 2016 12:06:00 | 1318502 | 19131810 | hadcm3n_xaii_198012_480_010220796_0 | 388,800 | 390,604 | 1.0046 |
07 Mar 2016 10:52:11 | 1318502 | 19131810 | hadcm3n_xaii_198012_480_010220796_0 | 362,880 | 364,335 | 1.0040 |
29 Feb 2016 17:06:40 | 1318502 | 19131810 | hadcm3n_xaii_198012_480_010220796_0 | 336,960 | 337,879 | 1.0027 |
23 Feb 2016 13:22:43 | 1318502 | 19131810 | hadcm3n_xaii_198012_480_010220796_0 | 311,040 | 311,273 | 1.0007 |
17 Feb 2016 15:19:00 | 1318502 | 19131810 | hadcm3n_xaii_198012_480_010220796_0 | 285,120 | 285,196 | 1.0003 |
14 Feb 2016 14:44:52 | 1318502 | 19131810 | hadcm3n_xaii_198012_480_010220796_0 | 259,200 | 258,749 | 0.9983 |
03 Feb 2016 14:58:37 | 1318502 | 19131810 | hadcm3n_xaii_198012_480_010220796_0 | 233,280 | 232,652 | 0.9973 |
02 Feb 2016 09:09:38 | 1318502 | 19131810 | hadcm3n_xaii_198012_480_010220796_0 | 207,360 | 206,576 | 0.9962 |
31 Jan 2016 09:12:24 | 1318502 | 19131810 | hadcm3n_xaii_198012_480_010220796_0 | 181,440 | 179,909 | 0.9916 |
28 Jan 2016 14:15:56 | 1318502 | 19131810 | hadcm3n_xaii_198012_480_010220796_0 | 155,520 | 153,691 | 0.9882 |
27 Jan 2016 10:05:19 | 1318502 | 19131810 | hadcm3n_xaii_198012_480_010220796_0 | 129,600 | 127,395 | 0.9830 |
25 Jan 2016 17:27:28 | 1318502 | 19131810 | hadcm3n_xaii_198012_480_010220796_0 | 103,680 | 101,243 | 0.9765 |
20 Jan 2016 11:05:20 | 1318502 | 19131810 | hadcm3n_xaii_198012_480_010220796_0 | 77,760 | 77,400 | 0.9954 |
11 Jan 2016 13:48:47 | 1318502 | 19131810 | hadcm3n_xaii_198012_480_010220796_0 | 51,840 | 51,721 | 0.9977 |
04 Jan 2016 13:52:36 | 1318502 | 19131810 | hadcm3n_xaii_198012_480_010220796_0 | 25,920 | 25,930 | 1.0004 |
©2024 cpdn.org