Name | hadcm3n_o1sc_2140_40_008270072_2 |
Workunit | 8425196 |
Created | 28 Jan 2013, 14:54:59 UTC |
Sent | 28 Jan 2013, 14:55:02 UTC |
Report deadline | 29 Apr 2013, 22:22:13 UTC |
Received | 12 Feb 2013, 4:35:34 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 22 (0x00000016) Unknown error code |
Computer ID | 1190785 |
Run time | 8 days 12 hours 2 min 48 sec |
CPU time | 6 days 23 hours 24 min 3 sec |
Validate state | Invalid |
Credit | 9,331.20 |
Device peak FLOPS | 3.33 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-apple-darwin |
Stderr | <core_client_version>7.0.31</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x21fbc04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x21fbc00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x11df604: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x11fac04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x11fac00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x29fcc04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x29fcc00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x29fcc04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x29fcc00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x29fcc04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x29fcc00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x29fcc04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x29fcc00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x21e0604: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x21fbc04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x21fbc00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x21fbc04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x21fbc00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x29fcc04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x29fcc00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x29fcc04: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x29fcc00: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug hadcm3n_6.07_i686-apple-darwin(42912,0xac1bd2c0) malloc: *** error for object 0x9d5204: incorrect checksum for freed object - object was probably modified after being freed. *** set a breakpoint in malloc_error_break to debug Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... 03:03:13 (89726): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:07:34 (95335): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:49:37 (95363): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:04:52 (95621): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:48:57 (96268): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:59:40 (96474): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:59:41 (96474): No heartbeat from core client for 30 sec - exiting 08:01:02 (96537): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 11:24:03 PM No files match the supplied pattern. MainError: 11:24:03 PM No files match the supplied pattern. MainError: 06:49:29 AM No files match the supplied pattern. MainError: 06:49:29 AM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 03:53:32 PM No files match the supplied pattern. MainError: 03:53:32 PM No files match the supplied pattern. MainError: 11:24:17 PM No files match the supplied pattern. MainError: 11:24:17 PM No files match the supplied pattern. MainError: 07:01:39 AM No files match the supplied pattern. MainError: 07:01:39 AM No files match the supplied pattern. Suspended CPDN Monitor - Suspend request from BOINC... MainError: 02:38:14 PM No files match the supplied pattern. MainError: 02:38:14 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 11:27:43 PM No files match the supplied pattern. MainError: 11:27:43 PM No files match the supplied pattern. MainError: 06:55:04 AM No files match the supplied pattern. MainError: 06:55:04 AM No files match the supplied pattern. MainError: 02:27:12 PM No files match the supplied pattern. MainError: 02:27:12 PM No files match the supplied pattern. CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... MainError: 07:15:25 PM No files match the supplied pattern. MainError: 07:15:25 PM No files match the supplied pattern. Suspended CPDN Monitor - Suspend request from BOINC... Error converting file to netcdf: dataout/o1scka.ph11c10 Error converting file to netcdf: dataout/o1scka.pg11c10 Error converting file to netcdf: dataout/o1scka.pe11c10 MainError: 03:34:49 AM No files match the supplied pattern. MainError: 03:34:49 AM No files match the supplied pattern. BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: No such file or directory BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 64 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 66 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 68 - Return code = 1 BUFFIN: Read Failed: Inappropriate ioctl for device BUFFIN: C I/O Error feof - Unit 69 - Return code = 1 BUFFIN: Read Failed: Result too large BUFFIN: C I/O Error feof - Unit 67 - Return code = 1 Model crashed: STWORK : I/O error - PP fixed length header tmp/pipe_dummy 2048 Sorry, too many model crashes! :-( Called boinc_finish </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
12 Feb 2013 03:38:29 | 1190785 | 15559844 | hadcm3n_o1sc_2140_40_008270072_2 | 777,600 | 640,325 | 0.8235 |
11 Feb 2013 19:19:37 | 1190785 | 15559844 | hadcm3n_o1sc_2140_40_008270072_2 | 751,680 | 617,154 | 0.8210 |
09 Feb 2013 14:30:28 | 1190785 | 15559844 | hadcm3n_o1sc_2140_40_008270072_2 | 725,760 | 593,760 | 0.8181 |
09 Feb 2013 06:56:23 | 1190785 | 15559844 | hadcm3n_o1sc_2140_40_008270072_2 | 699,840 | 570,502 | 0.8152 |
08 Feb 2013 23:29:24 | 1190785 | 15559844 | hadcm3n_o1sc_2140_40_008270072_2 | 673,920 | 547,328 | 0.8122 |
08 Feb 2013 14:40:35 | 1190785 | 15559844 | hadcm3n_o1sc_2140_40_008270072_2 | 648,000 | 524,024 | 0.8087 |
08 Feb 2013 07:06:25 | 1190785 | 15559844 | hadcm3n_o1sc_2140_40_008270072_2 | 622,080 | 500,751 | 0.8050 |
07 Feb 2013 23:28:15 | 1190785 | 15559844 | hadcm3n_o1sc_2140_40_008270072_2 | 596,160 | 477,443 | 0.8009 |
07 Feb 2013 15:56:37 | 1190785 | 15559844 | hadcm3n_o1sc_2140_40_008270072_2 | 570,240 | 454,170 | 0.7965 |
07 Feb 2013 06:52:13 | 1190785 | 15559844 | hadcm3n_o1sc_2140_40_008270072_2 | 544,320 | 430,841 | 0.7915 |
06 Feb 2013 23:24:46 | 1190785 | 15559844 | hadcm3n_o1sc_2140_40_008270072_2 | 518,400 | 407,584 | 0.7862 |
06 Feb 2013 15:35:49 | 1190785 | 15559844 | hadcm3n_o1sc_2140_40_008270072_2 | 492,480 | 386,090 | 0.7840 |
06 Feb 2013 10:23:28 | 1190785 | 15559844 | hadcm3n_o1sc_2140_40_008270072_2 | 466,560 | 365,959 | 0.7844 |
06 Feb 2013 00:41:19 | 1190785 | 15559844 | hadcm3n_o1sc_2140_40_008270072_2 | 440,640 | 345,964 | 0.7851 |
05 Feb 2013 17:01:06 | 1190785 | 15559844 | hadcm3n_o1sc_2140_40_008270072_2 | 414,720 | 323,851 | 0.7809 |
05 Feb 2013 08:36:52 | 1190785 | 15559844 | hadcm3n_o1sc_2140_40_008270072_2 | 388,800 | 300,503 | 0.7729 |
05 Feb 2013 00:25:04 | 1190785 | 15559844 | hadcm3n_o1sc_2140_40_008270072_2 | 362,880 | 277,197 | 0.7639 |
04 Feb 2013 05:32:05 | 1190785 | 15559844 | hadcm3n_o1sc_2140_40_008270072_2 | 336,960 | 253,841 | 0.7533 |
03 Feb 2013 22:09:55 | 1190785 | 15559844 | hadcm3n_o1sc_2140_40_008270072_2 | 311,040 | 230,577 | 0.7413 |
03 Feb 2013 14:15:36 | 1190785 | 15559844 | hadcm3n_o1sc_2140_40_008270072_2 | 285,120 | 207,248 | 0.7269 |
©2024 climateprediction.net