climateprediction.net home page
Task 15844966

Task 15844966

Name hadcm3n_o61h_1940_40_008380563_1
Workunit 8531422
Created 16 Jun 2013, 14:46:23 UTC
Sent 16 Jun 2013, 15:11:27 UTC
Report deadline 15 Sep 2013, 22:38:38 UTC
Received 26 Aug 2013, 11:08:27 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1166508
Run time 24 days 2 hours 39 min 54 sec
CPU time 9 days 15 hours 27 min 19 sec
Validate state Invalid
Credit 11,197.44
Device peak FLOPS 2.37 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-apple-darwin
Stderr 
<core_client_version>7.0.65</core_client_version>
<![CDATA[
<message>
process exited with code 22 (0x16, -234)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/12/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/12/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/12/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/12/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/12/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/12/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/12/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/12/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/12/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/12/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/12/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/12/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/12/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/12/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/12/../../switcher/switcher) is setuid or setgid
hadcm3n_6.07_i686-apple-darwin(453,0xaca24a28) malloc: *** error for object 0x6931e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(453,0xaca24a28) malloc: *** error for object 0x93ae04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(453,0xaca24a28) malloc: *** error for object 0x3937e04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(453,0xaca24a28) malloc: *** error for object 0x3937e00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(453,0xaca24a28) malloc: *** error for object 0x492a804: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(453,0xaca24a28) malloc: *** error for object 0x91e604: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(453,0xaca24a28) malloc: *** error for object 0x91e600: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(453,0xaca24a28) malloc: *** error for object 0x93fc04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(453,0xaca24a28) malloc: *** error for object 0x93fc00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(453,0xaca24a28) malloc: *** error for object 0x93fc04: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(453,0xaca24a28) malloc: *** error for object 0x93fc00: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(453,0xaca24a28) malloc: *** error for object 0x38fe404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(453,0xaca24a28) malloc: *** error for object 0x38fe400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(453,0xaca24a28) malloc: *** error for object 0x38fe404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(453,0xaca24a28) malloc: *** error for object 0x38fe400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(453,0xaca24a28) malloc: *** error for object 0x38fe404: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
hadcm3n_6.07_i686-apple-darwin(453,0xaca24a28) malloc: *** error for object 0x38fe400: incorrect checksum for freed object - object was probably modified after being freed.
*** set a breakpoint in malloc_error_break to debug
Suspended CPDN Monitor - Suspend request from BOINC...
OPEN:  File Creation Failed: No space left on device
OPEN:  Unable to Open File dataout/o61hka.daf73e0 for Read/Write

Model crashed: DUMPCTL : Fail to open output dump - may already exist                                                                                                                                                                                                          tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy               CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/12/../../switcher/switcher) is setuid or setgid
CPDN Monitor - Quit request from BOINC...
dyld: DYLD_ environment variables being ignored because main executable (/Library/Application Support/BOINC Data/slots/12/../../switcher/switcher) is setuid or setgid
Suspended CPDN Monitor - Suspend request from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITHEAD: I/O error                                                                                                                                                                                                                                             tmp/pipe_dummy                                                                  2048    
forrtl: No space left on device
forrtl: severe (38): error during write, unit 6, file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o61h_1940_40_008380563/dataout/stdout_um.txt
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0042E622  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0042D0EB  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003EF4DD  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003A66F5  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003A5E57  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003E6122  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0036B213  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  00378344  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  00209003  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  00160E7A  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  00164453  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0038CE7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0038A1ED  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  000048E1  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  000027FB  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  00002729  Unknown               Unknown  Unknown
Unknown            00000003  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=534, iMonCtr=1
Model crash detected, will try to restart...
forrtl: No space left on device
forrtl: severe (38): error during write, unit 6, file /Library/Application Support/BOINC Data/projects/climateprediction.net/hadcm3n_o61h_1940_40_008380563/dataout/stdout_um.txt
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0042E622  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0042D0EB  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003EF4DD  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003A66F5  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003A5E57  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003E1E32  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  003DF4CC  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  00209595  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  00160E7A  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  00164453  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0038CE7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0038A1ED  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  000048E1  UnCalled boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
26 Aug 2013 10:09:43 1166508 15844966 hadcm3n_o61h_1940_40_008380563_1 933,120 1,185,636 1.2706
25 Aug 2013 18:25:05 1166508 15844966 hadcm3n_o61h_1940_40_008380563_1 907,200 1,129,264 1.2448
25 Aug 2013 02:46:56 1166508 15844966 hadcm3n_o61h_1940_40_008380563_1 881,280 1,072,957 1.2175
24 Aug 2013 11:03:42 1166508 15844966 hadcm3n_o61h_1940_40_008380563_1 855,360 1,016,639 1.1886
23 Aug 2013 18:18:50 1166508 15844966 hadcm3n_o61h_1940_40_008380563_1 829,440 960,432 1.1579
23 Aug 2013 10:54:40 1166508 15844966 hadcm3n_o61h_1940_40_008380563_1 803,520 904,152 1.1252
22 Aug 2013 15:42:14 1166508 15844966 hadcm3n_o61h_1940_40_008380563_1 777,600 847,914 1.0904
21 Aug 2013 18:43:56 1166508 15844966 hadcm3n_o61h_1940_40_008380563_1 751,680 791,516 1.0530
21 Aug 2013 02:50:16 1166508 15844966 hadcm3n_o61h_1940_40_008380563_1 725,760 735,111 1.0129
20 Aug 2013 10:47:23 1166508 15844966 hadcm3n_o61h_1940_40_008380563_1 699,840 678,230 0.9691
19 Aug 2013 19:01:59 1166508 15844966 hadcm3n_o61h_1940_40_008380563_1 673,920 621,914 0.9228
26 Jul 2013 10:45:34 1166508 15844966 hadcm3n_o61h_1940_40_008380563_1 648,000 566,412 0.8741
25 Jul 2013 19:09:56 1166508 15844966 hadcm3n_o61h_1940_40_008380563_1 622,080 513,576 0.8256
25 Jul 2013 03:07:25 1166508 15844966 hadcm3n_o61h_1940_40_008380563_1 596,160 870,509 1.4602
24 Jul 2013 11:19:09 1166508 15844966 hadcm3n_o61h_1940_40_008380563_1 570,240 814,720 1.4287
23 Jul 2013 22:16:38 1166508 15844966 hadcm3n_o61h_1940_40_008380563_1 544,320 758,949 1.3943
23 Jul 2013 22:00:09 1166508 15844966 hadcm3n_o61h_1940_40_008380563_1 518,400 703,135 1.3564
23 Jul 2013 21:42:26 1166508 15844966 hadcm3n_o61h_1940_40_008380563_1 492,480 648,222 1.3162
23 Jul 2013 21:23:59 1166508 15844966 hadcm3n_o61h_1940_40_008380563_1 466,560 593,460 1.2720
23 Jul 2013 20:52:15 1166508 15844966 hadcm3n_o61h_1940_40_008380563_1 440,640 538,980 1.2232


©2024 climateprediction.net