climateprediction.net home page
Task 13303894

Task 13303894

Name hadcm3n_o64n_1980_40_007426474_0
Workunit 7623977
Created 26 Aug 2011, 22:52:48 UTC
Sent 27 Aug 2011, 0:51:06 UTC
Report deadline 26 Nov 2011, 8:18:17 UTC
Received 5 Sep 2011, 17:59:09 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 193 (0x000000C1) EXIT_SIGNAL
Computer ID 1163023
Run time 7 days 15 hours 2 min 9 sec
CPU time 6 days 15 hours 45 min 13 sec
Validate state Invalid
Credit 5,909.76
Device peak FLOPS 3.28 GFLOPS
Application version UK Met Office Coupled Model Full Resolution Ocean v6.07
i686-pc-linux-gnu
Stderr
<core_client_version>6.10.58</core_client_version>
<![CDATA[
<message>
process exited with code 193 (0xc1, -63)
</message>
<stderr_txt>
CPDN Monitor - Quit request from BOINC...
CPDN Monitor - Quit request from BOINC...
forrtl: No space left on device
forrtl: severe (38): error during write, unit 6, file /home/connor/Programmes/BOINC/projects/climateprediction.net/hadcm3n_o64n_1980_40_007426474/dataout/stdout_um.txt
Image              PC        Routine            Line        Source             
hadcm3n_um_6.07_i  0848EB7D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0848D975  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0845F3CF  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F90D  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0841F257  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  08450E2C  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  081DD74F  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0808D513  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  08299901  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0821C545  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  08219DA1  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838720B  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  083995C6  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0838F8B7  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0839BDF8  Unknown               Unknown  Unknown
libc.so.6          F7543E46  Unknown               Unknown  Unknown
hadcm3n_um_6.07_i  0804CB11  Unknown               Unknown  Unknown
Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=9553, iMonCtr=1
Model crash detected, will try to restart...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: STWORK  : Error in PP_FILE                                                                                                                                                                                                                                      tmp/pipe_dummy                                                                  2048    
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
CPDN Monitor - Quit request from BOINC...

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: WRITDUMP: BAD BUFFOUT OF DATA                                                                                                                                                                                                                                   tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: STWORK  : Error in PP_FILE                                                                                                                                                                                                                                      tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: STWORK  : Error in PP_FILE                                                                                                                                                                                                                                      tmp/pipe_dummy                                                                  2048    

BUFFOUT: Write Failed: No space left on device
BUFFOUT: C I/O Error - Return code = 1

Model crashed: STWORK  : Error in PP_FILE                                                                                                                                                                                                                                      tmp/pipe_dummy                                                                  2048  *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (!prev): 0x08db03c8 ***
======= Backtrace: =========
/lib32/libc.so.6(+0x6b6f1)[0xf75666f1]
/lib32/libc.so.6(+0x6cf78)[0xf7567f78]
/lib32/libc.so.6(cfree+0x6d)[0xf756b02d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf7748f1f]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7511e46]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]
======= Memory map: ========
08048000-080e3000 r-xp 00000000 08:08 3407937                            /home/connor/Programmes/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e3000-080e4000 rwxp 0009b000 08:08 3407937                            /home/connor/Programmes/BOINC/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu
080e4000-0813b000 rwxp 00000000 00:00 0 
08cec000-08dec000 rwxp 00000000 00:00 0                                  [heap]
f6f00000-f6f21000 rwxp 00000000 00:00 0 
f6f21000-f7000000 ---p 00000000 00:00 0 
f707d000-f74f8000 rwxs 00000000 08:08 3408275                            /home/connor/Programmes/BOINC/slots/4/134715
f74f8000-f74fb000 rwxp 00000000 00:00 0 
f74fb000-f764e000 r-xp 00000000 08:05 8956                               /lib32/libc-2.13.so
f764e000-f7650000 r-xp 00153000 08:05 8956                               /lib32/libc-2.13.so
f7650000-f7651000 rwxp 00155000 08:05 8956                               /lib32/libc-2.13.so
f7651000-f7654000 rwxp 00000000 00:00 0 
f7654000-f7670000 r-xp 00000000 08:05 262036                             /usr/lib32/libgcc_s.so.1
f7670000-f7671000 rwxp 0001b000 08:05 262036                             /usr/lib32/libgcc_s.so.1
f7671000-f7695000 r-xp 00000000 08:05 8958                               /lib32/libm-2.13.so
f7695000-f7696000 r-xp 00023000 08:05 8958                               /lib32/libm-2.13.so
f7696000-f7697000 rwxp 00024000 08:05 8958                               /lib32/libm-2.13.so
f7697000-f7779000 r-xp 00000000 08:05 262034                             /usr/lib32/libstdc++.so.6.0.16
f7779000-f777d000 r-xp 000e2000 08:05 262034                             /usr/lib32/libstdc++.so.6.0.16
f777d000-f777e000 rwxp 000e6000 08:05 262034                             /usr/lib32/libstdc++.so.6.0.16
f777e000-f7785000 rwxp 00000000 00:00 0 
f7785000-f7787000 r-xp 00000000 08:05 8954                               /lib32/libdl-2.13.so
f7787000-f7788000 r-xp 00001000 08:05 8954                               /lib32/libdl-2.13.so
f7788000-f7789000 rwxp 00002000 08:05 8954                               /lib32/libdl-2.13.so
f7789000-f779e000 r-xp 00000000 08:05 8953                               /lib32/libpthread-2.13.so
f779e000-f779f000 r-xp 00014000 08:05 8953                               /lib32/libpthread-2.13.so
f779f000-f77a0000 rwxp 00015000 08:05 8953                               /lib32/libpthread-2.13.so
f77a0000-f77a3000 rwxp 00000000 00:00 0 
f77b3000-f77b4000 rwxp 00000000 00:00 0 
f77b4000-f77b5000 ---p 00000000 00:00 0 
f77b5000-f77b8000 rwxp 00000000 00:00 0 
f77b8000-f77ba000 rwxs 00000000 08:08 3408161                            /home/connor/Programmes/BOINC/slots/4/boinc_mmap_file
f77ba000-f77bb000 rwxp 00000000 00:00 0 
f77bb000-f77bc000 r-xp 00000000 00:00 0                                  [vdso]
f77bc000-f77d8000 r-xp 00000000 08:05 8957                               /lib32/ld-2.13.so
f77d8000-f77d9000 r-xp 0001b000 08:05 8957                               /lib32/ld-2.13.so
f77d9000-f77da000 rwxp 0001c000 08:05 8957                               /lib32/ld-2.13.so
fff55000-fffc4000 rw-p 00000000 00:00 0                                  [stack]
SIGABRT: abort called
Stack trace (17 frames):
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df]
[0xf77bb400]
[0xf77bb430]
/lib32/libc.so.6(gsignal+0x51)[0xf7525bb1]
/lib32/libc.so.6(abort+0x182)[0xf7528fd2]
/lib32/libc.so.6(+0x61605)[0xf755c605]
/lib32/libc.so.6(+0x6b6f1)[0xf75666f1]
/lib32/libc.so.6(+0x6cf78)[0xf7567f78]
/lib32/libc.so.6(cfree+0x6d)[0xf756b02d]
/usr/lib32/libstdc++.so.6(_ZdlPv+0x1f)[0xf7748f1f]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a]
/lib32/libc.so.6(__libc_start_main+0xe6)[0xf7511e46]
../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51]

Exiting...

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
05 Sep 2011 09:11:39 1163023 13303894 hadcm3n_o64n_1980_40_007426474_0 492,480 581,636 1.1810
03 Sep 2011 09:36:43 1163023 13303894 hadcm3n_o64n_1980_40_007426474_0 466,560 550,308 1.1795
03 Sep 2011 00:49:36 1163023 13303894 hadcm3n_o64n_1980_40_007426474_0 440,640 519,008 1.1779
02 Sep 2011 14:13:49 1163023 13303894 hadcm3n_o64n_1980_40_007426474_0 414,720 487,692 1.1760
02 Sep 2011 04:08:10 1163023 13303894 hadcm3n_o64n_1980_40_007426474_0 388,800 456,415 1.1739
01 Sep 2011 18:41:21 1163023 13303894 hadcm3n_o64n_1980_40_007426474_0 362,880 425,130 1.1715
01 Sep 2011 09:31:16 1163023 13303894 hadcm3n_o64n_1980_40_007426474_0 336,960 393,892 1.1690
01 Sep 2011 00:39:00 1163023 13303894 hadcm3n_o64n_1980_40_007426474_0 311,040 362,683 1.1660
31 Aug 2011 15:04:46 1163023 13303894 hadcm3n_o64n_1980_40_007426474_0 285,120 343,431 1.2045
31 Aug 2011 06:03:32 1163023 13303894 hadcm3n_o64n_1980_40_007426474_0 259,200 312,204 1.2045
30 Aug 2011 20:58:40 1163023 13303894 hadcm3n_o64n_1980_40_007426474_0 233,280 280,919 1.2042
30 Aug 2011 11:51:42 1163023 13303894 hadcm3n_o64n_1980_40_007426474_0 207,360 249,760 1.2045
30 Aug 2011 02:51:53 1163023 13303894 hadcm3n_o64n_1980_40_007426474_0 181,440 218,629 1.2050
29 Aug 2011 16:57:19 1163023 13303894 hadcm3n_o64n_1980_40_007426474_0 155,520 187,447 1.2053
29 Aug 2011 07:48:32 1163023 13303894 hadcm3n_o64n_1980_40_007426474_0 129,600 156,226 1.2054
28 Aug 2011 22:35:47 1163023 13303894 hadcm3n_o64n_1980_40_007426474_0 103,680 124,964 1.2053
28 Aug 2011 13:27:57 1163023 13303894 hadcm3n_o64n_1980_40_007426474_0 77,760 93,700 1.2050
28 Aug 2011 04:15:48 1163023 13303894 hadcm3n_o64n_1980_40_007426474_0 51,840 62,460 1.2049
27 Aug 2011 17:33:12 1163023 13303894 hadcm3n_o64n_1980_40_007426474_0 25,920 31,236 1.2051


©2024 cpdn.org