Name | hadcm3n_o9bo_1900_40_008467207_1 |
Workunit | 8618046 |
Created | 6 Jan 2014, 9:23:48 UTC |
Sent | 6 Jan 2014, 9:24:21 UTC |
Report deadline | 7 Apr 2014, 16:51:32 UTC |
Received | 21 Jan 2014, 6:07:36 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 193 (0x000000C1) EXIT_SIGNAL |
Computer ID | 920678 |
Run time | 8 days 7 hours 46 min 2 sec |
CPU time | 7 days 9 hours 50 min 29 sec |
Validate state | Invalid |
Credit | 3,110.40 |
Device peak FLOPS | 2.43 GFLOPS |
Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
Stderr | <core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:46:47 (25541): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 04:35:32 (5248): No heartbeat from core client for 30 sec - exiting Suspended CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:30:44 (1708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 12:12:16 (21478): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 03:29:53 (17073): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 02:36:54 (12860): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:50:38 (20225): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 01:21:37 (7960): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:53:04 (21399): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:32:04 (17050): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:51:27 (13358): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:13:45 (30367): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:04:52 (27266): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x09872c60 *** ======= Backtrace: ========= /lib/libc.so.6(+0x6bba1)[0xf7492ba1] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xf7674321] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xf767437d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe6)[0xf743db96] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 fc:0e 765 /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rwxp 0009b000 fc:0e 765 /var/lib/boinc/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rwxp 00000000 00:00 0 0981d000-098a4000 rwxp 00000000 00:00 0 [heap] f6e00000-f6e21000 rwxp 00000000 00:00 0 f6e21000-f6f00000 ---p 00000000 00:00 0 f6fab000-f7426000 rwxs 00000000 fc:0e 55282 /var/lib/boinc/slots/3/136535 f7426000-f7427000 rwxp 00000000 00:00 0 f7427000-f7573000 r-xp 00000000 00:0f 80720 /lib/libc-2.11.1.so f7573000-f7574000 ---p 0014c000 00:0f 80720 /lib/libc-2.11.1.so f7574000-f7576000 r-xp 0014c000 00:0f 80720 /lib/libc-2.11.1.so f7576000-f7577000 rwxp 0014e000 00:0f 80720 /lib/libc-2.11.1.so f7577000-f757a000 rwxp 00000000 00:00 0 f757a000-f7596000 r-xp 00000000 00:0f 637 /lib/libgcc_s-4.4.3.so.1 f7596000-f7597000 rwxp 0001b000 00:0f 637 /lib/libgcc_s-4.4.3.so.1 f7597000-f7598000 rwxp 00000000 00:00 0 f7598000-f75bc000 r-xp 00000000 00:0f 80728 /lib/libm-2.11.1.so f75bc000-f75bd000 r-xp 00023000 00:0f 80728 /lib/libm-2.11.1.so f75bd000-f75be000 rwxp 00024000 00:0f 80728 /lib/libm-2.11.1.so f75be000-f76a2000 r-xp 00000000 00:26 3239 /usr/lib/libstdc++.so.6.0.13 f76a2000-f76a3000 ---p 000e4000 00:26 3239 /usr/lib/libstdc++.so.6.0.13 f76a3000-f76a7000 r-xp 000e4000 00:26 3239 /usr/lib/libstdc++.so.6.0.13 f76a7000-f76a8000 rwxp 000e8000 00:26 3239 /usr/lib/libstdc++.so.6.0.13 f76a8000-f76af000 rwxp 00000000 00:00 0 f76af000-f76b1000 r-xp 00000000 00:0f 80726 /lib/libdl-2.11.1.so f76b1000-f76b2000 r-xp 00001000 00:0f 80726 /lib/libdl-2.11.1.so f76b2000-f76b3000 rwxp 00002000 00:0f 80726 /lib/libdl-2.11.1.so f76b3000-f76c7000 r-xp 00000000 00:0f 80744 /lib/libpthread-2.11.1.so f76c7000-f76c8000 r-xp 00013000 00:0f 80744 /lib/libpthread-2.11.1.so f76c8000-f76c9000 rwxp 00014000 00:0f 80744 /lib/libpthread-2.11.1.so f76c9000-f76cb000 rwxp 00000000 00:00 0 f76e4000-f76e5000 rwxp 00000000 00:00 0 f76e5000-f76e6000 ---p 00000000 00:00 0 f76e6000-f76e9000 rwxp 00000000 00:00 0 f76e9000-f76eb000 rwxs 00000000 fc:0e 55000 /var/lib/boinc/slots/3/boinc_mmap_file f76eb000-f76ec000 rwxp 00000000 00:00 0 f76ec000-f7707000 r-xp 00000000 00:0f 80713 /lib/ld-2.11.1.so f7707000-f7708000 r-xp 0001a000 00:0f 80713 /lib/ld-2.11.1.so f7708000-f7709000 rwxp 0001b000 00:0f 80713 /lib/ld-2.11.1.so ff7d6000-ff846000 rw-p 00000000 00:00 0 [stack] ffffe000-fffff000 r-xp 00000000 00:00 0 [vdso] SIGABRT: abort called Stack trace (17 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xffffe400] [0xffffe425] /lib/libc.so.6(gsignal+0x51)[0xf7450ce1] /lib/libc.so.6(abort+0x182)[0xf7452632] /lib/libc.so.6(+0x65e4d)[0xf748ce4d] /lib/libc.so.6(+0x6bba1)[0xf7492ba1] /usr/lib/libstdc++.so.6(_ZdlPv+0x21)[0xf7674321] /usr/lib/libstdc++.so.6(_ZdaPv+0x1d)[0xf767437d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib/libc.so.6(__libc_start_main+0xe6)[0xf743db96] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
21 Jan 2014 06:09:24 | 920678 | 16202378 | hadcm3n_o9bo_1900_40_008467207_1 | 259,200 | 640,223 | 2.4700 |
20 Jan 2014 03:24:11 | 920678 | 16202378 | hadcm3n_o9bo_1900_40_008467207_1 | 233,280 | 574,868 | 2.4643 |
19 Jan 2014 03:44:04 | 920678 | 16202378 | hadcm3n_o9bo_1900_40_008467207_1 | 207,360 | 507,941 | 2.4496 |
17 Jan 2014 20:39:11 | 920678 | 16202378 | hadcm3n_o9bo_1900_40_008467207_1 | 181,440 | 441,584 | 2.4338 |
16 Jan 2014 18:58:26 | 920678 | 16202378 | hadcm3n_o9bo_1900_40_008467207_1 | 155,520 | 374,923 | 2.4108 |
15 Jan 2014 18:59:56 | 920678 | 16202378 | hadcm3n_o9bo_1900_40_008467207_1 | 129,600 | 308,401 | 2.3796 |
14 Jan 2014 15:02:38 | 920678 | 16202378 | hadcm3n_o9bo_1900_40_008467207_1 | 103,680 | 244,589 | 2.3591 |
14 Jan 2014 00:41:12 | 920678 | 16202378 | hadcm3n_o9bo_1900_40_008467207_1 | 77,760 | 181,276 | 2.3312 |
12 Jan 2014 15:15:14 | 920678 | 16202378 | hadcm3n_o9bo_1900_40_008467207_1 | 51,840 | 118,748 | 2.2907 |
11 Jan 2014 02:39:58 | 920678 | 16202378 | hadcm3n_o9bo_1900_40_008467207_1 | 25,920 | 61,985 | 2.3914 |
©2024 cpdn.org