 |
|
| Name | hadcm3n_3ajp_1980_40_008363835_0 |
| Workunit | 8514694 |
| Created | 10 May 2013, 18:15:37 UTC |
| Sent | 10 May 2013, 18:21:08 UTC |
| Report deadline | 10 Aug 2013, 1:48:19 UTC |
| Received | 30 May 2013, 4:19:32 UTC |
| Server state | Over |
| Outcome | Computation error |
| Client state | Compute error |
| Exit status | 193 (0x000000C1) EXIT_SIGNAL |
| Computer ID | 1179592 |
| Run time | 19 days 4 hours 21 min 17 sec |
| CPU time | 17 days 18 hours 18 min 38 sec |
| Validate state | Invalid |
| Credit | 6,220.80 |
| Device peak FLOPS | 1.77 GFLOPS |
| Application version | UK Met Office Coupled Model Full Resolution Ocean v6.07 i686-pc-linux-gnu |
| Stderr | <core_client_version>6.10.58</core_client_version> <![CDATA[ <message> process exited with code 193 (0xc1, -63) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... 20:08:12 (27425): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:08:13 (27425): No heartbeat from core client for 30 sec - exiting 20:39:57 (29873): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 22:13:32 (33181): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:14:01 (33181): No heartbeat from core client for 30 sec - exiting 22:14:02 (33181): No heartbeat from core client for 30 sec - exiting 22:14:03 (33181): No heartbeat from core client for 30 sec - exiting 22:14:04 (33181): No heartbeat from core client for 30 sec - exiting 22:14:05 (33181): No heartbeat from core client for 30 sec - exiting 22:14:06 (33181): No heartbeat from core client for 30 sec - exiting 22:14:07 (33181): No heartbeat from core client for 30 sec - exiting 23:00:24 (38088): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 00:57:38 (38341): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:02:27 (38639): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:03:15 (38894): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:03:28 (39144): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:06:19 (39503): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:27:05 (39759): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:10:56 (40183): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:21:29 (40412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:11:44 (40624): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:13:47 (40862): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:51:46 (41256): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:16:39 (41726): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:18:35 (41956): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:18:53 (42314): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:18:20 (42585): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 04:25:47 (43188): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:13:25 (43391): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:26:28 (43625): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 05:52:26 (43837): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:28:05 (44054): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:39:25 (44286): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:46 (44719): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:30:21 (44923): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:31:00 (45160): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:31:42 (45412): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:06:45 (45678): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:33:05 (45992): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:33:46 (46225): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 14:39:15 (46493): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 03:43:48 (46700): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 23:16:29 (47740): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:26:21 (2690): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 20:16:55 (3414): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:42:39 (6328): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 06:52:43 (6653): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:29 (6921): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:52:39 (7286): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:47:51 (7492): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:01:35 (7722): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:49:15 (8259): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:26 (8491): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:02:27 (8695): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:08:22 (8896): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 21:03:05 (9097): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 22:04:01 (9326): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:38:53 (9560): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 23:45:29 (9797): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 01:40:27 (10003): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:21:28 (10236): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:45:48 (10532): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 07:56:09 (10772): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 08:47:32 (11060): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 09:47:12 (11275): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:47:58 (11491): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 10:52:36 (11719): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 11:49:23 (11930): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 13:50:17 (12163): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 15:52:27 (12441): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 17:55:57 (12708): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 18:57:13 (12973): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 19:55:32 (13222): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 20:00:23 (13476): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:01:12 (13681): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... 02:05:34 (14047): No heartbeat from core client for 30 sec - exiting CPDN Monitor - No 'heartbeat' from BOINC... *** glibc detected *** ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu: double free or corruption (out): 0x087159c8 *** ======= Backtrace: ========= /lib32/libc.so.6(+0x6bff1)[0xf754dff1] /lib32/libc.so.6(+0x6d880)[0xf754f880] /lib32/libc.so.6(cfree+0x6d)[0xf755292d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf77297b1] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf772980d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe7)[0xf74f8ce7] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] ======= Memory map: ======== 08048000-080e3000 r-xp 00000000 08:02 3514599 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e3000-080e4000 rw-p 0009b000 08:02 3514599 /var/lib/boinc-client/projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu 080e4000-0813b000 rw-p 00000000 00:00 0 086c0000-08725000 rw-p 00000000 00:00 0 [heap] f6f00000-f6f21000 rw-p 00000000 00:00 0 f6f21000-f7000000 ---p 00000000 00:00 0 f7064000-f74df000 rw-s 00000000 08:02 5095651 /var/lib/boinc-client/slots/19/137290 f74df000-f74e2000 rw-p 00000000 00:00 0 f74e2000-f7636000 r-xp 00000000 08:02 9879703 /lib32/libc-2.12.1.so f7636000-f7637000 ---p 00154000 08:02 9879703 /lib32/libc-2.12.1.so f7637000-f7639000 r--p 00154000 08:02 9879703 /lib32/libc-2.12.1.so f7639000-f763a000 rw-p 00156000 08:02 9879703 /lib32/libc-2.12.1.so f763a000-f763d000 rw-p 00000000 00:00 0 f763d000-f7657000 r-xp 00000000 08:02 13436533 /usr/lib32/libgcc_s.so.1 f7657000-f7658000 r--p 00019000 08:02 13436533 /usr/lib32/libgcc_s.so.1 f7658000-f7659000 rw-p 0001a000 08:02 13436533 /usr/lib32/libgcc_s.so.1 f7659000-f767d000 r-xp 00000000 08:02 9879707 /lib32/libm-2.12.1.so f767d000-f767e000 r--p 00023000 08:02 9879707 /lib32/libm-2.12.1.so f767e000-f767f000 rw-p 00024000 08:02 9879707 /lib32/libm-2.12.1.so f767f000-f775e000 r-xp 00000000 08:02 13436540 /usr/lib32/libstdc++.so.6.0.14 f775e000-f7762000 r--p 000de000 08:02 13436540 /usr/lib32/libstdc++.so.6.0.14 f7762000-f7763000 rw-p 000e2000 08:02 13436540 /usr/lib32/libstdc++.so.6.0.14 f7763000-f776a000 rw-p 00000000 00:00 0 f776a000-f776c000 r-xp 00000000 08:02 9879706 /lib32/libdl-2.12.1.so f776c000-f776d000 r--p 00001000 08:02 9879706 /lib32/libdl-2.12.1.so f776d000-f776e000 rw-p 00002000 08:02 9879706 /lib32/libdl-2.12.1.so f776e000-f776f000 rw-p 00000000 00:00 0 f776f000-f7784000 r-xp 00000000 08:02 9879717 /lib32/libpthread-2.12.1.so f7784000-f7785000 r--p 00014000 08:02 9879717 /lib32/libpthread-2.12.1.so f7785000-f7786000 rw-p 00015000 08:02 9879717 /lib32/libpthread-2.12.1.so f7786000-f7788000 rw-p 00000000 00:00 0 f7799000-f779a000 rw-p 00000000 00:00 0 f779a000-f779b000 ---p 00000000 00:00 0 f779b000-f779e000 rw-p 00000000 00:00 0 f779e000-f77a0000 rw-s 00000000 08:02 5095543 /var/lib/boinc-client/slots/19/boinc_mmap_file f77a0000-f77a2000 rw-p 00000000 00:00 0 f77a2000-f77a3000 r-xp 00000000 00:00 0 [vdso] f77a3000-f77bf000 r-xp 00000000 08:02 9879700 /lib32/ld-2.12.1.so f77bf000-f77c0000 r--p 0001b000 08:02 9879700 /lib32/ld-2.12.1.so f77c0000-f77c1000 rw-p 0001c000 08:02 9879700 /lib32/ld-2.12.1.so ff9f1000-ffa60000 rw-p 00000000 00:00 0 [stack] SIGABRT: abort called Stack trace (19 frames): ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(boinc_catch_signal+0x6f)[0x80b80df] [0xf77a2400] [0xf77a2425] /lib32/libc.so.6(gsignal+0x51)[0xf750ca01] /lib32/libc.so.6(abort+0x182)[0xf750fe42] /lib32/libc.so.6(+0x61f15)[0xf7543f15] /lib32/libc.so.6(+0x6bff1)[0xf754dff1] /lib32/libc.so.6(+0x6d880)[0xf754f880] /lib32/libc.so.6(cfree+0x6d)[0xf755292d] /usr/lib32/libstdc++.so.6(_ZdlPv+0x21)[0xf77297b1] /usr/lib32/libstdc++.so.6(_ZdaPv+0x1d)[0xf772980d] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8053e8e] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8057bc4] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x804f232] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x8050491] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805112c] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu[0x805137a] /lib32/libc.so.6(__libc_start_main+0xe7)[0xf74f8ce7] ../../projects/climateprediction.net/hadcm3n_6.07_i686-pc-linux-gnu(__gxx_personality_v0+0x169)[0x804cb51] Exiting... </stderr_txt> ]]> |
| Latest Trickles Received | ||||||
|---|---|---|---|---|---|---|
| Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
| 30 May 2013 04:22:30 | 1179592 | 15773111 | hadcm3n_3ajp_1980_40_008363835_0 | 518,400 | 1,534,705 | 2.9605 |
| 29 May 2013 05:41:50 | 1179592 | 15773111 | hadcm3n_3ajp_1980_40_008363835_0 | 492,480 | 1,456,913 | 2.9583 |
| 28 May 2013 05:42:35 | 1179592 | 15773111 | hadcm3n_3ajp_1980_40_008363835_0 | 466,560 | 1,373,559 | 2.9440 |
| 27 May 2013 08:08:42 | 1179592 | 15773111 | hadcm3n_3ajp_1980_40_008363835_0 | 440,640 | 1,295,926 | 2.9410 |
| 26 May 2013 11:51:03 | 1179592 | 15773111 | hadcm3n_3ajp_1980_40_008363835_0 | 414,720 | 1,226,079 | 2.9564 |
| 25 May 2013 16:14:45 | 1179592 | 15773111 | hadcm3n_3ajp_1980_40_008363835_0 | 388,800 | 1,155,661 | 2.9724 |
| 24 May 2013 20:31:49 | 1179592 | 15773111 | hadcm3n_3ajp_1980_40_008363835_0 | 362,880 | 1,084,594 | 2.9889 |
| 23 May 2013 22:13:56 | 1179592 | 15773111 | hadcm3n_3ajp_1980_40_008363835_0 | 336,960 | 1,005,483 | 2.9840 |
| 23 May 2013 03:01:03 | 1179592 | 15773111 | hadcm3n_3ajp_1980_40_008363835_0 | 311,040 | 936,152 | 3.0097 |
| 22 May 2013 08:43:21 | 1179592 | 15773111 | hadcm3n_3ajp_1980_40_008363835_0 | 285,120 | 869,792 | 3.0506 |
| 21 May 2013 14:30:10 | 1179592 | 15773111 | hadcm3n_3ajp_1980_40_008363835_0 | 259,200 | 804,372 | 3.1033 |
| 20 May 2013 16:14:20 | 1179592 | 15773111 | hadcm3n_3ajp_1980_40_008363835_0 | 233,280 | 730,344 | 3.1308 |
| 19 May 2013 18:53:02 | 1179592 | 15773111 | hadcm3n_3ajp_1980_40_008363835_0 | 207,360 | 656,479 | 3.1659 |
| 19 May 2013 00:03:56 | 1179592 | 15773111 | hadcm3n_3ajp_1980_40_008363835_0 | 181,440 | 586,908 | 3.2347 |
| 18 May 2013 04:37:00 | 1179592 | 15773111 | hadcm3n_3ajp_1980_40_008363835_0 | 155,520 | 517,700 | 3.3288 |
| 17 May 2013 08:45:27 | 1179592 | 15773111 | hadcm3n_3ajp_1980_40_008363835_0 | 129,600 | 447,642 | 3.4540 |
| 16 May 2013 08:02:03 | 1179592 | 15773111 | hadcm3n_3ajp_1980_40_008363835_0 | 103,680 | 357,528 | 3.4484 |
| 14 May 2013 18:19:10 | 1179592 | 15773111 | hadcm3n_3ajp_1980_40_008363835_0 | 77,760 | 224,062 | 2.8815 |
| 13 May 2013 19:09:43 | 1179592 | 15773111 | hadcm3n_3ajp_1980_40_008363835_0 | 51,840 | 138,335 | 2.6685 |
| 12 May 2013 22:43:45 | 1179592 | 15773111 | hadcm3n_3ajp_1980_40_008363835_0 | 25,920 | 67,781 | 2.6150 |
©2024 climateprediction.net