Task 17806728

Name	hadam3pm2_i0mz_1959_10_009271965_1
Workunit	9364881
Created	19 Jan 2015, 2:47:19 UTC
Sent	19 Jan 2015, 7:06:27 UTC
Report deadline	1 Jan 2016, 12:26:27 UTC
Received	13 Feb 2015, 13:25:07 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1349621
Run time	9 days 9 hours 21 min 5 sec
CPU time	8 days 1 hours 16 min 56 sec
Validate state	Invalid
Credit	7,153.72
Device peak FLOPS	1.74 GFLOPS
Application version	UK Met Office HadAM3P (global only) with MOSES II landsurface scheme v7.03 i686-pc-linux-gnu
Stderr	<core_client_version>7.2.42</core_client_version> <![CDATA[ <message> process exited with code 22 (0x16, -234) </message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... oa.pc\|9dec.nc oa.pc\|0jan.nc oa.pc\|0feb.nc oa.pc\|0mar.nc oa.pc\|0apr.nc oa.pc\|0may.nc oa.pc\|0jun.nc oa.pc\|0jul.nc oa.pc\|0aug.nc oa.pc\|0sep.nc oa.pc\|0oct.nc oa.pc\|0nov.nc oa.pe\|9dec.nc oa.pe\|0jan.nc oa.pe\|0feb.nc oa.pe\|0mar.nc oa.pe\|0apr.nc oa.pe\|0may.nc oa.pe\|0jun.nc oa.pe\|0jul.nc oa.pe\|0aug.nc oa.pe\|0sep.nc oa.pe\|0oct.nc oa.pe\|0nov.nc Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 18:43:14 (23229): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 17:10:18 (6710): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 17:16:14 (1516): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 13:32:44 (3027): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 09:09:36 (3317): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 20:58:07 (1641): called boinc_finish Signal 15 received, exiting... 21:18:26 (1649): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 10:25:16 (5729): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 16:18:35 (1659): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 15:00:17 (6390): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 07:43:02 (1669): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 12:05:56 (1624): called boinc_finish Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=1624, selfPID=1624, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 09:25:32 (5933): called boinc_finish Worker:: CPDN process is not running, exiting, bRetVal = 1, checkPID=5933, selfPID=5933, iMonCtr=1 Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 11:32:24 (1656): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 12:46:41 (7875): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 12:51:29 (4902): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 20:38:51 (1676): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Signal 15 received, exiting... 18:47:45 (1651): called boinc_finish Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... SETPOS: Seek Failed: Invalid argument SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1 SETPOS: Seek Failed: Invalid argument SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1 SETPOS: Seek Failed: Invalid argument SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1 SETPOS: Seek Failed: Invalid argument SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1 SETPOS: Seek Failed: Invalid argument SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1 SETPOS: Seek Failed: Invalid argument SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1 Model crashed: SETPOS: Unit 64 to Word Address -198 Failed with Error Code -1 Sorry, too many model crashes! :-( 13:24:45 (1641): called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
10 Feb 2015 16:13:52	1349621	17806728	hadam3pm2_i0mz_1959_10_009271965_1	247,748	627,167	2.5315
10 Feb 2015 09:07:02	1349621	17806728	hadam3pm2_i0mz_1959_10_009271965_1	244,868	620,094	2.5324
09 Feb 2015 09:33:28	1349621	17806728	hadam3pm2_i0mz_1959_10_009271965_1	230,468	583,195	2.5305
09 Feb 2015 05:47:20	1349621	17806728	hadam3pm2_i0mz_1959_10_009271965_1	227,588	576,060	2.5312
09 Feb 2015 00:07:35	1349621	17806728	hadam3pm2_i0mz_1959_10_009271965_1	224,708	568,942	2.5319
08 Feb 2015 21:37:00	1349621	17806728	hadam3pm2_i0mz_1959_10_009271965_1	221,828	561,799	2.5326
08 Feb 2015 18:31:16	1349621	17806728	hadam3pm2_i0mz_1959_10_009271965_1	218,948	554,760	2.5338
08 Feb 2015 12:49:58	1349621	17806728	hadam3pm2_i0mz_1959_10_009271965_1	216,068	547,699	2.5348
08 Feb 2015 05:28:12	1349621	17806728	hadam3pm2_i0mz_1959_10_009271965_1	213,188	540,655	2.5360
08 Feb 2015 02:56:40	1349621	17806728	hadam3pm2_i0mz_1959_10_009271965_1	210,308	533,431	2.5364
06 Feb 2015 18:41:43	1349621	17806728	hadam3pm2_i0mz_1959_10_009271965_1	187,268	475,628	2.5398
06 Feb 2015 18:41:43	1349621	17806728	hadam3pm2_i0mz_1959_10_009271965_1	184,388	468,420	2.5404
06 Feb 2015 18:41:43	1349621	17806728	hadam3pm2_i0mz_1959_10_009271965_1	181,508	460,968	2.5397
06 Feb 2015 18:41:43	1349621	17806728	hadam3pm2_i0mz_1959_10_009271965_1	178,628	453,605	2.5394
06 Feb 2015 18:41:43	1349621	17806728	hadam3pm2_i0mz_1959_10_009271965_1	175,748	446,420	2.5401
01 Feb 2015 11:03:31	1349621	17806728	hadam3pm2_i0mz_1959_10_009271965_1	152,708	389,341	2.5496
01 Feb 2015 07:52:59	1349621	17806728	hadam3pm2_i0mz_1959_10_009271965_1	149,828	382,263	2.5513
01 Feb 2015 05:02:27	1349621	17806728	hadam3pm2_i0mz_1959_10_009271965_1	146,948	375,193	2.5532
01 Feb 2015 00:49:35	1349621	17806728	hadam3pm2_i0mz_1959_10_009271965_1	144,068	367,958	2.5541
31 Jan 2015 22:44:14	1349621	17806728	hadam3pm2_i0mz_1959_10_009271965_1	141,188	360,830	2.5557