Task 21387557

Name	hadcm3s_chj234_191012_120_771_011670980_1
Workunit	11670980
Created	20 Nov 2018, 17:53:26 UTC
Sent	20 Nov 2018, 17:53:29 UTC
Report deadline	2 Nov 2019, 23:13:29 UTC
Received	18 Jun 2019, 3:19:16 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-1073740791 (0xC0000409) STATUS_STACK_BUFFER_OVERRUN
Computer ID	1211647
Run time	86 days 16 hours 7 min 56 sec
CPU time	84 days 17 hours 54 min 28 sec
Validate state	Invalid
Credit	3,111.26
Device peak FLOPS	2.05 GFLOPS
Application version	UK Met Office HadCM3 short v8.34 windows_intelx86
Peak working set size	459.37 MB
Peak swap size	482.84 MB
Peak disk usage	1,101.95 MB
Stderr	<core_client_version>7.14.2</core_client_version> <![CDATA[ <message> (unknown error) - exit code -1073740791 (0xc0000409)</message> <stderr_txt> , iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:07:52 (6468): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4288, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:27:39 (7748): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6124, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:27:43 (4600): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6124, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:27:46 (5788): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6124, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:27:50 (7844): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6124, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:27:54 (7200): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6124, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:27:58 (7956): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6124, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 22:31:21 (1060): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4012, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 22:31:25 (2484): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4012, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 22:31:29 (3896): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4012, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 22:31:32 (5752): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4012, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 22:31:36 (7208): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4012, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 22:31:40 (7348): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4012, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:05 (3712): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=728, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:09 (7680): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=728, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:13 (6924): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=728, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:17 (480): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=728, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:21 (5568): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=728, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:24 (4372): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=728, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 07:28:16 (2212): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7472, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 07:28:20 (5356): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7472, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 07:28:24 (5936): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7472, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 07:28:28 (3340): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7472, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 07:28:32 (608): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7472, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 07:28:36 (7824): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=7472, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:06 (1144): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4032, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:10 (5480): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4032, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:14 (4792): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4032, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:18 (5616): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4032, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:21 (7600): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4032, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:25 (5276): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4032, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:30:13 (4212): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4732, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:30:17 (5384): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4732, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:30:21 (568): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4732, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:30:25 (616): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4732, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:30:29 (2484): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4732, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:30:33 (7152): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=4732, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:40:10 (5304): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6104, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:40:14 (5052): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6104, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:40:18 (3564): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6104, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:40:22 (6668): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6104, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:40:26 (3972): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6104, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:40:30 (3988): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=6104, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 19:51:54 (3272): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=656, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 19:51:58 (2052): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=656, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 19:52:02 (3360): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=656, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 19:52:06 (1476): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=656, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 19:52:10 (2988): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=656, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 19:52:14 (2328): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=656, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 19:59:13 (3192): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1764, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 19:59:17 (3140): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1764, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 19:59:21 (3004): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1764, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 19:59:25 (2340): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1764, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 19:59:29 (460): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1764, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 19:59:33 (3708): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1764, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:28:35 (2992): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3912, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:28:40 (728): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3912, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:28:45 (3676): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3912, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:28:48 (3132): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3912, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:28:52 (4020): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3912, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:28:56 (2764): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3912, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:56:04 (2948): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1228, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:56:08 (2736): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1228, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:56:12 (1492): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1228, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:56:16 (4008): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1228, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:56:20 (1864): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1228, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:56:23 (600): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1228, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 22:38:15 (3696): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1692, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 22:38:19 (2692): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1692, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 22:38:23 (3088): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1692, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 22:38:27 (3056): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1692, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 22:38:31 (2640): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1692, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 22:38:35 (2328): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1692, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 23:13:12 (3084): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2576, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 23:13:16 (2148): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2576, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 23:13:20 (3844): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2576, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 23:13:23 (4068): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2576, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 23:13:27 (3708): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2576, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 23:13:31 (3360): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2576, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 00:55:12 (536): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2208, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 00:55:16 (3368): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2208, iMonCtr=1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 01:23:39 (4012): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2836, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 01:23:43 (2896): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2836, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 01:23:47 (2308): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2836, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 01:23:51 (2200): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2836, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 01:23:55 (2012): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2836, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 01:23:59 (2076): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2836, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:06 (4052): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3984, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:09 (3732): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3984, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:13 (1196): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3984, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:17 (3852): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3984, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:21 (1528): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3984, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:25 (2660): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3984, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:11:48 (4052): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1272, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:11:52 (2312): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1272, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:11:55 (2748): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1272, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:11:59 (1764): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1272, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:12:03 (4072): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1272, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:12:07 (3200): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1272, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:18:53 (1012): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2592, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:18:57 (3232): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2592, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:19:01 (676): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2592, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:19:05 (4068): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2592, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:19:09 (1036): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2592, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:19:13 (1776): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2592, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:30:53 (2012): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2092, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:30:57 (3660): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2092, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:31:01 (3312): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2092, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:31:05 (4008): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2092, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:31:08 (3796): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2092, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:31:12 (2476): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2092, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 13:51:18 (2332): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2476, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 13:51:22 (580): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2476, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 13:51:26 (3528): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2476, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 13:51:30 (3912): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2476, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 13:51:34 (3284): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2476, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 13:51:38 (3696): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2476, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 14:07:14 (3852): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1904, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 14:07:18 (3656): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1904, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 14:07:22 (1804): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1904, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 14:07:25 (1300): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1904, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 14:07:29 (3628): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1904, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 14:07:33 (3660): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1904, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:13:12 (3256): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3272, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:13:16 (3784): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3272, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:13:20 (1876): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3272, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:13:24 (828): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3272, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:13:28 (3752): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3272, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:13:32 (2524): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3272, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:03:00 (1500): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3748, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:03:04 (548): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3748, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:03:08 (3736): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3748, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:03:12 (1632): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3748, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:03:16 (4012): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3748, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:03:19 (3712): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3748, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 23:17:22 (2648): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2608, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 23:17:26 (1596): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2608, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 23:17:29 (2596): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2608, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 23:17:33 (1692): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2608, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 23:17:37 (3220): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2608, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 23:17:41 (3620): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2608, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 00:02:04 (3708): called boinc_finish(193) Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1488, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 00:03:06 (3696): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1488, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 00:03:10 (2124): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1488, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 00:03:14 (1240): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1488, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 00:03:18 (3096): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1488, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 00:03:22 (204): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1488, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 00:15:40 (2188): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3772, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 00:15:44 (1612): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3772, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 00:15:48 (2896): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3772, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 00:15:52 (2480): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3772, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 00:15:56 (1956): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3772, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 00:16:00 (1932): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3772, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:05:27 (4056): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1680, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:05:31 (824): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1680, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:05:34 (1376): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1680, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:05:38 (3484): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1680, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:05:42 (3376): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1680, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:05:46 (2328): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1680, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:32:21 (4060): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3064, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:32:25 (1992): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3064, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:32:29 (2312): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3064, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:32:33 (3188): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3064, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:32:37 (2764): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3064, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 11:32:41 (2448): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3064, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 14:25:31 (3236): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=528, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 14:25:35 (2924): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=528, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 14:25:39 (2108): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=528, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 14:25:43 (2620): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=528, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 14:25:47 (1572): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=528, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 14:25:50 (4056): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=528, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 14:56:54 (3052): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3844, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 14:56:58 (3760): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3844, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 14:57:02 (3028): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3844, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 14:57:06 (2300): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3844, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 14:57:10 (3648): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3844, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 14:57:14 (584): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3844, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 15:06:28 (3444): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1692, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 15:06:31 (3684): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1692, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 15:06:35 (1708): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1692, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 15:06:39 (636): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1692, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 15:06:43 (3052): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1692, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 15:06:47 (2232): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1692, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 15:18:21 (332): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=676, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 15:18:25 (3020): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=676, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 15:18:29 (3012): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=676, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 15:18:33 (3388): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=676, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 15:18:37 (3940): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=676, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 15:18:41 (2208): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=676, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:18:53 (2340): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2856, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:18:57 (1504): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2856, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:19:01 (3944): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2856, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:19:05 (2076): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2856, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:19:09 (3004): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2856, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 17:19:13 (3012): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2856, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:05 (2108): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1780, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:09 (3908): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1780, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:13 (1520): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1780, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:17 (652): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1780, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:21 (1148): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1780, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:25 (3968): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1780, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:43:44 (932): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3020, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:43:48 (2892): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3020, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:43:52 (3880): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3020, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:43:56 (2932): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3020, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:44:00 (1552): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3020, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:44:04 (3380): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=3020, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:59:36 (3736): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2232, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:59:40 (3952): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2232, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:59:44 (332): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2232, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:59:48 (1192): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2232, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:59:51 (4060): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2232, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 21:59:55 (1508): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=2232, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:04 (3520): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=900, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:08 (2476): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=900, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:12 (3004): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=900, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:16 (4080): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=900, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:20 (3708): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=900, iMonCtr=1 Model crash detected, will try to restart... Signal 22 received: Abnormal termination triggered by abort call Signal 22 received, exiting... 02:32:24 (3188): called boinc_finish(193) Controller:: CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=900, iMonCtr=1 Model crash detected, will try to restart... Sorry, too many model crashes! :-( </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Nov 2018 07:01:13	1211647	21387557	hadcm3s_chj234_191012_120_771_011670980_1	259,272	85,994	0.3317