Posts by UBT - Timbo

1) Message boards : Number crunching : Never ending tasks (Message 1520)
Posted 16 Oct 2021 by UBT - Timbo
Post:
Over a year since a few members (inc myslef) were reporting issues with never ending tasks.

I thought things might have improved so I ran a small number of tasks and the last one was still running after over 6 days.

The task is this one:

https://quchempedia.univ-angers.fr/athome/workunit.php?wuid=2823715

(and a few other hosts have had issues, 4 had validate issues on Linux hosts, 1 was cancelled and the task on my Windows host was aborted - though 2 Linux hosts DID complete the task after 8k and 27k seconds !!).

and the (very long) Stderr output is here - though this is only about 2 days worth of the log, as the task was crunching for 6+ days and the early logs have not been saved in the Stderr.log file :-(:

<quote>
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
aborted by user</message>
<stderr_txt>
): Deleting stale snapshot.
2021-10-14 19:25:04 (8216): Checkpoint completed.
2021-10-14 19:25:09 (8216): Status Report: Trickle-Up Event.
2021-10-14 19:34:58 (8216): Creating new snapshot for VM.
2021-10-14 19:35:07 (8216): Deleting stale snapshot.
2021-10-14 19:35:08 (8216): Checkpoint completed.
2021-10-14 19:45:02 (8216): Creating new snapshot for VM.
2021-10-14 19:45:11 (8216): Deleting stale snapshot.
2021-10-14 19:45:12 (8216): Checkpoint completed.
2021-10-14 19:55:05 (8216): Creating new snapshot for VM.
2021-10-14 19:55:15 (8216): Deleting stale snapshot.
2021-10-14 19:55:15 (8216): Checkpoint completed.
2021-10-14 19:55:20 (8216): Status Report: Trickle-Up Event.
2021-10-14 20:05:09 (8216): Creating new snapshot for VM.
2021-10-14 20:05:19 (8216): Deleting stale snapshot.
2021-10-14 20:05:19 (8216): Checkpoint completed.
2021-10-14 20:10:16 (8216): Status Report: Elapsed Time: '414491.681100'
2021-10-14 20:10:16 (8216): Status Report: CPU Time: '22271.389164'
2021-10-14 20:15:13 (8216): Creating new snapshot for VM.
2021-10-14 20:15:23 (8216): Deleting stale snapshot.
2021-10-14 20:15:24 (8216): Checkpoint completed.
2021-10-14 20:25:18 (8216): Creating new snapshot for VM.
2021-10-14 20:25:28 (8216): Deleting stale snapshot.
2021-10-14 20:25:29 (8216): Checkpoint completed.
2021-10-14 20:25:34 (8216): Status Report: Trickle-Up Event.
2021-10-14 20:35:18 (8216): Creating new snapshot for VM.
2021-10-14 20:35:27 (8216): Deleting stale snapshot.
2021-10-14 20:35:28 (8216): Checkpoint completed.
2021-10-14 20:45:22 (8216): Creating new snapshot for VM.
2021-10-14 20:45:31 (8216): Deleting stale snapshot.
2021-10-14 20:45:32 (8216): Checkpoint completed.
2021-10-14 20:55:26 (8216): Creating new snapshot for VM.
2021-10-14 20:55:35 (8216): Deleting stale snapshot.
2021-10-14 20:55:35 (8216): Checkpoint completed.
2021-10-14 20:55:40 (8216): Status Report: Trickle-Up Event.
2021-10-14 21:05:29 (8216): Creating new snapshot for VM.
2021-10-14 21:05:39 (8216): Deleting stale snapshot.
2021-10-14 21:05:39 (8216): Checkpoint completed.
2021-10-14 21:15:33 (8216): Creating new snapshot for VM.
2021-10-14 21:15:43 (8216): Deleting stale snapshot.
2021-10-14 21:15:43 (8216): Checkpoint completed.
2021-10-14 21:25:37 (8216): Creating new snapshot for VM.
2021-10-14 21:25:46 (8216): Deleting stale snapshot.
2021-10-14 21:25:47 (8216): Checkpoint completed.
2021-10-14 21:25:52 (8216): Status Report: Trickle-Up Event.
2021-10-14 21:36:43 (8216): Creating new snapshot for VM.
2021-10-14 21:36:51 (8216): Deleting stale snapshot.
2021-10-14 21:36:52 (8216): Checkpoint completed.
2021-10-14 21:46:46 (8216): Creating new snapshot for VM.
2021-10-14 21:46:55 (8216): Deleting stale snapshot.
2021-10-14 21:46:56 (8216): Checkpoint completed.
2021-10-14 21:51:23 (8216): Status Report: Elapsed Time: '420492.491979'
2021-10-14 21:51:23 (8216): Status Report: CPU Time: '22315.506247'
2021-10-14 21:56:50 (8216): Creating new snapshot for VM.
2021-10-14 21:56:59 (8216): Deleting stale snapshot.
2021-10-14 21:56:59 (8216): Checkpoint completed.
2021-10-14 21:57:04 (8216): Status Report: Trickle-Up Event.
2021-10-14 22:06:53 (8216): Creating new snapshot for VM.
2021-10-14 22:07:03 (8216): Deleting stale snapshot.
2021-10-14 22:07:03 (8216): Checkpoint completed.
2021-10-14 22:16:57 (8216): Creating new snapshot for VM.
2021-10-14 22:17:07 (8216): Deleting stale snapshot.
2021-10-14 22:17:07 (8216): Checkpoint completed.
2021-10-14 22:27:01 (8216): Creating new snapshot for VM.
2021-10-14 22:27:10 (8216): Deleting stale snapshot.
2021-10-14 22:27:11 (8216): Checkpoint completed.
2021-10-14 22:27:16 (8216): Status Report: Trickle-Up Event.
2021-10-14 22:37:05 (8216): Creating new snapshot for VM.
2021-10-14 22:37:14 (8216): Deleting stale snapshot.
2021-10-14 22:37:14 (8216): Checkpoint completed.
2021-10-14 22:47:08 (8216): Creating new snapshot for VM.
2021-10-14 22:47:17 (8216): Deleting stale snapshot.
2021-10-14 22:47:17 (8216): Checkpoint completed.
2021-10-14 22:57:11 (8216): Creating new snapshot for VM.
2021-10-14 22:57:20 (8216): Deleting stale snapshot.
2021-10-14 22:57:21 (8216): Checkpoint completed.
2021-10-14 22:57:26 (8216): Status Report: Trickle-Up Event.
2021-10-14 23:07:15 (8216): Creating new snapshot for VM.
2021-10-14 23:07:23 (8216): Deleting stale snapshot.
2021-10-14 23:07:24 (8216): Checkpoint completed.
2021-10-14 23:17:18 (8216): Creating new snapshot for VM.
2021-10-14 23:17:27 (8216): Deleting stale snapshot.
2021-10-14 23:17:27 (8216): Checkpoint completed.
2021-10-14 23:27:22 (8216): Creating new snapshot for VM.
2021-10-14 23:27:31 (8216): Deleting stale snapshot.
2021-10-14 23:27:31 (8216): Checkpoint completed.
2021-10-14 23:27:36 (8216): Status Report: Trickle-Up Event.
2021-10-14 23:31:23 (8216): Status Report: Elapsed Time: '426492.720411'
2021-10-14 23:31:23 (8216): Status Report: CPU Time: '22354.943299'
2021-10-14 23:37:25 (8216): Creating new snapshot for VM.
2021-10-14 23:37:35 (8216): Deleting stale snapshot.
2021-10-14 23:37:35 (8216): Checkpoint completed.
2021-10-14 23:47:30 (8216): Creating new snapshot for VM.
2021-10-14 23:47:39 (8216): Deleting stale snapshot.
2021-10-14 23:47:39 (8216): Checkpoint completed.
2021-10-14 23:57:34 (8216): Creating new snapshot for VM.
2021-10-14 23:57:43 (8216): Deleting stale snapshot.
2021-10-14 23:57:44 (8216): Checkpoint completed.
2021-10-14 23:57:49 (8216): Status Report: Trickle-Up Event.
2021-10-15 00:07:38 (8216): Creating new snapshot for VM.
2021-10-15 00:07:47 (8216): Deleting stale snapshot.
2021-10-15 00:07:47 (8216): Checkpoint completed.
2021-10-15 00:17:41 (8216): Creating new snapshot for VM.
2021-10-15 00:17:50 (8216): Deleting stale snapshot.
2021-10-15 00:17:51 (8216): Checkpoint completed.
2021-10-15 00:27:45 (8216): Creating new snapshot for VM.
2021-10-15 00:27:54 (8216): Deleting stale snapshot.
2021-10-15 00:27:54 (8216): Checkpoint completed.
2021-10-15 00:27:59 (8216): Status Report: Trickle-Up Event.
2021-10-15 00:37:49 (8216): Creating new snapshot for VM.
2021-10-15 00:37:58 (8216): Deleting stale snapshot.
2021-10-15 00:37:58 (8216): Checkpoint completed.
2021-10-15 00:47:52 (8216): Creating new snapshot for VM.
2021-10-15 00:48:01 (8216): Deleting stale snapshot.
2021-10-15 00:48:02 (8216): Checkpoint completed.
2021-10-15 00:57:56 (8216): Creating new snapshot for VM.
2021-10-15 00:58:06 (8216): Deleting stale snapshot.
2021-10-15 00:58:06 (8216): Checkpoint completed.
2021-10-15 00:58:11 (8216): Status Report: Trickle-Up Event.
2021-10-15 01:08:00 (8216): Creating new snapshot for VM.
2021-10-15 01:08:09 (8216): Deleting stale snapshot.
2021-10-15 01:08:09 (8216): Checkpoint completed.
2021-10-15 01:11:26 (8216): Status Report: Elapsed Time: '432495.693692'
2021-10-15 01:11:26 (8216): Status Report: CPU Time: '22395.472359'
2021-10-15 01:18:04 (8216): Creating new snapshot for VM.
2021-10-15 01:18:14 (8216): Deleting stale snapshot.
2021-10-15 01:18:15 (8216): Checkpoint completed.
2021-10-15 01:28:04 (8216): Creating new snapshot for VM.
2021-10-15 01:28:14 (8216): Deleting stale snapshot.
2021-10-15 01:28:14 (8216): Checkpoint completed.
2021-10-15 01:28:19 (8216): Status Report: Trickle-Up Event.
2021-10-15 01:39:13 (8216): Creating new snapshot for VM.
2021-10-15 01:39:21 (8216): Deleting stale snapshot.
2021-10-15 01:39:22 (8216): Checkpoint completed.
2021-10-15 01:49:16 (8216): Creating new snapshot for VM.
2021-10-15 01:49:26 (8216): Deleting stale snapshot.
2021-10-15 01:49:26 (8216): Checkpoint completed.
2021-10-15 01:59:20 (8216): Creating new snapshot for VM.
2021-10-15 01:59:29 (8216): Deleting stale snapshot.
2021-10-15 01:59:30 (8216): Checkpoint completed.
2021-10-15 01:59:35 (8216): Status Report: Trickle-Up Event.
2021-10-15 02:09:24 (8216): Creating new snapshot for VM.
2021-10-15 02:09:33 (8216): Deleting stale snapshot.
2021-10-15 02:09:33 (8216): Checkpoint completed.
2021-10-15 02:19:28 (8216): Creating new snapshot for VM.
2021-10-15 02:19:37 (8216): Deleting stale snapshot.
2021-10-15 02:19:38 (8216): Checkpoint completed.
2021-10-15 02:29:33 (8216): Creating new snapshot for VM.
2021-10-15 02:29:42 (8216): Deleting stale snapshot.
2021-10-15 02:29:43 (8216): Checkpoint completed.
2021-10-15 02:29:48 (8216): Status Report: Trickle-Up Event.
2021-10-15 02:39:33 (8216): Creating new snapshot for VM.
2021-10-15 02:39:42 (8216): Deleting stale snapshot.
2021-10-15 02:39:42 (8216): Checkpoint completed.
2021-10-15 02:49:37 (8216): Creating new snapshot for VM.
2021-10-15 02:49:45 (8216): Deleting stale snapshot.
2021-10-15 02:49:46 (8216): Checkpoint completed.
2021-10-15 02:52:37 (8216): Status Report: Elapsed Time: '438499.045394'
2021-10-15 02:52:37 (8216): Status Report: CPU Time: '22438.091832'
2021-10-15 02:59:41 (8216): Creating new snapshot for VM.
2021-10-15 02:59:51 (8216): Deleting stale snapshot.
2021-10-15 02:59:51 (8216): Checkpoint completed.
2021-10-15 02:59:56 (8216): Status Report: Trickle-Up Event.
2021-10-15 03:02:33 (8216): Preference change detected
2021-10-15 03:02:33 (8216): Setting CPU throttle for VM. (100%)
2021-10-15 03:02:33 (8216): Setting checkpoint interval to 600 seconds. (Higher value of (Preference: 360 seconds) or (Vbox_job.xml: 600 seconds))
2021-10-15 03:09:43 (8216): Creating new snapshot for VM.
2021-10-15 03:09:55 (8216): Deleting stale snapshot.
2021-10-15 03:09:59 (8216): Checkpoint completed.
2021-10-15 03:19:44 (8216): Creating new snapshot for VM.
2021-10-15 03:19:53 (8216): Deleting stale snapshot.
2021-10-15 03:19:54 (8216): Checkpoint completed.
2021-10-15 03:29:49 (8216): Creating new snapshot for VM.
2021-10-15 03:29:58 (8216): Deleting stale snapshot.
2021-10-15 03:29:59 (8216): Checkpoint completed.
2021-10-15 03:30:04 (8216): Status Report: Trickle-Up Event.
2021-10-15 03:39:53 (8216): Creating new snapshot for VM.
2021-10-15 03:40:02 (8216): Deleting stale snapshot.
2021-10-15 03:40:03 (8216): Checkpoint completed.
2021-10-15 03:49:57 (8216): Creating new snapshot for VM.
2021-10-15 03:50:06 (8216): Deleting stale snapshot.
2021-10-15 03:50:07 (8216): Checkpoint completed.
2021-10-15 04:00:01 (8216): Creating new snapshot for VM.
2021-10-15 04:00:10 (8216): Deleting stale snapshot.
2021-10-15 04:00:11 (8216): Checkpoint completed.
2021-10-15 04:00:16 (8216): Status Report: Trickle-Up Event.
2021-10-15 04:10:05 (8216): Creating new snapshot for VM.
2021-10-15 04:10:14 (8216): Deleting stale snapshot.
2021-10-15 04:10:16 (8216): Checkpoint completed.
2021-10-15 04:20:06 (8216): Creating new snapshot for VM.
2021-10-15 04:20:15 (8216): Deleting stale snapshot.
2021-10-15 04:20:15 (8216): Checkpoint completed.
2021-10-15 04:30:10 (8216): Creating new snapshot for VM.
2021-10-15 04:30:18 (8216): Deleting stale snapshot.
2021-10-15 04:30:19 (8216): Checkpoint completed.
2021-10-15 04:30:24 (8216): Status Report: Trickle-Up Event.
2021-10-15 04:32:40 (8216): Status Report: Elapsed Time: '444501.739141'
2021-10-15 04:32:40 (8216): Status Report: CPU Time: '22478.215290'
2021-10-15 04:40:13 (8216): Creating new snapshot for VM.
2021-10-15 04:40:22 (8216): Deleting stale snapshot.
2021-10-15 04:40:23 (8216): Checkpoint completed.
2021-10-15 04:50:17 (8216): Creating new snapshot for VM.
2021-10-15 04:50:26 (8216): Deleting stale snapshot.
2021-10-15 04:50:27 (8216): Checkpoint completed.
2021-10-15 05:00:21 (8216): Creating new snapshot for VM.
2021-10-15 05:00:30 (8216): Deleting stale snapshot.
2021-10-15 05:00:31 (8216): Checkpoint completed.
2021-10-15 05:00:36 (8216): Status Report: Trickle-Up Event.
2021-10-15 05:10:26 (8216): Creating new snapshot for VM.
2021-10-15 05:10:35 (8216): Deleting stale snapshot.
2021-10-15 05:10:36 (8216): Checkpoint completed.
2021-10-15 05:20:26 (8216): Creating new snapshot for VM.
2021-10-15 05:20:36 (8216): Deleting stale snapshot.
2021-10-15 05:20:37 (8216): Checkpoint completed.
2021-10-15 05:30:27 (8216): Creating new snapshot for VM.
2021-10-15 05:30:37 (8216): Deleting stale snapshot.
2021-10-15 05:30:38 (8216): Checkpoint completed.
2021-10-15 05:30:43 (8216): Status Report: Trickle-Up Event.
2021-10-15 05:40:29 (8216): Creating new snapshot for VM.
2021-10-15 05:40:38 (8216): Deleting stale snapshot.
2021-10-15 05:40:39 (8216): Checkpoint completed.
2021-10-15 05:50:30 (8216): Creating new snapshot for VM.
2021-10-15 05:50:39 (8216): Deleting stale snapshot.
2021-10-15 05:50:40 (8216): Checkpoint completed.
2021-10-15 06:00:34 (8216): Creating new snapshot for VM.
2021-10-15 06:00:43 (8216): Deleting stale snapshot.
2021-10-15 06:00:44 (8216): Checkpoint completed.
2021-10-15 06:00:49 (8216): Status Report: Trickle-Up Event.
2021-10-15 06:10:38 (8216): Creating new snapshot for VM.
2021-10-15 06:10:47 (8216): Deleting stale snapshot.
2021-10-15 06:10:48 (8216): Checkpoint completed.
2021-10-15 06:12:44 (8216): Status Report: Elapsed Time: '450505.644038'
2021-10-15 06:12:44 (8216): Status Report: CPU Time: '22522.535174'
2021-10-15 06:20:43 (8216): Creating new snapshot for VM.
2021-10-15 06:20:53 (8216): Deleting stale snapshot.
2021-10-15 06:20:53 (8216): Checkpoint completed.
2021-10-15 06:30:44 (8216): Creating new snapshot for VM.
2021-10-15 06:30:54 (8216): Deleting stale snapshot.
2021-10-15 06:30:55 (8216): Checkpoint completed.
2021-10-15 06:31:00 (8216): Status Report: Trickle-Up Event.
2021-10-15 06:40:45 (8216): Creating new snapshot for VM.
2021-10-15 06:40:55 (8216): Deleting stale snapshot.
2021-10-15 06:40:56 (8216): Checkpoint completed.
2021-10-15 06:50:47 (8216): Creating new snapshot for VM.
2021-10-15 06:50:57 (8216): Deleting stale snapshot.
2021-10-15 06:50:57 (8216): Checkpoint completed.
2021-10-15 07:00:48 (8216): Creating new snapshot for VM.
2021-10-15 07:00:58 (8216): Deleting stale snapshot.
2021-10-15 07:00:59 (8216): Checkpoint completed.
2021-10-15 07:01:04 (8216): Status Report: Trickle-Up Event.
2021-10-15 07:10:50 (8216): Creating new snapshot for VM.
2021-10-15 07:11:00 (8216): Deleting stale snapshot.
2021-10-15 07:11:00 (8216): Checkpoint completed.
2021-10-15 07:20:51 (8216): Creating new snapshot for VM.
2021-10-15 07:21:01 (8216): Deleting stale snapshot.
2021-10-15 07:21:02 (8216): Checkpoint completed.
2021-10-15 07:30:53 (8216): Creating new snapshot for VM.
2021-10-15 07:31:03 (8216): Deleting stale snapshot.
2021-10-15 07:31:04 (8216): Checkpoint completed.
2021-10-15 07:31:09 (8216): Status Report: Trickle-Up Event.
2021-10-15 07:40:55 (8216): Creating new snapshot for VM.
2021-10-15 07:41:05 (8216): Deleting stale snapshot.
2021-10-15 07:41:06 (8216): Checkpoint completed.
2021-10-15 07:50:57 (8216): Creating new snapshot for VM.
2021-10-15 07:51:06 (8216): Deleting stale snapshot.
2021-10-15 07:51:08 (8216): Checkpoint completed.
2021-10-15 07:52:49 (8216): Status Report: Elapsed Time: '456510.261527'
2021-10-15 07:52:49 (8216): Status Report: CPU Time: '22570.053078'
2021-10-15 08:00:58 (8216): Creating new snapshot for VM.
2021-10-15 08:01:08 (8216): Deleting stale snapshot.
2021-10-15 08:01:09 (8216): Checkpoint completed.
2021-10-15 08:01:14 (8216): Status Report: Trickle-Up Event.
2021-10-15 08:11:00 (8216): Creating new snapshot for VM.
2021-10-15 08:11:10 (8216): Deleting stale snapshot.
2021-10-15 08:11:11 (8216): Checkpoint completed.
2021-10-15 08:21:02 (8216): Creating new snapshot for VM.
2021-10-15 08:21:12 (8216): Deleting stale snapshot.
2021-10-15 08:21:13 (8216): Checkpoint completed.
2021-10-15 08:31:03 (8216): Creating new snapshot for VM.
2021-10-15 08:31:13 (8216): Deleting stale snapshot.
2021-10-15 08:31:14 (8216): Checkpoint completed.
2021-10-15 08:31:19 (8216): Status Report: Trickle-Up Event.
2021-10-15 08:41:05 (8216): Creating new snapshot for VM.
2021-10-15 08:41:15 (8216): Deleting stale snapshot.
2021-10-15 08:41:16 (8216): Checkpoint completed.
2021-10-15 08:51:06 (8216): Creating new snapshot for VM.
2021-10-15 08:51:17 (8216): Deleting stale snapshot.
2021-10-15 08:51:18 (8216): Checkpoint completed.
2021-10-15 09:01:09 (8216): Creating new snapshot for VM.
2021-10-15 09:01:19 (8216): Deleting stale snapshot.
2021-10-15 09:01:20 (8216): Checkpoint completed.
2021-10-15 09:01:25 (8216): Status Report: Trickle-Up Event.
2021-10-15 09:11:11 (8216): Creating new snapshot for VM.
2021-10-15 09:11:21 (8216): Deleting stale snapshot.
2021-10-15 09:11:21 (8216): Checkpoint completed.
2021-10-15 09:21:12 (8216): Creating new snapshot for VM.
2021-10-15 09:21:22 (8216): Deleting stale snapshot.
2021-10-15 09:21:23 (8216): Checkpoint completed.
2021-10-15 09:31:15 (8216): Creating new snapshot for VM.
2021-10-15 09:31:24 (8216): Deleting stale snapshot.
2021-10-15 09:31:25 (8216): Checkpoint completed.
2021-10-15 09:31:30 (8216): Status Report: Trickle-Up Event.
2021-10-15 09:32:51 (8216): Status Report: Elapsed Time: '462512.769248'
2021-10-15 09:32:51 (8216): Status Report: CPU Time: '22617.882985'
2021-10-15 09:41:16 (8216): Creating new snapshot for VM.
2021-10-15 09:41:26 (8216): Deleting stale snapshot.
2021-10-15 09:41:27 (8216): Checkpoint completed.
2021-10-15 09:51:18 (8216): Creating new snapshot for VM.
2021-10-15 09:51:28 (8216): Deleting stale snapshot.
2021-10-15 09:51:29 (8216): Checkpoint completed.
2021-10-15 10:01:21 (8216): Creating new snapshot for VM.
2021-10-15 10:01:31 (8216): Deleting stale snapshot.
2021-10-15 10:01:32 (8216): Checkpoint completed.
2021-10-15 10:01:37 (8216): Status Report: Trickle-Up Event.
2021-10-15 10:11:23 (8216): Creating new snapshot for VM.
2021-10-15 10:11:33 (8216): Deleting stale snapshot.
2021-10-15 10:11:34 (8216): Checkpoint completed.
2021-10-15 10:21:26 (8216): Creating new snapshot for VM.
2021-10-15 10:21:36 (8216): Deleting stale snapshot.
2021-10-15 10:21:37 (8216): Checkpoint completed.
2021-10-15 10:31:28 (8216): Creating new snapshot for VM.
2021-10-15 10:31:38 (8216): Deleting stale snapshot.
2021-10-15 10:31:39 (8216): Checkpoint completed.
2021-10-15 10:31:44 (8216): Status Report: Trickle-Up Event.
2021-10-15 10:41:31 (8216): Creating new snapshot for VM.
2021-10-15 10:41:40 (8216): Deleting stale snapshot.
2021-10-15 10:41:41 (8216): Checkpoint completed.
2021-10-15 10:51:32 (8216): Creating new snapshot for VM.
2021-10-15 10:51:42 (8216): Deleting stale snapshot.
2021-10-15 10:51:43 (8216): Checkpoint completed.
2021-10-15 11:01:34 (8216): Creating new snapshot for VM.
2021-10-15 11:01:44 (8216): Deleting stale snapshot.
2021-10-15 11:01:45 (8216): Checkpoint completed.
2021-10-15 11:01:50 (8216): Status Report: Trickle-Up Event.
2021-10-15 11:11:36 (8216): Creating new snapshot for VM.
2021-10-15 11:11:47 (8216): Deleting stale snapshot.
2021-10-15 11:11:48 (8216): Checkpoint completed.
2021-10-15 11:12:53 (8216): Status Report: Elapsed Time: '468515.106448'
2021-10-15 11:12:53 (8216): Status Report: CPU Time: '22666.477296'
2021-10-15 11:21:39 (8216): Creating new snapshot for VM.
2021-10-15 11:21:49 (8216): Deleting stale snapshot.
2021-10-15 11:21:50 (8216): Checkpoint completed.
2021-10-15 11:31:41 (8216): Creating new snapshot for VM.
2021-10-15 11:31:50 (8216): Deleting stale snapshot.
2021-10-15 11:31:51 (8216): Checkpoint completed.
2021-10-15 11:31:56 (8216): Status Report: Trickle-Up Event.
2021-10-15 11:41:43 (8216): Creating new snapshot for VM.
2021-10-15 11:41:52 (8216): Deleting stale snapshot.
2021-10-15 11:41:53 (8216): Checkpoint completed.
2021-10-15 11:51:44 (8216): Creating new snapshot for VM.
2021-10-15 11:51:53 (8216): Deleting stale snapshot.
2021-10-15 11:51:53 (8216): Checkpoint completed.
2021-10-15 12:01:44 (8216): Creating new snapshot for VM.
2021-10-15 12:01:53 (8216): Deleting stale snapshot.
2021-10-15 12:01:53 (8216): Checkpoint completed.
2021-10-15 12:01:59 (8216): Status Report: Trickle-Up Event.
2021-10-15 12:11:44 (8216): Creating new snapshot for VM.
2021-10-15 12:11:53 (8216): Deleting stale snapshot.
2021-10-15 12:11:54 (8216): Checkpoint completed.
2021-10-15 12:21:45 (8216): Creating new snapshot for VM.
2021-10-15 12:21:54 (8216): Deleting stale snapshot.
2021-10-15 12:21:55 (8216): Checkpoint completed.
2021-10-15 12:31:45 (8216): Creating new snapshot for VM.
2021-10-15 12:31:54 (8216): Deleting stale snapshot.
2021-10-15 12:31:55 (8216): Checkpoint completed.
2021-10-15 12:32:00 (8216): Status Report: Trickle-Up Event.
2021-10-15 12:41:45 (8216): Creating new snapshot for VM.
2021-10-15 12:41:55 (8216): Deleting stale snapshot.
2021-10-15 12:41:56 (8216): Checkpoint completed.
2021-10-15 12:51:47 (8216): Creating new snapshot for VM.
2021-10-15 12:51:56 (8216): Deleting stale snapshot.
2021-10-15 12:51:57 (8216): Checkpoint completed.
2021-10-15 12:52:58 (8216): Status Report: Elapsed Time: '474519.497911'
2021-10-15 12:52:58 (8216): Status Report: CPU Time: '22706.631954'
2021-10-15 13:01:48 (8216): Creating new snapshot for VM.
2021-10-15 13:01:58 (8216): Deleting stale snapshot.
2021-10-15 13:01:59 (8216): Checkpoint completed.
2021-10-15 13:02:04 (8216): Status Report: Trickle-Up Event.
2021-10-15 13:11:49 (8216): Creating new snapshot for VM.
2021-10-15 13:11:58 (8216): Deleting stale snapshot.
2021-10-15 13:11:59 (8216): Checkpoint completed.
2021-10-15 13:21:54 (8216): Creating new snapshot for VM.
2021-10-15 13:22:03 (8216): Deleting stale snapshot.
2021-10-15 13:22:05 (8216): Checkpoint completed.
2021-10-15 13:31:55 (8216): Creating new snapshot for VM.
2021-10-15 13:32:04 (8216): Deleting stale snapshot.
2021-10-15 13:32:05 (8216): Checkpoint completed.
2021-10-15 13:32:10 (8216): Status Report: Trickle-Up Event.
2021-10-15 13:41:55 (8216): Creating new snapshot for VM.
2021-10-15 13:42:04 (8216): Deleting stale snapshot.
2021-10-15 13:42:05 (8216): Checkpoint completed.
2021-10-15 13:52:00 (8216): Creating new snapshot for VM.
2021-10-15 13:52:08 (8216): Deleting stale snapshot.
2021-10-15 13:52:09 (8216): Checkpoint completed.
2021-10-15 14:02:01 (8216): Creating new snapshot for VM.
2021-10-15 14:02:12 (8216): Deleting stale snapshot.
2021-10-15 14:02:15 (8216): Checkpoint completed.
2021-10-15 14:02:20 (8216): Status Report: Trickle-Up Event.
2021-10-15 14:12:06 (8216): Creating new snapshot for VM.
2021-10-15 14:12:16 (8216): Deleting stale snapshot.
2021-10-15 14:12:17 (8216): Checkpoint completed.
2021-10-15 14:22:09 (8216): Creating new snapshot for VM.
2021-10-15 14:22:18 (8216): Deleting stale snapshot.
2021-10-15 14:22:19 (8216): Checkpoint completed.
2021-10-15 14:32:09 (8216): Creating new snapshot for VM.
2021-10-15 14:32:20 (8216): Deleting stale snapshot.
2021-10-15 14:32:21 (8216): Checkpoint completed.
2021-10-15 14:32:26 (8216): Status Report: Trickle-Up Event.
2021-10-15 14:33:02 (8216): Status Report: Elapsed Time: '480523.781360'
2021-10-15 14:33:02 (8216): Status Report: CPU Time: '22749.376228'
2021-10-15 14:42:09 (8216): Creating new snapshot for VM.
2021-10-15 14:42:20 (8216): Deleting stale snapshot.
2021-10-15 14:42:20 (8216): Checkpoint completed.
2021-10-15 14:52:14 (8216): Creating new snapshot for VM.
2021-10-15 14:52:24 (8216): Deleting stale snapshot.
2021-10-15 14:52:28 (8216): Checkpoint completed.
2021-10-15 15:02:15 (8216): Creating new snapshot for VM.
2021-10-15 15:02:25 (8216): Deleting stale snapshot.
2021-10-15 15:02:25 (8216): Checkpoint completed.
2021-10-15 15:02:30 (8216): Status Report: Trickle-Up Event.
2021-10-15 15:12:18 (8216): Creating new snapshot for VM.
2021-10-15 15:12:28 (8216): Deleting stale snapshot.
2021-10-15 15:12:29 (8216): Checkpoint completed.
2021-10-15 15:22:22 (8216): Creating new snapshot for VM.
2021-10-15 15:22:32 (8216): Deleting stale snapshot.
2021-10-15 15:22:33 (8216): Checkpoint completed.
2021-10-15 15:32:26 (8216): Creating new snapshot for VM.
2021-10-15 15:32:36 (8216): Deleting stale snapshot.
2021-10-15 15:32:37 (8216): Checkpoint completed.
2021-10-15 15:32:42 (8216): Status Report: Trickle-Up Event.
2021-10-15 15:42:29 (8216): Creating new snapshot for VM.
2021-10-15 15:42:39 (8216): Deleting stale snapshot.
2021-10-15 15:42:39 (8216): Checkpoint completed.
2021-10-15 15:52:32 (8216): Creating new snapshot for VM.
2021-10-15 15:52:42 (8216): Deleting stale snapshot.
2021-10-15 15:52:43 (8216): Checkpoint completed.
2021-10-15 16:02:36 (8216): Creating new snapshot for VM.
2021-10-15 16:02:47 (8216): Deleting stale snapshot.
2021-10-15 16:02:47 (8216): Checkpoint completed.
2021-10-15 16:02:52 (8216): Status Report: Trickle-Up Event.
2021-10-15 16:12:41 (8216): Creating new snapshot for VM.
2021-10-15 16:12:52 (8216): Deleting stale snapshot.
2021-10-15 16:12:53 (8216): Checkpoint completed.
2021-10-15 16:13:03 (8216): Status Report: Elapsed Time: '486525.126933'
2021-10-15 16:13:03 (8216): Status Report: CPU Time: '22793.711712'
2021-10-15 16:22:42 (8216): Creating new snapshot for VM.
2021-10-15 16:22:52 (8216): Deleting stale snapshot.
2021-10-15 16:22:53 (8216): Checkpoint completed.
2021-10-15 16:32:45 (8216): Creating new snapshot for VM.
2021-10-15 16:32:56 (8216): Deleting stale snapshot.
2021-10-15 16:32:57 (8216): Checkpoint completed.
2021-10-15 16:33:02 (8216): Status Report: Trickle-Up Event.
2021-10-15 16:42:49 (8216): Creating new snapshot for VM.
2021-10-15 16:43:00 (8216): Deleting stale snapshot.
2021-10-15 16:43:01 (8216): Checkpoint completed.
2021-10-15 16:52:54 (8216): Creating new snapshot for VM.
2021-10-15 16:53:04 (8216): Deleting stale snapshot.
2021-10-15 16:53:06 (8216): Checkpoint completed.
2021-10-15 17:02:58 (8216): Creating new snapshot for VM.
2021-10-15 17:03:08 (8216): Deleting stale snapshot.
2021-10-15 17:03:09 (8216): Checkpoint completed.
2021-10-15 17:03:14 (8216): Status Report: Trickle-Up Event.
2021-10-15 17:13:02 (8216): Creating new snapshot for VM.
2021-10-15 17:13:11 (8216): Deleting stale snapshot.
2021-10-15 17:13:11 (8216): Checkpoint completed.
2021-10-15 17:23:03 (8216): Creating new snapshot for VM.
2021-10-15 17:23:13 (8216): Deleting stale snapshot.
2021-10-15 17:23:13 (8216): Checkpoint completed.
2021-10-15 17:33:05 (8216): Creating new snapshot for VM.
2021-10-15 17:33:14 (8216): Deleting stale snapshot.
2021-10-15 17:33:15 (8216): Checkpoint completed.
2021-10-15 17:33:20 (8216): Status Report: Trickle-Up Event.
2021-10-15 17:43:08 (8216): Creating new snapshot for VM.
2021-10-15 17:43:18 (8216): Deleting stale snapshot.
2021-10-15 17:43:19 (8216): Checkpoint completed.
2021-10-15 17:53:06 (8216): Status Report: Elapsed Time: '492528.107215'
2021-10-15 17:53:06 (8216): Status Report: CPU Time: '22840.434012'
2021-10-15 17:53:11 (8216): Creating new snapshot for VM.
2021-10-15 17:53:20 (8216): Deleting stale snapshot.
2021-10-15 17:53:21 (8216): Checkpoint completed.
2021-10-15 18:03:14 (8216): Creating new snapshot for VM.
2021-10-15 18:03:24 (8216): Deleting stale snapshot.
2021-10-15 18:03:25 (8216): Checkpoint completed.
2021-10-15 18:03:30 (8216): Status Report: Trickle-Up Event.
2021-10-15 18:13:18 (8216): Creating new snapshot for VM.
2021-10-15 18:13:28 (8216): Deleting stale snapshot.
2021-10-15 18:13:28 (8216): Checkpoint completed.
2021-10-15 18:23:20 (8216): Creating new snapshot for VM.
2021-10-15 18:23:31 (8216): Deleting stale snapshot.
2021-10-15 18:23:32 (8216): Checkpoint completed.
2021-10-15 18:33:21 (8216): Creating new snapshot for VM.
2021-10-15 18:33:30 (8216): Deleting stale snapshot.
2021-10-15 18:33:32 (8216): Checkpoint completed.
2021-10-15 18:33:37 (8216): Status Report: Trickle-Up Event.
2021-10-15 18:43:24 (8216): Creating new snapshot for VM.
2021-10-15 18:43:33 (8216): Deleting stale snapshot.
2021-10-15 18:43:34 (8216): Checkpoint completed.
2021-10-15 18:53:26 (8216): Creating new snapshot for VM.
2021-10-15 18:53:37 (8216): Deleting stale snapshot.
2021-10-15 18:53:37 (8216): Checkpoint completed.
2021-10-15 19:03:30 (8216): Creating new snapshot for VM.
2021-10-15 19:03:41 (8216): Deleting stale snapshot.
2021-10-15 19:03:42 (8216): Checkpoint completed.
2021-10-15 19:03:47 (8216): Status Report: Trickle-Up Event.
2021-10-15 19:13:35 (8216): Creating new snapshot for VM.
2021-10-15 19:13:45 (8216): Deleting stale snapshot.
2021-10-15 19:13:46 (8216): Checkpoint completed.
2021-10-15 19:23:39 (8216): Creating new snapshot for VM.
2021-10-15 19:23:49 (8216): Deleting stale snapshot.
2021-10-15 19:23:50 (8216): Checkpoint completed.
2021-10-15 19:33:07 (8216): Status Report: Elapsed Time: '498528.735696'
2021-10-15 19:33:07 (8216): Status Report: CPU Time: '22883.755489'
2021-10-15 19:33:42 (8216): Creating new snapshot for VM.
2021-10-15 19:33:52 (8216): Deleting stale snapshot.
2021-10-15 19:33:53 (8216): Checkpoint completed.
2021-10-15 19:33:58 (8216): Status Report: Trickle-Up Event.
2021-10-15 19:43:44 (8216): Creating new snapshot for VM.
2021-10-15 19:43:54 (8216): Deleting stale snapshot.
2021-10-15 19:43:55 (8216): Checkpoint completed.
2021-10-15 19:53:46 (8216): Creating new snapshot for VM.
2021-10-15 19:53:56 (8216): Deleting stale snapshot.
2021-10-15 19:53:57 (8216): Checkpoint completed.
2021-10-15 20:03:50 (8216): Creating new snapshot for VM.
2021-10-15 20:03:59 (8216): Deleting stale snapshot.
2021-10-15 20:03:59 (8216): Checkpoint completed.
2021-10-15 20:04:04 (8216): Status Report: Trickle-Up Event.
2021-10-15 20:13:51 (8216): Creating new snapshot for VM.
2021-10-15 20:14:00 (8216): Deleting stale snapshot.
2021-10-15 20:14:00 (8216): Checkpoint completed.
2021-10-15 20:23:52 (8216): Creating new snapshot for VM.
2021-10-15 20:24:01 (8216): Deleting stale snapshot.
2021-10-15 20:24:02 (8216): Checkpoint completed.
2021-10-15 20:33:55 (8216): Creating new snapshot for VM.
2021-10-15 20:34:04 (8216): Deleting stale snapshot.
2021-10-15 20:34:04 (8216): Checkpoint completed.
2021-10-15 20:34:10 (8216): Status Report: Trickle-Up Event.
2021-10-15 20:43:56 (8216): Creating new snapshot for VM.
2021-10-15 20:44:05 (8216): Deleting stale snapshot.
2021-10-15 20:44:06 (8216): Checkpoint completed.
2021-10-15 20:53:58 (8216): Creating new snapshot for VM.
2021-10-15 20:54:07 (8216): Deleting stale snapshot.
2021-10-15 20:54:08 (8216): Checkpoint completed.
2021-10-15 21:04:00 (8216): Creating new snapshot for VM.
2021-10-15 21:04:09 (8216): Deleting stale snapshot.
2021-10-15 21:04:10 (8216): Checkpoint completed.
2021-10-15 21:04:15 (8216): Status Report: Trickle-Up Event.
2021-10-15 21:13:11 (8216): Status Report: Elapsed Time: '504532.411067'
2021-10-15 21:13:11 (8216): Status Report: CPU Time: '22925.579357'
2021-10-15 21:14:01 (8216): Creating new snapshot for VM.
2021-10-15 21:14:11 (8216): Deleting stale snapshot.
2021-10-15 21:14:12 (8216): Checkpoint completed.
2021-10-15 21:24:04 (8216): Creating new snapshot for VM.
2021-10-15 21:24:13 (8216): Deleting stale snapshot.
2021-10-15 21:24:14 (8216): Checkpoint completed.
2021-10-15 21:34:06 (8216): Creating new snapshot for VM.
2021-10-15 21:34:15 (8216): Deleting stale snapshot.
2021-10-15 21:34:16 (8216): Checkpoint completed.
2021-10-15 21:34:21 (8216): Status Report: Trickle-Up Event.
2021-10-15 21:44:07 (8216): Creating new snapshot for VM.
2021-10-15 21:44:16 (8216): Deleting stale snapshot.
2021-10-15 21:44:17 (8216): Checkpoint completed.
2021-10-15 21:54:08 (8216): Creating new snapshot for VM.
2021-10-15 21:54:18 (8216): Deleting stale snapshot.
2021-10-15 21:54:19 (8216): Checkpoint completed.
2021-10-15 22:04:12 (8216): Creating new snapshot for VM.
2021-10-15 22:04:21 (8216): Deleting stale snapshot.
2021-10-15 22:04:22 (8216): Checkpoint completed.
2021-10-15 22:04:27 (8216): Status Report: Trickle-Up Event.
2021-10-15 22:14:14 (8216): Creating new snapshot for VM.
2021-10-15 22:14:25 (8216): Deleting stale snapshot.
2021-10-15 22:14:26 (8216): Checkpoint completed.
2021-10-15 22:24:18 (8216): Creating new snapshot for VM.
2021-10-15 22:24:28 (8216): Deleting stale snapshot.
2021-10-15 22:24:29 (8216): Checkpoint completed.
2021-10-15 22:34:22 (8216): Creating new snapshot for VM.
2021-10-15 22:34:32 (8216): Deleting stale snapshot.
2021-10-15 22:34:32 (8216): Checkpoint completed.
2021-10-15 22:34:38 (8216): Status Report: Trickle-Up Event.
2021-10-15 22:44:25 (8216): Creating new snapshot for VM.
2021-10-15 22:44:36 (8216): Deleting stale snapshot.
2021-10-15 22:44:36 (8216): Checkpoint completed.
2021-10-15 22:53:13 (8216): Status Report: Elapsed Time: '510534.553743'
2021-10-15 22:53:13 (8216): Status Report: CPU Time: '22970.258044'
2021-10-15 22:54:29 (8216): Creating new snapshot for VM.
2021-10-15 22:54:38 (8216): Deleting stale snapshot.
2021-10-15 22:54:39 (8216): Checkpoint completed.
2021-10-15 23:04:32 (8216): Creating new snapshot for VM.
2021-10-15 23:04:42 (8216): Deleting stale snapshot.
2021-10-15 23:04:43 (8216): Checkpoint completed.
2021-10-15 23:04:48 (8216): Status Report: Trickle-Up Event.
2021-10-15 23:14:36 (8216): Creating new snapshot for VM.
2021-10-15 23:14:46 (8216): Deleting stale snapshot.
2021-10-15 23:14:47 (8216): Checkpoint completed.
2021-10-15 23:24:40 (8216): Creating new snapshot for VM.
2021-10-15 23:24:50 (8216): Deleting stale snapshot.
2021-10-15 23:24:52 (8216): Checkpoint completed.
2021-10-15 23:34:45 (8216): Creating new snapshot for VM.
2021-10-15 23:34:55 (8216): Deleting stale snapshot.
2021-10-15 23:34:56 (8216): Checkpoint completed.
2021-10-15 23:35:01 (8216): Status Report: Trickle-Up Event.
2021-10-15 23:44:49 (8216): Creating new snapshot for VM.
2021-10-15 23:44:59 (8216): Deleting stale snapshot.
2021-10-15 23:45:00 (8216): Checkpoint completed.
2021-10-15 23:54:53 (8216): Creating new snapshot for VM.
2021-10-15 23:55:04 (8216): Deleting stale snapshot.
2021-10-15 23:55:05 (8216): Checkpoint completed.
2021-10-16 00:04:53 (8216): Creating new snapshot for VM.
2021-10-16 00:05:04 (8216): Deleting stale snapshot.
2021-10-16 00:05:05 (8216): Checkpoint completed.
2021-10-16 00:05:10 (8216): Status Report: Trickle-Up Event.
2021-10-16 00:14:53 (8216): Creating new snapshot for VM.
2021-10-16 00:15:04 (8216): Deleting stale snapshot.
2021-10-16 00:15:04 (8216): Checkpoint completed.
2021-10-16 00:24:58 (8216): Creating new snapshot for VM.
2021-10-16 00:25:08 (8216): Deleting stale snapshot.
2021-10-16 00:25:09 (8216): Checkpoint completed.
2021-10-16 00:33:16 (8216): Status Report: Elapsed Time: '516537.585531'
2021-10-16 00:33:16 (8216): Status Report: CPU Time: '23018.462353'
2021-10-16 00:35:02 (8216): Creating new snapshot for VM.
2021-10-16 00:35:12 (8216): Deleting stale snapshot.
2021-10-16 00:35:13 (8216): Checkpoint completed.
2021-10-16 00:35:18 (8216): Status Report: Trickle-Up Event.
2021-10-16 00:45:06 (8216): Creating new snapshot for VM.
2021-10-16 00:45:16 (8216): Deleting stale snapshot.
2021-10-16 00:45:17 (8216): Checkpoint completed.
2021-10-16 00:55:10 (8216): Creating new snapshot for VM.
2021-10-16 00:55:19 (8216): Deleting stale snapshot.
2021-10-16 00:55:21 (8216): Checkpoint completed.
2021-10-16 01:05:14 (8216): Creating new snapshot for VM.
2021-10-16 01:05:24 (8216): Deleting stale snapshot.
2021-10-16 01:05:25 (8216): Checkpoint completed.
2021-10-16 01:05:30 (8216): Status Report: Trickle-Up Event.
2021-10-16 01:15:19 (8216): Creating new snapshot for VM.
2021-10-16 01:15:28 (8216): Deleting stale snapshot.
2021-10-16 01:15:29 (8216): Checkpoint completed.
2021-10-16 01:25:22 (8216): Creating new snapshot for VM.
2021-10-16 01:25:32 (8216): Deleting stale snapshot.
2021-10-16 01:25:33 (8216): Checkpoint completed.
2021-10-16 01:35:27 (8216): Creating new snapshot for VM.
2021-10-16 01:35:36 (8216): Deleting stale snapshot.
2021-10-16 01:35:37 (8216): Checkpoint completed.
2021-10-16 01:35:42 (8216): Status Report: Trickle-Up Event.
2021-10-16 01:45:29 (8216): Creating new snapshot for VM.
2021-10-16 01:45:38 (8216): Deleting stale snapshot.
2021-10-16 01:45:39 (8216): Checkpoint completed.
2021-10-16 01:55:33 (8216): Creating new snapshot for VM.
2021-10-16 01:55:43 (8216): Deleting stale snapshot.
2021-10-16 01:55:43 (8216): Checkpoint completed.
2021-10-16 02:05:37 (8216): Creating new snapshot for VM.
2021-10-16 02:05:47 (8216): Deleting stale snapshot.
2021-10-16 02:05:48 (8216): Checkpoint completed.
2021-10-16 02:05:53 (8216): Status Report: Trickle-Up Event.
2021-10-16 02:13:20 (8216): Status Report: Elapsed Time: '522541.304906'
2021-10-16 02:13:20 (8216): Status Report: CPU Time: '23066.042658'
2021-10-16 02:15:42 (8216): Creating new snapshot for VM.
2021-10-16 02:15:51 (8216): Deleting stale snapshot.
2021-10-16 02:15:53 (8216): Checkpoint completed.
2021-10-16 02:25:42 (8216): Creating new snapshot for VM.
2021-10-16 02:25:52 (8216): Deleting stale snapshot.
2021-10-16 02:25:53 (8216): Checkpoint completed.
2021-10-16 02:35:46 (8216): Creating new snapshot for VM.
2021-10-16 02:35:56 (8216): Deleting stale snapshot.
2021-10-16 02:35:57 (8216): Checkpoint completed.
2021-10-16 02:36:02 (8216): Status Report: Trickle-Up Event.
2021-10-16 02:45:47 (8216): Creating new snapshot for VM.
2021-10-16 02:45:56 (8216): Deleting stale snapshot.
2021-10-16 02:45:57 (8216): Checkpoint completed.
2021-10-16 02:55:51 (8216): Creating new snapshot for VM.
2021-10-16 02:56:01 (8216): Deleting stale snapshot.
2021-10-16 02:56:01 (8216): Checkpoint completed.
2021-10-16 03:05:56 (8216): Creating new snapshot for VM.
2021-10-16 03:06:06 (8216): Deleting stale snapshot.
2021-10-16 03:06:06 (8216): Checkpoint completed.
2021-10-16 03:06:11 (8216): Status Report: Trickle-Up Event.
2021-10-16 03:13:02 (8216): Preference change detected
2021-10-16 03:13:02 (8216): Setting CPU throttle for VM. (100%)
2021-10-16 03:13:02 (8216): Setting checkpoint interval to 600 seconds. (Higher value of (Preference: 360 seconds) or (Vbox_job.xml: 600 seconds))
2021-10-16 03:16:00 (8216): Creating new snapshot for VM.
2021-10-16 03:16:11 (8216): Deleting stale snapshot.
2021-10-16 03:16:12 (8216): Checkpoint completed.
2021-10-16 03:26:02 (8216): Creating new snapshot for VM.
2021-10-16 03:26:13 (8216): Deleting stale snapshot.
2021-10-16 03:26:14 (8216): Checkpoint completed.
2021-10-16 03:36:04 (8216): Creating new snapshot for VM.
2021-10-16 03:36:14 (8216): Deleting stale snapshot.
2021-10-16 03:36:15 (8216): Checkpoint completed.
2021-10-16 03:36:20 (8216): Status Report: Trickle-Up Event.
2021-10-16 03:46:05 (8216): Creating new snapshot for VM.
2021-10-16 03:46:16 (8216): Deleting stale snapshot.
2021-10-16 03:46:17 (8216): Checkpoint completed.
2021-10-16 03:53:24 (8216): Status Report: Elapsed Time: '528545.456838'
2021-10-16 03:53:24 (8216): Status Report: CPU Time: '23115.354574'
2021-10-16 03:56:06 (8216): Creating new snapshot for VM.
2021-10-16 03:56:17 (8216): Deleting stale snapshot.
2021-10-16 03:56:18 (8216): Checkpoint completed.
2021-10-16 04:06:08 (8216): Creating new snapshot for VM.
2021-10-16 04:06:18 (8216): Deleting stale snapshot.
2021-10-16 04:06:19 (8216): Checkpoint completed.
2021-10-16 04:06:24 (8216): Status Report: Trickle-Up Event.
2021-10-16 04:16:08 (8216): Creating new snapshot for VM.
2021-10-16 04:16:19 (8216): Deleting stale snapshot.
2021-10-16 04:16:20 (8216): Checkpoint completed.
2021-10-16 04:26:09 (8216): Creating new snapshot for VM.
2021-10-16 04:26:19 (8216): Deleting stale snapshot.
2021-10-16 04:26:20 (8216): Checkpoint completed.
2021-10-16 04:36:10 (8216): Creating new snapshot for VM.
2021-10-16 04:36:20 (8216): Deleting stale snapshot.
2021-10-16 04:36:21 (8216): Checkpoint completed.
2021-10-16 04:36:26 (8216): Status Report: Trickle-Up Event.
2021-10-16 04:46:11 (8216): Creating new snapshot for VM.
2021-10-16 04:46:21 (8216): Deleting stale snapshot.
2021-10-16 04:46:21 (8216): Checkpoint completed.
2021-10-16 04:56:11 (8216): Creating new snapshot for VM.
2021-10-16 04:56:22 (8216): Deleting stale snapshot.
2021-10-16 04:56:23 (8216): Checkpoint completed.
2021-10-16 05:06:14 (8216): Creating new snapshot for VM.
2021-10-16 05:06:24 (8216): Deleting stale snapshot.
2021-10-16 05:06:25 (8216): Checkpoint completed.
2021-10-16 05:06:30 (8216): Status Report: Trickle-Up Event.
2021-10-16 05:16:14 (8216): Creating new snapshot for VM.
2021-10-16 05:16:24 (8216): Deleting stale snapshot.
2021-10-16 05:16:25 (8216): Checkpoint completed.
2021-10-16 05:26:15 (8216): Creating new snapshot for VM.
2021-10-16 05:26:26 (8216): Deleting stale snapshot.
2021-10-16 05:26:27 (8216): Checkpoint completed.
2021-10-16 05:33:28 (8216): Status Report: Elapsed Time: '534550.088329'
2021-10-16 05:33:28 (8216): Status Report: CPU Time: '23165.477695'
2021-10-16 05:36:16 (8216): Creating new snapshot for VM.
2021-10-16 05:36:27 (8216): Deleting stale snapshot.
2021-10-16 05:36:28 (8216): Checkpoint completed.
2021-10-16 05:36:33 (8216): Status Report: Trickle-Up Event.
2021-10-16 05:46:19 (8216): Creating new snapshot for VM.
2021-10-16 05:46:29 (8216): Deleting stale snapshot.
2021-10-16 05:46:29 (8216): Checkpoint completed.
2021-10-16 05:56:20 (8216): Creating new snapshot for VM.
2021-10-16 05:56:30 (8216): Deleting stale snapshot.
2021-10-16 05:56:31 (8216): Checkpoint completed.
2021-10-16 06:06:22 (8216): Creating new snapshot for VM.
2021-10-16 06:06:32 (8216): Deleting stale snapshot.
2021-10-16 06:06:33 (8216): Checkpoint completed.
2021-10-16 06:06:38 (8216): Status Report: Trickle-Up Event.
2021-10-16 06:16:22 (8216): Creating new snapshot for VM.
2021-10-16 06:16:33 (8216): Deleting stale snapshot.
2021-10-16 06:16:34 (8216): Checkpoint completed.
2021-10-16 06:26:24 (8216): Creating new snapshot for VM.
2021-10-16 06:26:34 (8216): Deleting stale snapshot.
2021-10-16 06:26:34 (8216): Checkpoint completed.
2021-10-16 06:36:24 (8216): Creating new snapshot for VM.
2021-10-16 06:36:35 (8216): Deleting stale snapshot.
2021-10-16 06:36:36 (8216): Checkpoint completed.
2021-10-16 06:36:41 (8216): Status Report: Trickle-Up Event.
2021-10-16 06:46:26 (8216): Creating new snapshot for VM.
2021-10-16 06:46:35 (8216): Deleting stale snapshot.
2021-10-16 06:46:36 (8216): Checkpoint completed.
2021-10-16 06:56:30 (8216): Creating new snapshot for VM.
2021-10-16 06:56:41 (8216): Deleting stale snapshot.
2021-10-16 06:56:42 (8216): Checkpoint completed.
2021-10-16 07:06:33 (8216): Creating new snapshot for VM.
2021-10-16 07:06:43 (8216): Deleting stale snapshot.
2021-10-16 07:06:44 (8216): Checkpoint completed.
2021-10-16 07:06:49 (8216): Status Report: Trickle-Up Event.
2021-10-16 07:13:31 (8216): Status Report: Elapsed Time: '540552.220002'
2021-10-16 07:13:31 (8216): Status Report: CPU Time: '23215.538416'
2021-10-16 07:16:34 (8216): Creating new snapshot for VM.
2021-10-16 07:16:44 (8216): Deleting stale snapshot.
2021-10-16 07:16:46 (8216): Checkpoint completed.
2021-10-16 07:26:37 (8216): Creating new snapshot for VM.
2021-10-16 07:26:47 (8216): Deleting stale snapshot.
2021-10-16 07:26:48 (8216): Checkpoint completed.
2021-10-16 07:36:38 (8216): Creating new snapshot for VM.
2021-10-16 07:36:49 (8216): Deleting stale snapshot.
2021-10-16 07:36:50 (8216): Checkpoint completed.
2021-10-16 07:36:55 (8216): Status Report: Trickle-Up Event.
2021-10-16 07:46:40 (8216): Creating new snapshot for VM.
2021-10-16 07:46:51 (8216): Deleting stale snapshot.
2021-10-16 07:46:53 (8216): Checkpoint completed.
2021-10-16 07:56:43 (8216): Creating new snapshot for VM.
2021-10-16 07:56:53 (8216): Deleting stale snapshot.
2021-10-16 07:56:54 (8216): Checkpoint completed.
2021-10-16 08:06:44 (8216): Creating new snapshot for VM.
2021-10-16 08:06:55 (8216): Deleting stale snapshot.
2021-10-16 08:06:56 (8216): Checkpoint completed.
2021-10-16 08:07:01 (8216): Status Report: Trickle-Up Event.
2021-10-16 08:16:46 (8216): Creating new snapshot for VM.
2021-10-16 08:16:57 (8216): Deleting stale snapshot.
2021-10-16 08:16:58 (8216): Checkpoint completed.
2021-10-16 08:26:48 (8216): Creating new snapshot for VM.
2021-10-16 08:26:58 (8216): Deleting stale snapshot.
2021-10-16 08:26:58 (8216): Checkpoint completed.
2021-10-16 08:36:49 (8216): Creating new snapshot for VM.
2021-10-16 08:36:59 (8216): Deleting stale snapshot.
2021-10-16 08:37:00 (8216): Checkpoint completed.
2021-10-16 08:37:05 (8216): Status Report: Trickle-Up Event.
2021-10-16 08:46:50 (8216): Creating new snapshot for VM.
2021-10-16 08:47:00 (8216): Deleting stale snapshot.
2021-10-16 08:47:01 (8216): Checkpoint completed.
2021-10-16 08:53:33 (8216): Status Report: Elapsed Time: '546554.687221'
2021-10-16 08:53:33 (8216): Status Report: CPU Time: '23267.003146'
2021-10-16 08:56:51 (8216): Creating new snapshot for VM.
2021-10-16 08:57:01 (8216): Deleting stale snapshot.
2021-10-16 08:57:03 (8216): Checkpoint completed.
2021-10-16 09:06:53 (8216): Creating new snapshot for VM.
2021-10-16 09:07:04 (8216): Deleting stale snapshot.
2021-10-16 09:07:05 (8216): Checkpoint completed.
2021-10-16 09:07:10 (8216): Status Report: Trickle-Up Event.
2021-10-16 09:16:56 (8216): Creating new snapshot for VM.
2021-10-16 09:17:06 (8216): Deleting stale snapshot.
2021-10-16 09:17:07 (8216): Checkpoint completed.
2021-10-16 09:26:58 (8216): Creating new snapshot for VM.
2021-10-16 09:27:09 (8216): Deleting stale snapshot.
2021-10-16 09:27:09 (8216): Checkpoint completed.
2021-10-16 09:37:01 (8216): Creating new snapshot for VM.
2021-10-16 09:37:10 (8216): Deleting stale snapshot.
2021-10-16 09:37:11 (8216): Checkpoint completed.
2021-10-16 09:37:16 (8216): Status Report: Trickle-Up Event.
2021-10-16 09:47:02 (8216): Creating new snapshot for VM.
2021-10-16 09:47:12 (8216): Deleting stale snapshot.
2021-10-16 09:47:13 (8216): Checkpoint completed.
2021-10-16 09:57:04 (8216): Creating new snapshot for VM.
2021-10-16 09:57:14 (8216): Deleting stale snapshot.
2021-10-16 09:57:15 (8216): Checkpoint completed.
2021-10-16 10:07:06 (8216): Creating new snapshot for VM.
2021-10-16 10:07:16 (8216): Deleting stale snapshot.
2021-10-16 10:07:17 (8216): Checkpoint completed.
2021-10-16 10:07:22 (8216): Status Report: Trickle-Up Event.
2021-10-16 10:17:08 (8216): Creating new snapshot for VM.
2021-10-16 10:17:19 (8216): Deleting stale snapshot.
2021-10-16 10:17:21 (8216): Checkpoint completed.
2021-10-16 10:27:12 (8216): Creating new snapshot for VM.
2021-10-16 10:27:22 (8216): Deleting stale snapshot.
2021-10-16 10:27:23 (8216): Checkpoint completed.
2021-10-16 10:33:35 (8216): Status Report: Elapsed Time: '552556.503354'
2021-10-16 10:33:35 (8216): Status Report: CPU Time: '23318.124674'
2021-10-16 10:37:14 (8216): Creating new snapshot for VM.
2021-10-16 10:37:24 (8216): Deleting stale snapshot.
2021-10-16 10:37:25 (8216): Checkpoint completed.
2021-10-16 10:37:30 (8216): Status Report: Trickle-Up Event.
2021-10-16 10:47:16 (8216): Creating new snapshot for VM.
2021-10-16 10:47:26 (8216): Deleting stale snapshot.
2021-10-16 10:47:27 (8216): Checkpoint completed.
2021-10-16 10:57:18 (8216): Creating new snapshot for VM.
2021-10-16 10:57:28 (8216): Deleting stale snapshot.
2021-10-16 10:57:29 (8216): Checkpoint completed.
2021-10-16 11:07:20 (8216): Creating new snapshot for VM.
2021-10-16 11:07:30 (8216): Deleting stale snapshot.
2021-10-16 11:07:30 (8216): Checkpoint completed.
2021-10-16 11:07:35 (8216): Status Report: Trickle-Up Event.
2021-10-16 11:17:21 (8216): Creating new snapshot for VM.
2021-10-16 11:17:31 (8216): Deleting stale snapshot.
2021-10-16 11:17:32 (8216): Checkpoint completed.
2021-10-16 11:27:23 (8216): Creating new snapshot for VM.
2021-10-16 11:27:33 (8216): Deleting stale snapshot.
2021-10-16 11:27:34 (8216): Checkpoint completed.
2021-10-16 11:37:24 (8216): Creating new snapshot for VM.
2021-10-16 11:37:35 (8216): Deleting stale snapshot.
2021-10-16 11:37:36 (8216): Checkpoint completed.
2021-10-16 11:37:41 (8216): Status Report: Trickle-Up Event.
2021-10-16 11:47:30 (8216): Creating new snapshot for VM.
2021-10-16 11:47:42 (8216): Deleting stale snapshot.
2021-10-16 11:47:48 (8216): Checkpoint completed.
2021-10-16 11:57:32 (8216): Creating new snapshot for VM.
2021-10-16 11:57:43 (8216): Deleting stale snapshot.
2021-10-16 11:57:44 (8216): Checkpoint completed.
2021-10-16 12:07:35 (8216): Creating new snapshot for VM.
2021-10-16 12:07:49 (8216): Deleting stale snapshot.
2021-10-16 12:07:52 (8216): Checkpoint completed.
2021-10-16 12:07:57 (8216): Status Report: Trickle-Up Event.
2021-10-16 12:08:28 (8216): Preference change detected
2021-10-16 12:08:28 (8216): Setting CPU throttle for VM. (100%)
2021-10-16 12:08:28 (8216): Setting checkpoint interval to 600 seconds. (Higher value of (Preference: 360 seconds) or (Vbox_job.xml: 600 seconds))
2021-10-16 12:13:38 (8216): Status Report: Elapsed Time: '558559.782171'
2021-10-16 12:13:38 (8216): Status Report: CPU Time: '23370.587810'
2021-10-16 12:17:37 (8216): Creating new snapshot for VM.
2021-10-16 12:17:47 (8216): Deleting stale snapshot.
2021-10-16 12:17:49 (8216): Checkpoint completed.
2021-10-16 12:27:40 (8216): Creating new snapshot for VM.
2021-10-16 12:27:50 (8216): Deleting stale snapshot.
2021-10-16 12:27:52 (8216): Checkpoint completed.
2021-10-16 12:37:43 (8216): Creating new snapshot for VM.
2021-10-16 12:37:54 (8216): Deleting stale snapshot.
2021-10-16 12:37:55 (8216): Checkpoint completed.
2021-10-16 12:38:00 (8216): Status Report: Trickle-Up Event.
2021-10-16 12:47:46 (8216): Creating new snapshot for VM.
2021-10-16 12:47:56 (8216): Deleting stale snapshot.
2021-10-16 12:47:57 (8216): Checkpoint completed.
2021-10-16 12:57:49 (8216): Creating new snapshot for VM.
2021-10-16 12:57:59 (8216): Deleting stale snapshot.
2021-10-16 12:58:00 (8216): Checkpoint completed.
2021-10-16 13:07:51 (8216): Creating new snapshot for VM.
2021-10-16 13:08:01 (8216): Deleting stale snapshot.
2021-10-16 13:08:03 (8216): Checkpoint completed.
2021-10-16 13:08:08 (8216): Status Report: Trickle-Up Event.
2021-10-16 13:17:52 (8216): Creating new snapshot for VM.
2021-10-16 13:18:03 (8216): Deleting stale snapshot.
2021-10-16 13:18:03 (8216): Checkpoint completed.
2021-10-16 13:27:53 (8216): Creating new snapshot for VM.
2021-10-16 13:28:02 (8216): Deleting stale snapshot.
2021-10-16 13:28:03 (8216): Checkpoint completed.
2021-10-16 13:37:54 (8216): Creating new snapshot for VM.
2021-10-16 13:38:04 (8216): Deleting stale snapshot.
2021-10-16 13:38:04 (8216): Checkpoint completed.
2021-10-16 13:38:10 (8216): Status Report: Trickle-Up Event.
2021-10-16 13:47:54 (8216): Creating new snapshot for VM.
2021-10-16 13:48:05 (8216): Deleting stale snapshot.
2021-10-16 13:48:07 (8216): Checkpoint completed.
2021-10-16 13:53:42 (8216): Status Report: Elapsed Time: '564564.072120'
2021-10-16 13:53:42 (8216): Status Report: CPU Time: '23418.714118'
2021-10-16 13:57:56 (8216): Creating new snapshot for VM.
2021-10-16 13:58:06 (8216): Deleting stale snapshot.
2021-10-16 13:58:07 (8216): Checkpoint completed.
2021-10-16 14:07:58 (8216): Creating new snapshot for VM.
2021-10-16 14:08:08 (8216): Deleting stale snapshot.
2021-10-16 14:08:10 (8216): Checkpoint completed.
2021-10-16 14:08:15 (8216): Status Report: Trickle-Up Event.
2021-10-16 14:18:00 (8216): Creating new snapshot for VM.
2021-10-16 14:18:12 (8216): Deleting stale snapshot.
2021-10-16 14:18:13 (8216): Checkpoint completed.
2021-10-16 14:28:04 (8216): Creating new snapshot for VM.
2021-10-16 14:28:14 (8216): Deleting stale snapshot.
2021-10-16 14:28:17 (8216): Checkpoint completed.
2021-10-16 14:38:04 (8216): Creating new snapshot for VM.
2021-10-16 14:38:14 (8216): Deleting stale snapshot.
2021-10-16 14:38:15 (8216): Checkpoint completed.
2021-10-16 14:38:20 (8216): Status Report: Trickle-Up Event.
2021-10-16 14:48:05 (8216): Creating new snapshot for VM.
2021-10-16 14:48:16 (8216): Deleting stale snapshot.
2021-10-16 14:48:18 (8216): Checkpoint completed.
2021-10-16 14:58:08 (8216): Creating new snapshot for VM.
2021-10-16 14:58:18 (8216): Deleting stale snapshot.
2021-10-16 14:58:19 (8216): Checkpoint completed.
2021-10-16 15:08:08 (8216): Creating new snapshot for VM.
2021-10-16 15:08:18 (8216): Deleting stale snapshot.
2021-10-16 15:08:20 (8216): Checkpoint completed.
2021-10-16 15:08:25 (8216): Status Report: Trickle-Up Event.
2021-10-16 15:18:11 (8216): Creating new snapshot for VM.
2021-10-16 15:18:22 (8216): Deleting stale snapshot.
2021-10-16 15:18:23 (8216): Checkpoint completed.
2021-10-16 15:28:12 (8216): Creating new snapshot for VM.
2021-10-16 15:28:22 (8216): Deleting stale snapshot.
2021-10-16 15:28:23 (8216): Checkpoint completed.
2021-10-16 15:33:43 (8216): Status Report: Elapsed Time: '570564.496078'
2021-10-16 15:33:43 (8216): Status Report: CPU Time: '23467.854433'
2021-10-16 15:38:16 (8216): Creating new snapshot for VM.
2021-10-16 15:38:26 (8216): Deleting stale snapshot.
2021-10-16 15:38:27 (8216): Checkpoint completed.
2021-10-16 15:38:32 (8216): Status Report: Trickle-Up Event.
2021-10-16 15:48:19 (8216): Creating new snapshot for VM.
2021-10-16 15:48:28 (8216): Deleting stale snapshot.
2021-10-16 15:48:30 (8216): Checkpoint completed.
2021-10-16 15:58:23 (8216): Creating new snapshot for VM.
2021-10-16 15:58:32 (8216): Deleting stale snapshot.
2021-10-16 15:58:33 (8216): Checkpoint completed.
2021-10-16 16:08:26 (8216): Creating new snapshot for VM.
2021-10-16 16:08:35 (8216): Deleting stale snapshot.
2021-10-16 16:08:35 (8216): Checkpoint completed.
2021-10-16 16:08:40 (8216): Status Report: Trickle-Up Event.
2021-10-16 16:18:28 (8216): Creating new snapshot for VM.
2021-10-16 16:18:38 (8216): Deleting stale snapshot.
2021-10-16 16:18:39 (8216): Checkpoint completed.
2021-10-16 16:28:31 (8216): Creating new snapshot for VM.
2021-10-16 16:28:40 (8216): Deleting stale snapshot.
2021-10-16 16:28:42 (8216): Checkpoint completed.
2021-10-16 16:38:35 (8216): Creating new snapshot for VM.
2021-10-16 16:38:44 (8216): Deleting stale snapshot.
2021-10-16 16:38:44 (8216): Checkpoint completed.
2021-10-16 16:38:49 (8216): Status Report: Trickle-Up Event.
2021-10-16 16:48:37 (8216): Creating new snapshot for VM.
2021-10-16 16:48:47 (8216): Deleting stale snapshot.
2021-10-16 16:48:48 (8216): Checkpoint completed.
2021-10-16 16:58:41 (8216): Creating new snapshot for VM.
2021-10-16 16:58:51 (8216): Deleting stale snapshot.
2021-10-16 16:58:52 (8216): Checkpoint completed.
2021-10-16 17:08:46 (8216): Creating new snapshot for VM.
2021-10-16 17:08:55 (8216): Deleting stale snapshot.
2021-10-16 17:08:56 (8216): Checkpoint completed.
2021-10-16 17:09:01 (8216): Status Report: Trickle-Up Event.
2021-10-16 17:13:45 (8216): Status Report: Elapsed Time: '576566.836778'
2021-10-16 17:13:45 (8216): Status Report: CPU Time: '23508.336693'
2021-10-16 17:18:50 (8216): Creating new snapshot for VM.
2021-10-16 17:18:59 (8216): Deleting stale snapshot.
2021-10-16 17:19:00 (8216): Checkpoint completed.
2021-10-16 17:28:54 (8216): Creating new snapshot for VM.
2021-10-16 17:29:03 (8216): Deleting stale snapshot.
2021-10-16 17:29:04 (8216): Checkpoint completed.
2021-10-16 17:38:54 (8216): Creating new snapshot for VM.
2021-10-16 17:39:03 (8216): Deleting stale snapshot.
2021-10-16 17:39:04 (8216): Checkpoint completed.
2021-10-16 17:39:09 (8216): Status Report: Trickle-Up Event.
2021-10-16 17:47:01 (8216): Powering off VM.
2021-10-16 17:47:05 (8216): Successfully stopped VM.
2021-10-16 17:47:10 (8216): Deregistering VM. (boinc_1084ca24093d52b4, slot#1)
2021-10-16 17:47:11 (8216): Removing virtual disk drive(s) from VM.
2021-10-16 17:47:11 (8216): Removing network bandwidth throttle group from VM.
2021-10-16 17:47:11 (8216): Removing storage controller(s) from VM.
2021-10-16 17:47:11 (8216): Removing VM from VirtualBox.

Hypervisor System Log:

78:55:45.179453 ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=false aResultDetail=0
78:55:50.241096 ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=false aResultDetail=0
78:55:50.241596 ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=false aResultDetail=0
78:55:55.309240 ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=false aResultDetail=0
78:55:55.309240 ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=false aResultDetail=0
78:56:00.371382 ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=false aResultDetail=0
78:56:00.371882 ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=false aResultDetail=0
78:56:05.450027 ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=false aResultDetail=0
78:56:05.450527 ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=false aResultDetail=0
78:56:10.533673 ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=false aResultDetail=0
78:56:10.533673 ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=false aResultDetail=0
78:56:17.924111 Saving settings file "C:\ProgramData\BOINC\slots\1\boinc_1084ca24093d52b4\boinc_1084ca24093d52b4.vbox" with version "1.16-windows"
78:56:18.350165 ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=false aResultDetail=0
78:56:18.350165 ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=false aResultDetail=0
78:56:25.463569 ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=false aResultDetail=0
78:56:25.463569 ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=false aResultDetail=0
78:56:25.530077 DeleteSnap ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=true aResultDetail=0
78:56:25.530077 DeleteSnap ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=true aResultDetail=0
78:56:25.540578 DeleteSnap ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=true aResultDetail=0
78:56:25.540578 DeleteSnap ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=true aResultDetail=0
78:56:25.540578 DeleteSnap ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=true aResultDetail=0
78:56:25.540578 DeleteSnap ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=true aResultDetail=0
78:56:25.541078 DeleteSnap ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=true aResultDetail=0
78:56:25.541078 DeleteSnap ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=true aResultDetail=0
78:56:25.541579 DeleteSnap Saving settings file "C:\ProgramData\BOINC\slots\1\boinc_1084ca24093d52b4\boinc_1084ca24093d52b4.vbox" with version "1.16-windows"
78:56:25.651092 DeleteSnap Saving settings file "C:\ProgramData\BOINC\slots\1\boinc_1084ca24093d52b4\boinc_1084ca24093d52b4.vbox" with version "1.16-windows"
78:56:25.728102 ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=false aResultDetail=0
78:56:25.728102 ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=false aResultDetail=0
78:56:25.730603 ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=false aResultDetail=0
78:56:25.730603 ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=false aResultDetail=0
78:56:25.737603 Saving settings file "C:\ProgramData\BOINC\slots\1\boinc_1084ca24093d52b4\boinc_1084ca24093d52b4.vbox" with version "1.16-windows"
78:56:25.788610 ERROR [COM]: aRC=E_ACCESSDENIED (0x80070005) aIID={85cd948e-a71f-4289-281e-0ca7ad48cd89} aComponent={MachineWrap} aText={The object functionality is limited}, preserve=false aResultDetail=0
78:56:25.788610
2) Message boards : Number crunching : Never ending tasks (Message 1437)
Posted 24 Jun 2021 by UBT - Timbo
Post:
Check the Properties of the task in question. If the difference between the CPU time and the Elapsed time is more than a few minutes, that WU has stopped processing. It will proceed no further and should be aborted.


Hi all

Good advice - I've allowed a couple of my hosts to crunch some QuChem tasks over the last few days and some crunch quite nicely on both hosts but a lot fail, with a result that the hosts are wasting energy and resources. grinding their wheels and doing nothing.

I checked the "Properties" box of these tasks and the CPU time seems to be around 2 minutes and the elapsed time is many, many hours.

So, I've now Aborted about 50 tasks as I have very little confidence in the project to actual FIX this issue. Yes, it might be a VBox issue...but I can run LHC VBox tasks without any problems on both hosts...so it may be related to VBox, but it seems to be more along the lines of how the tasks and VBox interact?

the trainee who developed the windows application is gone and it's really not my area of expertise...


Maybe the project admin needs to employ someone to fix this as it is not beneficial to the project for volunteers to be wasting their hosts time on number crunching tasks that do not complete? (And that volunteers see no reward for either !).

rgds
Tim
3) Message boards : Number crunching : Never ending tasks (Message 1292)
Posted 26 Dec 2020 by UBT - Timbo
Post:
Check the Properties of the task in question. If the difference between the CPU time and the Elapsed time is more than a few minutes, that WU has stopped processing. It will proceed no further and should be aborted.


Thanks for the tip.

This is what shows in the Properties of ONE task:

State Running
Received 19/12/2020 20:48:28
Report deadline 02/01/2021 20:48:41
Estimated computation size 20,000 GFLOPs
CPU time 00:11:12
CPU time since checkpoint 00:00:00
Elapsed time 6d 14:57:29
Estimated time remaining 00:00:00
Fraction done 100.000%


Various files in the QuChem task "Slots" directory are still incrementing and do not appear to be "stuck" on an older date/time than the current time now.

VBox claims the tasks are still "Running" - but I have my doubts.

regards
Tim
4) Message boards : Number crunching : Never ending tasks (Message 1290)
Posted 26 Dec 2020 by UBT - Timbo
Post:
Hi

I now have a number of tasks that are all stuck at 100% - the error log shows they are still sending trickles, but still there's no sign of them ending :-(

Still crunching:

after: 6d 12hr.

https://quchempedia.univ-angers.fr/athome/result.php?resultid=5084462

after 4d 12hr

https://quchempedia.univ-angers.fr/athome/result.php?resultid=5077365

after 6d 22hr

https://quchempedia.univ-angers.fr/athome/result.php?resultid=4320138

after 6 d

https://quchempedia.univ-angers.fr/athome/result.php?resultid=4998674

So, do I leave them be or cancel them and do some other projects tasks (as there are clearly issues with this projects tasks that the admin cannot fix).

regards
Tim
5) Message boards : Number crunching : Validate error. (Message 1278)
Posted 21 Dec 2020 by UBT - Timbo
Post:
Hi Benoit

Many thanks for the helpful message - shame that a Linux user has caused issues for you. :-(

I looked at the "Completed, can't validate" logs and it shows a report:

"Validate state Workunit error - check skipped"

So, is this an actual workunit error (and nothing to do with the host machine), or is this a local problem with VirtualBox or the PC itself (as 3 different hosts have the same issue?).

I would prefer to stop crunching QuChem tasks if it is my host machines that have the problem.

regards
Tim
6) Message boards : Number crunching : Validate error. (Message 1271)
Posted 19 Dec 2020 by UBT - Timbo
Post:
Hi

I've got multiple "Completed, can't validate" errors on 3 different Windows hosts all of which have spent thousands of seconds crunching but received ZERO credit.

And yet, most if not all of my wingmen on these tasks ERRORED (with "Validate error" code) on Linux hosts after maybe 3-10 seconds

5045004 1981312 3914 19 Dec 2020, 14:49:32 UTC 19 Dec 2020, 22:21:47 UTC Completed, can't validate 13,008.33 12,976.88 0.00 NWChem v0.11 (vbox64_t1)
windows_x86_64
5044963 1981290 3914 19 Dec 2020, 14:49:32 UTC 19 Dec 2020, 22:35:05 UTC Completed, can't validate 9,429.14 9,283.31 0.00 NWChem v0.11 (vbox64_t1)
windows_x86_64
5031572 1979972 3914 19 Dec 2020, 13:20:05 UTC 19 Dec 2020, 17:42:43 UTC Completed, can't validate 10,531.50 10,531.50 0.00 NWChem v0.11 (vbox64_t1)
windows_x86_64
5027266 1978902 3914 19 Dec 2020, 13:20:05 UTC 19 Dec 2020, 20:19:59 UTC Completed, can't validate 19,202.91 19,007.72 0.00 NWChem v0.11 (vbox64_t1)
windows_x86_64
5031772 1979969 3914 19 Dec 2020, 13:20:04 UTC 19 Dec 2020, 14:49:32 UTC Completed, can't validate 4,373.44 4,311.09 0.00 NWChem v0.11 (vbox64_t1)
windows_x86_64
4998619 1973464 1374 19 Dec 2020, 9:30:47 UTC 19 Dec 2020, 20:41:52 UTC Completed, can't validate 7,103.41 7,033.65 0.00 NWChem v0.11 (vbox64_t1)
windows_x86_64
4997662 1972752 1374 19 Dec 2020, 9:30:34 UTC 19 Dec 2020, 21:13:48 UTC Completed, can't validate 9,130.67 9,058.71 0.00 NWChem v0.11 (vbox64_t1)
windows_x86_64
4998462 1973293 1374 19 Dec 2020, 9:30:07 UTC 19 Dec 2020, 20:11:46 UTC Completed, can't validate 5,057.00 4,951.75 0.00 NWChem v0.11 (vbox64_t1)
windows_x86_64
4994809 1972481 1374 19 Dec 2020, 9:29:52 UTC 19 Dec 2020, 20:35:49 UTC Completed, can't validate 6,031.79 5,967.54 0.00 NWChem v0.11 (vbox64_t1)
windows_x86_64
4997673 1972932 1374 19 Dec 2020, 9:29:37 UTC 19 Dec 2020, 20:11:46 UTC Completed, can't validate 3,893.46 3,842.73 0.00 NWChem v0.11 (vbox64_t1)
windows_x86_64
4998670 1973534 1374 19 Dec 2020, 9:29:36 UTC 19 Dec 2020, 11:03:21 UTC Completed, can't validate 5,532.78 5,532.78 0.00 NWChem v0.11 (vbox64_t1)
windows_x86_64
4998672 1973535 1374 19 Dec 2020, 9:29:36 UTC 19 Dec 2020, 11:30:39 UTC Completed, can't validate 6,592.30 6,577.19 0.00 NWChem v0.11 (vbox64_t1)
windows_x86_64
4998191 1972993 1374 19 Dec 2020, 9:29:36 UTC 19 Dec 2020, 11:35:22 UTC Completed, can't validate 7,441.80 7,430.50 0.00 NWChem v0.11 (vbox64_t1)
windows_x86_64
4997863 1972905 1374 19 Dec 2020, 9:29:36 UTC 19 Dec 2020, 12:00:42 UTC Completed, can't validate 8,664.61 8,664.61 0.00 NWChem v0.11 (vbox64_t1)
windows_x86_64
4997865 1972909 1374 19 Dec 2020, 9:29:36 UTC 19 Dec 2020, 11:00:33 UTC Completed, can't validate 4,600.40 4,594.60 0.00 NWChem v0.11 (vbox64_t1)
windows_x86_64
4997869 1972947 1186 19 Dec 2020, 9:26:02 UTC 19 Dec 2020, 20:48:57 UTC Completed, can't validate 13,416.72 12,685.64 0.00 NWChem v0.11 (vbox64_t1)
windows_x86_64
4997507 1973117 1186 19 Dec 2020, 9:25:15 UTC 19 Dec 2020, 15:13:47 UTC Completed, can't validate 20,872.60 20,162.93 0.00 NWChem v0.11 (vbox64_t1)
windows_x86_64

This is a LOT of wasted time, for no gain - but more importantly, why are the ERRORS treated differently by whichever OS is used?

regards
Tim
7) Message boards : Number crunching : Never ending tasks (Message 1116)
Posted 30 Sep 2020 by UBT - Timbo
Post:
Yes indeed, I'm sorry about that. I don't have the funds and human resources to improve the virtualbox application for Windows. I put it back in beta after this observation.

The best solution I know is to install a Linux VM and run Boinc and Quchempedia@home in it. That way you get full control


Thanks for the reply.

One wonders what the issue is then, if your tasks and a "standard installation" of V Box are causing intermittent issues?

I know that LHC@home, Cosmology@home and nanoHub@home also use V Box and (AFAIK) their tasks do not seem to have any issues with V Box.

Also, it seems strange that each QuChem task requires V Box to set aside 2 Gb of RAM for each task, when the actual requirement is far less?

So, perhaps you could downsize the memory requirement for these tasks...as that might then allow more to run...and if it is a memory issue (or a lack of, at the point when each task starts) that is causing some of these "zombie" tasks, then maybe this might help?

regards
Tim
8) Message boards : Number crunching : Never ending tasks (Message 1106)
Posted 28 Sep 2020 by UBT - Timbo
Post:
Hi

I'm in the same boat - I have three hosts running Windows and using V Box and some tasks do successfully complete (and in a short period of time) and earn credits, whilst others seem to get stuck and use 0 CPU time.

These tasks have been going for days and only now have I found this posting where other members have found the same problem with "zombie" like tasks.

This of course means that each host has to be "watched over" in case working CPUs get "tied up" doing nothing, which means wasting electrical power if no work is being done by them.


I have today aborted 4 such tasks from one host:

https://quchempedia.univ-angers.fr/athome/result.php?resultid=3104633 for task #1673397

https://quchempedia.univ-angers.fr/athome/result.php?resultid=3104166 for task #1673163

https://quchempedia.univ-angers.fr/athome/result.php?resultid=3103980 for task #1673070

https://quchempedia.univ-angers.fr/athome/result.php?resultid=3104741 for task #1673451


The stderr logs shows a whole load of information (far too long to copy and paste here) but it does seem that there is an issue with some tasks and not with others, which I assume is down to how the tasks are originally generated?

regards
Tim
9) Message boards : Number crunching : Long work units. (Message 745)
Posted 10 Apr 2020 by UBT - Timbo
Post:
Go to your "QuChemPedIA@home preferences" and select as folows:

Run only the selected applications:
NWChem: yes
NWChem long: no

Max # CPUs: 1

That might help and you won't get any LONG tasks.

If that doesn't work as you want, then you should create an "app_config.xml" file (in ordinary "txt" format, using say Notepad) in the "BOINC/projects/quchempedia.univ-angers.fr_athome folder of your PC.

This should contain the following:

<app_config>
<app>
<name>nwchem</name>
<max_concurrent>1</max_concurrent>
</app>
</app_config>

Note: I *think* the app name is "nwchem" but it might be something else...so once you create the above file, use "BOINC Manager > Options > Read config files" and then immediately check "BOINC Manager>Tools>Event Log" and it will tell you the correct name of the QuChem app.

So, re-edit the "app_config.xml" file with Notepad and use the correct name instead of "nwchem". Then save the file, and close Notepad. Then use the "Read config files" function again.
10) Message boards : News : Credits and Gridcoin (Message 481)
Posted 1 Feb 2020 by UBT - Timbo
Post:
Wow and the user wasn't even Gridcoin.


mmmmmm....are you sure about that?
11) Message boards : News : Credits and Gridcoin (Message 480)
Posted 1 Feb 2020 by UBT - Timbo
Post:
No one was cheating. Nice way to jump to conclusions.


And you know this HOW exactly?

The admin of this project would not publically state that they found someone was cheating if they did not have some proof.

And I prefer to believe the project admins, unless you can prove otherwise.

Cheaters bring down the whole idea of volunteer computing and give it a bad name, when we offer our computer time to improve science and other worthy projects, rather than waste their time having to 100% check and perhaps then double check all results and to then have to suspend cheaters for their wrong doing.
12) Message boards : Number crunching : Very little CPU usage (Message 406)
Posted 8 Jan 2020 by UBT - Timbo
Post:
Hi all

I have one task that is now at 50 hrs of elapsed time (according to BOINC Manager).

I can see very little CPU time being used by the task which is this:

https://quchempedia.univ-angers.fr/athome/result.php?resultid=702088

Here is the output from the task "properties"

Application NWChem 0.11 (vbox64_t1)
Name od9_0_athome_b3lyp-321gd,batch21,dsgdb9nsd_088715,nwchem,1576787625
State Running
Received 05/01/2020 19:49:45
Report deadline 19/01/2020 19:49:46
Estimated computation size 3,500 GFLOPs
CPU time 00:04:31
CPU time since checkpoint 00:00:01
Elapsed time 2d 02:39:48
Estimated time remaining 00:00:00
Fraction done 100.000%
Virtual memory size 80.89 MB
Working set size 2.00 GB
Directory slots/1
Process ID 4948
Progress rate 1.800% per hour
Executable vboxwrapper_26200_windows_x86_64.exe


So, I am aborting it, as I prefer to run other tasks that actually do good.

Question: Is this project in alpha, beta or just "development" or is it fully operational?

regards
Tim
13) Message boards : Number crunching : VM job unmanageable (Message 389)
Posted 6 Jan 2020 by UBT - Timbo
Post:
Hi all

I found this message thread on Github that might interest those affected by this issue:

https://github.com/BOINC/boinc/issues/3173

It seems that VBox thinks there isn't enough memory to complete the job and hence it delays restarting for 1 day.

The fix seems to be to restart the BOINC Manager client and VBox shoud then restart, assuming any local memory intensive apps have ceased.

A YouTube video claims that if you reduce the "Computing preferences > Computing > Use at most __% of the CPU time" setting prior to the restart of BOINC Manager might also fix this.

https://www.youtube.com/watch?v=2CK8Yxxylnw

regards
Tim




©2024 Benoit DA MOTA - LERIA, University of Angers, France