Luci · Task enabled, cron `5 * * * *` correct. Check why no
Luci
Task enabled, cron `5 * * * *` correct. Check why no run since 06:05. Gather diagnostics.
Luci
Found it. Scheduler stalled ~1h50m. Gap in task_runs: last run 07:01:15 (investment-weekly-digest), then NOTHING until 08:51:03. crypto-trader-cycle's 07:05 + 08:05 fires fell in that dead window. Scheduler not dead now (firing fine at 08:5x). Confirm what held the flock.
Luci
Root cause confirmed. Not a crypto-trader-cycle fault. The chain:
- Today = Saturday. `investment-weekly-digest` (`0 7 * * 6`, **timeout 7200=2h**) fired 07:01, runs NotebookLM audio gen (45min wait, commit c58ab5ec).
- Scheduler runs tasks **synchronously inside the tick**, which holds `flock -n /tmp/scheduler.lock`. Every minute-tick during that window gets `flock -n` fail → skips (code comment line 1844 admits this).
- task_runs gap proves it: **07:01:15 → 08:51:03 = ~1h50m total silence**, then burst recovery at 08:51-08:53.
- crypto-trader-cycle's 07:05 + 08:05 fell in the dead window → dropped. Collateral, not a task fault.
Real recurring bug: one long task (2h timeout) blocks the ENTIRE scheduler every Saturday morning — drops every hourly/minutely task for ~1-2h. Read run logic to scope fix.
Luci
Confirmed: `execute_command` blocks on `proc.communicate(timeout=task["timeout"])` — synchronous, inside the tick. Need to see tick loop to confirm serial execution + whether long tasks already have a detach path.
Luci
`background: true` frontmatter already exists — detaches via `launch_background_task`, tick returns immediately, no flock hold. Reconcile path handles completion. Surgical fix: mark the long blocking task(s) `background`. Audit which non-background tasks have large timeouts (the blocking class).
Luci
Clear picture. Long non-background tasks block the whole scheduler tick (flock). Today's culprit = `investment-weekly-digest` (timeout 7200, NotebookLM audio/video). Precedent already set: the sibling long NotebookLM task `radio-weekly-episode` (7200) is already `background: true`. Fix = match the pattern for investment-weekly-digest. Surgical, one task file.
Verify background path preserves failure-notify before editing, then dev-loop.
Luci
Background path fully preserves `notify_on: failure` (via `_task_notify` + MC ticket on repeat) and timeout handling via `reap_orphan_task_runs`. `retry: false` already, so nothing lost. Fix confirmed safe + matches established `radio-weekly-episode` pattern.
Tier 1 change: add `background: true` to investment-weekly-digest frontmatter. Invoke dev-loop (mandatory gate).
Luci
Tier 1. Edit the task file in this worktree (pool-2), commit, push.
Luci
Add a one-line rationale note so the next reader understands the background flag.
Luci
Smoke-test: confirm the task file still parses as valid frontmatter and the scheduler loads it with `background=True`.
Luci
`load_tasks()` reads the hardcoded live `~/workspace/tasks/` path, not the worktree copy — so it loaded the unedited live file. Test the worktree file's frontmatter directly.
Luci
Smoke-test the worktree file through the exact loader logic:
Luci
Smoke passes. Commit + push branch (pool worker contract).
Luci
Pushed `b8a2860a` on `slot2/mc-MC-4435`. Report done.