MC-4310 — [watchdog:dispatch:ticket-pickup:MC-4306] Dispatch anomaly hidden in completed run: ticket-pickup

Home Board MC-4310

[watchdog:dispatch:ticket-pickup:MC-4306] Dispatch anomaly hidden in completed run: ticket-pickup

Core scheduler task `ticket-pickup` completed at 2026-05-27 16:31:14, but its captured output contains a dispatch/revert error. The task row is marked completed, so normal faile...

State Done Next Action Closed Owner Luci Runtime Closed Age 17d ago

Description

MC-4310

Core scheduler task `ticket-pickup` completed at 2026-05-27 16:31:14, but its captured output contains a dispatch/revert error. The task row is marked completed, so normal failed-run monitoring would miss it. Ticket/run key: `MC-4306` No newer clean run of the same core task and no active runtime for the affected ticket was found, so this needs Luci triage. Captured output excerpt: ``` Found 2 MC worker todo ticket(s), 1 workers active, 1 slot(s) free ERROR dispatching MC-4306 to ticket runtime: HTTP Error 409: CONFLICT Reverted MC-4306 -> todo (tmux spawn failed) ERROR dispatching MC-4302 to ticket runtime: HTTP Error 409: CONFLICT Reverted MC-4302 -> todo (tmux spawn failed) No larry tickets to pick up. ```

Activity

done

Luci is working...

Details — Done · High · Luci ▼

State

Done

Closed

State

Priority

People

Owner (assigned to)

Controller

Timing / Details

Due Date

Snooze

Source scheduler-watchdog (scheduled)

Project infra

Created 17d ago

Updated 17d ago

Advanced / Operator evidence

Routing owner

Routes via

Operator console

Evidence

Ticket is done; runtime is closed. ticket_marked_done profile claude_opus_1m_medium · cwd /home/lucienne/workspace · uptime 16d 17h · last activity 16d 15h ago MC is visibility-only. Hermes Luci launches and gates work outside MC, then mirrors evidence/status here. Raw console: luci · claude/anthropic/opus[1m]

Workflow

Start Dev Review + QA ▾

Select phases to include:

Research (scott) Implement (larry) (required) Council Review (council) Code Review (luci) Validate (tessa) (required) Sign-off (atlas)

Agents

Review Gates

Decision

WAT routing: choose an agent, review gate, or decision. Buttons use the live runtime when one is attached.

Luci 17d ago

Triage: pickup hit HTTP 409 CONFLICT dispatching MC-4306/4302 (and earlier MC-4286/4207/4291) for ~2h. Root cause: orphan reaper reverts ticket→todo but leaves runtime_sessions row in non-terminal status + live tmux session; next /runtime/send 409s in assert_ready_for_input because MC-3513 stale-reconciliation only fires when tmux is GONE. Self-heal eventually fired when tmux died. Fix committed on branch slot2/mc-MC-4310 (commit bb141f58): orphan reaper now calls models.close_ticket_runtime_sessions(status='stale', kill_tmux=True) after status revert. Pushed to origin. NOT yet merged to master — workspace root is on stale branch feat/mc-4304-deadworker-retry with unrelated dirty state from prior worker, so I did not auto-merge. Needs: (1) merge slot2/mc-MC-4310 → master, (2) reset workspace root checkout to master so live scheduler picks up the fix.

api 17d ago

Closed (orchestrator). Cherry-picked bb141f58 onto current master as c288a1ba and pushed. Orphan reaper now closes runtime_sessions + kills tmux on revert. Fixes the 409 wedge pattern affecting MC-4286/4302/4306. Next scheduler tick will load updated mc_pickup.py.