Disabling autowho while it's enabled doesn't take effect immediately; Konversation still sends *one* more autowho to all channels. Looks like turning off autowho makes the timers not start again after they trigger, but doesn't stop the timers that are already running.
Fixed in 36ae92a.