Bug 486574

Summary: Alpaka doesn't work properly with the ollama systemd service (it always repeats the first answer)
Product: [Applications] Alpaka Reporter: Mark B <kde.ppvo2>
Component: GeneralAssignee: Loren Burkholder <loren>
Status: RESOLVED FIXED    
Severity: normal CC: mundolibre
Priority: NOR    
Version First Reported In: unspecified   
Target Milestone: ---   
Platform: Arch Linux   
OS: Linux   
Latest Commit: Version Fixed/Implemented In:
Sentry Crash Report:

Description Mark B 2024-05-04 13:48:15 UTC 
SUMMARY
Alpaka doesn't work properly with the ollama systemd service (with "ollama serve" on the command line Alpaka works properly). This is on archlinux.

"ollama run" on the cli works fine with the systemd service.

The problem: with the systemd service, Alpaka always repeats the same answer. When asked different questions it always repeats the answer to the first question. (ollama run on the cli works fine).

STEPS TO REPRODUCE
1. Start Alpaka
2. Ask a question
3. Alpaka give the correct answer.
4. Ask another question
5. Alpaka always gives the answer to the first question
6. repeat from point 4 in a loop.

OBSERVED RESULT
Alpaka always gives the answer to the first question for every question asked after the first one (with the ollama systemd service, not when ollama is started from cli).


EXPECTED RESULT
Alpaka should give a different answer for each question (as it does when ollama is started from the cli).

SOFTWARE/OS VERSIONS
Linux/KDE Plasma:
KDE Plasma Version: 6.0.4
KDE Frameworks Version: 6.1.0
Qt Version: 6.7.0

Thanks!
Comment 1 David Marzal 2024-06-16 15:37:05 UTC 
Same problem.

alpaka-git r319.f99795e-1
model: llama3:8b               365c0bd3c000

Operating System: Arch Linux 
KDE Plasma Version: 6.0.5
KDE Frameworks Version: 6.3.0
Qt Version: 6.7.1
Graphics Platform: Wayland
Processors: 6 × Intel® Core™ i5-8400 CPU @ 2.80GHz
Memory: 15.6 GiB of RAM
Comment 2 Mark B 2024-12-28 14:20:56 UTC 
This is working fine for me now with the new kde & alpaka versions. So I am closing this.
Comment 3 David Marzal 2024-12-28 19:45:07 UTC 
Agree, tested again and works.