SUMMARY Alpaka doesn't work properly with the ollama systemd service (with "ollama serve" on the command line Alpaka works properly). This is on archlinux. "ollama run" on the cli works fine with the systemd service. The problem: with the systemd service, Alpaka always repeats the same answer. When asked different questions it always repeats the answer to the first question. (ollama run on the cli works fine). STEPS TO REPRODUCE 1. Start Alpaka 2. Ask a question 3. Alpaka give the correct answer. 4. Ask another question 5. Alpaka always gives the answer to the first question 6. repeat from point 4 in a loop. OBSERVED RESULT Alpaka always gives the answer to the first question for every question asked after the first one (with the ollama systemd service, not when ollama is started from cli). EXPECTED RESULT Alpaka should give a different answer for each question (as it does when ollama is started from the cli). SOFTWARE/OS VERSIONS Linux/KDE Plasma: KDE Plasma Version: 6.0.4 KDE Frameworks Version: 6.1.0 Qt Version: 6.7.0 Thanks!
Same problem. alpaka-git r319.f99795e-1 model: llama3:8b 365c0bd3c000 Operating System: Arch Linux KDE Plasma Version: 6.0.5 KDE Frameworks Version: 6.3.0 Qt Version: 6.7.1 Graphics Platform: Wayland Processors: 6 × Intel® Core™ i5-8400 CPU @ 2.80GHz Memory: 15.6 GiB of RAM
This is working fine for me now with the new kde & alpaka versions. So I am closing this.
Agree, tested again and works.