Bug 265452

Summary: onscreen keyboard with word completion feature
Product: [Unmaintained] plasma4 Reporter: Kyle <kylepablo>
Component: widget-miscAssignee: Björn Ruberg <bjoern>
Status: RESOLVED UNMAINTAINED    
Severity: wishlist CC: a9016009, bhubbard, bjoern, cfeck, gladhorn, gortab, jononor, kossebau, michael, notmart, rdieter, thomas.pfeiffer
Priority: NOR    
Version: unspecified   
Target Milestone: ---   
Platform: Unlisted Binaries   
OS: Linux   
Latest Commit: Version Fixed In:
Sentry Crash Report:
Attachments: Dictionary

Description Kyle 2011-02-04 20:38:03 UTC
Version:           4.5 (using KDE 4.5.5) 
OS:                Linux

Can we implement a word completion feature for a new onscreen keyboard? The accessability tools are limited and having an onscreen keyboard that is similar to Windows 7's in features and design would be beneficial for those who have difficulty typing (I have muscular dystrophy) so I use an onscreen keyboard (xvkd which is archaic)..

Reproducible: Didn't try
Comment 1 Björn Ruberg 2011-02-06 17:34:59 UTC
We have an onscreen keyboard in kdeplasma-addons. It does not offer word completion. If someone can inspire me how to get this done technically (where to get the words from?) and how to include it in the interface, I'd be glad to hear.
Comment 2 Kyle 2011-02-06 18:00:28 UTC
Created attachment 56925 [details]
Dictionary

Attached is a dictionary file used by GOK.
Comment 3 Björn Ruberg 2011-02-06 18:11:29 UTC
That's a way - but only for english language.
Comment 4 Kyle 2011-02-07 23:30:52 UTC
Look at xvkbd. It has a horrible implementation of word completion. But the right idea.

http://homepage3.nifty.com/tsato/xvkbd/
Comment 5 Kyle 2011-02-19 00:45:01 UTC
What about porting over android keyboard word completion feature?
Comment 6 Friedrich W. H. Kossebau 2011-04-15 23:10:22 UTC
My suggestion would be to try Maliit [M], a cross graphical user interface 
toolkit input method framework (comes with a virtual keyboard reference 
implementation). Within the Maliit framework, error correction/prediction 
engines can be implemented as plugins.

While currently basically developed for MeeGo it is usable in other GNU/Linux 
distributions as well, there are packages referenced at [P]. Maliit already 
has connectors to the input method systems of Qt as well as GTK, so e.g. the 
same virtual keyboard is coming up for programs using any of these toolkits. 
See also the blog of one of my co-workers at Openismus, Michael [B] :)

IIRC there are a QML and a MeeGo Touch variant of the reference virtual keyboard. Porting the Plasma keyboard to be a plugin to Maliit would be an interesting idea. Maliit is currently very actively developed, but also already production-ready, so a perfect time for joining the effort and to see to adapt/expand it to own needs, like for a Plasma-styled keyboard variant.

[M] http://wiki.meego.com/Maliit
[P] http://wiki.meego.com/Maliit/ForDevelopers
[B] http://taschenorakel.de/tags/meego-input-methods/
Comment 7 Kyle 2011-05-02 21:48:25 UTC
Can we get some votes?
Comment 8 Kyle 2011-05-08 02:02:41 UTC
Porting over android's word completion feature should be considered.  I can type faster on my android phone compared to using an onscreen keyboard on my computer.
Comment 9 Michael Hasselmann 2011-06-10 03:44:34 UTC
Maliit seems to work with Plasma:
http://i.imgur.com/bbVmf.jpg
Comment 11 Thomas Pfeiffer 2012-05-26 17:23:24 UTC
Currently, Marco Martin (notmart) is implementing a QML frontend for Maliit for Plasma Active. See http://www.notmart.org/index.php/Software/Maliit_and_Plasma_Active . Maybe this can be used for Plasma Desktop as well?
It doesn't have word completion yet either, but the Maliit framework supports it and Marco plans to implement it at some point.
Comment 12 Marco Martin 2012-05-29 12:34:07 UTC
The current implementation isn't ready for the desktop, some issue still remain, connected to the qml based plugins in maliit, but i definitely agree that should be in plasma desktop as well.
Comment 13 Michael Hasselmann 2012-05-29 12:37:01 UTC
Maliit uses Presage for word prediction, which takes surrounding text into account, see http://mikhas.posterous.com/maliit-keyboard-now-with-word-prediction-and

@Kyle: Is that actually enough for your needs, or would you need auto-commit of the primary word candidate?
Comment 14 Björn Ruberg 2012-05-29 12:50:01 UTC
Can someone point me to a libary, that does the word completion? If there is one, I think I can implement a word completition similar as I've seen in this malit video above.
Comment 15 Kyle 2012-05-29 14:31:00 UTC
(In reply to comment #13)
> Maliit uses Presage for word prediction, which takes surrounding text into
> account, see
> http://mikhas.posterous.com/maliit-keyboard-now-with-word-prediction-and
> 
> @Kyle: Is that actually enough for your needs, or would you need auto-commit
> of the primary word candidate?

Michael,

Yes it does seem what I am looking for.  The ability to type a few letters then select a word from a list as shown in the video.  Typing each word out is tedious.   Are you familiar with Windows 7 on-screen keyboard and Android's word prediction feature?  Same concept.  This looks promising!!
Comment 16 Michael Hasselmann 2012-05-30 18:10:51 UTC
The Windows 7 virtual keyboard is very accurate in its predictions, even if you don't hit the letters properly. This is what we need to improve still, in Maliit. But I feel that with Presage, we made the right technology choice already.
Comment 17 Kyle 2012-05-30 19:23:50 UTC
Michael,

I look forward to seeing it implimented.  Typing for me is tedious.  Let me know if I can help out by testing it.
Comment 18 Michael Hasselmann 2012-06-01 18:15:06 UTC
The most pressing need is probably packaging for distros that use KDE, and then to figure out how much integration Maliit needs in KDE proper (with Plasma).

We have some packaging done for Ubuntu and Fedora (currently not working, see https://build.opensuse.org/package/show?package=maliit-plugins&project=M17N%3AMaliit and https://build.opensuse.org/package/show?package=maliit-framework&project=M17N%3AMaliit), but we'd also need to get Presage packaged properly (Presage at least has proper Debian packaging, see http://packages.debian.org/sid/libpresage1).

Without proper packaging, software doesn't exist for regular users.
Comment 19 Kyle 2012-08-06 17:40:37 UTC
Any progress?
Comment 20 Michael Hasselmann 2012-08-06 18:23:10 UTC
Sorry for letting you wait, but it's really the packaging and KDE integration that would need the help from someone who knows the inner working of KDE (so not me).

I'd be glad to help but I simply don't have the time to do everything myself :-(
Comment 21 Kyle 2012-09-24 01:28:32 UTC
Hello,

I have an idea.  Since we need kde developers to get this integrated into KDE how about I start a Kickstarter project to raise $$$ for this?  Feedback, Ideas, Criticism are all welcome.

Kyle
Comment 22 Frederik Gladhorn 2012-09-26 00:00:21 UTC
I think we can only do that if we have someone that is actually committed to implementing this. I think it might be a good idea, but it's a bit hard to find someone if you just had the money. I'm not sure if anyone is around willing to do that.

On another note, I checked the current state of the plasma-active-maliit and talked to Aaron Seigo a bit about it. It is probably the most promising we have with a solid foundation. But currently it is still extremely basic and needs work, especially for autocompletion, but also in several other areas such as layout switching.
Comment 23 Michael Hasselmann 2013-02-22 06:08:04 UTC
Kyle, there should now be Maliit packages for Debian & (K)Ubuntu. It's all very experimental still, but feedback is appreciated.
Comment 24 Kyle 2013-03-09 21:38:03 UTC
(In reply to comment #23)
> Kyle, there should now be Maliit packages for Debian & (K)Ubuntu. It's all
> very experimental still, but feedback is appreciated.

I'm using Fedora and there are Maliit packages but it is buggy.  Plus there was no word completion feature included.
Comment 25 Kyle 2013-09-12 19:04:24 UTC
What is the status of this?  Any progress?
Comment 26 Kyle 2013-09-22 02:29:57 UTC
*** Bug 234483 has been marked as a duplicate of this bug. ***
Comment 27 Kyle 2013-12-03 03:37:35 UTC
The link below demonstrates the need for an onscreen keyboard with a word completion feature.  Feel free to contact me for questions.

http://tinyurl.com/KeyboardVideoLinux
Comment 28 Brad Hubbard 2013-12-14 01:04:59 UTC
(In reply to comment #18)
> 
> Without proper packaging, software doesn't exist for regular users.

I'll see what i can do on the fedora side.
Comment 29 ray-ven 2014-03-14 14:57:13 UTC
really need maliit for kde-desktops. Won't work in Kubuntu Trusty by now
Comment 30 Kyle 2014-06-18 16:29:48 UTC
Status update?
Comment 31 Nate Graham 2018-06-08 20:10:25 UTC
Hello!

This feature request was filed for KDE Plasma 4, which reached end-of-support status in August 2015. KDE Plasma 5's desktop shell has been almost completely rewritten for better performance and usability, so it is likely that this feature request is already implemented in Plasma 5, or is no longer applicable.

Accordingly, we hope you understand why we must close this feature request. If the requested feature is still desired but not implemented in KDE Plasma 5.12 or later, please feel free to open a new ticket in the "plasmashell" product after reading https://community.kde.org/Get_Involved/Bug_Reporting

If you would like to get involved in KDE's bug triaging effort so that future mass bug closes like this are less likely, please read https://community.kde.org/Get_Involved#Bug_Triaging

Thanks for your understanding!

Nate Graham