Bug 103266 - Search on KDE application manual doesn't work
Summary: Search on KDE application manual doesn't work
Status: RESOLVED FIXED
Alias: None
Product: khelpcenter
Classification: Applications
Component: general (show other bugs)
Version: 3.4
Platform: unspecified Linux
: NOR normal
Target Milestone: ---
Assignee: Documentation Editorial Team
URL:
Keywords:
: 112346 (view as bug list)
Depends on:
Blocks:
 
Reported: 2005-04-05 09:14 UTC by Andrey Cherepanov
Modified: 2016-03-12 23:27 UTC (History)
1 user (show)

See Also:
Latest Commit:
Version Fixed In:
Sentry Crash Report:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Andrey Cherepanov 2005-04-05 09:14:36 UTC
Version:           3.4 (using KDE 3.4.0, compiled sources)
Compiler:          gcc version 3.2.2 20030222 (Red Hat Linux 3.2.2-5)
OS:                Linux (i686) release 2.4.26-01-NeTraverse-i686-SMP-64GB

First I create indef for application manual.

First warning is 
"Creating index for 'kde_application_manuals'
ht://dig Start Time: Tue Apr  5 11:08:51 2005
Warning: unknown locale!"
Why? I set system-wide locale ru_RU.KOI8-R.

After new server determination I see a lot of errors:
1:208:1:help://kmplot/index.docbook:  host not found
2:163:1:help://ksirtet/index.docbook:  host not found
... and so on.

Then "htdig: Run complete
htdig: 268 servers seen:". It seems to be OK?

Possible no! I get a lot of: 
htdig: Errors to take note of:
Unknown host or unable to contact server: help://kmplot/index.docbook Ref: file:///home/cas/.kde/share/apps/khelpcenter/index/kde_application_manuals.tmp/index.html

And at the end:
HTTP statistics
===============
 Persistent connections    : Yes
 HEAD call before GET      : No
 Connections opened        : 0
 Connections closed        : 0
 Changes of server         : 0
 HTTP Requests             : 0
 HTTP KBytes requested     : 0
 HTTP Average request time : 0 secs
 HTTP Average speed        : 0 KBytes/secs

Index doesn't created?
Dialog show "Index creted successful".

Try to search anything in application manual failed.
Comment 1 Luigi Toscano 2016-03-12 21:59:40 UTC
*** Bug 112346 has been marked as a duplicate of this bug. ***
Comment 2 Pino Toscano 2016-03-12 23:06:10 UTC
Git commit 583ed246c75ce2c686957b6e1dc34aaed31206b4 by Pino Toscano.
Committed on 12/03/2016 at 23:01.
Pushed by pino into branch 'master'.

Add Xapian support for indexing and searching

Start using Xapian for indexing and searching the documentation: it
works much better than htp://dig, it provides a C++ API, and it is well
maintained.

Introduce two helper tools to create/update an index, and search on it,
starting from the cache.bz2 files generated by meinproc: this way it is
possible to index the whole text, with the entities already expanded
(something which would not be there when parsing the docbook files
directly). Make use of libxml2 to parse the HTML documents, and get all
the text in them.

Xapian and libxml2 are currently considered as mandatory dependencies:
they are portable, generally available everywhere, and not requiring
themselves too many extra dependencies.
Related: bug 126710, bug 93664, bug 115935, bug 122437, bug 125276, bug 152671, bug 158633, bug 209415, bug 256397, bug 266290

M  +13   -0    CMakeLists.txt
M  +35   -0    searchhandlers/CMakeLists.txt
A  +134  -0    searchhandlers/cachereader.cpp     [License: GPL (v2+)]
A  +49   -0    searchhandlers/cachereader.h     [License: GPL (v2+)]
A  +107  -0    searchhandlers/htmltextdump.cpp     [License: GPL (v2+)]
A  +29   -0    searchhandlers/htmltextdump.h     [License: GPL (v2+)]
A  +5    -0    searchhandlers/xapian.desktop.cmake
A  +126  -0    searchhandlers/xapiancommon.cpp     [License: GPL (v2+)]
A  +50   -0    searchhandlers/xapiancommon.h     [License: GPL (v2+)]
A  +269  -0    searchhandlers/xapianindexer.cpp     [License: GPL (v2+)]
A  +151  -0    searchhandlers/xapiansearch.cpp     [License: GPL (v2+)]

http://commits.kde.org/khelpcenter/583ed246c75ce2c686957b6e1dc34aaed31206b4
Comment 3 Pino Toscano 2016-03-12 23:26:30 UTC
Git commit cafde04221d0f0d20b042f9afcf63669f23b7a1d by Pino Toscano.
Committed on 12/03/2016 at 23:02.
Pushed by pino into branch 'master'.

Re-enable the full-index search

Now that
- Xapian is in place for indexing and searching
- ht://dig is removed
- indexes are updated automatically each startup
we can enable the full-index search again.
Related: bug 57897, bug 93664, bug 112958, bug 115935, bug 161514, bug 173767, bug 207519, bug 222494, bug 237329, bug 266290, bug 269260, bug 269619

M  +1    -3    navigator.cpp

http://commits.kde.org/khelpcenter/cafde04221d0f0d20b042f9afcf63669f23b7a1d
Comment 4 Pino Toscano 2016-03-12 23:27:33 UTC
Git commit 163133768d77ae16e36b31d1174d6c60d53cfdce by Pino Toscano.
Committed on 12/03/2016 at 23:01.
Pushed by pino into branch 'master'.

Remove the ht://dig support

ht://dig is basically unmantained for the past decade, and its
integration in khelpcenter has always been a sort of hack (execute
a CGI, and print its resulting HTML text).

Since Xapian is used as better solution, all of the htp://dig
supporting code can be removed completely.
Related: bug 122437, bug 125276, bug 152671, bug 158633, bug 209415, bug 244091, bug 255384, bug 256397, bug 277464, bug 112958

M  +0    -2    CMakeLists.txt
D  +0    -14   README.htdig
M  +0    -14   doc/khelpcenter/index.docbook
M  +0    -9    docmetainfo.cpp
M  +0    -3    docmetainfo.h
D  +0    -61   htmlsearch.cpp
D  +0    -51   htmlsearch.h
D  +0    -47   htmlsearch/CMakeLists.txt
D  +0    -5    htmlsearch/Messages.sh
D  +0    -23   htmlsearch/checked.xpm
D  +0    -470  htmlsearch/htmlsearch.cpp
D  +0    -254  htmlsearch/htmlsearch.desktop
D  +0    -62   htmlsearch/htmlsearch.h
D  +0    -25   htmlsearch/index.cpp
D  +0    -371  htmlsearch/kcmhtmlsearch.cpp
D  +0    -84   htmlsearch/kcmhtmlsearch.h
D  +0    -52   htmlsearch/klangcombo.cpp
D  +0    -47   htmlsearch/klangcombo.h
D  +0    -246  htmlsearch/ktagcombobox.cpp
D  +0    -92   htmlsearch/ktagcombobox.h
D  +0    -6    htmlsearch/long.html
D  +0    -4    htmlsearch/meinproc_wrapper
D  +0    -21   htmlsearch/nomatch.html
D  +0    -89   htmlsearch/progressdialog.cpp
D  +0    -32   htmlsearch/progressdialog.h
D  +0    -1    htmlsearch/short.html
D  +-    --    htmlsearch/star.png
D  +-    --    htmlsearch/star_blank.png
D  +0    -19   htmlsearch/syntax.html
D  +0    -22   htmlsearch/unchecked.xpm
D  +0    -16   htmlsearch/wrapper.html
D  +0    -156  htmlsearchconfig.cpp
D  +0    -58   htmlsearchconfig.h
M  +0    -1    kcmhelpcenter.cpp
M  +0    -2    kcmhelpcenter.h
M  +2    -14   searchhandlers/CMakeLists.txt
D  +0    -8    searchhandlers/docbook.desktop.cmake
D  +0    -8    searchhandlers/htdig.desktop.cmake
D  +0    -2    searchhandlers/htdig_long.html
D  +0    -222  searchhandlers/khc_docbookdig.pl.cmake
D  +0    -148  searchhandlers/khc_htdig.pl.cmake
D  +0    -117  searchhandlers/khc_htsearch.pl
M  +1    -2    tests/CMakeLists.txt

http://commits.kde.org/khelpcenter/163133768d77ae16e36b31d1174d6c60d53cfdce