Announcement

Collapse
No announcement yet.

Baloo only indexing filenames, not content or metadata

Collapse
This topic is closed.
X
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

    Baloo only indexing filenames, not content or metadata

    I've just upgraded from Kubuntu 14.10 to 15.04. Previously I'd disabled Baloo/Nepomuk indexing and used Recoll instead.

    Now that Baloo seems to be quicker/better I'd like to try it out. Having reset my Baloo configuration files and reindexed, as far as I can see, only filenames are indexed, not metadata or content. How do I get it to index everything?

    #2
    How, What, ....

    How did you test ?
    What did you test ?


    Baloo Links: https://www.kubuntuforums.net/showth...71-Baloo-links
    --> Baloo/Debugging: https://community.kde.org/Baloo/Debugging



    At here:

    1) Making a text file
    2) Copying some text to the file, saving
    Checking if the text file is indexed:
    :~$ balooshow /home/oneline/Balootest/DoYouFindMe.txt
    11558 /home/oneline/Balootest/DoYouFindMe.txt
    Line Count: 4
    3&4) Searching content from Dolphin and KRunner



    Image metadata:
    :~$ balooshow /home/oneline/Pictures/Hot/snapshot-2015-04-26-15-53-48.png
    11559 /home/oneline/Pictures/Hot/snapshot-2015-04-26-15-53-48.png
    Width: 1180
    Height: 444
    Last edited by OneLine; Apr 26, 2015, 07:08 AM.
    Have you tried ?

    - How to Ask a Question on the Internet and Get It Answered
    - How To Ask Questions The Smart Way

    Comment


      #3
      Reindexing

      With the KDE4: http://marc.info/?t=139614360800002&r=1&w=2
      On Sunday, March 30, 2014 11:39:23 AM Lindsay Mathieson wrote:
      > 1. Is the baloo file index stored at: "~.kde/share/apps/baloo/file/" ?
      >

      It was until beta2, for beta3 it has been moved ~/.local/share/baloo/file/

      >
      > 2. Would deleting the above directory be sufficient to fore a reindex of my
      > content?
      >

      No. You will need to tell it to reindex everything as well.

      $ qdbus org.kde.baloo.file /indexer updateAllFolders false
      With the Vivid:
      Code:
      :~$ qdbus org.kde.baloo /indexer
      signal void org.kde.baloo.fileIndexingDone()
      signal void org.kde.baloo.indexingStarted()
      signal void org.kde.baloo.indexingStopped()
      signal void org.kde.baloo.statusChanged()
      method void org.kde.baloo.indexFile(QString path)
      method void org.kde.baloo.indexFolder(QString path, bool forced)
      method void org.kde.baloo.indexXAttr(QString path)
      method bool org.kde.baloo.isIndexing()
      method bool org.kde.baloo.isSuspended()
      method void org.kde.baloo.quit()
      method void org.kde.baloo.removeFileData(int id)
      method void org.kde.baloo.resume()
      method void org.kde.baloo.setSuspended(bool)
      method QString org.kde.baloo.statusMessage()
      method void org.kde.baloo.suspend()
      method void org.kde.baloo.updateAllFolders(bool forced)
      signal void org.freedesktop.DBus.Properties.PropertiesChanged(QString interface_name, QVariantMap changed_properties, QStringList invalidated_properties)
      method QDBusVariant org.freedesktop.DBus.Properties.Get(QString interface_name, QString property_name)
      method QVariantMap org.freedesktop.DBus.Properties.GetAll(QString interface_name)
      method void org.freedesktop.DBus.Properties.Set(QString interface_name, QString property_name, QDBusVariant value)
      method QString org.freedesktop.DBus.Introspectable.Introspect()
      method QString org.freedesktop.DBus.Peer.GetMachineId()
      method void org.freedesktop.DBus.Peer.Ping()
      Have you tried ?

      - How to Ask a Question on the Internet and Get It Answered
      - How To Ask Questions The Smart Way

      Comment


        #4
        Hi OneLine. Thanks for replying quickly with some pointers. Sorry my OP was a bit vague.

        I'd been used balooshow to test what information is stored by baloo. All I get for any file is:
        ~$ balooshow balootest.txt
        20114 /home/chris/balootest.txt
        And so in Dolphin or KRunner I can only search for filenames, not content/metadata.

        I've tried running
        qdbus org.kde.baloo /indexer updateAllFolders false
        balooctl status showed that it was doing some reindexing, but again, balooshow gave the same result.

        Any thoughts about what to try next?

        Comment


          #5
          I would...

          I would make a new user.

          Log in as the new user and test the indexing.

          If the indexing is working as the new user I would try to clean the old user configuration files.
          If the indexing is not working as the new user ... well... I would make a new installation.

          Comment


            #6
            Thanks.

            I made a new user and tested the indexing. Same issue: only filenames indexed, not content.

            Re-installation is quite an ask. Anything else I could try first?

            Comment


              #7
              Something to try...

              Try to run the baloo_file_extractor with the debug option.

              :~$ baloo_file_extractor --help
              Usage: baloo_file_extractor [options] urls
              The File Extractor extracts the file metadata and text

              Options:
              -h, --help Displays this help.
              -v, --version Displays version information.
              --debug Print the data being indexed
              --ignoreConfig Ignore the baloofilerc config and always index the file
              --db <path> Specify a custom path for the database

              Arguments:
              urls The URL/id of the files to be indexed
              Any errors ? - something like :
              ...
              "/path/to/file.type" should not be indexed. Ignoring
              ------- IO ---------
              Read: 226 kb
              Write: 0 kb
              Actual Reads: 0 kb
              Actual Writes: 0 kb
              Are the data extractors installed ?
              At here:

              :~$ locate kfilemetadata | grep extractor
              /usr/include/KF5/KFileMetaData/kfilemetadata/extractor.h
              /usr/include/KF5/KFileMetaData/kfilemetadata/extractorcollection.h
              /usr/include/KF5/KFileMetaData/kfilemetadata/extractorplugin.h
              /usr/lib/kde4/kfilemetadata_epubextractor.so
              /usr/lib/kde4/kfilemetadata_exiv2extractor.so
              /usr/lib/kde4/kfilemetadata_ffmpegextractor.so
              /usr/lib/kde4/kfilemetadata_mobiextractor.so
              /usr/lib/kde4/kfilemetadata_odfextractor.so
              /usr/lib/kde4/kfilemetadata_office2007extractor.so
              /usr/lib/kde4/kfilemetadata_officeextractor.so
              /usr/lib/kde4/kfilemetadata_plaintextextractor.so
              /usr/lib/kde4/kfilemetadata_popplerextractor.so
              /usr/lib/kde4/kfilemetadata_taglibextractor.so
              /usr/lib/x86_64-linux-gnu/qt5/plugins/kf5/kfilemetadata/kfilemetadata_epubextractor.so
              /usr/lib/x86_64-linux-gnu/qt5/plugins/kf5/kfilemetadata/kfilemetadata_exiv2extractor.so
              /usr/lib/x86_64-linux-gnu/qt5/plugins/kf5/kfilemetadata/kfilemetadata_ffmpegextractor.so
              /usr/lib/x86_64-linux-gnu/qt5/plugins/kf5/kfilemetadata/kfilemetadata_odfextractor.so
              /usr/lib/x86_64-linux-gnu/qt5/plugins/kf5/kfilemetadata/kfilemetadata_office2007extractor.so
              /usr/lib/x86_64-linux-gnu/qt5/plugins/kf5/kfilemetadata/kfilemetadata_officeextractor.so
              /usr/lib/x86_64-linux-gnu/qt5/plugins/kf5/kfilemetadata/kfilemetadata_plaintextextractor.so
              /usr/lib/x86_64-linux-gnu/qt5/plugins/kf5/kfilemetadata/kfilemetadata_poextractor.so
              /usr/lib/x86_64-linux-gnu/qt5/plugins/kf5/kfilemetadata/kfilemetadata_popplerextractor.so
              /usr/lib/x86_64-linux-gnu/qt5/plugins/kf5/kfilemetadata/kfilemetadata_taglibextractor.so
              /usr/share/kde4/services/kfilemetadata_epubextractor.desktop
              /usr/share/kde4/services/kfilemetadata_exiv2extractor.desktop
              /usr/share/kde4/services/kfilemetadata_ffmpegextractor.desktop
              /usr/share/kde4/services/kfilemetadata_mobiextractor.desktop
              /usr/share/kde4/services/kfilemetadata_odfextractor.desktop
              /usr/share/kde4/services/kfilemetadata_office2007extractor.desktop
              /usr/share/kde4/services/kfilemetadata_officeextractor.desktop
              /usr/share/kde4/services/kfilemetadata_plaintextextractor.desktop
              /usr/share/kde4/services/kfilemetadata_popplerextractor.desktop
              /usr/share/kde4/services/kfilemetadata_taglibextractor.desktop
              /usr/share/kde4/servicetypes/kfilemetadataextractor.desktop
              Note:
              /usr/include/KF5/KFileMetaData/kfilemetadata/extractor.h
              /usr/include/KF5/KFileMetaData/kfilemetadata/extractorcollection.h
              /usr/include/KF5/KFileMetaData/kfilemetadata/extractorplugin.h
              are from development package so you probably don't have those.


              Try to reinstall the:

              libkf5filemetadata-bin
              libkfilemetadata4

              Code:
              sudo apt-get install --reinstall <package>
              Last edited by OneLine; Apr 28, 2015, 01:05 PM.
              Have you tried ?

              - How to Ask a Question on the Internet and Get It Answered
              - How To Ask Questions The Smart Way

              Comment


                #8
                Great - thanks. That last bit did the trick - libkf5filemetadata-bin wasn't installed. Indexing of content now working.

                Do you think I should report it as a possible bug in the upgrade process? I won't be able to reproduce it, but surely libkf5filemetadata-bin should have been installed in the update?

                Comment


                  #9
                  libkf5filemetadata-bin ?

                  Do you think I should report it as a possible bug in the upgrade process?
                  If you did have the kubuntu-desktop package installed before the upgrade and you did have the default setting ' install recommended' on - then I think that it is a bug.


                  Ubuntu packages:

                  Package: kubuntu-desktop: http://packages.ubuntu.com/vivid/kubuntu-desktop
                  --> depends: Package: baloo-kf5: http://packages.ubuntu.com/vivid/baloo-kf5
                  -----> depends: Package: libkf5filemetadata3: http://packages.ubuntu.com/vivid/libkf5filemetadata3
                  --------> recommends: Package: libkf5filemetadata-bin: http://packages.ubuntu.com/vivid/libkf5filemetadata-bin
                  Have you tried ?

                  - How to Ask a Question on the Internet and Get It Answered
                  - How To Ask Questions The Smart Way

                  Comment


                    #10
                    OK - no, not a bug then, since I had previously disabled the 'install recommended' feature to avoid 'unnecessary' packages. Clearly it would have been wisest to re-enable this before doing the upgrade!

                    Is there a simple way to check whether or not other recommended packages are installed that should have been part of the upgrade?

                    Comment


                      #11
                      My baloo is also not searching content, only filename.

                      But, in my case, all libs are installed.
                      balooctl status shows:

                      Code:
                      Baloo File Indexer is running
                      Indexed 1416 / 10788 files
                      I also reinstalled libkf5filemetadata-bin and libkfilemetadata4 and ran qdbus org.kde.baloo /indexer updateAllFolders false. No results...

                      Any other suggestion?
                      Kubuntu 15.10 - Asus All-in-one (i3, 4GB ram)

                      Comment


                        #12
                        I can't make baloo searches inside documents.
                        I tried to remove the config files, force indexation, reinstall the baloo package and nothing changes...

                        When I create a new file and search for it, this is the output:

                        Code:
                        balooshow /home/leo/teste.txt
                        No index information found
                        And nothing changes neither after running qdbus org.kde.baloo /indexer updateAllFolders false

                        What am I doing wrong? Any clues?
                        Kubuntu 15.10 - Asus All-in-one (i3, 4GB ram)

                        Comment


                          #13
                          balooctl status shows:

                          Code:
                          Baloo File Indexer is running
                          Indexed 1416 / 10788 files
                          Wait a moment - the indexing is not ready - only 1416 files of the 10788 has been indexed.


                          When I create a new file and search for it, this is the output:

                          Code:
                          balooshow /home/leo/teste.txt
                          No index information found

                          And nothing changes neither after running qdbus org.kde.baloo /indexer updateAllFolders false


                          Have you tried to manual force the indexing of the
                          /home/leo/teste.txt ?

                          What is the output of
                          Code:
                          [FONT=monospace]baloo_file_extractor [/FONT]/home/leo/teste.txt

                          The KDE Forums ( https://forum.kde.org ) has a sub forum: https://forum.kde.org/viewforum.php?f=154 . The Baloo developer is following it.

                          Comment


                            #14
                            First: baloo_file_extractor /home/leo/teste.txt
                            Code:
                            "/home/leo/.local/share/baloo/file/" true
                            Removing: 0 docs
                            Adding: 1 docs
                            Xapian Committed
                            Second: balooshow /home/leo/teste.txt
                            Code:
                            2 /home/leo/teste.txt
                                    Line Count: 1
                            And now Dolphin is finding the content of that particular file.

                            Wheel inventor said "the indexing is not ready". What can I do to make it scan my HD? It is turned on but the number of scanned files never changes...
                            Kubuntu 15.10 - Asus All-in-one (i3, 4GB ram)

                            Comment


                              #15
                              First: baloo_file_extractor /home/leo/teste.txt
                              Code:
                              "/home/leo/.local/share/baloo/file/" true
                              Removing: 0 docs
                              Adding: 1 docs
                              Xapian Committed
                              Second: balooshow /home/leo/teste.txt
                              Code:
                              2 /home/leo/teste.txt
                                      Line Count: 1
                              And now Dolphin is finding the content of that particular file.

                              Wheel inventor said "the indexing is not ready". What can I do to make it scan my HD? It is turned on but the number of scanned files never changes...
                              Kubuntu 15.10 - Asus All-in-one (i3, 4GB ram)

                              Comment

                              Working...
                              X