create new tag
, view all tags

Bug: Formatted search doesn't show all results

FormattedSearch in the InternetExplorerSidebar has started to show very old links about half way down, e.g. pages from May or June, even though Codev has been busy recently. Also happens on other webs.

Test case

Click on Main.WebSidebarIEAll and compare to Codev's Changes link - even though minor changes don't show up in the Changes list, that doesn't explain the discrepancy. Not sure when this started happening, but I think it might be the last day or so - has anything changed in TWiki.org's code?

Actual SEARCH string is, with URLPARAM and HTML omitted for readability:

%SEARCH{".*" web="Codev" regex="on" nosearch="on" order="modified" reverse="on"
    nototal="on" limit="18" format=" .... actual HTML here links to $topic ....."}%

Actual results - curiously, topics such as NbspBreaksRssFeed are not present below at time of writing, but are listed in my sidebar, about 2/3 of the way down, refreshed a few minutes ago... Also, the topic InternetExplorerSidebar appears below (at time of writing) but not in the sidebar...



TWiki version: TWiki.org
TWiki plugins: TWiki.org
Server OS: TWiki.org
Web server: TWiki.org
Perl version: TWiki.org
Client OS:  
Web Browser:  

-- RichardDonkin - 20 Jul 2002

Follow up

The last 'recent' topic seems to be VerbatimFailsOnSomeTags, but the same problem happens on other topics so I don't think it's dependent on a certain topic. This is the tenth topic in the sidebar.

Changing the search to only look for topic names did not fix the problem. Side note: The various sidebar searches should all include scope="topic" in the SEARCH, to avoid actually searching topic text when all that's needed is the topic name.

WebChanges has a similar problem, but not identical - there are a lot of missing topics between 5th and 16th July, for example. However, http://twiki.org/cgi-bin/changes/Codev is OK.

-- RichardDonkin - 20 Jul 2002

This is probably an artifact of renaming the Test web to Sandbox, I did that on Friday. I created a small script to patch existing topics that point to the topics in the Test web, i.e. Test.SomeTopic, [[Test.SomeTopic]], [[Test.SomeTopic][some label]], web="Test.SomeTopic". The script changed the file time stamp of about 30 topics in the Codev web; search sorted by modfication date has an algorithm tuned for performance that fails in this unusual case: For performance not all topics are opened to find out the time stamp. Rather, file are sort by timestamp (to get a rough list); the list is shortened to the limit plus a slack of 20 topics; then the shortened list is sorted by rev date to get the acurate list.

So, my guess is: All should be fine after a few days.

For refereence, here is the lo of changed topics when renaming the Test to Sandbox:

-- PeterThoeny - 21 Jul 2002

Fix record

Seems to have fixed itself as described by Peter - however, I'm curious why the changes script didn't have this problem. Perhaps we could make the other routines use the same algorithm as this script, to make them more robust against this sort of change?

As for the script, it would be possible to make it record and re-instate the last-modified time (using the touch command or a Perl equivalent), avoiding this problem completely.

-- RichardDonkin - 22 Jul 2002

The changes script is based on the .changes file, which gets updated when saving a topic with "Minor changes" unchecked. Search must not depend on the "Minor changes" flag, only on the actual modification time of the topics. We could easily change the algorithm to look always for the RCS timestamp, but that would be a big performance loss. My quick-and-dirty hack was a one time thing. My recommendation: Keep the algorithm as it is.

-- PeterThoeny - 22 Jul 2002

Edit | Attach | Watch | Print version | History: r6 < r5 < r4 < r3 < r2 | Backlinks | Raw View | Raw edit | More topic actions
Topic revision: r6 - 2006-02-04 - PeterThoeny
  • Learn about TWiki  
  • Download TWiki
This site is powered by the TWiki collaboration platform Powered by Perl Hosted by OICcam.com Ideas, requests, problems regarding TWiki? Send feedback. Ask community in the support forum.
Copyright © 1999-2017 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.