Bug: Grave Inline Search Error when Web Size grows very big

When more than a thousand Topics are in a Web, the WebChanges, WebIndex and all Inline Search does not yield ANY results! The Apache error log file states: sh: /usr/bin/egrep: arg list too long

any workarounds despite reducing the arg list ie topics of the web by deleting ? is there an official maximum of Topics in a Web ?

Test case

Environment

-- SvenVowe - 12 May 2003

Follow up

First of all, congratulations on having a successful TWiki ... See Google:twiki+xargs (ArgumentListTooLong) for a fairly simple solution to this. Should really go into the TWiki core as a commented-out line in TWiki.cfg, ready to be uncommented when sites hit this limit (which varies depending on the Unix version by the way).

-- RichardDonkin - 12 May 2003

Fix record

This is now fixed, is in TWikiAlphaRelease and at TWiki.org. This is part of working on SearchTopicNameAndTopicText, ExcludeWebTopicsFromSearch, SearchWithNoPipe, ArgumentListIsTooLongForSearch, SearchWebHasTooManyParameters, SiteMapIsSlow.

How: The Search module first gets all topics in a web, then calls the external grep with sets of up to 512 files at a time.

-- PeterThoeny - 01 Nov 2003