Question

Related to IncludeTopicsAndWebPages:

When trying to include some part of information from twiki.org, e.g. as in

%INCLUDE{ "http://twiki.org/cgi-bin/view/Plugins/PublishWebPluginDev" pattern=".*patternRevInfo\">([^>]+>[^>]+>).*" }%

Forbidden

You don't have permission to access /cgi-bin/view/Plugins/PublishWebPluginDev on this server.

Test to see whether it works (if something like "r52 - 13 Sep 2006 - 16:43:06 - PeterThoeny" does not appear, it doesn't work): Failed to include URL http://twiki.org/cgi-bin/view/Plugins/PublishWebPluginDev Protocol scheme 'https' is not supported (LWP::Protocol::https not installed)

Environment

-- WolfgangSlany - 19 Sep 2006

Answer

If you answer a question - or someone answered one of your questions - please remember to edit the page and set the status to answered. The status selector is below the edit box.

For security and performance reasons we block most scripted access to twiki.org, including access from TWiki itself. If you install TWiki on your site you will be able to screen scrape your own pages.

-- PeterThoeny - 19 Sep 2006

Thank you. I saw your answer only after my last edit --- just ignore it. wget works as a workaround.

-- WolfgangSlany - 20 Sep 2006

Wget doesn't work for accessing twiki org. This makes it extremely frustrating to install plugins as instead of simply wgeting, people must now download to a desktop, then bring over to install machine.

-- EricHanson - 21 Dec 2007

pass the -U or --user-agent= command line parameter to wget and then it will work.

-- WillNorris - 22 Dec 2007