create new tag
, view all tags

What constitutes testing of extensions?

Every extension has a field that indicates what major versions it has been "tested on". If set by the author, it's probably been reasonably well tested, but, other than that, it probably indicates that someone has succeeded in using it on that version and not that it's been tested by any reasonable definition of the word.

Given that this is an OSS project, which means we don't have a QR department, I'm not sure it's possible to go farther than "seems to work", but it's worth discussing. (I'm not recommending we change the label to that, just pointing out what the field usually means.)

If, as has been asserted by at least a few, over 50% of the value of TWiki are the plugins, this is not a minor issue. It hurts TWiki's reputation if people see the "tested on" field and believe the TWiki developers are vouching for a plugin which doesn't work well. At the same time, obviously we don't want to discourage people from contributing plugins.

-- MeredithLesly - 06 Jun 2006


There are way more than 30 plugins that work in Dakar. Folks need to update the individual plugin pages when they successfully use a plugin in Dakar to note that it's been tested!

-- MeredithLesly - 02 Mar 2006

You are not supposed to edit the Plugin topics. It says so on most of them. They automatically get overwritten when a new version is released. So why do you expect users to suddenly edit those topics?

It is actually worrying that TWiki is quickly turning away from being a wiki and into being a traditional webmasters syndrome site. Documentation for TWiki and Plugin docs are all static where you have to request updated from the "webmaster" via a bug report.

-- KennethLavrsen - 02 Mar 2006

what the? TWiki releases have always had this issue. previously, it was just the core group, and mostly Peter I think who you would 'request' to have make a change in the next release, by submitting a patch to a topic, or editing the TWiki web here - and he would painstakingly work out what needed to be merged across.

Now at least, you have half a clue as to what needs to be done, and the work is openly distributable via the Bugs web.

I still contend however, that a static TWiki and Plugins web on twiki.org is not the intended solution, I always expected that someone would find it annoying, and thus finish the work on the Subversion based Store (Subversive.pm) so that editing those would go straight to svn. (and I'm pretty sure that we can figure out something wrt Bug Items too)

-- SvenDowideit - 02 Mar 2006

The form attached to the extension topic does not change when a Plugin topics is updated via build, so it is OK to change the form fields values.

The *Dev topic is supposed to be a place to provide feedback, but I have seen that some changes to the Plugin topic with feedback on the Dev topic get ignored. It would be helpful if developers check the Dev topics more before updating a Plugin.

-- PeterThoeny - 03 Mar 2006

There is also the problem of defining what being tested means. If I'm running a plugin successfully on a TWiki install, does that mean it's been tested? One install hardly counts as even semi-rigorous testing, after all.

-- MeredithLesly - 08 Mar 2006

(I put in Meredith's signature and the CommentPlugin line - something must have busted the page 'cos they were missing.)

I agree - someone installing a plugin at home on whatever they're running doesn't really qualify as software testing. Plugins don't get the same testing process as core TWiki, but many (most?) of us surely use plugins for critical features of our TWiki installations/applications. We don't have a lower level of tolerance just because a plugin's involved. This implies that plugins should get the same level of testing as TWiki core. Which may not happen, but something a bit more rigorous than "yeah it worked for me" seems called for. Voting? Scores? A chunk of the plugin's Appraisal page (or another "Plugin testing" page) that gets summarised/included on the main Plugin page?

-- MarcusLeonard - 08 Mar 2006

Discussion to this point moved from ExtensionsTestedOnTWiki04x00

Topic revision: r1 - 2006-06-06 - MeredithLesly
  • Learn about TWiki  
  • Download TWiki
This site is powered by the TWiki collaboration platform Powered by Perl Hosted by OICcam.com Ideas, requests, problems regarding TWiki? Send feedback. Ask community in the support forum.
Copyright © 1999-2018 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.