Tags:
create new tag
, view all tags

The Sun V240 server hosted by Fastmetrics is now the live TWiki.org web server

We have moved TWiki.org to our own server (with unchanged twiki.org URL) because SourceForge announced that:

> On 2005-05-23, we will be remounting project group directories read-only on the > project web servers (they will remain read-write from the shell server).

In other words, TWiki.org's TWiki would be read-only, not very useful as all would agree I guess.

We got a very generous offer for a free Sun V240 server.

AndreasGlocker, CEO of Fastmetrics generously offers us to host the twiki server at his company for free!

we now have 4 new hostnames to use (they are all pointing at the same place for now)

-- PeterThoeny & SvenDowideit


Great job - thanks a lot!

-- BenoitFauvel - 20 Jun 2005

Good work. This much faster.

Now we have better access as well - meaning we can consider WebDav access and automated mail-out to InterestedParties

-- MartinCleaver - 20 Jun 2005

I can only say "WOW".

Good work smile

-- RafaelAlvarez - 20 Jun 2005

Peter and Sven; a heartfelt thank you from all of us. I am well aware of the work both of you put in to make this happen!

-- CrawfordCurrie - 20 Jun 2005

The first time I loaded the page about the new server took a few moments to load. Is it possible it could have been Twikied (like slashdotted)?? smile Congrats and Thanks!

-- MichaelGindonis - 20 Jun 2005

Hey, congratulations for the work with this! I'm sure this new server will improve the work on TWiki even more. big grin

-- AntonioTerceiro - 21 Jun 2005

Yes, I like all this

-- AndreaOlgiati - 23 Jun 2005

CLAP CLAP CLAP CLAP

-- MattWilkie - 23 Jun 2005

I noticed that newly edited topics do not show the new text that was edited until one performs a refresh of the webpage -- like just now when I added via the CommentPlugin, then I added more text via regular EDIT and the same thing happened. I was under the impression that this was an artifact from using the TWikiCacheAddOn, but according to Sven the cache addon has been turned off. So, anyone else seeing this behavior?

-- SteveRJones - 28 Jun 2005

Hmmm, I just added some stuff to the previous comment and the new text showed up with a refresh. The only difference that I see is that I spent a little more time typing.

-- SteveRJones - 28 Jun 2005

testing to see if i get the same thing Steve reports. Added to the comment using edit... - yep, i see the edited text as soon as i hit save... Sorry Steve - I can't reproduce... What browser are you using? (FireFox on Winblows for me)

-- SvenDowideit - 28 Jun 2005

Ok, here goes again -- I am now at home trying this

-- SteveRJones - 29 Jun 2005

Blast it! I swear it did it twice when I first created the entry -- now it doesn't. Yes, FireFox on Win XP Pro - at home and at work. trying to modify this from edit mode . .

-- SteveRJones - 29 Jun 2005

Sven, I can't make it do it again - but I swear I get this behavior elsewhere. Something else I noticed - maybe related - the main twiki.org page does not come through with the CSS applied, but all other twiki pages are rendered correctly. Is the main page a regular web page?

-- SteveRJones - 29 Jun 2005

yeah, the main page is a regular web page - i'll take a look later today (i'll bet that the behavior is reall, and very very cache / net connection dependant)

-- SvenDowideit - 29 Jun 2005

E.g. Microsoft ISA server has a problem with twiki.org, (often) showing a cached view after save. Perhaps a (default/hidden) proxy at work makes the difference between the different browser behaviour at home/work, Steve?

-- SteffenPoulsen - 29 Jun 2005

This could very well be the source of the problem - we do sit behind MS proxy servers at work - and at home I do not smile

Strange thing is, I never saw this behavior until the temp server came online, then when the new V240 came online the caching behavior got better but never went away completely.

-- SteveRJones - 29 Jun 2005

This server is starting to feel the load, so i've begun a more detailed investigation (i was hoping i had a few more months)

one stat that is interesing, is the total Bandwidth used to serve pages - this is the top 41 - the last column is the total Bandwidth use to serve the page over the last 24 days (attachements, images css inclusive i think)

the total BW used for this period is 31GB - more than all of July

pages-url Viewed Average size (KB) Entry Exit total BW (MB)
/swd/TWiki20040902.zip 2588 2200.00 144 734 5560.15625
/cgi-bin/xtra/tzdate 149227 35.58 13523 13420 5185.055332
/swd/TWiki20040902.tar.gz 2065 1590.00 255 565 3206.396484
/release/TWiki20041030beta.zip 440 2230.00 37 135 958.203125
/ 45698 12.78 32903 16507 570.3324609
/cgi-bin/search/TWiki/ 2967 157.85 150 302 457.364209
/cgi-bin/view/Codev/WebRss 29176 8.37 6696 7469 238.4796094
/cgi-bin/view/Codev/WebIndex 177 1260.00 18 34 217.7929688
/cgi-bin/view/TWiki/TWikiDocumentation 5796 35.04 430 290 198.331875
/cgi-bin/view/TWiki/TWikiInstallationGuide 5817 32.67 471 1796 185.5872949
/cgi-bin/view/Plugins/PluginPackage 4470 38.17 257 565 166.6209961
/cgi-bin/view/Plugins/WebRss 23041 7.32 5976 4301 164.7071484
/cgi-bin/view/TWiki/WebRss 20066 8.36 7604 7403 163.8200781
/cgi-bin/view/TWiki/TWikiDocGraphics 1758 90.99 110 147 156.2113477
/cgi-bin/view/Main/DavidBarreiro 24568 5.92 16491 16396 142.03375 I've just removed the inline image to reduce this
/cgi-bin/view/Main/TWikiInstallation 1292 101.38 134 233 127.9130469
/cgi-bin/view/Main/TWikiUsers 1343 86.40 20 173 113.315625
/cgi-bin/view/TWiki/WebHome 9087 12.30 498 857 109.1504883
/cgi-bin/view/Support/WebRss 13344 8.12 1592 2248 105.81375
/cgi-bin/view/TWiki/WindowsInstallCookbook 2701 35.42 360 915 93.42716797
/cgi-bin/view/Sandbox/WebHome 4610 18.55 142 478 83.51123047
/cgi-bin/view/Main/WebRss 9400 8.80 1262 1538 80.78125
/cgi-bin/view/Codev/TWikiUserGroupsInGermany 116 620.02 83 71 70.23664063
/cgi-bin/view/TWiki/TWikiHistory 817 80.38 180 169 64.13130859
/cgi-bin/view/TWiki/WelcomeGuest 3322 18.49 107 554 59.98416016
/p/pub/TWiki/TWikiDrawPlugin/twikidraw.jar 388 152.69 3 10 57.85519531
/cgi-bin/view/Support/WebHome 1817 32.16 101 148 57.06515625
/p/pub/Plugins/WysiwygPlugin/WysiwygPlugin.zip 152 355.60 7 18 52.784375
/cgi-bin/view/Plugins/WebHome 4743 10.45 359 361 48.40268555
/cgi-bin/view/TWiki/TWikiVariables 1351 34.37 115 254 45.34557617
/cgi-bin/view/Codev/TWikiUserGroupsInUnitedKingdom 108 429.09 60 55 45.25558594
/cgi-bin/view/Main/WebHome 4872 9.41 222 697 44.77101563
/cgi-bin/view/Codev/WebTopicList 215 211.70 13 44.44873047
/cgi-bin/viewauth/Support/AnsweredQuestions 111 391.34 8 42.42064453
/cgi-bin/view/Plugins/AddOnPackage 2058 20.50 86 191 41.20019531
/cgi-bin/view/Codev/WebChangesForAllWebs 2329 17.70 408 241 40.25712891
/cgi-bin/view/Plugins/SpreadSheetPlugin 870 47.11 88 143 40.02509766
/cgi-bin/view/TWiki/TextFormattingRules 1857 21.89 334 643 39.69700195
/p/pub/Plugins/TWikiDrawPlugin/TWikiDrawPlugin.zip 166 233.27 13 32 37.81525391
/download.html 8028 4.63 675 917 36.29847656

-- SvenDowideit - 25 Aug 2005

Could we just disable the tzdate program? It's a nice service to provide but it's using a lot of bandwidth, and there are many other 'show current time' services on the Internet.

Also, why not use SourceForge for software distribution now that we have NoRegisterDownload? It has a huge network of mirror sites and will also enable our downloads to register on the SourceForge statistics reports, helping increase visibility of TWiki.

Re the proxy cache issues mentioned above - see BrowserAndProxyCacheControl and in particular ViewAfterSaveCachesOldPage, this is a known problem that needs some cache control work to really resolve. There was a lot of discussion about this on TWiki in the past, most of which should be linked or backlinked from BrowserAndProxyCacheControl. Getting this fixed would help quite a lot with deploying TWiki on large intranets that use internal proxy caches at remote sites, as well as improving Internet scalability.

Another approach to scalability is doing a reverse proxy cache (near or on the TWiki servers). This is partly what enables the WikiPedia site to scale to enormous volumes, though they do also have more hardware and more system admin people.

-- RichardDonkin - 03 Sep 2006

Above starts are outdated. Here are up-to-date stats for Aug 2006:

URL Viewed Average
Size, KB
Entry Exit Bandwidth,
MB
/ 369579 34.39 52943 26089 12709
/cgi-bin/view/Codev/WebRss 109225 7.71 20051 21115 842
/cgi-bin/view/Plugins/WebRss 70778 6.46 9164 9433 457
/cgi-bin/view/TWiki/WebRss 50989 7.63 9631 10520 389
/cgi-bin/xtra/tzdate 36125 2.57 4910 5217 92
/cgi-bin/view/Main/WebRss 35881 7.50 3829 4979 269
/p/pub/Plugins/FirefoxExtensionAddOn/update.rdf 27283 0.47 21615 21563 12
/cgi-bin/view/Support/WebRss 26756 5.77 2785 3966 154
/cgi-bin/view/TWiki04/WebRss 21614 9.88 1660 2549 213
/cgi-bin/view/Codev/DownloadTWiki 17035 14.49 1275 2060 246
/cgi-bin/view/Sandbox/WebRss 14432 8.16 1144 1400 117
/cgi-bin/view/TWiki/WebHome 13158 14.47 871 1408 190
/cgi-bin/view/TWiki04/TagMeSearch 10036 16.52 167 507 165
/cgi-bin/view/Main/WebHome 9988 12.40 680 1407 123
/cgi-bin/view/Plugins/WebHome 8104 16.75 713 580 135
/cgi-bin/view/TWiki/WebSearch 7707 80.12 478 763 617
/cgi-bin/view/Sandbox/WebHome 6430 21.25 307 710 136
/p/pub/Codev/Release/TWiki-4.0.4.zip 6365 4750.00 180 1746 30233
/cgi-bin/view/Plugins/PluginPackage 6156 61.78 406 527 380
/cgi-bin/view/Wikilearn/WebRss 6151 17.10 836 984 105
/cgi-bin/view/Codev/TWikiVMDebianStable 4762 30.15 1807 1597 143
/cgi-bin/view/TWiki04/TWikiInstallationGuide 4351 11.96 276 1066 52
/p/pub/Codev/Release/TWiki-4.0.4.tgz 4313 3890.00 754 1549 16777
/cgi-bin/view/TWiki/TWikiInstallationGuide 4185 18.97 473 1046 79
/cgi-bin/view/Codev/TWikiUserGroupsInUS 2647 432.44 1598 1466 1144
/cgi-bin/view/Main/TWikiUsers 2319 557.23 55 407 1292
/cgi-bin/view/Support/AnsweredQuestions 901 437.58 254 271 394
/cgi-bin/viewfile/Plugins/NatSkin 784 265.31 9 40 208
/cgi-bin/view/TWiki04/TWikiDocumentation 639 259.17 47 126 165
/cgi-bin/view/Support/WebIndex 390 691.68 153 167 269
/cgi-bin/view/Codev/WebIndex 359 921.55 210 214 330
/p/pub/TWiki04/TWikiDrawPlugin/twikidraw.jar 341 210.25 2 6 71
/cgi-bin/view/Sandbox/WebTopicCreator 369 192.89 1 43 71
/cgi-bin/viewfile/Plugins/WysiwygPlugin 290 629.02 8 71 182
/cgi-bin/viewfile/Plugins/TWikiDrawPlugin 255 292.05 4 38 74
/cgi-bin/view/Sandbox/WebTopicList 183 212.14 1 19 38
/cgi-bin/view/Wikilearn/WebIndex 172 321.19 110 103 55
/cgi-bin/view/Main/WebTopicList 153 491.48 20 32 75
/cgi-bin/view/TWiki/TWikiOrgTopicIndex 139 422.09 52 54 58
/cgi-bin/viewfile/Plugins/BlogPlugin 126 697.75   11 87
/cgi-bin/view/Plugins/WebIndex 125 297.59 42 34 37
/p/pub/Plugins/NatSkin/NatSkin.zip 122 800.91 9 20 97
/cgi-bin/viewfile/Plugins/BlueSkin 109 431.72 3 20 47
/p/pub/Codev/Release/TWiki-4.0.2.tgz 101 3710.00 68 73 374
/cgi-bin/viewfile/Plugins/PatternSkin 100 467.61 5 20 46
/cgi-bin/viewfile/Plugins/EasyTimelinePlugin 86 1920.00 4 15 165

The biggest bandwidth use is by the TWiki zip and tgz packages. Bandwidth is not really the issue, the biggest issue we have on twiki.org is CPU usage caused by the cgi scripts.

The tzdate program is a useful utility: It also brings new traffic to twiki.org, free PR in other words (see twiki ad at http://twiki.org/cgi-bin/xtra/tzdate. A long time ago I reduced the size from 35.58 KB to 2.57 KB and removed the images, so bandwidth is not really an issue (it is page number 32 by bandwidth). I also blocked the abusers, reducing the number of views from 149K to 36K.

We need to improve the performance of twiki.org. People evaluating twiki get a negative firts impression if twiki.org is slow (they do not know that twiki.org is much slower than a typical TWiki installation). Low hanging fruits to improve the performance is (a) newer hardware, (b) caching content for TWikiGuest users. The biggest traffic is by spiders and WebRss pulls.

-- PeterThoeny - 03 Sep 2006

BasicForm
TopicClassification TWikiDevQuestion
TopicSummary 2005 Change to a new Sun v240 server for twiki.org
InterestedParties

RelatedTopics

Topic attachments
I Attachment History Action Size Date Who Comment
Unknown file formatcfg twiki.cfg r1 manage 1.2 K 2005-08-28 - 13:57 SvenDowideit  
Texttxt twiki.pl.txt r1 manage 7.3 K 2005-08-28 - 13:57 SvenDowideit  
Edit | Attach | Watch | Print version | History: r64 < r63 < r62 < r61 < r60 | Backlinks | Raw View | Raw edit | More topic actions
Topic revision: r64 - 2008-02-17 - SteffenPoulsen
 
  • Learn about TWiki  
  • Download TWiki
This site is powered by the TWiki collaboration platform Powered by Perl Hosted by OICcam.com Ideas, requests, problems regarding TWiki? Send feedback. Ask community in the support forum.
Copyright © 1999-2017 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.