OpenGuides-Dev November 2005

openguides-dev@lists.openguides.org

13 participants
28 discussions

[OpenGuides-Dev] OG performance
by Paul Makepeace 20 Jun '07

20 Jun '07

Hi, I don't follow OG development but as host operator a few things are coming up. The machine's load is gradually climbing over time and some of that is OG. Despite a relatively low hit rate on OG it is consuming quite a bit of resource. If OG started taking off it would take the machine down. First up: index.cgi requires 0.35s to perform a `perl -c` syntax check. Any thoughts on putting OG on a mod_perl server? I have mod_perl running here of course and we'd need to coordinate some apache.conf stuff. Second: the supersearch.cgi gulps down CPU, often for seconds at a time. It is a frequent resident of `top` output. This isn't really acceptable. I'm going to request this feature be turned off unless an effective optimisation plan or some other way to reduce its impact here is constructed pretty soon. Sorry about this but it's encroaching on others. Third: I wonder if there's some way to instruct robots not to spider parts of your wiki. This ought to speak for itself: $ grep crawl /var/log/apache/london.openguides.org-access.log | grep 'action=edit' | wc -l 8242 $ Finally: I posted about a DoS and was wondering what the status of a solution was. http://openguides.org/mail/openguides-dev/2004-October/000542.html Cheers, Paul (any overbearing tone unintentional ;-) -- Paul Makepeace .............................. http://paulm.com/inchoate/ "If my elbow was straight, then I'll show oyu mine!" -- http://paulm.com/toys/surrealism/

10 22

Re: [openguides-commits] r726 - in trunk: lib/OpenGuides t
by Dominic Hargreaves 02 Dec '05

02 Dec '05

On Wed, Nov 30, 2005 at 10:41:41PM +0000, svnadmin(a)urchin.earth.li wrote: > Author: earle > Date: 2005-11-30 22:41:41 +0000 (Wed, 30 Nov 2005) > New Revision: 726 > > Modified: > trunk/lib/OpenGuides/RDF.pm > trunk/t/21_rdf.t > Log: > fixes #50 Could I ask that people continue to put meaningful log messages in rather than *just* links to trac? It would be useful to be able to make sense of changesets in their own right. Cheers, Dominic. -- Dominic Hargreaves | http://www.larted.org.uk/~dom/ PGP key 5178E2A5 from the.earth.li (keyserver,web,email)

2 1

simplification of the edit page.
by Bob Walker 30 Nov '05

30 Nov '05

Given last night IRCs conversations i was pondering earle's contention that openguides is intimidating. One answer to this is to have two levels of edit page. A simple page and an advanced page. the advanced page would be the same as currently. The simple page would have the following bits to fill in. Address: Postcode: Description(content): Where is it? (aka locales): What is it? (aka categories): Summmary: Username: Comment about addition/change (possibly): This shoudl be enough data for a useful entry. make it obvious that only really decription and node name is vitally important and possibly one of locale or category. Add some ajaxian suggest magic for locale and categories Also so as not to poeple off it might be worth having this form on the new page cgi as well. So they dont have to go through multiple pages to create a page. We shoudl probably look at ways to autogenerate the map links and geodata. I know soem guides are already doing this. then we can have what edit page you see as an option. For those of who like to fiddle with all the data. And of course give the users the ability to see the full edit page if they want. now i just need to rememebr the othe ridea i had last night. -- Bob Walker http://www.randomness.org.uk/ Very few things dont taste good once deep fried.

5 7

Re: [OGDev] Re: [OpenGuides-Dev] Release, bugs, and Search::InvertedIndex support?
by Dominic Hargreaves 30 Nov '05

30 Nov '05

On Mon, Nov 21, 2005 at 10:39:19AM -0500, IvorW wrote: > I think it's worth retaining the pluggability of searches, so that we could add alternative(s) to Plucene at some future stage. I had a problem with installing Plucene on one machine, and fell back to SII, but since resolved the problem with Plucene. Noted. > IMHO, it's nice to have an alternative to Plucene so that we can check it for anomalies in the search results, even though it's inferior. > > By the way, any news on the proken compatibility with the latest Text::WikiFormat? I needed to dive into backpan to retrieve an old T::WF that worked with CGI::Wiki. This shouldn't be needed in the latest release. It was fixed in: http://dev.openguides.org/changeset/707 It should probably be caught in CGI::Wiki too, but at the moment at least I don't have any direct involvement in the development of that. Cheers, Dominic. -- Dominic Hargreaves | http://www.larted.org.uk/~dom/ PGP key 5178E2A5 from the.earth.li (keyserver,web,email)

2 4

Re: [OGDev] Swish-e search library
by Alex McLintock 30 Nov '05

30 Nov '05

I've used it for searching on http://galactic-guide.com I dont know how well it will cope with the Wiki database though. I'd stick to plucene since it is being actively developed. On 29/11/05, IvorW <ivorw-openguides(a)xemaps.com> wrote: > > http://www.swish-e.org/ > >

1 0

RE: [OGDev] Re: [OpenGuides-Dev] Release, bugs, and Search::InvertedIndex support?
by IvorW 29 Nov '05

29 Nov '05

> -----Original Message----- > From: openguides-dev-bounces(a)openguides.org > [mailto:openguides-dev-bounces@openguides.org]On Behalf Of Dominic > Hargreaves > Sent: 29 November 2005 13:07 > To: OpenGuides software developers' list > Subject: Re: [OGDev] Re: [OpenGuides-Dev] Release, bugs,and > Search::InvertedIndex support? > > > On Tue, Nov 29, 2005 at 01:05:54PM +0000, Barbie wrote: > > I'd like to dispute that. Birmingham's planned announcement of > > OpenGuides has stalled because of this. I have installed the latest > > Text::WikiFormat and OpenGuides and now several links returning > > 'Can't call method "type" on an undefined value...' > > > > Whether I use RecentChanges or action=rc makes no differenc for that > > link as well. > > > > If there is a patch someone can point me to, I would be > very grateful, > > as we had hoped to announce this several weeks ago. > > I'll look into this fully later, but the issue should only apply to > blank nodes, so if you manually munge the URL with an action=edit and > put content in the nodes you can work around the problem. > I worked around this by snarfing an old version of Text::WikiFormat from backpan, not ideal, but it got my installation up and running. I've also raised ticket #53 for this: http://dev.openguides.org/ticket/53 Ivor.

1 0

Using trac and svn for other OpenGuides modules
by IvorW 29 Nov '05

29 Nov '05

I detected a problem this morning with CPAN not updating (owing to funet being ever so slightly fubar at the moment) This has set me thinking, that we maybe we should have all the subsidiary modules in subversion also. ... ant managed by trac. Why not? Can trac operate with multiple subversion repositories at different addresses or does it have to be under one roof (which may be a better idea anyway)? If the latter, maybe we should keep repositories for other modules on urchin. Dom - thoughts? I have the following modules which are all OpenGuides related: OpenGuides::RDF::Reader CGI::Wiki::Plugin::Diff CGI::Wiki::Plugin::Locator::UTM Ivor.

1 0

Swish-e search library
by IvorW 29 Nov '05

29 Nov '05

Anybody know if it is good or bad? We could use it as a search backend as an alternetive to plucene http://www.swish-e.org/

1 0

RE: [OGDev] extension to mirror.pl
by IvorW 25 Nov '05

25 Nov '05

> -----Original Message----- > From: openguides-dev-bounces(a)openguides.org > [mailto:openguides-dev-bounces@openguides.org]On Behalf Of Bob Walker > Sent: 25 November 2005 17:51 > To: openguides-dev(a)openguides.org > Subject: [OGDev] extension to mirror.pl > > > > Whilst out shopping today my mind started thinking about things. > While its great that we can now mirror an entire guide it > would be great > if we could mirror only bits of it. For example mirror only > pages about > croydon and set up croydon.openguides.org. then fiddle with > the templates > so thats edits (and possibly new pages) get sent back to the > main guide > (london.openguides.org). > Admittledy this new guide would then have to create soem of the pages > itself for instance the category_pubs page would need to say > different > things to the original so in fact you might need to have two edit > functions. im sure it oculd work or soemthing. > > So the extension would be to tell mirror.pl that you want to > mirror only > certainy categories or locales and disregard anything else. That should be easy enough to code. og_mirror is a fairly small script, and you are welcome to produce a custom version of it. Add filtering logic into sub populate_local_wiki. You probably want to test @{$metadata->{locale}} to see if any entries in the array contain 'Croydon'. > Shame i cant code :) No time like the present to start :). You can always get some help. Buy a copy of the Llama (Learning Perl by Randall Schwarz) and post your questions to #perl-help on irc.perl.org or http://perlmonks.org If this is a common requirement from others hosting guides, I'll look at enhancing og_mirror to provide select options. Anyway, I'm looking to write a "pull" function to grab individual pages from another guide. Hope this helps, Ivor.

1 0

extension to mirror.pl
by Bob Walker 25 Nov '05

25 Nov '05

Whilst out shopping today my mind started thinking about things. While its great that we can now mirror an entire guide it would be great if we could mirror only bits of it. For example mirror only pages about croydon and set up croydon.openguides.org. then fiddle with the templates so thats edits (and possibly new pages) get sent back to the main guide (london.openguides.org). Admittledy this new guide would then have to create soem of the pages itself for instance the category_pubs page would need to say different things to the original so in fact you might need to have two edit functions. im sure it oculd work or soemthing. So the extension would be to tell mirror.pl that you want to mirror only certainy categories or locales and disregard anything else. Shame i cant code :) -- Bob Walker http://www.randomness.org.uk/ Very few things dont taste good once deep fried.

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

OpenGuides-Dev November 2005