OpenGuides-Dev October 2005

openguides-dev@lists.openguides.org

5 participants
11 discussions

[OpenGuides-Dev] OG performance
by Paul Makepeace 20 Jun '07

20 Jun '07

Hi, I don't follow OG development but as host operator a few things are coming up. The machine's load is gradually climbing over time and some of that is OG. Despite a relatively low hit rate on OG it is consuming quite a bit of resource. If OG started taking off it would take the machine down. First up: index.cgi requires 0.35s to perform a `perl -c` syntax check. Any thoughts on putting OG on a mod_perl server? I have mod_perl running here of course and we'd need to coordinate some apache.conf stuff. Second: the supersearch.cgi gulps down CPU, often for seconds at a time. It is a frequent resident of `top` output. This isn't really acceptable. I'm going to request this feature be turned off unless an effective optimisation plan or some other way to reduce its impact here is constructed pretty soon. Sorry about this but it's encroaching on others. Third: I wonder if there's some way to instruct robots not to spider parts of your wiki. This ought to speak for itself: $ grep crawl /var/log/apache/london.openguides.org-access.log | grep 'action=edit' | wc -l 8242 $ Finally: I posted about a DoS and was wondering what the status of a solution was. http://openguides.org/mail/openguides-dev/2004-October/000542.html Cheers, Paul (any overbearing tone unintentional ;-) -- Paul Makepeace .............................. http://paulm.com/inchoate/ "If my elbow was straight, then I'll show oyu mine!" -- http://paulm.com/toys/surrealism/

10 22

[OpenGuides-Dev] Release, bugs, and Search::InvertedIndex support?
by Dominic Hargreaves 21 Nov '05

21 Nov '05

A handful of changes have queued up so I thought I would make a release of OpenGuides this weekend. Should anything go into the current snapshot[1] for 0.48? The following bugs will remain open after 0.48, unless someone fixes them soon (from https://rt.cpan.org/): Important: #13148 Error with links containing underscores Normal: #8208 International characters in new pages #8814 Undeletable garbage nodes on london.openguides.org #8852 node.tt doesn't look for osie_x #9390 Bug handling <pre> #6386 Search Engine has an issue with international characters #6398 International Characters in RSS feed. Unimportant: #9746 Recent Changes table layout Wishlist: #8203 More helpful Create a page in this category link #11799 Summary field #9555 Edit page category/locale selection #9313 mod_perl support #9315 Merge london.og.org templates #9340 Basic auth integration #9380 Custom metadata fields #12972 Category/locale links in metadata behave differently to normal links #4077 Review date field If anyone would like to tackle any of these bugs (especially the one tagged as Important) in the next couple of days, please let me know your plans so I can wait for any fixes that you make. Equally if you have further information on any of the bugs or think that any should be closed, let me know or comment in RT. Lastly, I would like to solicit comments on dropping support for Search::InvertedIndex soon. My personal need for it no longer exists, so I am tempted to drop it for 0.49 or thereabouts, but if people want otherwise and can help with its continued support, then I am happy for that too. So, if you currently use S::II, let me know your views. Cheers, [1] https://urchin.earth.li/svn/openguides/trunk/ -- Dominic Hargreaves | http://www.larted.org.uk/~dom/ PGP key 5178E2A5 from the.earth.li (keyserver,web,email)

3 4

Re: [OGDev] Mirroring of guides
by Dominic Hargreaves 30 Oct '05

30 Oct '05

On Mon, Oct 24, 2005 at 07:40:04AM -0400, IvorW wrote: > I had a reason for keeping it separate - that it doesn't need OpenGuides to be installed to use it (and that process - installing OpenGuides - can be quite tortuous for the unwary). It could be used by mapping sites, or indeed anyone else wanting to making sense of our metadata. > > If you feel it belongs inside the OpenGuides distro, include it by all means. But I still would like to provide a separate distro of this module that doesn't need the main OG kit installing. I am willing to listen to others' opinions on this though. Okay, no, that makes sense. Any chance you could include your mirror script in that distribution? :) By the way, I notice you've submitted quite a few bugs recently, which is great. I know that you used to have CVS access on un.earth.li - would you find it useful to have write access to the subversion repository? If so, drop me a private mail and I'll get it set up. Cheers, -- Dominic Hargreaves | http://www.larted.org.uk/~dom/ PGP key 5178E2A5 from the.earth.li (keyserver,web,email)

2 1

Re: [OGDev] Mirroring of guides
by IvorW 27 Oct '05

27 Oct '05

IvorW wrote: >I now have a mirror script, which I have posted onto the dev wiki (which has ignored my leading spaces ):). > >http://openguides.org/dev/?node=Mirror > >This script enables "hoovering" an existing guide and keeping it in line using a cron job. > >This is the fruition of some late night IRC sessions with Earle. > >See also my use.perl journal entry: http://use.perl.org/~ivorw/journal/27209 > > > I'm running a mirror of the London OG site on one of my machines. I notice that one piece of metadata does not come across: the map link. Could Jo or someone else who knows about semantic web metadata suggest how we should tag this information in the RDF. I have raised RT ticket #15333 for this. Ivor.

1 0

RE: [OGDev] Mirroring of guides
by IvorW 24 Oct '05

24 Oct '05

> -----Original Message----- > From: openguides-dev-bounces(a)openguides.org > [mailto:openguides-dev-bounces@openguides.org]On Behalf Of Dominic > Hargreaves > Sent: 24 October 2005 12:21 > To: OpenGuides software developers' list > Subject: Re: [OGDev] Mirroring of guides > > > On Wed, Oct 19, 2005 at 09:26:39AM -0400, IvorW wrote: > > I now have a mirror script, which I have posted onto the > dev wiki (which has ignored my leading spaces ):). > > > > http://openguides.org/dev/?node=Mirror > > > > This script enables "hoovering" an existing guide and > keeping it in line using a cron job. > > This looks cool. I noticed that you've implemented > OpenGuides::RDF::Reader - would it make sense for this to be > part of the > OpenGuides distribution, do you think? I'm wary to increase the number > of tiny CPAN modules that OpenGuides uses. I had a reason for keeping it separate - that it doesn't need OpenGuides to be installed to use it (and that process - installing OpenGuides - can be quite tortuous for the unwary). It could be used by mapping sites, or indeed anyone else wanting to making sense of our metadata. If you feel it belongs inside the OpenGuides distro, include it by all means. But I still would like to provide a separate distro of this module that doesn't need the main OG kit installing. I am willing to listen to others' opinions on this though. Ivor.

1 0

Re: [OGDev] Mirroring of guides
by Dominic Hargreaves 24 Oct '05

24 Oct '05

On Wed, Oct 19, 2005 at 09:26:39AM -0400, IvorW wrote: > I now have a mirror script, which I have posted onto the dev wiki (which has ignored my leading spaces ):). > > http://openguides.org/dev/?node=Mirror > > This script enables "hoovering" an existing guide and keeping it in line using a cron job. This looks cool. I noticed that you've implemented OpenGuides::RDF::Reader - would it make sense for this to be part of the OpenGuides distribution, do you think? I'm wary to increase the number of tiny CPAN modules that OpenGuides uses. -- Dominic Hargreaves | http://www.larted.org.uk/~dom/ PGP key 5178E2A5 from the.earth.li (keyserver,web,email)

1 0

Mirroring of guides
by IvorW 19 Oct '05

19 Oct '05

I now have a mirror script, which I have posted onto the dev wiki (which has ignored my leading spaces ):). http://openguides.org/dev/?node=Mirror This script enables "hoovering" an existing guide and keeping it in line using a cron job. This is the fruition of some late night IRC sessions with Earle. See also my use.perl journal entry: http://use.perl.org/~ivorw/journal/27209 enjoy, Ivor.

1 0

Open Guide to Southampton and mSpace Mobile
by Daniel Alexander Smith 19 Oct '05

19 Oct '05

Hi, I'm Daniel Smith, a PhD student in the School of Electronics and Computer Science, University of Southampton. We've just setup the Open Guide to Southampton, hosted here at the University: http://southampton.openguides.org/ There's still some work to be done to the CSS, making a good logo, etc., but there are a fair few places already added, which we've managed to test out our application with. We first heard of OpenGuides when we used the RDF data from the London Open Guide for our mSpace Mobile application ( http://mspace.fm/ mobile/ ), a handheld application running on a semantic backend. The website has more information and a video of the application running. If you have any questions about anything, feel free to let know, i'm subscribed on the list. Kind Regards, Daniel Smith

2 1

OS IE bug?
by Earle Martin 12 Oct '05

12 Oct '05

I just checked in a patch to node.tt to address http://rt.cpan.org/NoAuth/Bug.html?id=8852 , but Dom informs me there is apparently an additional problem with Irish coordinates. Can anyone advise? -- Earle Martin http://downlode.org/ http://purl.oclc.org/net/earlemartin/

1 0

New features
by Earle Martin 12 Oct '05

12 Oct '05

New in the codebase: - "Summary" metadata field. This allows you to enter a one-line description of the content of a node. This summary will then be displayed in search results. Example: http://london.openguides.org/supersearch.cgi?latlong_dist=500&latitude=51.5… It will also appear in the RDF view of the node as a dc:description. - Per Ivor's request, a "format=raw" output option. This will give you the raw content of a node. Example: http://london.openguides.org/index.cgi?id=Sandbox;format=raw As you can see, both of these features are live on London. -- Earle Martin http://downlode.org/ http://purl.oclc.org/net/earlemartin/

1 0

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

OpenGuides-Dev October 2005