Hi, I don't follow OG development but as host operator a few things are
coming up. The machine's load is gradually climbing over time and some
of that is OG.
Despite a relatively low hit rate on OG it is consuming quite a bit of
resource. If OG started taking off it would take the machine down.
First up: index.cgi requires 0.35s to perform a `perl -c` syntax check.
Any thoughts on putting OG on a mod_perl server? I have mod_perl running
here of course and we'd need to coordinate some apache.conf stuff.
Second: the supersearch.cgi gulps down CPU, often for seconds at a time.
It is a frequent resident of `top` output. This isn't really
acceptable. I'm going to request this feature be turned off unless an
effective optimisation plan or some other way to reduce its impact
here is constructed pretty soon. Sorry about this but it's encroaching
on others.
Third: I wonder if there's some way to instruct robots not to spider
parts of your wiki. This ought to speak for itself:
$ grep crawl /var/log/apache/london.openguides.org-access.log | grep 'action=edit' | wc -l
8242
$
Finally: I posted about a DoS and was wondering what the status of a
solution was. http://openguides.org/mail/openguides-dev/2004-October/000542.html
Cheers,
Paul (any overbearing tone unintentional ;-)
--
Paul Makepeace .............................. http://paulm.com/inchoate/
"If my elbow was straight, then I'll show oyu mine!"
-- http://paulm.com/toys/surrealism/
On Wed, Nov 30, 2005 at 10:41:41PM +0000, svnadmin(a)urchin.earth.li wrote:
> Author: earle
> Date: 2005-11-30 22:41:41 +0000 (Wed, 30 Nov 2005)
> New Revision: 726
>
> Modified:
> trunk/lib/OpenGuides/RDF.pm
> trunk/t/21_rdf.t
> Log:
> fixes #50
Could I ask that people continue to put meaningful log messages in
rather than *just* links to trac? It would be useful to be able to make
sense of changesets in their own right.
Cheers,
Dominic.
--
Dominic Hargreaves | http://www.larted.org.uk/~dom/
PGP key 5178E2A5 from the.earth.li (keyserver,web,email)
Given last night IRCs conversations i was pondering earle's contention
that openguides is intimidating.
One answer to this is to have two levels of edit page.
A simple page and an advanced page.
the advanced page would be the same as currently.
The simple page would have the following bits to fill in.
Address:
Postcode:
Description(content):
Where is it? (aka locales):
What is it? (aka categories):
Summmary:
Username:
Comment about addition/change (possibly):
This shoudl be enough data for a useful entry. make it obvious that
only really decription and node name is vitally important and possibly
one of locale or category. Add some ajaxian suggest magic for locale and
categories
Also so as not to poeple off it might be worth having this form on the new
page cgi as well. So they dont have to go through multiple pages to create
a page.
We shoudl probably look at ways to autogenerate the map links and geodata.
I know soem guides are already doing this.
then we can have what edit page you see as an option. For those of who
like to fiddle with all the data.
And of course give the users the ability to see the full edit page if they
want.
now i just need to rememebr the othe ridea i had last night.
--
Bob Walker
http://www.randomness.org.uk/
Very few things dont taste good once deep fried.
On Mon, Nov 21, 2005 at 10:39:19AM -0500, IvorW wrote:
> I think it's worth retaining the pluggability of searches, so that we could add alternative(s) to Plucene at some future stage. I had a problem with installing Plucene on one machine, and fell back to SII, but since resolved the problem with Plucene.
Noted.
> IMHO, it's nice to have an alternative to Plucene so that we can check it for anomalies in the search results, even though it's inferior.
>
> By the way, any news on the proken compatibility with the latest Text::WikiFormat? I needed to dive into backpan to retrieve an old T::WF that worked with CGI::Wiki.
This shouldn't be needed in the latest release. It was fixed in:
http://dev.openguides.org/changeset/707
It should probably be caught in CGI::Wiki too, but at the moment at
least I don't have any direct involvement in the development of that.
Cheers,
Dominic.
--
Dominic Hargreaves | http://www.larted.org.uk/~dom/
PGP key 5178E2A5 from the.earth.li (keyserver,web,email)
I've used it for searching on http://galactic-guide.com
I dont know how well it will cope with the Wiki database though.
I'd stick to plucene since it is being actively developed.
On 29/11/05, IvorW <ivorw-openguides(a)xemaps.com> wrote:
>
> http://www.swish-e.org/
>
>
> -----Original Message-----
> From: openguides-dev-bounces(a)openguides.org
> [mailto:openguides-dev-bounces@openguides.org]On Behalf Of Dominic
> Hargreaves
> Sent: 29 November 2005 13:07
> To: OpenGuides software developers' list
> Subject: Re: [OGDev] Re: [OpenGuides-Dev] Release, bugs,and
> Search::InvertedIndex support?
>
>
> On Tue, Nov 29, 2005 at 01:05:54PM +0000, Barbie wrote:
> > I'd like to dispute that. Birmingham's planned announcement of
> > OpenGuides has stalled because of this. I have installed the latest
> > Text::WikiFormat and OpenGuides and now several links returning
> > 'Can't call method "type" on an undefined value...'
> >
> > Whether I use RecentChanges or action=rc makes no differenc for that
> > link as well.
> >
> > If there is a patch someone can point me to, I would be
> very grateful,
> > as we had hoped to announce this several weeks ago.
>
> I'll look into this fully later, but the issue should only apply to
> blank nodes, so if you manually munge the URL with an action=edit and
> put content in the nodes you can work around the problem.
>
I worked around this by snarfing an old version of Text::WikiFormat from backpan, not ideal, but it got my installation up and running.
I've also raised ticket #53 for this: http://dev.openguides.org/ticket/53
Ivor.
I detected a problem this morning with CPAN not updating (owing to funet being ever so slightly fubar at the moment)
This has set me thinking, that we maybe we should have all the subsidiary modules in subversion also.
... ant managed by trac. Why not?
Can trac operate with multiple subversion repositories at different addresses or does it have to be under one roof (which may be a better idea anyway)?
If the latter, maybe we should keep repositories for other modules on urchin. Dom - thoughts?
I have the following modules which are all OpenGuides related:
OpenGuides::RDF::Reader
CGI::Wiki::Plugin::Diff
CGI::Wiki::Plugin::Locator::UTM
Ivor.
> -----Original Message-----
> From: openguides-dev-bounces(a)openguides.org
> [mailto:openguides-dev-bounces@openguides.org]On Behalf Of Bob Walker
> Sent: 25 November 2005 17:51
> To: openguides-dev(a)openguides.org
> Subject: [OGDev] extension to mirror.pl
>
>
>
> Whilst out shopping today my mind started thinking about things.
> While its great that we can now mirror an entire guide it
> would be great
> if we could mirror only bits of it. For example mirror only
> pages about
> croydon and set up croydon.openguides.org. then fiddle with
> the templates
> so thats edits (and possibly new pages) get sent back to the
> main guide
> (london.openguides.org).
> Admittledy this new guide would then have to create soem of the pages
> itself for instance the category_pubs page would need to say
> different
> things to the original so in fact you might need to have two edit
> functions. im sure it oculd work or soemthing.
>
> So the extension would be to tell mirror.pl that you want to
> mirror only
> certainy categories or locales and disregard anything else.
That should be easy enough to code. og_mirror is a fairly small script, and you are
welcome to produce a custom version of it. Add filtering logic into sub populate_local_wiki. You probably want to test @{$metadata->{locale}} to see if any entries in the array contain 'Croydon'.
> Shame i cant code :)
No time like the present to start :).
You can always get some help. Buy a copy of the Llama (Learning Perl by Randall Schwarz)
and post your questions to #perl-help on irc.perl.org or http://perlmonks.org
If this is a common requirement from others hosting guides, I'll look at enhancing og_mirror to provide select options.
Anyway, I'm looking to write a "pull" function to grab individual pages from another guide.
Hope this helps,
Ivor.
Whilst out shopping today my mind started thinking about things.
While its great that we can now mirror an entire guide it would be great
if we could mirror only bits of it. For example mirror only pages about
croydon and set up croydon.openguides.org. then fiddle with the templates
so thats edits (and possibly new pages) get sent back to the main guide
(london.openguides.org).
Admittledy this new guide would then have to create soem of the pages
itself for instance the category_pubs page would need to say different
things to the original so in fact you might need to have two edit
functions. im sure it oculd work or soemthing.
So the extension would be to tell mirror.pl that you want to mirror only
certainy categories or locales and disregard anything else.
Shame i cant code :)
--
Bob Walker
http://www.randomness.org.uk/
Very few things dont taste good once deep fried.