Hi, I don't follow OG development but as host operator a few things are
coming up. The machine's load is gradually climbing over time and some
of that is OG.
Despite a relatively low hit rate on OG it is consuming quite a bit of
resource. If OG started taking off it would take the machine down.
First up: index.cgi requires 0.35s to perform a `perl -c` syntax check.
Any thoughts on putting OG on a mod_perl server? I have mod_perl running
here of course and we'd need to coordinate some apache.conf stuff.
Second: the supersearch.cgi gulps down CPU, often for seconds at a time.
It is a frequent resident of `top` output. This isn't really
acceptable. I'm going to request this feature be turned off unless an
effective optimisation plan or some other way to reduce its impact
here is constructed pretty soon. Sorry about this but it's encroaching
on others.
Third: I wonder if there's some way to instruct robots not to spider
parts of your wiki. This ought to speak for itself:
$ grep crawl /var/log/apache/london.openguides.org-access.log | grep 'action=edit' | wc -l
8242
$
Finally: I posted about a DoS and was wondering what the status of a
solution was. http://openguides.org/mail/openguides-dev/2004-October/000542.html
Cheers,
Paul (any overbearing tone unintentional ;-)
--
Paul Makepeace .............................. http://paulm.com/inchoate/
"If my elbow was straight, then I'll show oyu mine!"
-- http://paulm.com/toys/surrealism/
I recently received a request from someone looking to set up the Open
Guide to Atlanta. I spent an hour last night doing the steps that are
needed to set up a new guide on Athena (the boston.og.org webserver):
* Create web directories with appropriate permissions (5 minutes --
scripted)
* Copy over Boston web directory. This ended up including a couple
things that I didn't mean for it to, like extra files I had
accidentally stuck in the directory. Clean those up (10 minutes)
* Grab new gmaps key. (5 minutes)
* Add a temporary domain forward from atlanta.crschmidt.net -- then
realize that meant I had to get a new gmaps key. D'oh. (10 minutes)
* Modify all the "base" lat and long pairs to use ones that worked for
Atlanta, rather than ones that worked for Boston. Note that this is
probably not required if I ever get around to updating my templates
and configuration to the latest code, since I'm assuming Dom made
these configuration params. This took about 10 minutes.
* Remove all the Boston-specific stuff - T lines (both special icons
and the polylines), town boundary drawing, etc. This took the longest
-- about 15 minutes -- but now that it's done, I can simply copy out
the Atlanta templates instead of the Boston ones.
* Copied over and set up configuration files for stats (a la
http://boston.openguides.org/stats/) and webstats (a la
http://boston.openguides.org/webstats/). 10 minutes.
* Copied over and set up scripts for loading places from
atlanta.zami.com, added 43 places to the guide, checked it out,
called it done.
Total time: 1 hour.
Total time next time around: Probably closer to 30 minutes.
hex, when you get back, if you could please set up
atlanta.openguides.org to point to 65.110.51.60 or as a CNAME to Boston,
I'd appreciate it.
Next step: Setting up a couple more Guides, that people can claim from
me later if they want. I'll do the hosting and admin until someone else
comes along who wants to admin the site -- then they can either keep it
on my server, or they can have the data and files and move elsewhere.
The ones that I plan to set up at the moment are:
* Chicago
* Seattle
* Portland
Because I know people who know those areas well enough to add some
content. I would also be happy to set up guides for any of the places
listed on http://zami.com/ -- because I have a spider which can crawl
the data out of there a bit more easily than I'd be able to get it
elsewhere otherwise. If anyone has any requests for these places, I'd
love to hear them, and set them up.
(Note that crawling this data in the US is considered legal -- at least
for the time being. "Collection" protection only comes into play when
there is some level of creativity involved in the data -- which yellow
page listings are not. The original court case regarding this actually
used white pages as an example, which is exactly the data I'm copying at
the moment.)
Also, thanks to rich_gibson of Geocoder.us, Athena now has
non-restricted access to Geocoder.us. Thanks a million for that, Rich!
Geocoder.us offers a ton of great commercial services, so if you're in
the US and wanting to do location lookups, he's a good person to talk
to.
This is long and rambly. I'm going to stop talking, and get on to
working on setting these things up.
--
Christopher Schmidt
Web Developer
Can those running a guide let me know (on or off-list as preferred) what
their guide settings are for:
geo_handler
ellipsoid
as I'm trying to judge how best to integrate/release some of the Google
maps stuff that was merged last month.
Cheers,
Dominic.
--
Dominic Hargreaves | http://www.larted.org.uk/~dom/
PGP key 5178E2A5 from the.earth.li (keyserver,web,email)
Kerry Bosworth and I have started an Open Guide for Derby, found at:
http://derby.randomstuff.org.uk/
It is currently lacking pretty CSS, which I will add in time, and only
has a few entries so far, but I think it is at a reasonable point to
open to the world at large. Unless there is anything else that you feel
should be done first, please could the guide be added to the list of
available guides on openguides.org.
The server hosting it should be configured to accept requests for
http://derby.openguides.org/ and/or http://derby.uk.openguides.org/ (as
per a recent thread on this mailing list), if the hostmaster would be
kind enough to CNAME one (or both) of these to
'derby.randomstuff.org.uk.' - whatever is appropriate under the current
policy - that would be good.
--
Stephen White
On Tue, Nov 29, 2005 at 07:51:51AM -0500, IvorW wrote:
> This has set me thinking, that we maybe we should have all the subsidiary modules in subversion also.
>
> ... ant managed by trac. Why not?
>
> Can trac operate with multiple subversion repositories at different addresses or does it have to be under one roof (which may be a better idea anyway)?
The latter. Perhaps we could have an OpenGuides::* in the openguides
trac/repo and CGI::Wiki::* in a new cgi-wiki trac/repo?
What's the maintenance status of CGI::Wiki these days? ISTR it's still
Kake's but I've not seen any activity on it for a long time.
Cheers,
Dominic.
--
Dominic Hargreaves | http://www.larted.org.uk/~dom/
PGP key 5178E2A5 from the.earth.li (keyserver,web,email)
Kerry Bosworth and I have started an Open Guide for Derby, found at:
http://derby.randomstuff.org.uk/
It is currently lacking pretty CSS, which I will add in time, and only
has a few entries so far, but I think it is at a reasonable point to
open to the world at large. Unless there is anything else that you feel
should be done first, please could the guide be added to the list of
available guides on openguides.org.
The server hosting it should be configured to accept requests for
http://derby.openguides.org/ and/or http://derby.uk.openguides.org/ (as
per a recent thread on this mailing list), if the hostmaster would be
kind enough to CNAME one (or both) of these to
'derby.randomstuff.org.uk.' - whatever is appropriate under the current
policy - that would be good.
--
Stephen White