Hi, I don't follow OG development but as host operator a few things are
coming up. The machine's load is gradually climbing over time and some
of that is OG.
Despite a relatively low hit rate on OG it is consuming quite a bit of
resource. If OG started taking off it would take the machine down.
First up: index.cgi requires 0.35s to perform a `perl -c` syntax check.
Any thoughts on putting OG on a mod_perl server? I have mod_perl running
here of course and we'd need to coordinate some apache.conf stuff.
Second: the supersearch.cgi gulps down CPU, often for seconds at a time.
It is a frequent resident of `top` output. This isn't really
acceptable. I'm going to request this feature be turned off unless an
effective optimisation plan or some other way to reduce its impact
here is constructed pretty soon. Sorry about this but it's encroaching
on others.
Third: I wonder if there's some way to instruct robots not to spider
parts of your wiki. This ought to speak for itself:
$ grep crawl /var/log/apache/london.openguides.org-access.log | grep 'action=edit' | wc -l
8242
$
Finally: I posted about a DoS and was wondering what the status of a
solution was. http://openguides.org/mail/openguides-dev/2004-October/000542.html
Cheers,
Paul (any overbearing tone unintentional ;-)
--
Paul Makepeace .............................. http://paulm.com/inchoate/
"If my elbow was straight, then I'll show oyu mine!"
-- http://paulm.com/toys/surrealism/
A handful of changes have queued up so I thought I would make a release
of OpenGuides this weekend. Should anything go into the current
snapshot[1] for 0.48?
The following bugs will remain open after 0.48, unless someone fixes
them soon (from https://rt.cpan.org/):
Important:
#13148 Error with links containing underscores
Normal:
#8208 International characters in new pages
#8814 Undeletable garbage nodes on london.openguides.org
#8852 node.tt doesn't look for osie_x
#9390 Bug handling <pre>
#6386 Search Engine has an issue with international characters
#6398 International Characters in RSS feed.
Unimportant:
#9746 Recent Changes table layout
Wishlist:
#8203 More helpful Create a page in this category link
#11799 Summary field
#9555 Edit page category/locale selection
#9313 mod_perl support
#9315 Merge london.og.org templates
#9340 Basic auth integration
#9380 Custom metadata fields
#12972 Category/locale links in metadata behave differently to normal links
#4077 Review date field
If anyone would like to tackle any of these bugs (especially the one
tagged as Important) in the next couple of days, please let me know your
plans so I can wait for any fixes that you make. Equally if you have
further information on any of the bugs or think that any should be
closed, let me know or comment in RT.
Lastly, I would like to solicit comments on dropping support for
Search::InvertedIndex soon. My personal need for it no longer exists,
so I am tempted to drop it for 0.49 or thereabouts, but if people want
otherwise and can help with its continued support, then I am happy for
that too. So, if you currently use S::II, let me know your views.
Cheers,
[1] https://urchin.earth.li/svn/openguides/trunk/
--
Dominic Hargreaves | http://www.larted.org.uk/~dom/
PGP key 5178E2A5 from the.earth.li (keyserver,web,email)
You might do well to link to the new O'Reilly "Mapping Hacks" book,
which not only has a section all about OpenGuides.org BUT this
section is freely downloadable as a "Sample Hack".
You might use something like this:
For a more detailed description, see this
<a href="http://www.oreilly.com/catalog/mappinghks/chapter/
hack97.pdf">sample chapter</a>
from the O'Reilly book
<a href="http://www.oreilly.com/catalog/mappinghks/">Mapping Hacks</a>
by Schuyler Erle, Rich Gibson and Jo Walsh.
I hope to set up a couple of these myself soon, as soon as I get the
CPAN modules into OpenBSD "package" format
(like Debian APT but done differently "because, hey, this is BSD not
Linux" :-)
Cheers
Ian Darwin
ian on darwinsys period co m
I had a quick play this evening as I've used but not played with
greasemonkey and google maps as yet.
So I put together a simple script that adds a small google map to the
bottom of London OpenGuide pages that have coordinates on.
It "cheats" and inserts an iframe that loads the php based map page up
from my site.
greasemonkey script can be got from here:
http://www.cowfish.org.uk/maps/ogl.user.js
php src from here:
http://www.cowfish.org.uk/maps/ogl.phps
greasemonkey can be found here:
http://greasemonkey.mozdev.org/
google maps api can be found here:
http://www.google.com/apis/maps/
and a screenshot of what I done did here:
http://www.flickr.com/photos/cowfish/22442786/ (click all sizes for a full
size version)
The google maps API access is being restricted by a key which is being
generated from the URL that you want to use the API from. This is one
reason why I went the PHP route, as I don't know what they are doing with
the submitted URLs and in a fit of paranoia didn't want to send on the ogl
URL. I also don't know whether I could dynamically load their API script
from greasemonkey, but haven't got that far yet :)
Anyway, thought I'd share and see if anyone else has played with this kind
of thing and has any tips.
billy
--
"My doctor says now I have enough silicone in my
body to kill a small elephant! Isn't that cool?"
Billy Abbott billy at cowfish dot org dot uk
Good afternoon dear developers,
upon gnoming through the OpenGuide to London and inserting pages with
horribly long Website Addresses a though came cross my mind. I wrote a CGI
that reads an URL from a MYSQL defined by a 5-character code, and sends a
Location: Command to the Browser. It will be needed to write some CGIs that
make it possible to add a link between the 5-char-code and an url to the
database. There are some more possiblities to get rid of long urls. I would
be happy if some developer would act upon my request.
This is my CGI:
#!/usr/bin/perl
use DBI;
$DB_DB = "test";
$DB_Host = "localhost";
$DB_User = "root";
$DB_Password = "***";
$dbh = DBI->connect("dbi:mysql:$DB_DB:$DB_Host",$DB_User,$DB_Password);
$sth = $dbh->prepare("select url from test where shortname =
'".$ARGV[0]."'");
$sth->execute;
if($sth->rows == 0)
{
print "Error";
} else {
while ($row = $sth->fetchrow_hashref)
{
print "Location: ",$row->{'url'},"\n\n";
}
}
$dbh->disconnect;
exit 0;
The DB looks temporalily like this
test
|--- test
|--- ID, shortname, url
Regards
Kai M Poppe
I'm not sure if people have seen it yet, but Google have unveiled a
system for submitting site maps to them, as crawl hints; the idea is
that the site map can hint at page importance, edit frequency, and last
edit date, so they can crawl more sensibly.
Google FAQ - https://www.google.com/webmasters/sitemaps/docs/en/faq.html
My Sitemap - http://nottingham.openguides.org/sitemap.xml
My (not very pretty) script to create said sitemap
- http://www.jimbo.org.uk/code/make_sitemap.txt
It's not documented or commented yet, and I'm not sure what best to do
with the <priority> and <changefreq> elements yet, but it mostly seems
to have worked thus far.
Hope this is useful to someone!
Cheers,
James
--
jkg(a)jimbo.org.uk | http://blog.jimbo.org.uk/ | PGP key ID 81AE1FF
All men are mortal. Socrates was mortal. Therefore, all men are Socrates.
-- Woody Allen
This from last Friday's NTK. I'd be willing to do a very quick (15
mins?) lightning talk on Openguides, with quick demo of one of the sites
(perhaps with a laptop copy as backup in case Net access is
unavailable).
Thoughts?
>> OPEN TECH CFP <<
* Call for Participation - Please Redistribute Freely *
The UK Unix User Group, NTK.net, and the organisers of NotCon '04 present:
backstage.bbc.co.uk Open Tech 2005
Saturday July 23rd - The Reynolds Building, Hammersmith, London W6 8RP
http://www.ukuug.org/events/opentech2005/
Sponsored by backstage.bbc.co.uk, Open Tech 2005 is an informal
one-day conference about technologies that anyone can have a go at,
from "Open Source"-style ways of working to repurposing everyday
electronics hardware.
So far, the line-up features:
* Ted Nelson, inventor of hypertext, on where the web went wrong
* The official launch of the backstage.bbc.co.uk developer network,
opening up BBC content for you to play with
* Plus: able to record an entire week of all Freeview TV and radio
channels, probably the UK's largest (fridge-sized) PVR
More speakers will be confirmed over the next few weeks - but, as the
title implies, we're very much "Open" to suggestions. If you're
reverse-engineering proprietary protocols, making useful information
available in a way people couldn't get at before, pioneering
unexpected methods of knowledge sharing - or (equally likely) doing
something so cool we haven't even thought of it yet, then please get
in touch via the submissions form at:
http://www.ukuug.org/events/opentech2005/offer/
The deadline for submissions is midnight UK time Saturday June 25th,
and we'll aim to notify everyone who's submitted a proposal by July
1st.
We'll be trying to fit in as many talks (and lightning presentations)
as possible, so the shorter you can make yours, the better.
Alternatively, if you have an idea for a panel discussion, or a
workshop, or anything else that's vaguely in keeping with the theme of
the event, then we also can't wait to hear from you.
And there'll most likely be some sort of internet access at the event,
but offline demonstrations are strongly encouraged, as bandwidth may
not be guaranteed.
* Further information *
You don't have to suggest a session to take part; you can stay
informed about the event by subscribing to our low-traffic
announcement-only mailing list - send a blank email to:
notcon-subscribe(a)socialswirl.com
(your address will only be used to contact you about the event and
will not be passed onto third parties).
- or you can email opentech(a)ukuug.org if you've any other questions.
backstage.bbc.co.uk Open Tech 2005
Saturday July 23rd - The Reynolds Building, Hammersmith, London W6 8RP
http://www.ukuug.org/events/opentech2005/
Final programme may be subject to alteration. Thanks for reading!
--
Rev Simon Rumble <simon(a)rumble.net>
www.rumble.net
The Tourist Engineer
Because nerds travel too.
http://engineer.openguides.org/
"When you wake up to the fact that your paper is Tory,
Just remember that there are two sides to every story."
- Billy Bragg - It Says Here