Many of the pages on the Open Guide to London have acquired bizarre characters in locales and categories. These characters are concatenating the locales and categories into something bizarre. See for example http://london.openguides.org/index.cgi?Marylebone_Station
oglondontest=> select metadata_value from metadata where node='Marylebone Station' and metadata_type='category' and version=8; metadata_value ---------------- Rail Tube
(1 row)
I suspect this might have something to do with the wiki hoover - certainly the "last five nodes" edited by it all exhibit the problem. http://london.openguides.org/index.cgi?username=Wiki%20Hoover&action=use...
Ivor, can you investigate please?
Argh, I really don't have time to work up something to fix all the mangled data right now. I'm going to have lunch and a think.
Kake
On Mon 15 Dec 2003, Kate L Pugh kake@earth.li wrote:
Many of the pages on the Open Guide to London have acquired bizarre characters in locales and categories.
OK, I wrote a script to fix this by dint of taking a slightly extended lunch hour, and I have now run it to fix the problems.
Please, please be careful when doing automated things to our data. I am not very happy that I had to sort this out.
Kake
On Mon, Dec 15, 2003 at 03:32:29PM +0000, Kate L Pugh wrote:
Please, please be careful when doing automated things to our data. I am not very happy that I had to sort this out.
Bummer. Unfortunately, our indices now seem to be screwed up again. What's the procedure for deleting corrupt index files and then reindexing? I'd like to be able to do it myself if it happens again.
On Mon 15 Dec 2003, Earle Martin openguides@downlode.org wrote:
Unfortunately, our indices now seem to be screwed up again. What's the procedure for deleting corrupt index files and then reindexing? I'd like to be able to do it myself if it happens again.
What I've been doing is deleting the index files, running a script to read and re-write all the nodes, then chowning the index files back for the webserver. There's a script in openguides.org:~kake/local/bin/
*But* if you run that it *will* rewrite all the nodes. See previous discussion.
Kake
----- Original Message ----- From: "Kate L Pugh" kake@earth.li To: openguides-london@openguides.org Sent: 15 December 2003 13:03 Subject: [OpenGuides-London] Mangled metadata
Many of the pages on the Open Guide to London have acquired bizarre characters in locales and categories. These characters are concatenating the locales and categories into something bizarre. See for example http://london.openguides.org/index.cgi?Marylebone_Station
oglondontest=> select metadata_value from metadata where node='Marylebone Station' and metadata_type='category' and version=8; metadata_value
Rail Tube
(1 row)
Hummm... This is interesting, as the hoover script does not attempt to do anything clever with the metadata - it just passes other form fields intact - or so it appears to do. Perhaps there is something that a browser does to a textarea field which my LWP::UserAgent code is not doing, or maybe some escaping that is needed with POST :(.
We have a textbox containing Rail\nTube AFAIAA. This is passed intact to POST, and to the CGI script, which should DWIM and turn 2 lines of text into two rows. Why is the CGI script not seeing the text as separate lines?
I'm puzzled.
I suspect this might have something to do with the wiki hoover - certainly the "last five nodes" edited by it all exhibit the problem. http://london.openguides.org/index.cgi?username=Wiki%20Hoover&action=use...
Ivor, can you investigate please?
Argh, I really don't have time to work up something to fix all the mangled data right now. I'm going to have lunch and a think.
Are you responsible for Wiki Dyson? LOL :)
Before coming home and catching up on my emails, I did contemplate repackaging and releasing the Wiki Hoover to CPAN as a module (with a full set of tests of course ;).
I need to think about this error and do some client side debugging. I'll probably use my existing test pages on collab.orative.org for this.
Ivor.
On Mon 15 Dec 2003, Ivor Williams ivor.williams@tiscali.co.uk wrote:
Hummm... This is interesting, as the hoover script does not attempt to do anything clever with the metadata - it just passes other form fields intact - or so it appears to do. Perhaps there is something that a browser does to a textarea field which my LWP::UserAgent code is not doing, or maybe some escaping that is needed with POST :(.
If it helps - something that not a lot of people seem to know is that the CGI spec says newlines are \r\n regardless of OS.
Kake
openguides-london@lists.openguides.org
-
Earle Martin -
Ivor Williams -
Kate L Pugh