pycs-devel archive weblog

A blog for archiving the pycs-devel mailing list

2003-3-14

Phillip Pearson: Re: [PyCS-devel] forking inside a module script

> Hmm. fork doesn't exist in all OS - for example I seem to recall some
> problems with regard to Windows in that area (windows only supporting
> threading under python, not forking).
>
> And we have to take precautions if the forked process needs to talk to
> metakit databases [...]

Good points. In this case, the forking is restricted to a _very_
small function, so there's no need for extra locking. I guess we'd
need to hack something up with CreateProcess if we want it to run on
Windows. But then, does ht://Dig run on Windows anyway? :-)

Cheers,
Phil

Georg Bauer: Re: [PyCS-devel] did I mention?

Hi!

> it in the body of the app, and get PyCS to regenerate the page when it
> sees an RSS file being upstreamed...

That was my idea. Just a combined blog of everything that's upstreamed
on the community server. Something like weblogs.com on steroids - not
only the weblogs that are updated, but the actual updates in the feeds.
Might be interesting to have something like that. And it might
stimulate comunity building a bit.

bye, Georg

Phillip Pearson: Re: [PyCS-devel] did I mention?

> >a little mini-aggregator for pycs.net.
>
> Nice. You couldn't let Dave Winer go away with his little thing, right?
> ;-)

Haha... actually it was inspired by one of the other free blogging
sites (freeroller or blogalia or something) which has a big aggregated
feed of everything on the front page.

> Hmm. I already envision automatic inclusion of specially marked local
> rss feeds to give a non-admin-overhead community feed. Maybe with added
> auto-rss-generating, so the community feed can be included easily by
> others without the need to include all local feeds. Maybe some markup
> in the rss of the local feed and some auto-recognizing of RSS feeds
> with that markup in the Upstreaming-Code of xmlStorageSystem? Hmm.

Generating another RSS feed out of this sounds like a plan. If we put
some sort of templating in there, we can just have multiple output
templates and generate whatever format we like, I guess.

I guess if we swap over to the parser from PyDS (I'm using Mark
Pilgrim's one atm, just because I already had a copy), we can include
it in the body of the app, and get PyCS to regenerate the page when it
sees an RSS file being upstreamed...

Cheers,
Phil :)

Georg Bauer: Re: [PyCS-devel] did I mention?

Hi!

> http://www.pycs.net/allyourrss.html
>
> a little mini-aggregator for pycs.net.

Nice. You couldn't let Dave Winer go away with his little thing, right?
;-)

Hmm. I already envision automatic inclusion of specially marked local
rss feeds to give a non-admin-overhead community feed. Maybe with added
auto-rss-generating, so the community feed can be included easily by
others without the need to include all local feeds. Maybe some markup
in the rss of the local feed and some auto-recognizing of RSS feeds
with that markup in the Upstreaming-Code of xmlStorageSystem? Hmm.

bye, Georg

Georg Bauer: Re: [PyCS-devel] forking inside a module script

Hi!

> I've decided that the safest way to run htsearch is to fork inside the
> module script, run htsearch in the child process, and let the OS clean
> up after it.

Hmm. fork doesn't exist in all OS - for example I seem to recall some
problems with regard to Windows in that area (windows only supporting
threading under python, not forking).

And we have to take precautions if the forked process needs to talk to
metakit databases, as those are only single-user (but it might be that
they are only single-write but multiple-read, I didn't check that).

That's why in PyDS every tool has it's own lock object, so I can
protect database access against background threads concurrent access.

bye, Georg