[Scons-dev] Multiprocessing instead of threads?

[Russel Winder]

On Fri, 2015-11-20 at 19:51 -0800, Bill Deegan wrote:
> Greetings,
> 
> Would there be value in using python's multiprocessing package
> instead of
> threads?

As any consultant will tell you: it depends. Threads in Python suck due
to the GIL. Conversely, threads work fine for concurrency due to the
GIL, assuming you have no interest whatsoever in parallelism.

Parallelism in Python currently requires use of multiprocessing. It
works but there is an overhead. And the synchronization infrastructure
of multiprocessing is really rather naïve and under-performant.

Sarah Mount has needed a far better low level process communication
synchronization and communication infrastructure for Python-CSP. I said
I would investigate. To date I have failed. Perhaps in 2016-02…

> Anyone have experience using this package?

Yes.

!

-- 
Russel.
=============================================================================
Dr Russel Winder      t: +44 20 7585 2200   voip: sip:russel.winder at ekiga.net
41 Buckmaster Road    m: +44 7770 465 077   xmpp: russel at winder.org.uk
London SW11 1EN, UK   w: www.russel.org.uk  skype: russel_winder

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 181 bytes
Desc: This is a digitally signed message part
URL: <https://pairlist2.pair.net/pipermail/scons-dev/attachments/20151122/720132e5/attachment.pgp>