Current File : //usr/local/lib/python3.8/multiprocessing/__pycache__/managers.cpython-38.pyc
U
qa @ sB d ddddgZ ddlZddlZddlZddlZddlZddlZddlZddlmZ ddl m
Z
d d
l m Z d d l
mZmZmZ d d l mZ d d
l mZ d dl mZ d dl mZ zd dl mZ dZW n ek
r dZY nX dd Zeeje dd dD Zed ek r.dd Z eD ]Z ee e qG dd de Z di fd d Z d d Z!G d d! d!e"Z#d"d# Z$d$d% Z%G d&d' d'e Z&G d(d) d)e Z'e j(e j)fe j*e j+fd*Z,G d+d d e Z-G d,d- d-e.Z/G d.d de Z0d/d0 Z1i fd1d2Z2dld3d4Z3G d5d6 d6e Z4G d7d8 d8e Z5dmd9d:Z6G d;d< d<e0Z7G d=d> d>e0Z8G d?d@ d@e8Z9G dAdB dBe0Z:G dCdD dDe0Z;G dEdF dFe0Z<G dGdH dHe0Z=e2dIdJZ>G dKdL dLe>Z?e2dMdNZ@dOdPie@_Ae2dQdRZBe2dSdTZCdUdUdUdPdPdVeC_AG dWdS dSeCZDG dXd de-ZEeEdYejF eEdZejF eEd[ejGe: eEd\ejHe8 eEd]ejIe8 eEd^ejJe8 eEd_ejKe8 eEd`ejLe9 eEdaejMe; eEdbejNeD eEdcee? eEddeOe@ eEd8e5e= eEd:e6eB eEd6e4e< eEjdPe7dde eEjdUddf er>G dgdh dhZPG didj dje&ZQG dkd de-ZRdS )n BaseManager SyncManager BaseProxyTokenSharedMemoryManager N)getpid)
format_exc )
connection) reductionget_spawning_popen ProcessError)pool)process)util) get_context)
shared_memoryTFc C s t j | j| ffS N)arraytypecodetobytes)a r 4/usr/local/lib/python3.8/multiprocessing/managers.py reduce_array- s r c C s g | ]}t ti | qS r )typegetattr.0namer r r
<listcomp>1 s r )itemskeysvaluesc C s t t | ffS r )listobjr r r rebuild_as_list3 s r' c @ s4 e Zd ZdZdZdd Zdd Zdd Zd d
Zd S ) r z3
Type to uniquely identify a shared object
typeidaddressidc C s ||| | _ | _| _d S r r( )selfr) r* r+ r r r __init__B s zToken.__init__c C s | j | j| jfS r r( r, r r r __getstate__E s zToken.__getstate__c C s |\| _ | _| _d S r r( r, stater r r __setstate__H s zToken.__setstate__c C s d| j j| j| j| jf S )Nz %s(typeid=%r, address=%r, id=%r)) __class____name__r) r* r+ r. r r r __repr__K s zToken.__repr__N) r4
__module__ __qualname____doc__ __slots__r- r/ r2 r5 r r r r r < s r c C s8 | ||||f | \}}|dkr*|S t||dS )zL
Send a message to manager using connection `c` and return response
#RETURNN)sendrecvconvert_to_error)cr+
methodnameargskwdskindresultr r r dispatchS s
rD c C sd | dkr |S | dkrRt |ts4td|| t|| dkrHtd| S t|S ntd| S d S )N#ERROR)
#TRACEBACK#UNSERIALIZABLEz.Result {0!r} (kind '{1}') type is {2}, not strrG zUnserializable message: %s
z Unrecognized message type {!r})
isinstancestr TypeErrorformatr RemoteError
ValueError)rB rC r r r r= ] s
r= c @ s e Zd Zdd ZdS )rL c C s dt | jd d S )NzM
---------------------------------------------------------------------------
r zK---------------------------------------------------------------------------)rI r@ r. r r r __str__m s zRemoteError.__str__N)r4 r6 r7 rN r r r r rL l s rL c C s2 g }t | D ] }t| |}t|r || q |S )z4
Return a list of names of methods of `obj`
)dirr callableappend)r& tempr funcr r r all_methodst s
rT c C s dd t | D S )zP
Return a list of names of methods of `obj` which do not start with '_'
c S s g | ]}|d dkr|qS )r _r r r r r r s z"public_methods.<locals>.<listcomp>)rT r% r r r public_methods s rV c @ s e Zd ZdZdddddddd d
g Zd d Zd
d Zdd Zdd Zdd Z dd Z
dd Z dd Z e e e
dZ
d d Zd d Zd d! Zd"d# Zd$d% Zd&e_d'd( Zd)d* Zd+d, Zd-d. Zd/S )0ServerzM
Server class which runs in a process controlled by a manager object
shutdowncreateaccept_connection get_methods
debug_infonumber_of_objectsdummyincrefdecrefc C sx t |ts td|t||| _t|| _t | \}}||dd| _
| j
j | _ ddi| _ i | _
i | _t | _d S )Nz&Authkey {0!r} is type {1!s}, not bytes )r* backlog0Nr )rH bytesrJ rK r registryr AuthenticationStringauthkeylistener_clientlistenerr* id_to_objid_to_refcountid_to_local_proxy_obj threadingLockmutex)r, rf r* rh
serializerListenerClientr r r r- s
zServer.__init__c C s t | _| t _zVt j| jd}d|_| z | j sL| jd q4W n ttfk
rf Y nX W 5 tjtjkrt
d tjt_tj t_ t
d X dS )z(
Run the server forever
zresetting stdout, stderrr )targetTr N)rn Event
stop_eventr current_process_manager_serversysstdout
__stdout__r debug
__stderr__stderrexitThreadaccepterdaemonstartis_setwaitKeyboardInterrupt
SystemExit)r, r r r r
serve_forever s
zServer.serve_foreverc C sN z| j }W n tk
r& Y q Y nX tj| j|fd}d|_| q d S )Nrt r@ T)rj acceptOSErrorrn r handle_requestr r )r, r> tr r r r s
zServer.accepterc C sL d } }}zTt || j t || j | }|\}}}}|| jksTtd| t| |}W n tk
r~ dt f} Y n>X z||f||}W n tk
r dt f} Y n
X d|f} z|
| W nt tk
r> }
zTz|
dt f W n tk
r Y nX t d| t d| t d|
W 5 d}
~
X Y nX |
dS )z)
Handle a new connection
Nz%r unrecognizedrF r: zFailure to send message: %rz ... request was %r ... exception was %r)r
deliver_challengerh answer_challenger< publicAssertionErrorr Exceptionr r; r infoclose) r, r> funcnamerC requestignorer@ rA rS msger r r r s4 zServer.handle_requestc
C s t dt j |j}|j}| j}| j szBd }}| }|\}}} }
z|| \}} } W n^ t
k
r }
z@z| j | \}} } W n& t
k
r } z|
W 5 d}~X Y nX W 5 d}
~
X Y nX || krt d|t
|| f t||}z|| |
}W n, tk
r" } z d|f}W 5 d}~X Y nPX | o4| |d}|rj| |||\}}t|| j|}d||ff}nd|f}W n t k
r |dkrdt f}nNz,| j| }|| |||f| |
}d|f}W n tk
r dt f}Y nX Y nP tk
r t dt j td Y n tk
r< dt f}Y nX zDz || W n2 tk
r~ } z|d
t f W 5 d}~X Y nX W q$ tk
r } z@t d t j t d | t d
| | td W 5 d}~X Y q$X q$dS )zQ
Handle requests from the proxies in a particular process/thread
z$starting server thread to service %rNz+method %r of %r object is not in exposed=%rrE #PROXYr: rF z$got EOF -- exiting thread serving %rr rG z exception in thread serving %rz ... message was %rr r )r r| rn current_threadr r< r; rk rv r KeyErrorrm AttributeErrorr r r getrY r r* r fallback_mappingEOFErrorry r r r )r, connr< r; rk r? r& r identr@ rA exposed gettypeidkeZ second_kefunctionresr r r) ZridentZrexposedtokenZ
fallback_funcrC r r r serve_client s (
$ zServer.serve_clientc C s |S r r r, r r r& r r r fallback_getvalue5 s zServer.fallback_getvaluec C s t |S r rI r r r r fallback_str8 s zServer.fallback_strc C s t |S r )reprr r r r
fallback_repr; s zServer.fallback_repr)rN r5 #GETVALUEc C s d S r r r, r> r r r r^ D s z Server.dummyc
C s | j t g }t| j }| |D ]<}|dkr&|d|| j| t| j| d dd f q&d|W 5 Q R S Q R X dS )zO
Return some info --- useful to spot problems with refcounting
rc z %s: refcount=%s
%sr NK
) rp r$ rl r" sortrQ rI rk join)r, r> rC r" r r r r r\ G s
zServer.debug_infoc C s
t | jS )z*
Number of shared objects
)lenrl r r r r r] W s zServer.number_of_objectsc C sL z:ztd |d W n ddl}| Y nX W 5 | j X dS )z'
Shutdown this process
z!manager received shutdown messager: Nr N)rv setr r| r; traceback print_exc)r, r> r r r r rX ^ s
zServer.shutdownc O s t | dkr| ^}}}} n| s(tdnd|krDtdt | d |d}t | dkr~| ^}}} ddl}|jd tdd
nFd |krtdt | d |d }| ^}} ddl}|jd tdd
t| } |j |j| \}}}} |dkr|st | dkr t d
| d }
n
|| |}
|dkr2t
|
}|dk rlt |t s\td
|t|t|t| }dt|
} td|| |
t||f|j| < | |jkrd|j| < W 5 Q R X ||| | t|fS )z>
Create a new shared object and return its id
z8descriptor 'create' of 'Server' object needs an argumentr) 7create expected at least 2 positional arguments, got %dr r Nz2Passing 'typeid' as keyword argument is deprecated)
stacklevelr> z-Passing 'c' as keyword argument is deprecatedz4Without callable, must have one non-keyword argumentz,Method_to_typeid {0!r}: type {1!s}, not dictz%xz&%r callable returned object with id %r)r rJ popwarningswarnDeprecationWarningtuplerp rf rM rV rH dictrK r r$ r+ r r| r rk rl r_ ) r@ rA r, r> r) r rP r method_to_typeid proxytyper& r r r r rY k sp
z
Server.createz$($self, c, typeid, /, *args, **kwds)c C s t | j|j d S )zL
Return the methods of the shared object indicated by token
r )r rk r+ )r, r> r r r r r[ s zServer.get_methodsc C s" |t _|d | | dS )z=
Spawn a new thread to serve this connection
r N)rn r r r; r )r, r> r r r r rZ s
zServer.accept_connectionc C s | j z| j| d7 < W nh tk
r } zJ|| jkrrd| j|< | j| | j|< | j| \}}}td| n|W 5 d }~X Y nX W 5 Q R X d S )Nr z&Server re-enabled tracking & INCREF %r)rp rl r rm rk r r| )r, r> r r r& r r r r r r_ s
z
Server.increfc C s || j kr$|| jkr$td| d S | jZ | j | dkrXtd|| j| | j | | j | d8 < | j | dkr| j |= W 5 Q R X || j krd| j|< td| | j | j|= W 5 Q R X d S )NzServer DECREF skipping %rr z+Id {0!s} ({1!r}) has refcount {2:n}, not 1+r )Nr Nzdisposing of obj with id %r)rl rm r r| rp r rK rk )r, r> r r r r r` s,
z
Server.decrefN)r4 r6 r7 r8 r r- r r r r r r r r r^ r\ r] rX rY __text_signature__r[ rZ r_ r` r r r r rW s<
"Q
=rW c @ s e Zd ZdgZdZdZdZdS )Statevaluer r r N)r4 r6 r7 r9 INITIALSTARTEDSHUTDOWNr r r r r s r )pickle xmlrpclibc @ s e Zd ZdZi ZeZd"ddZdd Zdd Z d#d d Z
e d$d
dZ dd Z
d%ddZdd Zdd Zdd Zdd Zedd Zed d Ze d&d d!ZdS )'r z!
Base class for managers
Nr c C s\ |d krt j}|| _t || _t | _tj| j_ || _
t | \| _ | _
|pTt | _d S r )r rw rh _addressrg _authkeyr _stater r _serializerri Z _Listener_Clientr _ctx)r, r* rh rq ctxr r r r- s
zBaseManager.__init__c C sf | j jtjkrP| j jtjkr&tdn*| j jtjkr>tdntd| j jt| j | j
| j | j S )zX
Return server object with serve_forever() method and address attribute
Already started serverManager has shut downUnknown state {!r})
r r r r r r
r rK rW _registryr r r r. r r r
get_server s
zBaseManager.get_serverc C s8 t | j \}}|| j| jd}t|dd tj| j_dS )z>
Connect manager object to the server process
rh Nr^ ) ri r r r rD r r r r )r, rr rs r r r r connect s zBaseManager.connectr c C s4 | j jtjkrP| j jtjkr&tdn*| j jtjkr>tdntd| j j|dk rht|sht dt
j dd\}}| j j
t| j| j| j| j| j|||fd| _d d
d | jjD }t| jd | | j_| j | | | _| tj| j _t j | t| j | j| j| j| j | j fd
d| _ dS )z@
Spawn a server process for this manager object
r r r Nz initializer must be a callableF)duplexr :c s s | ]}t |V qd S r r )r ir r r <genexpr>A s z$BaseManager.start.<locals>.<genexpr>-r r@ exitpriority)!r r r r r r
r rK rP rJ r
Piper Processr _run_serverr r r r _processr _identityr4 r r r r< r Finalize_finalize_managerr rX )r, initializerinitargsreaderwriterr r r r r ( sH
zBaseManager.startc C s^ t t jt j |dk r || | ||||}||j | td|j | dS )z@
Create a server, report its address and run it
Nzmanager serving at %r)
signalSIGINTSIG_IGN_Serverr; r* r r r r ) clsrf r* rh rq r r r serverr r r r S s zBaseManager._run_serverc O sd | j jtjkstd| j| j| jd}z t |dd|f| |\}}W 5 | X t
|| j||fS )zP
Create a new shared object; return the token and exposed tuple
zserver not yet startedr NrY ) r r r r r r r r r rD r )r, r) r@ rA r r+ r r r r _createj s
zBaseManager._createc C s* | j dk r&| j | | j s&d| _ dS )zC
Join the manager process (if it has been spawned)
N)r r is_aliver, timeoutr r r r v s
zBaseManager.joinc C s2 | j | j| jd}zt|ddW S | X dS )zS
Return some info about the servers shared objects and connections
r Nr\ r r r r rD r, r r r r _debug_info s zBaseManager._debug_infoc C s2 | j | j| jd}zt|ddW S | X dS )z5
Return the number of shared objects
r Nr] r r r r r _number_of_objects s z BaseManager._number_of_objectsc C sj | j jtjkr| | j jtjkrf| j jtjkr<tdn*| j jtjkrTtdntd| j j| S )NzUnable to start serverr r ) r r r r r r r
r rK r. r r r __enter__ s
zBaseManager.__enter__c C s | d S r )rX r, exc_typeexc_valexc_tbr r r __exit__ s zBaseManager.__exit__c C s | rtd z,|||d}zt|dd W 5 | X W n tk
rR Y nX | jdd | rtd t| drtd | | jd
d | rtd t j
|_ z t j
|= W n tk
r Y nX dS ) zQ
Shutdown the manager process; will be registered as a finalizer
z#sending shutdown message to managerr NrX g ?)r zmanager still alive terminatez'trying to `terminate()` manager processg?z#manager still alive after terminate)r r r r rD r r hasattrr r r r r _address_to_localr )r r* rh r1 r r r r r r s.
z BaseManager._finalize_managerc C s | j S r )r r. r r r r* s zBaseManager.addressTc
s d| j kr| j | _ dkr"t |p0t dd}|p@t dd}|rt| D ]8\}}t|tksrt d| t|tksRt d| qR||| f| j< |r fdd} | _
t | | dS )z9
Register a typeid with the manager type
r N _exposed__method_to_typeid_z%r is not a stringc s` t d | jf||\}} || j| | j|d}| j|j| jd}t|d d|jf |S )Nz)requesting creation of a shared %r objectmanagerrh r r r` ) r r| r r r r r* rD r+ )r, r@ rA r expproxyr r r) r r rR s z"BaseManager.register.<locals>.temp) __dict__r copy AutoProxyr r$ r! r rI r r4 setattr)
r r) rP r r r
create_methodkeyr rR r r
r register s*
zBaseManager.register)NNr N)Nr )Nr )N)NNNNT)r4 r6 r7 r8 r rW r r- r r r classmethodr r r r r r r staticmethodr propertyr* r r r r r r s8
+
c @ s e Zd Zdd Zdd ZdS )ProcessLocalSetc C s t | dd d S )Nc S s | S r )clearr% r r r <lambda> z*ProcessLocalSet.__init__.<locals>.<lambda>)r register_after_forkr. r r r r- s zProcessLocalSet.__init__c C s t | dfS rd )r r. r r r
__reduce__ s zProcessLocalSet.__reduce__N)r4 r6 r7 r- r r r r r r s r c @ s e Zd ZdZi Ze Zd ddZdd Z d i fd
d Z
d d
Z dd Z e
dd Zdd Zdd Zdd Zdd Zdd ZdS ) r z.
A base for proxies of shared objects
NTFc C s t j8 t j|jd }|d kr:t t f}|t j|j< W 5 Q R X |d | _|d | _ || _
| j
j | _ || _
|| _t| d | _|| _|d k rt|| _n"| j
d k r| j
j| _n t j| _|r| t| t j d S )Nr r )r _mutexr r r* r ForkAwareLocalr _tls_idset_tokenr+ _id_managerr ri r _owned_by_managerr rg r rw rh _increfr _after_fork) r, r rq r
rh r r_
manager_ownedZ tls_idsetr r r r- s*
zBaseProxy.__init__c C sd t d t j}t jdkr4|dt j 7 }| j| jj | j
d}t |d d|f || j _
d S )Nz making connection to manager
MainThread|r rZ )r r| r rw r rn r r r" r* r rD r r
)r, r r r r r _connect- s
zBaseProxy._connectr c C s z | j j}W n6 tk
rB tdt j | | j j}Y nX | | j
|||f | \}}|dkrp|S |dkr|\}}| j j
|j d } | jj|_| || j| j | j|d}
| j|j| jd}t|dd|jf |
S t||dS ) zV
Try to call a method of the referent and return a copy of the result
z#thread %r does not own a connectionr: r r r Nr` )r r
r r r| rn r r r+ r; r# r< r$ r r) r" r* r r r rD r+ r= ) r, r? r@ rA r rB rC r r r r r r r _callmethod6 s6
zBaseProxy._callmethodc C s
| dS )z9
Get a copy of the value of the referent
r r- r. r r r _getvalueT s zBaseProxy._getvaluec C s | j rtd| jj d S | j| jj| jd}t|d d| j f td| jj | j
| j | j oj| j j
}tj| tj| j| j|| j| j
| jfdd| _d S )Nz%owned_by_manager skipped INCREF of %rr r_ z INCREF %r
r )r% r r| r" r+ r r* r rD r# r! addr$ r r r _decrefr _close)r, r r1 r r r r& Z s$
zBaseProxy._increfc
C s | | j |d ks |jtjkrz2td| j || j|d}t|d d| jf W q t k
r } ztd| W 5 d }~X Y qX ntd| j |st
|drtdt j
|j |`d S )Nz DECREF %rr r` z... decref failed %sz%DECREF %r -- manager already shutdownr
z-thread %r has no more proxies so closing conn)discardr+ r r r r r| r* rD r r rn r r r
r )r rh r1 ZtlsZidsetr r r r r r r2 n s
zBaseProxy._decrefc
C sH d | _ z | W n0 tk
rB } ztd| W 5 d }~X Y nX d S )Nzincref failed: %s)r$ r& r r r )r, r r r r r' s
zBaseProxy._after_forkc C s^ i }t d k r| j|d< t| ddrB| j|d< tt| j| j|ffS tt| | j| j|ffS d S )Nrh _isautoFr ) r r r r RebuildProxyr r" r r r, rA r r r r s
zBaseProxy.__reduce__c C s | S r )r/ )r, memor r r __deepcopy__ s zBaseProxy.__deepcopy__c C s dt | j| jjt| f S )Nz <%s object, typeid %r at %#x>)r r4 r" r) r+ r. r r r r5 s zBaseProxy.__repr__c C s: z | dW S tk
r4 t| dd d Y S X dS )zV
Return representation of the referent (or a fall-back if that fails)
r5 Nr, z; '__str__()' failed>)r- r r r. r r r rN s zBaseProxy.__str__)NNNTF)r4 r6 r7 r8 r r ForkAwareThreadLockr r- r+ r- r/ r& r r2 r' r r9 r5 rN r r r r r s(
)
c C s t t dd}|rT|j|jkrTtd| d|d< |j|jkrT|j|j |j|j< | ddopt t dd }| ||fd|i|S ) z5
Function used for unpickling proxy objects.
rx Nz*Rebuild a proxy owned by manager, token=%rTr( r_ Z _inheritingF)
r r rw r* r r| r+ rm rk r )rS r rq rA r r_ r r r r6 s
r6 c C sp t |}z|| |f W S tk
r* Y nX i }|D ]}td||f | q4t| tf|}||_||| |f< |S )zB
Return a proxy type whose methods are given by `exposed`
zOdef %s(self, /, *args, **kwds):
return self._callmethod(%r, args, kwds))r r execr r r )r r _cacheZdicmeth ProxyTyper r r
MakeProxyType s r? c
C s t | d }|dkrB|| j|d}zt|dd| f}W 5 | X |dkrX|dk rX|j}|dkrjt j}td| j |}|| ||||d} d| _
| S )z*
Return an auto-proxy for `token`
r Nr r[ z
AutoProxy[%s])r
rh r_ T) ri r* r rD r r rw rh r? r) r5 )
r rq r
rh r r_ r r r> r r r r r s
r c @ s e Zd Zdd Zdd ZdS ) Namespacec K s | j | d S r )r updater7 r r r r- s zNamespace.__init__c C sZ t | j }g }|D ]$\}}|ds|d||f q| d| jjd|f S )NrU z%s=%rz%s(%s)z, ) r$ r r!
startswithrQ r r3 r4 r )r, r! rR r r r r r r5 s
zNamespace.__repr__N)r4 r6 r7 r- r5 r r r r r@ s r@ c @ s8 e Zd Zd ddZdd Zdd Zdd ZeeeZd
S ) ValueTc C s || _ || _d S r ) _typecode_value)r, r r lockr r r r- s zValue.__init__c C s | j S r rE r. r r r r s z Value.getc C s
|| _ d S r rG r, r r r r r
s z Value.setc C s dt | j| j| jf S )Nz
%s(%r, %r))r r4 rD rE r. r r r r5 s zValue.__repr__N)T) r4 r6 r7 r- r r r5 r r r r r r rC s
rC c C s t | |S r )r )r sequencerF r r r Array s rJ c @ s8 e Zd ZdZdd Zdd Zdd Zdd Zd
d Zd S )
IteratorProxy)__next__r; throwr c C s | S r r r. r r r __iter__ s zIteratorProxy.__iter__c G s | d|S )NrL r. r, r@ r r r rL s zIteratorProxy.__next__c G s | d|S )Nr; r. rO r r r r; s zIteratorProxy.sendc G s | d|S )NrM r. rO r r r rM s zIteratorProxy.throwc G s | d|S )Nr r. rO r r r r ! s zIteratorProxy.closeN) r4 r6 r7 r rN rL r; rM r r r r r rK s rK c @ s2 e Zd ZdZd ddZdd Zdd Zd
d ZdS )
AcquirerProxy)acquirereleaseTNc C s" |d kr|fn||f}| d|S NrQ r. )r, blockingr r@ r r r rQ ' s zAcquirerProxy.acquirec C s
| dS NrR r. r. r r r rR * s zAcquirerProxy.releasec C s
| dS rS r. r. r r r r , s zAcquirerProxy.__enter__c C s
| dS rU r. r r r r r . s zAcquirerProxy.__exit__)TN)r4 r6 r7 r rQ rR r r r r r r rP % s
rP c @ s6 e Zd ZdZd ddZd
ddZdd Zdd
d ZdS )ConditionProxy)rQ rR r notify
notify_allNc C s | d|fS Nr r. r r r r r 4 s zConditionProxy.waitr c C s | d|fS )NrW r. )r, nr r r rW 6 s zConditionProxy.notifyc C s
| dS )NrX r. r. r r r rX 8 s zConditionProxy.notify_allc C sd | }|r|S |d k r$t | }nd }d }|s`|d k rN|t }|dkrNq`| | | }q,|S )Nr )time monotonicr )r, predicater rC endtimewaittimer r r wait_for: s
zConditionProxy.wait_for)N)r )N)r4 r6 r7 r r rW rX r` r r r r rV 2 s
rV c @ s2 e Zd ZdZdd Zdd Zdd Zd d d
ZdS )
EventProxy)r r r r c C s
| dS )Nr r. r. r r r r O s zEventProxy.is_setc C s
| dS Nr r. r. r r r r Q s zEventProxy.setc C s
| dS )Nr r. r. r r r r S s zEventProxy.clearNc C s | d|fS rY r. r r r r r U s zEventProxy.wait)N)r4 r6 r7 r r r r r r r r r ra M s
ra c @ sN e Zd ZdZdddZdd Zdd Zed d
Zed d Z ed
d Z
dS ) BarrierProxy)__getattribute__r abortresetNc C s | d|fS rY r. r r r r r [ s zBarrierProxy.waitc C s
| dS )Nre r. r. r r r re ] s zBarrierProxy.abortc C s
| dS )Nrf r. r. r r r rf _ s zBarrierProxy.resetc C s | ddS )Nrd )partiesr. r. r r r rg a s zBarrierProxy.partiesc C s | ddS )Nrd ) n_waitingr. r. r r r rh d s zBarrierProxy.n_waitingc C s | ddS )Nrd )brokenr. r. r r r ri g s zBarrierProxy.broken)N) r4 r6 r7 r r re rf r rg rh ri r r r r rc Y s
rc c @ s( e Zd ZdZdd Zdd Zdd ZdS ) NamespaceProxy)rd __setattr__ __delattr__c C s0 |d dkrt | |S t | d}|d|fS )Nr rU r- rd )objectrd r, r
callmethodr r r __getattr__n s zNamespaceProxy.__getattr__c C s4 |d dkrt | ||S t | d}|d||fS )Nr rU r- rk )rm rk rd )r, r r ro r r r rk s s zNamespaceProxy.__setattr__c C s0 |d dkrt | |S t | d}|d|fS )Nr rU r- rl )rm rl rd rn r r r rl x s zNamespaceProxy.__delattr__N)r4 r6 r7 r rp rk rl r r r r rj l s rj c @ s* e Zd ZdZdd Zdd ZeeeZdS )
ValueProxy)r r c C s
| dS )Nr r. r. r r r r s zValueProxy.getc C s | d|fS rb r. rH r r r r s zValueProxy.setN)r4 r6 r7 r r r r r r r r r rq s rq
BaseListProxy)__add__ __contains__ __delitem__ __getitem____len____mul__ __reversed____rmul__ __setitem__rQ countextendindexinsertr removereverser __imul__c @ s e Zd Zdd Zdd ZdS ) ListProxyc C s | d|f | S )Nr} r. rH r r r __iadd__ s zListProxy.__iadd__c C s | d|f | S )Nr r. rH r r r r s zListProxy.__imul__N)r4 r6 r7 r r r r r r r s r DictProxy)rt ru rv rN rw r{ r r r r! r" r popitem
setdefaultrA r# rN Iterator
ArrayProxy)rw rv r{ PoolProxy) Zapply apply_asyncr imapimap_unorderedr map map_asyncstarmap
starmap_asyncr Z AsyncResult)r r r r r c @ s e Zd Zdd Zdd ZdS )r c C s | S r r r. r r r r s zPoolProxy.__enter__c C s | d S r )r r r r r r s zPoolProxy.__exit__N)r4 r6 r7 r r r r r r r s c @ s e Zd ZdZdS )r a(
Subclass of `BaseManager` which supports a number of shared object types.
The types registered are those intended for the synchronization
of threads, plus `dict`, `list` and `Namespace`.
The `multiprocessing.Manager()` function creates started instances of
this class.
N)r4 r6 r7 r8 r r r r r s Queue
JoinableQueueru ro RLock SemaphoreBoundedSemaphore ConditionBarrierPoolr$ r )r r )r c @ sL e Zd ZdZg fddZdd Zdd Zdd Zd
d Zd d
Z dd Z
dS )_SharedMemoryTrackerz+Manages one or more shared memory segments.c C s || _ || _d S r Zshared_memory_context_name
segment_names)r, r r r r r r- s z _SharedMemoryTracker.__init__c C s( t d|dt | j| dS )z6Adds the supplied shared memory block name to tracker.zRegister segment in pid N)r r| r r rQ r, segment_namer r r register_segment s z%_SharedMemoryTracker.register_segmentc C sB t d|dt | j| t|}| | dS )zCalls unlink() on the shared memory block with the supplied name
and removes it from the list of blocks being tracked.zDestroy segment r N) r r| r r r r SharedMemoryr unlink)r, r Zsegmentr r r destroy_segment s
z$_SharedMemoryTracker.destroy_segmentc C s" | j dd D ]}| | qdS )z<Calls destroy_segment() on all tracked shared memory blocks.N)r r r r r r r s z_SharedMemoryTracker.unlinkc C s( t d| jj dt | d S )NzCall z .__del__ in )r r| r3 r4 r r r. r r r __del__ s z _SharedMemoryTracker.__del__c C s | j | jfS r r r. r r r r/ s z!_SharedMemoryTracker.__getstate__c C s | j | d S r )r- r0 r r r r2 s z!_SharedMemoryTracker.__setstate__N) r4 r6 r7 r8 r- r r r r r/ r2 r r r r r s r c @ sR e Zd Zejdddg Zdd Zdd Zde_d d
Zd d Z d
d Z
dd Z dS )SharedMemoryServer
track_segmentrelease_segment
list_segmentsc O sZ t j| f|| | j}t|tr,t|}td| dt | _ t
dt d S )NZshm_rU z"SharedMemoryServer started by pid ) rW r- r* rH re osfsdecoder r shared_memory_contextr r| )r, r@ kwargsr* r r r r-
s
zSharedMemoryServer.__init__c O st t | dkr| d }n4d|kr(|d }n"| s6tdntdt | d ttj| d drhtj|d < tj| |S )
zCreate a new distributed-shared object (not backed by a shared
memory block) and return its id to be used in a Proxy Object.r r r) zDdescriptor 'create' of 'SharedMemoryServer' object needs an argumentr r r, Z_shared_memory_proxyr )r rJ r r, rf r rW rY )r@ r Ztypeodr) r r r rY s
zSharedMemoryServer.createz&($self, c, typeid, /, *args, **kwargs)c C s | j t| |S )zACall unlink() on all tracked shared memory, terminate the Server.)r r rW rX r r r r rX ) s
zSharedMemoryServer.shutdownc C s | j | dS )z?Adds the supplied shared memory block name to Server's tracker.N)r r r, r> r r r r r . s z SharedMemoryServer.track_segmentc C s | j | dS )zCalls unlink() on the shared memory block with the supplied name
and removes it from the tracker instance inside the Server.N)r r r r r r r 2 s z"SharedMemoryServer.release_segmentc C s | j jS )zbReturns a list of names of shared memory blocks that the Server
is currently tracking.)r r r r r r r 7 s z SharedMemoryServer.list_segmentsN) r4 r6 r7 rW r r- rY r rX r r r r r r r r s
r c @ s< e Zd ZdZeZdd Zdd Zdd Zdd Z d
d Z
d S )
r a Like SyncManager but uses SharedMemoryServer instead of Server.
It provides methods for creating and returning SharedMemory instances
and for creating a list-like object (ShareableList) backed by shared
memory. It also provides methods that create and return Proxy Objects
that support synchronization across processes (i.e. multi-process-safe
locks and semaphores).
c O sN t jdkr ddlm} | tj| f|| t| j j
dt d S )Nposixr )resource_trackerz created by pid ) r r r Zensure_runningr r- r r| r3 r4 r )r, r@ r r r r r r- I s
z SharedMemoryManager.__init__c C s t | jj dt d S )Nz.__del__ by pid )r r| r3 r4 r r. r r r r U s zSharedMemoryManager.__del__c C sh | j jtjkrP| j jtjkr&tdn*| j jtjkr>tdntd| j j| | j | j
| j | j S )z@Better than monkeypatching for now; merge into Server ultimatelyz"Already started SharedMemoryServerz!SharedMemoryManager has shut downr )
r r r r r r
r rK r r r r r r. r r r r Y s
z SharedMemoryManager.get_serverc C sx | j | j| jd\}tjdd|d}zt|dd|jf W n. tk
rh } z| |W 5 d}~X Y nX W 5 Q R X |S )zoReturns a new SharedMemory instance with the specified size in
bytes, to be tracked by the manager.r NT)rY sizer ) r r r r r rD r
BaseExceptionr )r, r r Zsmsr r r r r f s z SharedMemoryManager.SharedMemoryc C sv | j | j| jdZ}t|}zt|dd|jjf W n0 tk
rf } z|j |W 5 d}~X Y nX W 5 Q R X |S )zReturns a new ShareableList instance populated with the values
from the input sequence, to be tracked by the manager.r Nr )
r r r r
ShareableListrD Zshmr r r )r, rI r slr r r r r r s
z!SharedMemoryManager.ShareableListN) r4 r6 r7 r8 r r r- r r r r r r r r r = s
)NNNT)T)S__all__ry rn r r queuer[ r r r r r r
contextr r r
r r r r r Z HAS_SHMEM ImportErrorr r Z
view_typesr$ r' Z view_typerm r rD r= r rL rT rV rW r rr rs XmlListener XmlClientri r r r r r6 r? r r@ rC rJ rK rP rV ra rc rj rq rr r r r r Z
BasePoolProxyr r r ru ro r r r r r r r r r r r r r r <module> s
c
w
4
%8
Mini Shell