o i@sdZddlmZddlmZddlmZmZmZddl m Z ddl m Z ddl mZdd lmZGd d d Ze e Gd d d ZdS)zZ Implementation of a L{Team} of workers; a thread-pool that can allocate work to workers. ) annotations)deque)CallableOptionalSet) implementer)IWorker)Quit)IExclusiveWorkerc@seZdZdZd dd Zd S) Statisticsa Statistics about a L{Team}'s current activity. @ivar idleWorkerCount: The number of idle workers. @type idleWorkerCount: L{int} @ivar busyWorkerCount: The number of busy workers. @type busyWorkerCount: L{int} @ivar backloggedWorkCount: The number of work items passed to L{Team.do} which have not yet been sent to a worker to be performed because not enough workers are available. @type backloggedWorkCount: L{int} idleWorkerCountintbusyWorkerCountbackloggedWorkCountreturnNonecCs||_||_||_dSN)r rr)selfr rrr\C:\Users\psant\Downloads\PAF backend\school\venv\Lib\site-packages\twisted/_threads/_team.py__init__%s zStatistics.__init__N)r rrrrrrr)__name__ __module__ __qualname____doc__rrrrrr sr c@sneZdZdZd&dd Zd'd d Zd(ddZd)d*ddZd)d*ddZd+ddZ d,ddZ d-d"d#Z d.d$d%Z dS)/Teamax A composite L{IWorker} implementation. @ivar _quit: A L{Quit} flag indicating whether this L{Team} has been quit yet. This may be set by an arbitrary thread since L{Team.quit} may be called from anywhere. @ivar _coordinator: the L{IExclusiveWorker} coordinating access to this L{Team}'s internal resources. @ivar _createWorker: a callable that will create new workers. @ivar _logException: a 0-argument callable called in an exception context when there is an unhandled error from a task passed to L{Team.do} @ivar _idle: a L{set} of idle workers. @ivar _busyCount: the number of workers currently busy. @ivar _pending: a C{deque} of tasks - that is, 0-argument callables passed to L{Team.do} - that are outstanding. @ivar _shouldQuitCoordinator: A flag indicating that the coordinator should be quit at the next available opportunity. Unlike L{Team._quit}, this flag is only set by the coordinator. @ivar _toShrink: the number of workers to shrink this L{Team} by at the next available opportunity; set in the coordinator. coordinatorr createWorkerCallable[[], Optional[IWorker]] logExceptionCallable[[], None]cCs@t|_||_||_||_t|_d|_t|_ d|_ d|_ dS)a @param coordinator: an L{IExclusiveWorker} which will coordinate access to resources on this L{Team}; that is to say, an L{IExclusiveWorker} whose C{do} method ensures that its given work will be executed in a mutually exclusive context, not in parallel with other work enqueued by C{do} (although possibly in parallel with the caller). @param createWorker: A 0-argument callable that will create an L{IWorker} to perform work. @param logException: A 0-argument callable called in an exception context when the work passed to C{do} raises an exception. rFN) r _quit _coordinator _createWorker _logExceptionset_idle _busyCountr_pending_shouldQuitCoordinator _toShrink)rrrr rrrrMs z Team.__init__rr cCstt|j|jt|jS)z Gather information on the current status of this L{Team}. @return: a L{Statistics} describing the current state of this L{Team}. N)r lenr'r(r)rrrr statisticsmszTeam.statisticsnrrcs&jjjdfdd }dS)z Increase the the number of idle workers by C{n}. @param n: The number of new idle workers to create. @type n: L{int} rrcs2tD]}}|durdS|qdSr)ranger$_recycleWorker)xworkerr/rrrcreateOneWorker~s  z"Team.grow..createOneWorkerNrrr"checkr#do)rr/r5rr4rgrowus z Team.growN Optional[int]cs$jjfdddS)z Decrease the number of idle workers by C{n}. @param n: The number of idle workers to shut down, or L{None} (or unspecified) to shut down all workers. @type n: L{int} or L{None} cs Sr) _quitIdlersrr4rr zTeam.shrink..Nr7)rr/rr4rshrinks z Team.shrinkcCsp|dur t|j|j}t|D]}|jr|jq|jd7_q|jr4|jdkr6|jdSdSdS)z| The implmentation of C{shrink}, performed by the coordinator worker. @param n: see L{Team.shrink} Nrr) r,r'r(r0popquitr+r*r#)rr/r2rrrr<s zTeam._quitIdlerstaskCallable[[], object]cs$jjfdddS)zu Perform some work in a worker created by C{createWorker}. @param task: the callable to run cs Sr)_coordinateThisTaskrrrBrrr=r>zTeam.do..Nr7rErrErr9s zTeam.doCallable[..., object]cs^jrjn}|durjdS|jd7_|jdfdd }dS)z Select a worker to dispatch to, either an idle one or a new one, and perform it. This method should run on the coordinator worker. @param task: the task to dispatch @type task: 0-argument callable NrrrcsBzWn tyYnwjjdfdd }dS)Nrrcsjd8_dS)Nr)r(r1r)not_none_workerrrridleAndPendingsz@Team._coordinateThisTask..doWork..idleAndPendingr6) BaseExceptionr%r#r9)rHrGrrBrrdoWorks   z(Team._coordinateThisTask..doWorkr6)r'r@r$r)appendr(r9)rrBr3rKrrJrrDs  zTeam._coordinateThisTaskr3r cCsl|j||jr||jdS|jr|dS|jdkr4|jd8_|j|| dSdS)z Called only from coordinator. Recycle the given worker into the idle pool. @param worker: a worker created by C{createWorker} and now idle. @type worker: L{IWorker} rrN) r'addr)rDpopleftr*r<r+removerA)rr3rrrr1s     zTeam._recycleWorkercs$jjjdfdd }dS)zA Stop doing work and shut down all idle workers. rrcsd_dS)NT)r*r<rr-rrstartFinishings z!Team.quit..startFinishingNr6)r"r&r#r9)rrPrr-rrAs z Team.quit)rr rrr r!)rr )r/rrrr)r/r;rr)rBrCrr)rBrFrr)r3r rrr6) rrrrrr.r:r?r<r9rDr1rArrrrr-s     rN)r __future__r collectionsrtypingrrrZzope.interfacerr Z _conveniencer Z _ithreadsr r rrrrrs