U n5{ip8@sdZddlZddlmZmZmZmZmZmZm Z m Z ddl m Z ddl mZddlmZddlmZmZddlmZmZdd lmZdd lmZmZdd lmZdd lmZdd l m!Z!ddl"m#Z#ddl$m%Z%ddl&m'Z'ddl(m)Z)m*Z*m+Z+m,Z,ddl-m.Z.ddl/m0Z0ddl1m2Z2m3Z3ddl4m5Z5ddl6m7Z7m8Z8m9Z9eddGddde:Z;GdddeZee=gee>fZ?Gd!d"d"e!Z@Gd#d$d$e!ZAeeGd%d&d&ZBeeGd'd(d(ZCGd)d*d*e:ZDGd+d,d,eZEdS)-z: This module implements the worker classes. @since: 12.3 N)Any AwaitableCallableDictListOptionalTextIOTypeVar)TestCase) implementer)frozen)Protocol TypedDict)Deferred DeferredList) ProcessDone)IAddress ITransport)ProcessProtocol)Logger)AMP)Failure)FilePath) namedObject)_WORKER_AMP_STDIN_WORKER_AMP_STDOUTmanagercommandsworkercommands)WorkerReporter) TestResult) TestLoader TrialSuite)Todo) StreamOpenStreamReceiver StreamWriteF)Zauto_excc@seZdZUdZeed<dS)WorkerExceptionz An exception was reported by a test running in a worker process. @ivar message: An error message describing the exception. messageN)__name__ __module__ __qualname____doc__str__annotations__r/r/>/tmp/pip-unpacked-wheel-mnhg7r0q/twisted/trial/_dist/worker.pyr'+s r'c@seZdZUdZeed<dS) RunResultzB Represent the result of a L{workercommands.Run} command. successN)r)r*r+r,boolr.r/r/r/r0r16s r1c@s"eZdZdZeeedddZdS)Workerz) An object that can run actions. )caseresultreturncsdS)z" Run a test case. Nr/)selfr5r6r/r/r0runCsz Worker.runN)r)r*r+r,r rr1r9r/r/r/r0r4>sr4_Tc@sHeZdZdZeZd ddZejj e e dddZ ej j dd Zd S) WorkerProtocolz5 The worker-side trial distributed protocol. FcCst|_t||_||_dSN)r _loaderr_result_forceGarbageCollection)r8ZforceGarbageCollectionr/r/r0__init__Ts zWorkerProtocol.__init__)testCaser7c s|j,}|j|}t|g|j}||jW5QRXd}t|ddIdHD]^\}}|r`qRd}|jj d||dz|j ||IdHWqRt k r|j dYqRXqRd|iS) z* Run a test case by name. T)Z consumeErrorsNFz Result reporting for {id} failed)failureidz5Additionally, reporting the reporting failure failed.r2) r>ZgatherReportingResultsr=Z loadByNamer!r?r9rloggerrBZaddErrorFallible BaseException)r8rAresultsr5ZsuiteZ allSucceededr2r6r/r/r0r9Ys0   zWorkerProtocol.runcCst|ddiS)zb Set up the worker, moving into given directory for tests to run in them. r2T)oschdir)r8 directoryr/r/r0starts zWorkerProtocol.startN)F)r)r*r+r,rrDr@rRun responderr-r1r9StartrJr/r/r/r0r;Ms ,r;cs$eZdZdZd"fdd ZejddZejddZ e j jd d Z e eeeed d d Ze jjeeeeeeefdddZe jjeeeeeeefdddZe jjddZe jjeeeeeeefdddZe jjddZe j jddZ!e"e#e$dddZ%d d!Z&Z'S)#LocalWorkerAMPz7 Local implementation of the manager commands. Ncst||t|_dSr<)superr@r%_streams)r8Z boxReceiverlocator __class__r/r0r@szLocalWorkerAMP.__init__cCsd|jiS)NstreamId)rPopenr8r/r/r0 streamOpenszLocalWorkerAMP.streamOpencCs|j||iSr<)rPwrite)r8rTdatar/r/r0 streamWriteszLocalWorkerAMP.streamWritecCs|j|jddiS)z0 Add a success to the reporter. r2T)r> addSuccess _testCase)r8testNamer/r/r0r[szLocalWorkerAMP.addSuccess)error errorClassframesr7c CsZt|}t||}tdt|dD]2}|j||||dt||dggfq"|S)a Helper to build a C{Failure} with some traceback. @param error: An C{Exception} instance. @param errorClass: The class name of the C{error} class. @param frames: A flat list of strings representing the information need to approximatively rebuild C{Failure} frames. @return: A L{Failure} instance with enough information about a test error. rr#)rrrangelenr`appendint)r8r^r_r`Z errorTyperBir/r/r0 _buildFailures $zLocalWorkerAMP._buildFailure)r]r_ errorStreamIdframesStreamIdr7cCsXd|j|d}dd|j|D}|t|||}|j|j|ddiS)a Add an error to the reporter. @param errorStreamId: The identifier of a stream over which the text of this error was previously completely sent to the peer. @param framesStreamId: The identifier of a stream over which the lines of the traceback for this error were previously completely sent to the peer. @param error: A message describing the error. utf-8cSsg|]}|dqSrldecode.0framer/r/r0 sz+LocalWorkerAMP.addError..r2T) joinrPfinishrorhr'r>addErrorr\)r8r]r_rirjr^r`rBr/r/r0rvs zLocalWorkerAMP.addError)r] failStreamId failClassrjr7cCsXd|j|d}dd|j|D}|t|||}|j|j|ddiS)az Add a failure to the reporter. @param failStreamId: The identifier of a stream over which the text of this failure was previously completely sent to the peer. @param framesStreamId: The identifier of a stream over which the lines of the traceback for this error were previously completely sent to the peer. rkrlcSsg|]}|dqSrmrnrpr/r/r0rssz-LocalWorkerAMP.addFailure..r2T) rtrPrurorhr'r> addFailurer\)r8r]rwrxrjZfailr`rBr/r/r0rys zLocalWorkerAMP.addFailurecCs|j|j|ddiS)z- Add a skip to the reporter. r2T)r>addSkipr\)r8r]reasonr/r/r0rzszLocalWorkerAMP.addSkip)r]ritodor7cCsFd|j|d}t|dkr&dn|}|j|j||ddiS)z Add an expected failure to the reporter. @param errorStreamId: The identifier of a stream over which the text of this error was previously completely sent to the peer. rkrlNz r2T)rtrPruror"r>addExpectedFailurer\)r8r]rir|r^Z_todor/r/r0r}s z!LocalWorkerAMP.addExpectedFailurecCs|j|j|ddiS)z< Add an unexpected success to the reporter. r2T)r>addUnexpectedSuccessr\)r8r]r|r/r/r0r~sz#LocalWorkerAMP.addUnexpectedSuccesscCs"|j|d|jddiS)z4 Print test output from the worker.  r2T) _testStreamrXflush)r8outr/r/r0 testWrites zLocalWorkerAMP.testWrite)rAr6r7c sN||_||_|j||}z|jtj|dIdHWS|j|XdS)z Run a test. )rAN)r\r>Z startTestrCZstopTest callRemoterrK)r8rAr6Z testCaseIdr/r/r0r9(s zLocalWorkerAMP.runcCs ||_dS)z? Set the stream used to log output from tests. N)r)r8streamr/r/r0 setTestStream5szLocalWorkerAMP.setTestStream)NN)(r)r*r+r,r@r$rLrWr&rZrZ AddSuccessr[r'r-rrrhZAddErrorrfrr3rvZ AddFailureryZAddSkiprzZAddExpectedFailurerr}ZAddUnexpectedSuccessr~Z TestWriterr rr1r9r __classcell__r/r/rRr0rNsR           rNc@seZdZdZdS)LocalWorkerAddressz A L{IAddress} implementation meant to provide stub addresses for L{ITransport.getPeer} and L{ITransport.getHost}. Nr)r*r+r,r/r/r/r0r<src@s@eZdZdZddZddZddZdd Zd d Zd d Z dS)LocalWorkerTransportzi A stub transport implementation used to support L{AMP} over a L{ProcessProtocol} transport. cCs ||_dSr<) _transport)r8 transportr/r/r0r@KszLocalWorkerTransport.__init__cCs|jt|dS)z, Forward data to transport. NrZ writeToChildrr8rYr/r/r0rXNszLocalWorkerTransport.writecCs|D]}|jt|qdS)zP Emulate C{writeSequence} by iterating data in the C{sequence}. Nr)r8sequencerYr/r/r0 writeSequenceTsz"LocalWorkerTransport.writeSequencecCs|jdS)z' Closes the transport. N)rloseConnectionrVr/r/r0r[sz#LocalWorkerTransport.loseConnectioncCstSz: Return a L{LocalWorkerAddress} instance. rrVr/r/r0getHostaszLocalWorkerTransport.getHostcCstSrrrVr/r/r0getPeergszLocalWorkerTransport.getPeerN) r)r*r+r,r@rXrrrrr/r/r/r0rDsrc@seZdZdZdS) NotRunningzN An operation was attempted on a worker process which is not running. Nrr/r/r/r0rnsrc@sleZdZdZeeeedddZddddZ d d Z d d Z e dd ddZ ddZddZddZdS) LocalWorkeraL Local process worker protocol. This worker runs as a local process and communicates via stdin/out. @ivar _ampProtocol: The L{AMP} protocol instance used to communicate with the worker. @ivar _logDirectory: The directory where logs will reside. @ivar _logFile: The main log file for tests output. ) ampProtocol logDirectorylogFilecCs||_||_||_t|_dSr<) _ampProtocol _logDirectory_logFiler endDeferred)r8rrrr/r/r0r@szLocalWorker.__init__N)r7csJ|jdkrt|j}|jtz|IdHWntk rDYnXdS)z3 Cause the worker process to exit. N)rrrZ closeChildFDrr)r8rr/r/r0exits  zLocalWorker.exitcCs~|jt|j|jjdd|jdd|_|jdd|_ |j |j |jj t j|jjd}|ddd S) zL When connection is made, create the AMP protocol instance. T)ZignoreExistingDirectoryzout.logwzerr.log)rIcSsdSr<r/)xr/r/r0rkz,LocalWorker.connectionMade..N)rZmakeConnectionrrrmakedirschildrU_outLog_errLogrrrrrMpathZ addErrback)r8dr/r/r0connectionMadeszLocalWorker.connectionMadecCs|j|jd|_dS)zk On connection lost, close the log files that we're managing for stdin and stdout. N)rcloserrr8r{r/r/r0connectionLosts  zLocalWorker.connectionLost)r{r7cCs&|||j||j|dS)z When the process closes, call C{connectionLost} for cleanup purposes and forward the information to the C{_ampProtocol}. N)rrrcallbackrr/r/r0 processEndeds  zLocalWorker.processEndedcCs|j|dS)z8 Send data received from stdout to log. N)rrXrr/r/r0 outReceivedszLocalWorker.outReceivedcCs|j|dS)z* Write error data to log. N)rrXrr/r/r0 errReceivedszLocalWorker.errReceivedcCs(|tkr|j|nt|||dS)zT Handle data received on the specific pipe for the C{_ampProtocol}. N)rrZ dataReceivedrchildDataReceived)r8ZchildFDrYr/r/r0rszLocalWorker.childDataReceived)r)r*r+r,rNrrrr@rrrrrrrrr/r/r/r0rts   r)Fr,rGtypingrrrrrrrr Zunittestr Zzope.interfacer attrsr Ztyping_extensionsr rZtwisted.internet.deferrrZtwisted.internet.errorrZtwisted.internet.interfacesrrZtwisted.internet.protocolrZtwisted.loggerrZtwisted.protocols.amprZtwisted.python.failurerZtwisted.python.filepathrZtwisted.python.reflectrZtwisted.trial._distrrrrZ"twisted.trial._dist.workerreporterrZtwisted.trial.reporterrZtwisted.trial.runnerr r!Ztwisted.trial.unittestr"rr$r%r& Exceptionr'r1r4r:Z WorkerActionr;rNrrrrr/r/r/r0sH(               C-)