U 2ܟj2@s"dZddlZddlZddlZz ddlZWnek r@dZYnXddlmZddlm Z m Z ddl m Z m Z ddlmZmZddlmZmZmZmZmZmZmZmZmZmZmZddlmZdd lm Z dd l!m"Z"ee j#$e  d Gd d d e"Z%ee j#$e  d Gddde"Z&dS)z Whitebox tests for TCP APIs. N)skipIf) interfacesreactor) gatherResults maybeDeferred)Protocol ServerFactory) _ACCEPT_ERRORSEAGAIN ECONNABORTED EINPROGRESSEMFILEENFILEENOBUFSENOMEMEPERM EWOULDBLOCKPort)log)platform)TestCasez?This test only applies to reactors that implement IReactorFDsetc@sFeZdZdZdZddZddZddZee d kd d d Z d S)PlatformAssumptionsTestsz4 Test assumptions about platform behaviors. i cCs\g|_tdk rXddlm}t|d}ttj|_ttj||jdf|d|_ dS)Nr) _listOpenFDsd) openSocketsresourceZtwisted.internet.processrlen getrlimit RLIMIT_NOFILEoriginalFileLimit setrlimit socketLimit)selfrZnewLimitr%C/tmp/pip-unpacked-wheel-4b529toj/twisted/test/test_tcp_internals.pysetUp4s  zPlatformAssumptionsTests.setUpcCsT|jr|jqtdk rPttjd}t|jd|}ttj||fdS)Nrr) rpopcloserrr minr!r")r$ZcurrentHardLimitZ newSoftLimitr%r%r&tearDownFs z!PlatformAssumptionsTests.tearDowncCst}|j||S)z| Create and return a new socket object, also tracking it so it can be closed in the test tear down. )socketrappend)r$sr%r%r&r,Rs zPlatformAssumptionsTests.socketwin32zhWindows requires an unacceptably large amount of resources to provoke this behavior in the naive manner.c Cs|}|d|d}|d|}|dt|jD]T}z |WqDtk r}z$|jdt t fkrWY qnW5d}~XYqDXqD| d| | d|fdtf|tj|j}| |jdt t fdS) z Test that the platform accept(2) call fails with either L{EMFILE} or L{ENOBUFS} when there are too many file descriptors open. ) 127.0.0.1rrFrNz7Could provoke neither EMFILE nor ENOBUFS from platform.r0)r,bind getsocknamelisten setblockingranger#OSErrorargsr rfailZassertIn connect_exr assertRaiseserroraccept)r$portZserverPortNumberclientieexcr%r%r&test_acceptOutOfFiles[s(         z.PlatformAssumptionsTests.test_acceptOutOfFilesN) __name__ __module__ __qualname____doc__r#r'r+r,rrgetTyperCr%r%r%r&r)s   rc@seZdZdZddZddZddZdd Zd d Zd d Z ddZ e e dkdddZe e dkdddZe ejddkdddZe e dkdddZdd Zd!S)"SelectReactorTestsz7 Tests for select-specific failure conditions. cCsg|_g|_t|jjdSN)portsmessagesrZ addObserverr-r$r%r%r&r'szSelectReactorTests.setUpcCs"t|jjtdd|jDS)NcSsg|]}t|jqSr%)r stopListening).0pr%r%r& sz/SelectReactorTests.tearDown..)rZremoveObserverrLr-rrKrMr%r%r&r+szSelectReactorTests.tearDowncCs&t|||d}||j||S)z Create, start, and return a new L{Port}, also tracking it so it can be stopped in the test tear down.  interface)rZstartListeningrKr-)r$Z portNumberfactoryrSrPr%r%r&r>s zSelectReactorTests.portcsGfddd}t}|jd|dd}||d||dtjfdd |jD}|t|dd |jfd S) a Test behavior in the face of an exception from C{accept(2)}. On any exception which indicates the platform is unable or unwilling to allocate further resources to us, the existing port should remain listening, a message should be logged, and the exception should not propagate outward from doRead. @param socketErrorNumber: The errno to simulate from accept. cseZdZdZfddZdS)z9SelectReactorTests._acceptFailureTest..FakeSocketzI Pretend to be a socket in an overloaded system. csttdSrJ)r7osstrerrorrMsocketErrorNumberr%r&r=sz@SelectReactorTests._acceptFailureTest..FakeSocket.acceptNrDrErFrGr=r%rWr%r& FakeSocketsrZrr0rRr,z/Could not accept new connection ({acceptError})cs(g|] }|dko"|dkqS)Z log_formatZ acceptError)get)rOmsg)expectedErrorCodeexpectedFormatr%r&rQsz9SelectReactorTests._acceptFailureTest..z+Log event for failed accept not found in %rN) rr>patchdoReaderrno errorcoderL assertGreaterr)r$rXrZrTr>ZmatchingMessagesr%)r]r^rXr&_acceptFailureTests    z%SelectReactorTests._acceptFailureTestcCs |tS)a* C{accept(2)} can fail with C{EMFILE} when there are too many open file descriptors in the process. Test that this doesn't negatively impact any other existing connections. C{EMFILE} mainly occurs on Linux when the open file rlimit is encountered. )rdr rMr%r%r&test_tooManyFilesFromAccepts z.SelectReactorTests.test_tooManyFilesFromAcceptcCs |tS)z Similar to L{test_tooManyFilesFromAccept}, but test the case where C{accept(2)} fails with C{ENOBUFS}. This mainly occurs on Windows and FreeBSD, but may be possible on Linux and other platforms as well. )rdrrMr%r%r&test_noBufferSpaceFromAcceptsz/SelectReactorTests.test_noBufferSpaceFromAcceptcCs |tS)z Similar to L{test_tooManyFilesFromAccept}, but test the case where C{accept(2)} fails with C{ECONNABORTED}. It is not clear whether this is actually possible for TCP connections on modern versions of Linux. )rdr rMr%r%r& test_connectionAbortedFromAcceptsz3SelectReactorTests.test_connectionAbortedFromAcceptr/z(Windows accept(2) cannot generate ENFILEcCs |tS)z Similar to L{test_tooManyFilesFromAccept}, but test the case where C{accept(2)} fails with C{ENFILE}. This can occur on Linux when the system has exhausted (!) its supply of inodes. )rdrrMr%r%r&test_noFilesFromAccepts z)SelectReactorTests.test_noFilesFromAcceptz(Windows accept(2) cannot generate ENOMEMcCs |tS)a Similar to L{test_tooManyFilesFromAccept}, but test the case where C{accept(2)} fails with C{ENOMEM}. On Linux at least, this can sensibly occur, even in a Python program (which eats memory like no ones business), when memory has become fragmented or low memory has been filled (d_alloc calls kmem_cache_alloc calls kmalloc - kmalloc only allocates out of low memory). )rdrrMr%r%r&test_noMemoryFromAccepts z*SelectReactorTests.test_noMemoryFromAcceptZINFRASTRUCTUREZAZUREPIPELINESz(Hangs on Azure Pipelines due to firewallcst}t|_|jd|dd|jgfdd}||fdd}|d_| jd|| jd| jdd S) z L{tcp.Port.doRead} increases the number of consecutive C{accept} calls it performs if all of the previous C{accept} calls succeed; otherwise, it reduces the number to the amount of successful calls. rr0rRcsD] }|qdSrJ)r)r?)clientsr%r&closeAllsz7SelectReactorTests.test_acceptScaling..closeAllcs(ttjtj}|djf|S)Nr0)r,AF_INET SOCK_STREAMconnectZgetHostr>rj)r>r%r&rosz6SelectReactorTests.test_acceptScaling..connectrN) rrprotocolr>Z addCleanuprNr- numberAcceptsr`rc assertEqual)r$rTrlror%)rkr>r&test_acceptScalings"       z%SelectReactorTests.test_acceptScalingz'Windows accept(2) cannot generate EPERMcsddgGfddd}tD]}tj|jq(j|jdgt}jd|dd}d|_ |d||  |jdd S) z C{accept(2)} returning C{EPERM} is treated as a transient failure and the call retried no more than the maximum number of consecutive C{accept(2)} calls. {rcs eZdZdZfddZdS)zLSelectReactorTests.test_permissionFailure..FakeSocketWithAcceptLimit Pretend to be a socket in an overloaded system whose C{accept} method can only be called C{maximumNumberOfAccepts} times. cs:dd7<dkr&dttttdS)Nrrz(Maximum number of accept calls exceeded.)r9r7rrUrVZoselfZ acceptCallsZmaximumNumberOfAcceptsr$r%r&r=Cs  zSSelectReactorTests.test_permissionFailure..FakeSocketWithAcceptLimit.acceptNrYr%rwr%r&FakeSocketWithAcceptLimit<srxr0rRr,rN) r6r;r,r<r=ZfailureExceptionrr>rqr_r`Z assertEquals)r$rx_rTr>r%rwr&test_permissionFailure2s z)SelectReactorTests.test_permissionFailurecstt}|tttgtdd|DdGfddd}t}|jd|dd}| |d || | t j }|dt|||djjdd S) z} A C{socket.error} raised by C{accept(2)} whose C{errno} is unknown to the recovery logic is logged. css|]}t|tr|VqdSrJ) isinstanceint)rOr<r%r%r& gs zBSelectReactorTests.test_unknownSocketErrorRaise..rcseZdZdZfddZdS)zYSelectReactorTests.test_unknownSocketErrorRaise..FakeSocketWithUnknownAcceptErrorrucstddS)Nzunknown socket error message)r7rvZunknownAcceptErrorr%r&r=qsz`SelectReactorTests.test_unknownSocketErrorRaise..FakeSocketWithUnknownAcceptError.acceptNrYr%r~r%r& FakeSocketWithUnknownAcceptErrorjsrrr0rRr,N)listr extendr rrmaxrr>r_r`ZflushLoggedErrorsr,r<rrrvaluer8)r$Z knownErrorsrrTr>Zfailuresr%r~r&test_unknownSocketErrorRaise^s  z/SelectReactorTests.test_unknownSocketErrorRaiseN)rDrErFrGr'r+r>rdrerfrgrrrHrhrirUenvironr[rsrzrr%r%r%r&rIs( )      ) +rI)'rGrarUr,r ImportErrorZunittestrZtwisted.internetrrZtwisted.internet.deferrrZtwisted.internet.protocolrrZtwisted.internet.tcpr r r r r rrrrrrZtwisted.pythonrZtwisted.python.runtimerZtwisted.trial.unittestrZ IReactorFDSetZ providedByrrIr%r%r%r&s2   4    [