U n5{i%@sdZddlZddlZddlZddlZGdddejZGdddZGdddeZ Gd d d eZ d Z d d Z ddZ dddZdS)z An incremental approach to unzipping files. This allows you to unzip a little bit of a file at a time, which means you can report progress as a file unzips. Nc@seZdZdZddZdS)ChunkingZipFilez~ A L{zipfile.ZipFile} object which, with L{readfile}, also gives you access to a file-like object for each entry. cCs(|jdkrtd|js td||}|j|jd|jtj}|ddtj krdt dt tj |}|j|tj}|tjr|j|tj|jd@r|d}n |d }||jkrt d |j|f|jtjkrt||jS|jtjkrt||jSt d |j|fd S) z3 Return file-like object for name. )razread() requires mode "r" or "a"z3Attempt to read ZIP archive that was already closedrz Bad magic number for file headerizutf-8cp437z3File name in directory "%s" and header "%s" differ.z-Unsupported compression method %d for file %sN)mode RuntimeErrorfpgetinfoseek header_offsetreadzipfilesizeFileHeaderstringFileHeader BadZipFilestructunpackstructFileHeader_FH_FILENAME_LENGTH_FH_EXTRA_FIELD_LENGTH flag_bitsdecode orig_filename compress_type ZIP_STORED ZipFileEntry compress_size ZIP_DEFLATEDDeflatedZipFileEntry)selfnamezinfofheaderfname fname_strr&           zChunkingZipFile.readfileN)__name__ __module__ __qualname____doc__r(r&r&r&r'rsrc@sdeZdZdZddZddZddZdd Zd d ZeZ d d Z ddZ ddZ ddZ ddZdS) _FileEntrya! Abstract superclass of both compressed and uncompressed variants of file-like objects within a zip archive. @ivar chunkingZipFile: a chunking zip file. @type chunkingZipFile: L{ChunkingZipFile} @ivar length: The number of bytes within the zip file that represent this file. (This is the size on disk, not the number of decompressed bytes which will result from reading it.) @ivar fp: the underlying file object (that contains pkzip data). Do not touch this, please. It will quite likely move or go away. @ivar closed: File-like 'closed' attribute; True before this file has been closed, False after. @type closed: L{bool} @ivar finished: An older, broken synonym for 'closed'. Do not touch this, please. @type finished: L{int} cCs&||_|jj|_||_d|_d|_dS)zC Create a L{_FileEntry} from a L{ChunkingZipFile}. rFN)chunkingZipFiler lengthfinishedclosedr r.r/r&r&r'__init__[s  z_FileEntry.__init__cCsdS)zD Returns false because zip files should not be ttys Fr&r r&r&r'isattyesz_FileEntry.isattycCsd|_d|_|`dS)z/ Close self (file-like object) TN)r1r0r r4r&r&r'closeksz_FileEntry.closecs4d}tfdddD]}||7}|dkrq0q|S)z Read a line. cs dS)Nr6)r r&r4r&r'xr8z%_FileEntry.readline.. )iter)r linebyter&r4r'readliness z_FileEntry.readlinecCs|}|r|StdS)zi Implement next as file does (like readline, except raises StopIteration at EOF) N)r> StopIteration)r Znextliner&r&r'__next__~sz_FileEntry.__next__cCst|S)z1 Returns a list of all the lines )listr4r&r&r' readlinessz_FileEntry.readlinescCs|Sz/ Returns an iterator (so self) r&r4r&r&r' xreadlinessz_FileEntry.xreadlinescCs|SrCr&r4r&r&r'__iter__sz_FileEntry.__iter__cCs|SNr&r4r&r&r' __enter__sz_FileEntry.__enter__cCs |dSrF)r7)r exc_type exc_value tracebackr&r&r'__exit__sz_FileEntry.__exit__N)r)r*r+r,r3r5r7r>r@nextrBrDrErGrKr&r&r&r'r-Cs   r-c@s*eZdZdZddZddZd ddZdS) rzJ File-like object used to read an uncompressed entry in a ZipFile cCst|||d|_dS)Nr)r-r3 readBytesr2r&r&r'r3szZipFileEntry.__init__cCs|jSrF)rMr4r&r&r'tellszZipFileEntry.tellNcCsv|dkr|j|j}|dks"|jr&dS|jjt||j|j}|jt|7_|j|jkslt||krrd|_|S)Nrr8r6)r/rMr0r.r r minlen)r ndatar&r&r'r s zZipFileEntry.read)Nr)r*r+r,r3rNr r&r&r&r'rsrc@s*eZdZdZddZddZd ddZdS) rzE File-like object used to read a deflated entry in a ZipFile cCs0t|||d|_d|_td|_d|_dS)Nrir8)r-r3 returnedBytesrMzlib decompressobjdecompbufferr2r&r&r'r3s  zDeflatedZipFileEntry.__init__cCs|jSrF)rTr4r&r&r'rNszDeflatedZipFileEntry.tellNcCs`|jr dS|dkr|jg}||j|jj|j|j ||jd||j d|_d|_d |}|j t |7_ |St |j|kr(|jjt|d|j|j }|j t |7_ |s|j|jd|j }d|_d|_|j t |7_ |S|j|j|7_q|jd|}|j|d|_|j t |7_ |SdS)Nr8Zr6i)r0rXappendrW decompressr.r r r/rMflushjoinrTrPrO)r rQresultrRr&r&r'r sD zDeflatedZipFileEntry.read)NrSr&r&r&r'rsrcCs,d}t|}|D]}|t||7}q|S)zr Predict the number of chunks that will be extracted from the entire zipfile, given chunksize blocks. r)rinfolistcountFileChunks)filename chunksizeZ totalchunkszfinfor&r&r'countZipFileChunkss  rfcCs(t|j|\}}|dkr |d7}|p&dS)a9 Count the number of chunks that will result from the given C{ZipInfo}. @param zipinfo: a C{zipfile.ZipInfo} instance describing an entry in a zip archive to be counted. @return: the number of chunks present in the zip file. (Even an empty file counts as one chunk.) @rtype: L{int} rr6)divmod file_size)zipinforccountextrar&r&r'ras ra.c csPt|d}tj|s t|t||}|}|}t||D]\}} | j t @} tj ||} | rtj| st| |d8}|VqDtj | d} tj| st| |stj| s6| |} | jdkr|d8}|Vt| d:}| | jkr*| |}|||d8}|VqW5QRXqD|t| |8}|VqDdS)z Return a generator for the zipfile. This implementation will yield after every chunksize uncompressed bytes, or at the end of a file, whichever comes first. The value it yields is the number of chunks left to unzip. rr6rwbN)rospathexistsmakedirsrfnamelistr`zip external_attrDIR_BITr]splitr(rhopenrNr writera)rb directory overwritercZczf remainingnamesZinfosentryreisdirfZfdirr outfileZhunkr&r&r'unzipIterChunkys<              r)rlrrm)r,os.pathrorrrUZipFilerr-rrrvrfrarr&r&r&r's3a8