U P^IO@sddlmZddlZddlZddlZddlZddlZddlZddlZddl m Z ddl m Z m Z ddlmZddlmZddlmZmZddlmZdd lmZdd lmZdd lmZdd lmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'dd l(m)Z)ddl*m+Z+ddl,m-Z-ddl.m/Z/ddl0m1Z1ddl2m3Z3e+rddl4m5Z5m6Z6m7Z7m8Z8m9Z9m:Z:ddl;mZ>ddl?m@Z@ddlAmBZBered0d ZSd1d2ZTd3d4ZUd?d5dZVd@d6d!ZWd7d#ZXd8d"ZYd9d:ZZd;d<Z[dS)A)absolute_importN)requests)CONTENT_CHUNK_SIZEResponse)PY2)parse) HashMismatchInstallationError)PyPI) PipSession) auto_decode) copy2_fixed) ask_path_exists backup_dirconsume display_path format_sizehide_urlpath_to_displayrmtreesplitext) TempDirectory)MYPY_CHECK_RUNNING)DownloadProgressProvider) unpack_file)get_url_scheme)vcs)IOCallableListOptionalTextTuple) TypedDict)Link)Hashes)VersionControlCopytreeKwargsignoresymlinksF)total) copy_functionr)ignore_dangling_symlinksr*get_file_contentunpack_vcs_linkunpack_file_urlunpack_http_url unpack_urlparse_content_dispositionsanitize_content_filenamec Cs6|dkrtdt|}|dkr>||}||j|jfS|dkr|rd|drdtd||f|ddd}| d d }t |}|r| dd|d dd}t |}|d rd |d }|}z&t|d }t|}W5QRXWn4tk r,} ztd t| W5d} ~ XYnX||fS)a*Gets the content of a file; it may be a filename, file: URL, or http: URL. Returns (location, content). Content is unicode. :param url: File path or url. :param comes_from: Origin description of requirements. :param session: Instance of pip.download.PipSession. NzAget_file_content() missing 1 required keyword argument: 'session')httphttpsfiler5z6Requirements file %s references URL %s, which is local:\/|rbz$Could not open requirements file: %s) TypeErrorrgetraise_for_statusurltext startswithr splitreplace_url_slash_drive_rematchgroup urllib_parseunquotelstripopenr readIOErrorstr) rA comes_fromsessionschemeresppathrGfcontentexcrX7/tmp/pip-install-220asx0h/pip/pip/_internal/download.pyr.UsB         z /*([a-z])\|cCs,t|}|dk st|j|t|jddS)N)rA)_get_used_vcs_backendAssertionErrorunpackrrA)linklocation vcs_backendrXrXrYr/s cCs$tjD]}|j|jkr|SqdS)z1 Return a VersionControl object or None. N)rbackendsrRschemes)r]r_rXrXrYrZs   rZcOs|SNrX)iterableargskwargsrXrXrY_progress_indicatorsrfc s6ztjd}Wntttfk r0d}YnXtdd}ttj krRd}n&|r\d}n|dkrjd}n|std}nd}|j }fdd} fd d } t } |j t j kr|} n|j} |rt||d } |rtd | t|n td | n|rtd| n td | | | | tt} |r*|| nt| dS)Nzcontent-lengthr from_cacheFi@Tc3sTz jj|ddD] }|VqWn.tk rNj|}|sBqJ|Vq0YnXdS)NF)decode_content)rawstreamAttributeErrorrM) chunk_sizechunk)rSrXrY resp_reads   z _download_url..resp_readc3s|D]}||VqdSrb)write)chunksrm) content_filerXrYwritten_chunkss z%_download_url..written_chunks)maxzDownloading %s (%s)zDownloading %szUsing cached %s)intheaders ValueErrorKeyErrorr>getattrloggergetEffectiveLevelloggingINFOshow_urlrfnetlocr url_without_fragmentrinforrcheck_against_chunksr)rSr]rqhashes progress_bar total_length cached_resp show_progressr}rnrrprogress_indicatorrAdownloaded_chunksrX)rqrSrY _download_urlsP   %    rcCsd}tj||j}tj|rtdt|d}|dkr@d}nj|dkrdtdt|t |nF|dkrt |}td t|t|t ||n|d krt d |rt ||td t|dS) NTz8The file %s exists. (i)gnore, (w)ipe, (b)ackup, (a)abort)iwbarFrz Deleting %srzBacking up %s to %srzSaved %s)osrTjoinfilenameexistsrrrywarningremovershutilmovesysexitcopyr)rr^r]rdownload_locationresponse dest_filerXrXrY _copy_files6    ronc Cs|dkrtdtddv}d}|r0t|||}|rH|}t|d} nt|||j||\}} t||| |r~|s~t||||st |W5QRXdS)Nz@unpack_http_url() missing 1 required keyword argument: 'session'r\)kindr) r>r_check_download_dir mimetypes guess_type_download_http_urlrTrrrunlink) r]r^ download_dirrQrrtemp_diralready_downloaded_path from_path content_typerXrXrYr1s2    c CsTzt||Wn@tjk rN}z tdt|t|t|W5d}~XYnXdS)zCopying special files is not supported, but as a convenience to users we skip errors copying them. This supports tools that may create e.g. socket files in the project source directory. z>Ignoring special file error '%s' encountered copying %s to %s.N)r rSpecialFileErrorryrrOr)srcdesterXrXrY_copy2_ignoring_special_filesJsrcs8fdd}t|dd}ts$t|d<tj|f|dS)Ncs|krddgSgS)Nz.toxz.noxrX)dnamessourcerXrYr)asz!_copy_source_tree..ignoreTr(r,)dictrrrcopytree)rtargetr)rerXrrY_copy_source_tree_s   rcCs|j}|r>tj|r"t|t|||r:tddS|rL| |d}|r`t |||}|rj|}n|}t |d}t ||||r|st|||dS)zUnpack link into location. If download_dir is provided and link points to a file, make a copy of the link file inside download_dir. z*Link is a directory, ignoring download_dirNr) file_pathZis_existing_dirrrTisdirrrryrcheck_against_pathrrrrr)r]r^rr link_pathrrrrXrXrYr0rs.      cCsP|jrt||n:|jr*t||||dn"|dkr8t}t||||||ddS)avUnpack link. If link is a VCS link: if only_download, export into download_dir and ignore location else unpack into location for other types of link: - unpack into location - if download_dir, copy the file into download_dir - if only_download, mark location for deletion :param hashes: A Hashes object, one of whose embedded hashes must match, or HashMismatch will be raised. If the Hashes is empty, no matches are required, and unhashable types of requirements (like VCS ones, which would ordinarily raise HashUnsupported) are allowed. )rN)rr)Zis_vcsr/is_filer0r r1)r]r^rrQrrrXrXrYr2s cCs tj|S)zJ Sanitize the "filename" value from a Content-Disposition header. )rrTbasename)rrXrXrYr4scCs,t|\}}|d}|r$t|}|p*|S)z Parse the "filename" value from a Content-Disposition header, and return the default filename if the result is empty. r)cgi parse_headerr?r4)content_dispositionZdefault_filename_typeparamsrrXrXrYr3s  c Cs*|jddd}z |j|ddidd}|Wn8tjk rj}ztd|jj |W5d }~XYnX|j d d }|j } |j d } | rt | | } t | d} | st|} | r| | 7} | s|j|jkrtj |jd} | r| | 7} tj|| } t| d } t||| ||W5QRX| |fS)z6Download link url into temp_dir using provided session#r9rzAccept-EncodingidentityT)rurjzHTTP error %s while getting %sNz content-typezcontent-dispositionwb)rArDr?r@r HTTPErrorrycriticalr status_coderurr3rrguess_extensionrrTrrLr)r]rQrrr target_urlrSrWrrrextrrqrXrXrYrsB       rcCsptj||j}tj|s dStd||rlz||Wn,tk rjt d|t |YdSX|S)z Check download_dir for previously downloaded file with correct hash If a correct file is found return its path else None NzFile was already downloaded %sz;Previously-downloaded file %s has bad hash. Re-downloading.) rrTrrrryrrrrr)r]rr download_pathrXrXrYr+s   r)NN)NNNr)NN)NNNr)\ __future__rrr{rrrerr pip._vendorrZpip._vendor.requests.modelsrrpip._vendor.sixrpip._vendor.six.moves.urllibrrIpip._internal.exceptionsrr pip._internal.models.indexr Zpip._internal.network.sessionr pip._internal.utils.encodingr pip._internal.utils.filesystemr pip._internal.utils.miscrrrrrrrrrpip._internal.utils.temp_dirrpip._internal.utils.typingrpip._internal.utils.uirZpip._internal.utils.unpackingrZpip._internal.utils.urlsrpip._internal.vcsrtypingrrrr r!r"Zmypy_extensionsr#pip._internal.models.linkr$pip._internal.utils.hashesr%Z pip._internal.vcs.versioncontrolr&rOboolr'__all__ getLogger__name__ryr.compileIrFr/rZrfrrr1rrr0r2r4r3rrrXrXrXrYs        ,               0 d - 8 .?