U @vg5H @sZdZddlmZddlZddlZddlZddlZddlZddlm Z ddl m Z ddl mZddlmZmZddlmZdd lmZmZdd lmZdd lmZdd lmZerej?ej@ejAejBejCejDejEg ZFejGejHejIgZJddeJDZKGdddeLZMd6ddZNddZOd7dd ZPGd!d"d"eLZQd#d$ZRd%d&ZSGd'd(d(eTZUd)d*ZVd+d,ZWd-d.ZXd/d0ZYd1d2ZZd8d3d4Z[e4d5ej5Z\dS)9z Requirements file parsing )absolute_importN) filterfalse)parse) cmdoptions)InstallationErrorRequirementsFileParseError) SearchScope)install_req_from_editableinstall_req_from_line) auto_decode)MYPY_CHECK_RUNNING)get_url_scheme)Values)AnyCallableIteratorListNoReturnOptionalTextTuple)InstallRequirement) WheelCache) PackageFinder) PipSessionparse_requirementsz^(http|https|file):z (^|\s+)#.*$z#(?P\$\{(?P[A-Z0-9_]+)\})cCsg|]}t|jqS)strdest).0orr>/tmp/pip-unpacked-wheel-gw11q0wt/pip/_internal/req/req_file.py Tsr"c@seZdZddZdS) ParsedLinecCs(||_||_||_||_||_||_dSN)filenamelineno comes_fromargsopts constraint)selfr%r&r'r(r)r*rrr!__init__Xs zParsedLine.__init__N__name__ __module__ __qualname__r,rrrr!r#Wsr#Fc csZ|r |jnd}t|} t|| ||} | ||D]$} t| |||||} | dk r0| Vq0dS)a!Parse a requirements file and yield InstallRequirement instances. :param filename: Path or url of requirements file. :param session: PipSession instance. :param finder: Instance of pip.index.PackageFinder. :param comes_from: Origin description of requirements. :param options: cli options. :param constraint: If true, parsing a constraint file rather than requirements file. :param wheel_cache: Instance of pip.wheel.WheelCache :param use_pep517: Value of the --use-pep517 option. N)skip_requirements_regexget_line_parserRequirementsFileParserr handle_line) r%sessionfinderr'optionsr* wheel_cache use_pep517r1 line_parserparser parsed_linereqrrr!rjs( cCs:t|dd}t|}t|}|r.t||}t|}|S)zSplit, filter, and join lines, and return a line iterator :param content: the content of the requirements file :param options: cli options )start) enumerate splitlines join_linesignore_comments skip_regexexpand_env_variables)contentr1 lines_enumrrr! preprocesss rHc Csd|jr dnd|j|jf}|jr|r,|jnd}|rBt||ji}tD],} | |jj krJ|jj | rJ|jj | || <qJd |j|j} t |j||||||j| dS|jj r|r|jnd}t |jj d|||j||dS|jjr|jj|_n|r|j} |j} |jjr|jjg} |jjd kr&g} |jjr>| |jj|jjr|jjd} tjtj|j}tj|| }tj|r|} | | t| | d }||_|jjr||r|jj pgD]$}d |j|j}|j!||d qd S) aHandle a single parsed requirements line; This can result in creating/yielding requirements, or updating the finder. For lines that contain requirements, the only options that have an effect are from SUPPORTED_OPTIONS_REQ, and they are scoped to the requirement. Other options from SUPPORTED_OPTIONS may be present, but are ignored. For lines that do not contain requirements, the only options that have an effect are from SUPPORTED_OPTIONS. Options from SUPPORTED_OPTIONS_REQ may be present, but are ignored. These lines may contain multiple options (although our docs imply only one is supported), and all our parsed and affect the finder. z%s %s (line %s)z-cz-rFz line {} of {})r'r9isolatedr7r8r* line_sourcer)r'r9r*rIr8T) find_links index_urls)sourceN)"r*r%r&r( isolated_modercheck_install_build_globalr)SUPPORTED_OPTIONS_REQ_DEST__dict__formatr editablesr require_hashesrKrL index_urlno_indexextra_index_urlsextendospathdirnameabspathjoinexistsappendr search_scopepreset_allow_all_prereleases trusted_hostsadd_trusted_host)liner6r7r5r8r9line_comes_fromrI req_optionsrrJrKrLvaluereq_dirrelative_to_reqs_filer`hostrMrrr!r4s          r4c@s,eZdZddZddZddZddZd S) r3cCs||_||_||_||_dSr$)_session _line_parser _comes_from_skip_requirements_regex)r+r5r:r'r1rrr!r, szRequirementsFileParser.__init__ccs|||D] }|Vq dS)z3Parse a given file, yielding parsed lines. N)_parse_and_recurse)r+r%r*rerrr!rszRequirementsFileParser.parseccs|||D]}|js|jjs|jjs.|jjr|jjrH|jjd}d}n|jjd}d}t|rpt ||}n t|st j t j ||}|||D] }|Vqq |Vq dS)NrFT) _parse_filer(r)rS requirements constraints SCHEME_REsearch urllib_parseurljoinrYrZr]r[rp)r+r%r*rereq_pathnested_constraint inner_linerrr!rps6      z)RequirementsFileParser._parse_and_recursec cst||j|jd\}}t||j}|D]j\}}z||\}} Wn8tk rx} zd|| jf} t| W5d} ~ XYnXt |||j|| |Vq&dS)N)r'zInvalid requirement: %s %s) get_file_contentrlrnrHrormOptionParsingErrormsgrr#) r+r%r*_rFrG line_numberreargs_strr)er}rrr!rq?s(   z"RequirementsFileParser._parse_fileN)r.r/r0r,rrprqrrrr!r3s "r3csfdd}|S)Ncs^t}|}d|_r j|_t|\}}tjdkr@|d}|t ||\}}||fS)N)utf8) build_parserget_default_valuesrUformat_controlbreak_args_optionssys version_infoencode parse_argsshlexsplit)rer;defaultsr options_strr)r~r6rr! parse_line[s   z#get_line_parser..parse_liner)r6rrrr!r2Ys r2cCsf|d}g}|dd}|D]2}|ds6|dr<qRq|||dqd|d|fS)zBreak up the line into an args and options string. We only want to shlex (and then optparse) the options, not the args. args can contain markers which are corrupted by shlex.  N-z--r)r startswithr_popr])retokensr(r7tokenrrr!rts    rc@seZdZddZdS)r|cCs ||_dSr$)r}r+r}rrr!r,szOptionParsingError.__init__Nr-rrrr!r|sr|cCs@tjdd}tt}|D]}|}||qdd}||_|S)z7 Return a parser for parsing requirement lines F)add_help_optioncSs t|dSr$)r|rrrr! parser_exitsz!build_parser..parser_exit)optparse OptionParserSUPPORTED_OPTIONSSUPPORTED_OPTIONS_REQ add_optionexit)r;option_factoriesoption_factoryoptionrrrr!rs  rccsd}g}|D]v\}}|dr(t|rjt|r:d|}|r^|||d|fVg}q||fVq |sr|}||dq |r|d|fVdS)zJoins a line ending in '' with the previous line (except when following comments). The joined line takes on the index of the first line. N\r)endswith COMMENT_REmatchr_r]strip)rGprimary_line_numbernew_linerrerrr!rBs     rBccs4|D]*\}}td|}|}|r||fVqdS)z1 Strips comments and filter empty lines. rN)rsubr)rGrrerrr!rCs   rCcs t|tfdd|}|S)zd Skip lines that match the provided pattern Note: the regex pattern is only built once cs|dS)Nr>)ru)rmatcherrr!zskip_regex..)recompiler)rGpatternrrr!rDs rDccsL|D]B\}}t|D]$\}}t|}|s.q|||}q||fVqdS)aReplace all environment variables that can be retrieved via `os.getenv`. The only allowed format for environment variables defined in the requirement file is `${MY_VARIABLE_1}` to ensure two things: 1. Strings that contain a `$` aren't accidentally (partially) expanded. 2. Ensure consistency across platforms for requirement files. These points are the result of a discussion on the `github pull request #3514 `_. Valid characters in variable names follow the `POSIX standard `_ and are limited to uppercase letter, digits and the `_` (underscore). N) ENV_VAR_REfindallrYgetenvreplace)rGrreenv_varvar_namerhrrr!rEs  rEc Cs&t|}|dkr.||}||j|jfS|dkr|rT|drTtd||f|ddd}|dd}t |}|r| dd|d dd}t |}|drd|d}|}z&t|d }t|}W5QRXWn4tk r} ztd t| W5d } ~ XYnX||fS) aZGets the content of a file; it may be a filename, file: URL, or http: URL. Returns (location, content). Content is unicode. Respects # -*- coding: declarations on the retrieved files. :param url: File path or url. :param session: PipSession instance. :param comes_from: Origin description of requirements. )httphttpsfilerz6Requirements file %s references URL %s, which is local:r>r/|rbz$Could not open requirements file: %sN)r getraise_for_statusurltextrrrr_url_slash_drive_rergrouprvunquotelstripopenr readIOErrorr) rr5r'schemeresprZrfrFexcrrr!r{s:         r{z /*([a-z])\|)NNNFNN)NNNNN)N)]__doc__ __future__rrrYrrrZpip._vendor.six.movesrZpip._vendor.six.moves.urllibrrvZpip._internal.clirpip._internal.exceptionsrr!pip._internal.models.search_scoperpip._internal.req.constructorsr r pip._internal.utils.encodingr pip._internal.utils.typingr pip._internal.utils.urlsr rtypingrrrrrrrrZpip._internal.reqrpip._internal.cacher"pip._internal.index.package_finderrpip._internal.network.sessionrintZ ReqFileLinesrZ LineParser__all__rIrtrrrUextra_index_urlrVrsrreditablerK no_binary only_binaryrTra trusted_host always_unziprinstall_optionsglobal_optionshashrrPobjectr#rrHr4r3r2r Exceptionr|rrBrCrDrEr{rrrrr!s         (       ' gQ   ,