3
V'ícë ã @ sÞ d Z ddlZddlZddlZddlmZ ddlmZ ddl m
Z
ddl m Z m
Z
mZmZ ddlmZ dd lmZ dd
lmZ dd lmZ dd lmZmZmZ dd
l m Z m Z m Z m Z m!Z!m"Z"m#Z#m$Z$ ddl m%Z& ddl'm(Z(m)Z) ddl*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2m3Z3m4Z4 ddl5m6Z6m7Z7m8Z8m9Z9m:Z:m;Z;m<Z<m=Z=m>Z>m?Z?m@Z@mAZAm%Z% ddl5mBZC ddlDmEZE eEjFeEjGeEjHeEjIeEjJfZKdZLd"ZMdZNG dd deOZPG dd deOZQG d d d eQZRG d d d ePeQZSG d d! d!eOZTdS )#z`
requests.models
~~~~~~~~~~~~~~~
This module contains the primary objects that power Requests.
é N)Ú RequestField)Úencode_multipart_formdata)Ú parse_url)Ú DecodeErrorÚReadTimeoutErrorÚ
ProtocolErrorÚLocationParseError)ÚUnsupportedOperationé )Ú
default_hooks)ÚCaseInsensitiveDict)Ú
HTTPBasicAuth)Úcookiejar_from_dictÚget_cookie_headerÚ_copy_cookie_jar)Ú HTTPErrorÚ
MissingSchemaÚ
InvalidURLÚChunkedEncodingErrorÚContentDecodingErrorÚConnectionErrorÚStreamConsumedErrorÚInvalidJSONError)ÚJSONDecodeError)Úto_native_stringÚunicode_is_ascii)
Úguess_filenameÚget_auth_from_urlÚ requote_uriÚ stream_decode_response_unicodeÚto_key_val_listÚparse_header_linksÚ iter_slicesÚguess_json_utfÚ super_lenÚcheck_header_validity)
ÚCallableÚMappingÚ cookielibÚ
urlunparseÚurlsplitÚ urlencodeÚstrÚbytesÚis_py2ÚchardetÚ builtin_strÚ
basestringr )Újson)Úcodesé é
i i c @ s0 e Zd Zedd Zedd Zedd ZdS )ÚRequestEncodingMixinc C sN g }t | j}|j}|s d}|j| |j}|rD|jd |j| dj|S )zBuild the path URL to use.ú/ú?Ú )r* ÚurlÚpathÚappendÚqueryÚjoin)Úselfr: Úpr; r= © rA ú3/tmp/pip-build-gk9425m9/requests/requests/models.pyÚpath_url? s
z RequestEncodingMixin.path_urlc C sÀ t | ttfr| S t| dr | S t| dr¸g }x|t| D ]p\}}t |tsVt|d r\|g}xJ|D ]B}|dk rb|jt |tr|jdn|t |tr|jdn|f qbW q8W t|ddS | S dS )züEncode parameters in a piece of data.
Will successfully encode parameters when passed as a dict or a list of
2-tuples. Order is retained if data is a list of 2-tuples but arbitrary
if parameters are supplied as a dict.
ÚreadÚ__iter__Nzutf-8T)Údoseq) Ú
isinstancer, r- Úhasattrr r1 r< Úencoder+ )ÚdataÚresultÚkÚvsÚvrA rA rB Ú_encode_paramsT s
$ z#RequestEncodingMixin._encode_paramsc C s¾ | st dnt|tr t dg }t|p,i }t| p8i } x|D ]\}}t|ts`t|d rf|g}x\|D ]T}|dk rlt|tst|}|jt|tr¢|jdn|t|tr¸|j dn|f qlW qBW xà| D ]Ø\}}d}d} t|t
t fr.t |dkr|\}
} n&t |dkr |\}
} }n |\}
} }} nt
|p:|}
|} t| tttfrX| } n(t| drn| j } n| dkr|qÎn| } t|| |
| d }
|
j|d
|j|
qÎW t|\}}||fS ) a¥ Build the body for a multipart/form-data request.
Will successfully encode files when passed as a dict or a list of
tuples. Order is retained if data is a list of tuples but arbitrary
if parameters are supplied as a dict.
The tuples may be 2-tuples (filename, fileobj), 3-tuples (filename, fileobj, contentype)
or 4-tuples (filename, fileobj, contentype, custom_headers).
zFiles must be provided.zData must not be a string.rE Nzutf-8é é rD )ÚnamerJ ÚfilenameÚheaders)Ú content_type)Ú
ValueErrorrG r1 r rH r- r, r< ÚdecoderI ÚtupleÚlistÚlenr Ú bytearrayrD r Úmake_multipartr )ÚfilesrJ Ú
new_fieldsÚfieldsÚfieldÚvalrN rL ÚftÚfhÚfnÚfpÚfdataÚrfÚbodyrU rA rA rB Ú
_encode_fileso sP
$
z"RequestEncodingMixin._encode_filesN)Ú__name__Ú
__module__Ú __qualname__ÚpropertyrC Ú staticmethodrO ri rA rA rA rB r6 > s r6 c @ s e Zd Zdd Zdd ZdS )ÚRequestHooksMixinc C sZ || j krtd| t|tr2| j | j| n$t|drV| j | jdd |D dS )zProperly register a hook.z1Unsupported event specified, with event name "%s"rE c s s | ]}t |tr|V qd S )N)rG r& )Ú.0ÚhrA rA rB ú <genexpr>º s z2RequestHooksMixin.register_hook.<locals>.<genexpr>N)ÚhooksrV rG r& r< rH Úextend)r? ÚeventÚhookrA rA rB Ú
register_hook± s
z RequestHooksMixin.register_hookc C s. y| j | j| dS tk
r( dS X dS )ziDeregister a previously registered hook.
Returns True if the hook existed, False if not.
TFN)rs ÚremoverV )r? ru rv rA rA rB Úderegister_hook¼ s
z!RequestHooksMixin.deregister_hookN)rj rk rl rw ry rA rA rA rB ro ° s ro c
@ s* e Zd ZdZd ddZdd Zdd ZdS )
ÚRequesta{ A user-created :class:`Request <Request>` object.
Used to prepare a :class:`PreparedRequest <PreparedRequest>`, which is sent to the server.
:param method: HTTP method to use.
:param url: URL to send.
:param headers: dictionary of headers to send.
:param files: dictionary of {filename: fileobject} files to multipart upload.
:param data: the body to attach to the request. If a dictionary or
list of tuples ``[(key, value)]`` is provided, form-encoding will
take place.
:param json: json for the body to attach to the request (if files or data is not specified).
:param params: URL parameters to append to the URL. If a dictionary or
list of tuples ``[(key, value)]`` is provided, form-encoding will
take place.
:param auth: Auth handler or (user, pass) tuple.
:param cookies: dictionary or CookieJar of cookies to attach to this request.
:param hooks: dictionary of callback hooks, for internal usage.
Usage::
>>> import requests
>>> req = requests.Request('GET', 'https://httpbin.org/get')
>>> req.prepare()
<PreparedRequest [GET]>
Nc
C sº |d kr g n|}|d kr g n|}|d kr,i n|}|d kr<i n|}| d krLi n| } t | _x&t| j D ]\} } | j| | d qfW || _|| _|| _|| _|| _ |
| _
|| _ || _ || _
d S )N)ru rv )r rs rY Úitemsrw Úmethodr: rT r] rJ r2 ÚparamsÚauthÚcookies)
r? r| r: rT r] rJ r} r~ r rs r2 rL rN rA rA rB Ú__init__ä s" zRequest.__init__c C s
d| j S )Nz<Request [%s]>)r| )r? rA rA rB Ú__repr__ý s zRequest.__repr__c C s< t }|j| j| j| j| j| j| j| j| j | j
| j d
|S )zXConstructs a :class:`PreparedRequest <PreparedRequest>` for transmission and returns it.)
r| r: rT r] rJ r2 r} r~ r rs ) ÚPreparedRequestÚpreparer| r: rT r] rJ r2 r} r~ r rs )r? r@ rA rA rB r s
zRequest.prepare)
NNNNNNNNNN)rj rk rl Ú__doc__r r r rA rA rA rB rz È s
rz c
@ s e Zd ZdZdd Zd ddZdd Zd d
Zd d Ze d
d Z
dd Z dd Z d ddZ
dd Zd ddZdd Zd d ZdS )!r a) The fully mutable :class:`PreparedRequest <PreparedRequest>` object,
containing the exact bytes that will be sent to the server.
Instances are generated from a :class:`Request <Request>` object, and
should not be instantiated manually; doing so may produce undesirable
effects.
Usage::
>>> import requests
>>> req = requests.Request('GET', 'https://httpbin.org/get')
>>> r = req.prepare()
>>> r
<PreparedRequest [GET]>
>>> s = requests.Session()
>>> s.send(r)
<Response [200]>
c C s0 d | _ d | _d | _d | _d | _t | _d | _d S )N)r| r: rT Ú_cookiesrh r rs Ú_body_position)r? rA rA rB r ' s zPreparedRequest.__init__Nc C sR | j | | j|| | j| | j| | j|||
| j|| | j| dS )z6Prepares the entire request with the given parameters.N)Úprepare_methodÚ prepare_urlÚprepare_headersÚprepare_cookiesÚ prepare_bodyÚ prepare_authÚ
prepare_hooks) r? r| r: rT r] rJ r} r~ r rs r2 rA rA rB r 8 s
zPreparedRequest.preparec C s
d| j S )Nz<PreparedRequest [%s]>)r| )r? rA rA rB r J s zPreparedRequest.__repr__c C sX t }| j|_| j|_| jd k r*| jj nd |_t| j|_| j|_| j|_| j |_ |S )N)
r r| r: rT Úcopyr r
rh rs r )r? r@ rA rA rB r M s zPreparedRequest.copyc C s$ || _ | j dk r t| j j | _ dS )z Prepares the given HTTP method.N)r| r Úupper)r? r| rA rA rB r X s
z PreparedRequest.prepare_methodc C s@ dd l }y|j| ddjd} W n |jk
r: tY nX | S )Nr T)Úuts46zutf-8)ÚidnarI rW Ú IDNAErrorÚ UnicodeError)Úhostr rA rA rB Ú_get_idna_encoded_host^ s
z&PreparedRequest._get_idna_encoded_hostc C s0 t |tr|jd}ntr"t|nt|}|j }d|krT|j jd rT|| _ dS yt
|\}}}}}}} W n, t k
r }
zt |
j
W Y dd}
~
X nX |s¼d} | jt|d} t| |sÌt d| t|sy| j|}W n tk
r t dY nX n|jdrt d|p"d
} | r2| d 7 } | |7 } |rP| dt| 7 } |sZd }trÎt |trv|jd
}t | tr| jd
} t |tr¢|jd
}t |tr¸|jd
}t | trÎ| jd
} t |ttfræt|}| j|}
|
r|r
d||
f }n|
}tt|| |d|| g}|| _ dS )z Prepares the given HTTP URL.Úutf8ú:ÚhttpNzDInvalid URL {0!r}: No scheme supplied. Perhaps you meant http://{0}?z Invalid URL %r: No host suppliedzURL has an invalid label.Ú*Ú.r9 ú@r7 zutf-8z%s&%s)r r )rG r- rW r. Úunicoder, ÚlstripÚlowerÚ
startswithr: r r r ÚargsÚformatr r r r r rI rO r r) )r? r: r} Úschemer~ r Úportr; r= ÚfragmentÚeÚerrorÚnetlocÚ
enc_paramsrA rA rB r h sh
zPreparedRequest.prepare_urlc C s@ t | _|r<x.|j D ]"}t| |\}}|| jt|< qW dS )z Prepares the given HTTP headers.N)r rT r{ r% r )r? rT ÚheaderrR ÚvaluerA rA rB r ¾ s z PreparedRequest.prepare_headersc " C s¶ d}d}| rp|dk rpd}yt j|dd}W n. tk
rZ } zt|| dW Y dd}~X nX t|tsp|jd}tt|dt|t t
t t f g}|r<y t
|}W n tttfk
r d}Y nX |}t|dddk r y|j | _W n" ttfk
r
t | _Y nX |rtd |r0t|| jd
< n
d | jd < np|rT| j||\}}n2|r| j|}t|t s|t|d
rd}nd}| j | |r¬d| jkr¬|| jd< || _ dS )z"Prepares the given HTTP body data.Nzapplication/jsonF)Ú allow_nan)Úrequestzutf-8rE Útellz1Streamed bodies and files are mutually exclusive.zContent-LengthÚchunkedzTransfer-EncodingrD z!application/x-www-form-urlencodedz content-typez Content-Type) Ú complexjsonÚdumpsrV r rG r- rI ÚallrH r1 rY rX r' r$ Ú TypeErrorÚAttributeErrorr Úgetattrr r ÚIOErrorÚOSErrorÚobjectÚNotImplementedErrorr0 rT ri rO Úprepare_content_lengthrh ) r? rJ r] r2 rh rU ÚveÚ is_streamÚlengthrA rA rB r É sP
z PreparedRequest.prepare_bodyc C sL |dk r$t |}|rHt|| jd< n$| jdkrH| jjddkrHd| jd< dS )z>Prepare Content-Length header based on request method and bodyNzContent-LengthÚGETÚHEADÚ0)r½ r¾ )r$ r0 rT r| Úget)r? rh r¼ rA rA rB r¹ s z&PreparedRequest.prepare_content_lengthr9 c C sj |dkr"t | j}t|r |nd}|rft|trDt|dkrDt| }|| }| jj|j | j | j
dS )z"Prepares the given HTTP auth data.NrP ) r r: ÚanyrG rX rZ r
Ú__dict__Úupdater¹ rh )r? r~ r: Úurl_authÚrrA rA rB r s
z PreparedRequest.prepare_authc C s@ t |tjr|| _n
t|| _t| j| }|dk r<|| jd< dS )a Prepares the given HTTP cookie data.
This function eventually generates a ``Cookie`` header from the
given cookies using cookielib. Due to cookielib's design, the header
will not be regenerated if it already exists, meaning this function
can only be called once for the life of the
:class:`PreparedRequest <PreparedRequest>` object. Any subsequent calls
to ``prepare_cookies`` will have no actual effect, unless the "Cookie"
header is removed beforehand.
NÚCookie)rG r( Ú CookieJarr
r r rT )r? r Ú
cookie_headerrA rA rB r 6 s
z PreparedRequest.prepare_cookiesc C s* |pg }x |D ]}| j ||| qW dS )zPrepares the given hooks.N)rw )r? rs ru rA rA rB r J s
z PreparedRequest.prepare_hooks)
NNNNNNNNNN)N)r9 )rj rk rl r r r r r r rn r r r r r¹ r r r rA rA rA rB r s
V
J
r c
@ s e Zd ZdZdddddddd d
d g
Zd d
Zdd Zdd Zdd Zdd Z dd Z
dd Z dd Z d d Z
ed d Zed d! Zed"d# Zed$d% Zed&d' Zd;d*d+Zed)d,fd-d.Zed/d0 Zed1d2 Zd3d4 Zed5d6 Zd7d8 Zd9d: Z d,S )<ÚResponsezhThe :class:`Response <Response>` object, which contains a
server's response to an HTTP request.
Ú_contentÚ status_coderT r: ÚhistoryÚencodingÚreasonr Úelapsedr¬ c C s^ d| _ d| _d | _d | _t | _d | _d | _d | _g | _ d | _
t i | _ t
jd| _d | _d S )NFr )rÊ Ú_content_consumedÚ_nextrË r rT Úrawr: rÍ rÌ rÎ r r ÚdatetimeÚ timedeltarÏ r¬ )r? rA rA rB r ^ s
zResponse.__init__c C s | S )NrA )r? rA rA rB Ú __enter__ s zResponse.__enter__c G s | j d S )N)Úclose)r? r rA rA rB Ú__exit__ s zResponse.__exit__c s j s j fdd jD S )Nc s i | ]}t |d |qS )N)r´ )rp Úattr)r? rA rB ú
<dictcomp> s z)Response.__getstate__.<locals>.<dictcomp>)rÐ ÚcontentÚ __attrs__)r? rA )r? rB Ú __getstate__ s zResponse.__getstate__c C s> x |j D ]\}}t| || q
W t| dd t| dd d S )NrÐ TrÒ )r{ Úsetattr)r? ÚstaterR rª rA rA rB Ú __setstate__ s zResponse.__setstate__c C s
d| j S )Nz<Response [%s]>)rË )r? rA rA rB r £ s zResponse.__repr__c C s | j S )ak Returns True if :attr:`status_code` is less than 400.
This attribute checks if the status code of the response is between
400 and 600 to see if there was a client error or a server error. If
the status code, is between 200 and 400, this will return True. This
is **not** a check to see if the response code is ``200 OK``.
)Úok)r? rA rA rB Ú__bool__¦ s zResponse.__bool__c C s | j S )ak Returns True if :attr:`status_code` is less than 400.
This attribute checks if the status code of the response is between
400 and 600 to see if there was a client error or a server error. If
the status code, is between 200 and 400, this will return True. This
is **not** a check to see if the response code is ``200 OK``.
)rà )r? rA rA rB Ú __nonzero__° s zResponse.__nonzero__c C s
| j dS )z,Allows you to use a response as an iterator.é )Ú iter_content)r? rA rA rB rE º s zResponse.__iter__c C s& y | j W n tk
r dS X dS )ax Returns True if :attr:`status_code` is less than 400, False if not.
This attribute checks if the status code of the response is between
400 and 600 to see if there was a client error or a server error. If
the status code is between 200 and 400, this will return True. This
is **not** a check to see if the response code is ``200 OK``.
FT)Úraise_for_statusr )r? rA rA rB rà ¾ s
z Response.okc C s d| j ko| jtkS )zTrue if this Response is a well-formed HTTP redirect that could have
been processed automatically (by :meth:`Session.resolve_redirects`).
Úlocation)rT rË ÚREDIRECT_STATI)r? rA rA rB Ú is_redirectÍ s zResponse.is_redirectc C s d| j ko| jtjtjfkS )z@True if this Response one of the permanent versions of redirect.ræ )rT rË r3 Úmoved_permanentlyÚpermanent_redirect)r? rA rA rB Úis_permanent_redirectÔ s z Response.is_permanent_redirectc C s | j S )zTReturns a PreparedRequest for the next request in a redirect chain, if there is one.)rÑ )r? rA rA rB ÚnextÙ s z
Response.nextc C s t j| jd S )zOThe apparent encoding, provided by the charset_normalizer or chardet libraries.rÍ )r/ ÚdetectrÚ )r? rA rA rB Úapparent_encodingÞ s zResponse.apparent_encodingr
Fc s~ fdd}j r(tjtr(t n$ dk rLt t rLtdt tj }| }j rh|n|}|rzt |}|S )aø Iterates over the response data. When stream=True is set on the
request, this avoids reading the content at once into memory for
large responses. The chunk size is the number of bytes it should
read into memory. This is not necessarily the length of each item
returned as decoding can take place.
chunk_size must be of type int or None. A value of None will
function differently depending on the value of `stream`.
stream=True will read data as it arrives in whatever size the
chunks are received. If stream=False, data is returned as
a single chunk.
If decode_unicode is True, content will be decoded using the best
available encoding based on the response.
c 3 sÖ t jdr®y$x jj ddD ]
} | V q W W qÌ tk
rZ } zt|W Y d d }~X qÌ tk
r } zt|W Y d d }~X qÌ tk
rª } zt|W Y d d }~X qÌX n x jj } | sÂP | V q°W d_
d S )NÚstreamT)Údecode_content) rH rÒ rï r r r r r r rD rÐ )Úchunkr¥ )Ú
chunk_sizer? rA rB Úgenerateô s
z'Response.iter_content.<locals>.generateNz.chunk_size must be an int, it is instead a %s.)
rÐ rG rÊ Úboolr Úintr² Útyper" r )r? rò Údecode_unicoderó Ú
reused_chunksÚ
stream_chunksÚchunksrA )rò r? rB rä ã s
zResponse.iter_contentNc c s d}x| j ||dD ]r}|dk r(|| }|r8|j|}n|j }|rn|d rn|rn|d d |d krn|j }nd}x|D ]
}|V qxW qW |dk r|V dS )zõIterates over the response data, one line at a time. When
stream=True is set on the request, this avoids reading the
content at once into memory for large responses.
.. note:: This method is not reentrant safe.
N)rò r÷ r
éÿÿÿÿrû rû rû )rä ÚsplitÚ
splitlinesÚpop)r? rò r÷ Ú delimiterÚpendingrñ ÚlinesÚlinerA rA rB Ú
iter_lines s $
zResponse.iter_linesc C sV | j dkrJ| jrtd| jdks,| jdkr4d| _ ndj| jtpFd| _ d| _| j S )z"Content of the response, in bytes.Fz2The content for this response was already consumedr Nó T)rÊ rÐ Ú RuntimeErrorrË rÒ r> rä ÚCONTENT_CHUNK_SIZE)r? rA rA rB rÚ 9 s
zResponse.contentc C sh d}| j }| jstdS | j dkr(| j}yt| j|dd}W n& ttfk
rb t| jdd}Y nX |S )aÚ Content of the response, in unicode.
If Response.encoding is None, encoding will be guessed using
``charset_normalizer`` or ``chardet``.
The encoding of the response content is determined based solely on HTTP
headers, following RFC 2616 to the letter. If you can take advantage of
non-HTTP knowledge to make a better guess at the encoding, you should
set ``r.encoding`` appropriately before accessing this property.
Nr9 Úreplace)Úerrors)rÍ rÚ r, rî Ú LookupErrorr² )r? rÚ rÍ rA rA rB ÚtextM s
z
Response.textc K s´ | j rZ| jrZt| jdkrZt| j}|dk rZytj| jj|f|S tk
rX Y nX ytj| jf|S t k
r® } z(t
rt |j nt |j
|j|jW Y dd}~X nX dS )zýReturns the json-encoded content of a response, if any.
:param \*\*kwargs: Optional arguments that ``json.loads`` takes.
:raises requests.exceptions.JSONDecodeError: If the response body does not
contain valid json.
rQ N)rÍ rÚ rZ r# r¯ ÚloadsrW ÚUnicodeDecodeErrorr
r r. ÚRequestsJSONDecodeErrorÚmessageÚmsgÚdocÚpos)r? ÚkwargsrÍ r¥ rA rA rB r2 s s
z
Response.jsonc C sJ | j jd}i }|rFt|}x(|D ] }|jdp8|jd}|||< q"W |S )z8Returns the parsed header links of the response, if any.ÚlinkÚrelr: )rT rÀ r! )r? r© ÚlÚlinksr ÚkeyrA rA rB r s
zResponse.linksc C s¸ d}t | jtrDy| jjd}W qJ tk
r@ | jjd}Y qJX n| j}d| j ko^dk n rxd| j|| jf }n,d| j kodk n r¤d| j|| jf }|r´t|| d d
S ) z+Raises :class:`HTTPError`, if one occurred.r9 zutf-8z
iso-8859-1i iô z %s Client Error: %s for url: %siX z %s Server Error: %s for url: %s)ÚresponseN)rG rÎ r- rW r rË r: r )r? Úhttp_error_msgrÎ rA rA rB rå © s zResponse.raise_for_statusc C s0 | j s| jj t| jdd}|dk r,| dS )zØReleases the connection back to the pool. Once this method has been
called the underlying ``raw`` object must not be accessed again.
*Note: Should not normally need to be called explicitly.*
Ú release_connN)rÐ rÒ rÖ r´ )r? r rA rA rB rÖ Â s
zResponse.close)r
F) rj rk rl r rÛ r rÕ r× rÜ rß r rá râ rE rm rà rè rë rì rî rä ÚITER_CHUNK_SIZEr rÚ r
r2 r rå rÖ rA rA rA rB rÉ T s2
/
7 &$ rÉ i ( )Ur rÓ ÚsysÚencodings.idnaÚ encodingsZurllib3.fieldsr Zurllib3.filepostr Z urllib3.utilr Zurllib3.exceptionsr r r r Úior rs r Ú
structuresr r~ r
r r r r Ú
exceptionsr r r r r r r r r r
Ú_internal_utilsr r Úutilsr r r r r r! r" r# r$ r% Úcompatr& r' r( r) r* r+ r, r- r. r/ r0 r1 r2 r¯ Ú status_codesr3 ÚmovedÚfoundÚotherÚtemporary_redirectrê rç ÚDEFAULT_REDIRECT_LIMITr r r· r6 ro rz r rÉ rA rA rA rB Ú<module> sD ( 0< rJ D