3
V'ícT ã @ sÜ d Z ddlZddlZddlmZmZ ddlmZ ddl m
Z
ddl m Z ddl
mZ ddlmZ dd lmZ dd
lmZ dd lmZ dd lmZ dd
lmZ ddlmZ ddlmZ ddlmZ ddlm Z ddlm Z ddlm Z ddl m!Z! ddl"m#Z#m$Z$ ddl%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+m,Z, ddl-m.Z. ddl/m0Z0 ddl1m2Z2m3Z3m4Z4m Z mZm5Z5m6Z6m7Z7m8Z8mZ ddl9m:Z: ydd l;m<Z< W n e=k
r¦ d d Z<Y nX d Z>d Z?dZ@dZAG d!d" d"eBZCG d#d$ d$eCZDdS )%z
requests.adapters
~~~~~~~~~~~~~~~~~
This module contains the transport adapters that Requests uses to define
and maintain connections.
é N)Ú PoolManagerÚproxy_from_url)Ú HTTPResponse)Ú parse_url)ÚTimeout)ÚRetry)ÚClosedPoolError)ÚConnectTimeoutError)Ú HTTPError)Ú
InvalidHeader)Ú
MaxRetryError)ÚNewConnectionError)Ú
ProxyError)Ú
ProtocolError)ÚReadTimeoutError)ÚSSLError)Ú
ResponseError)ÚLocationValueErroré )ÚResponse)ÚurlparseÚ
basestring)ÚDEFAULT_CA_BUNDLE_PATHÚextract_zipped_pathsÚget_encoding_from_headersÚprepend_scheme_if_neededÚget_auth_from_urlÚ
urldefragauthÚ select_proxy)ÚCaseInsensitiveDict)Úextract_cookies_to_jar)
ÚConnectionErrorÚConnectTimeoutÚ ReadTimeoutr r Ú
RetryErrorÚ
InvalidSchemaÚInvalidProxyURLÚ
InvalidURLr )Ú_basic_auth_str)ÚSOCKSProxyManagerc O s t dd S )Nz'Missing dependencies for SOCKS support.)r% )ÚargsÚkwargs© r, ú5/tmp/pip-build-gk9425m9/requests/requests/adapters.pyr) / s r) Fé
c s2 e Zd ZdZ fddZd ddZd d
Z ZS ) Ú BaseAdapterzThe Base Transport Adapterc s t t| j d S )N)Úsuperr/ Ú__init__)Úself)Ú __class__r, r- r1 ; s zBaseAdapter.__init__FNTc C s t dS )aC Sends PreparedRequest object. Returns Response object.
:param request: The :class:`PreparedRequest <PreparedRequest>` being sent.
:param stream: (optional) Whether to stream the request content.
:param timeout: (optional) How long to wait for the server to send
data before giving up, as a float, or a :ref:`(connect timeout,
read timeout) <timeouts>` tuple.
:type timeout: float or tuple
:param verify: (optional) Either a boolean, in which case it controls whether we verify
the server's TLS certificate, or a string, in which case it must be a path
to a CA bundle to use
:param cert: (optional) Any user-provided SSL certificate to be trusted.
:param proxies: (optional) The proxies dictionary to apply to the request.
N)ÚNotImplementedError)r2 ÚrequestÚstreamÚtimeoutÚverifyÚcertÚproxiesr, r, r- Úsend> s zBaseAdapter.sendc C s t dS )z!Cleans up adapter specific items.N)r4 )r2 r, r, r- ÚcloseP s zBaseAdapter.close)FNTNN)Ú__name__Ú
__module__Ú __qualname__Ú__doc__r1 r; r< Ú
__classcell__r, r, )r3 r- r/ 8 s
r/ c s e Zd ZdZdddddgZeeeef fdd Zd d
Z d d Z
efd
dZ dd Z dd Z
dd Zd$ddZdd Zdd Zd d Zd d Zd%d"d#Z ZS )&Ú HTTPAdaptera The built-in HTTP Adapter for urllib3.
Provides a general-case interface for Requests sessions to contact HTTP and
HTTPS urls by implementing the Transport Adapter interface. This class will
usually be created by the :class:`Session <Session>` class under the
covers.
:param pool_connections: The number of urllib3 connection pools to cache.
:param pool_maxsize: The maximum number of connections to save in the pool.
:param max_retries: The maximum number of retries each connection
should attempt. Note, this applies only to failed DNS lookups, socket
connections and connection timeouts, never to requests where data has
made it to the server. By default, Requests does not retry failed
connections. If you need granular control over the conditions under
which we retry a request, import urllib3's ``Retry`` class and pass
that instead.
:param pool_block: Whether the connection pool should block for connections.
Usage::
>>> import requests
>>> s = requests.Session()
>>> a = requests.adapters.HTTPAdapter(max_retries=3)
>>> s.mount('http://', a)
Ú max_retriesÚconfigÚ_pool_connectionsÚ
_pool_maxsizeÚ _pool_blockc sd |t krtddd| _n tj|| _i | _i | _tt| j || _ || _
|| _ | j |||d d S )Nr F)Úread)Úblock)
ÚDEFAULT_RETRIESr rC Úfrom_intrD Ú
proxy_managerr0 rB r1 rE rF rG Úinit_poolmanager)r2 Úpool_connectionsÚ pool_maxsizerC Ú
pool_block)r3 r, r- r1 r s zHTTPAdapter.__init__c s fdd j D S )Nc s i | ]}t |d |qS )N)Úgetattr)Ú.0Úattr)r2 r, r- ú
<dictcomp>
s z,HTTPAdapter.__getstate__.<locals>.<dictcomp>)Ú __attrs__)r2 r, )r2 r- Ú __getstate__ s zHTTPAdapter.__getstate__c C sH i | _ i | _x |j D ]\}}t| || qW | j| j| j| jd d S )N)rI )rL rD ÚitemsÚsetattrrM rE rF rG )r2 ÚstaterS Úvaluer, r, r- Ú __setstate__ s zHTTPAdapter.__setstate__c K s0 || _ || _|| _tf |||dd|| _dS )a Initializes a urllib3 PoolManager.
This method should not be called from user code, and is only
exposed for use when subclassing the
:class:`HTTPAdapter <requests.adapters.HTTPAdapter>`.
:param connections: The number of urllib3 connection pools to cache.
:param maxsize: The maximum number of connections to save in the pool.
:param block: Block when no free connections are available.
:param pool_kwargs: Extra keyword arguments used to initialize the Pool Manager.
T)Ú num_poolsÚmaxsizerI ÚstrictN)rE rF rG r Ú poolmanager)r2 Ú connectionsr] rI Ú pool_kwargsr, r, r- rM s
z HTTPAdapter.init_poolmanagerc K s || j kr| j | }n||j jdr^t|\}}t|f||| j| j| jd| }| j |< n4| j|}t |f|| j| j| jd| }| j |< |S )aÏ Return urllib3 ProxyManager for the given proxy.
This method should not be called from user code, and is only
exposed for use when subclassing the
:class:`HTTPAdapter <requests.adapters.HTTPAdapter>`.
:param proxy: The proxy to return a urllib3 ProxyManager for.
:param proxy_kwargs: Extra keyword arguments used to configure the Proxy Manager.
:returns: ProxyManager
:rtype: urllib3.ProxyManager
Úsocks)ÚusernameÚpasswordr\ r] rI )Ú
proxy_headersr\ r] rI )
rL ÚlowerÚ
startswithr r) rE rF rG re r )r2 ÚproxyÚ proxy_kwargsÚmanagerrc rd re r, r, r- Úproxy_manager_for§ s*
z HTTPAdapter.proxy_manager_forc C s |j jdrr|rrd}|dk r"|}|s.tt}| sBtjj| rPtdj|d|_ tjj
|sj||_ q||_ nd|_ d|_ d|_ |rt
|tsª|d |_|d |_n ||_d|_|jrÜtjj|j rÜtd j|j|joðtjj|j rtd
j|jdS ) aA Verify a SSL certificate. This method should not be called from user
code, and is only exposed for use when subclassing the
:class:`HTTPAdapter <requests.adapters.HTTPAdapter>`.
:param conn: The urllib3 connection object associated with the cert.
:param url: The requested URL.
:param verify: Either a boolean, in which case it controls whether we verify
the server's TLS certificate, or a string, in which case it must be a path
to a CA bundle to use
:param cert: The SSL certificate to verify.
ÚhttpsNTzECould not find a suitable TLS CA certificate bundle, invalid path: {}Ú
CERT_REQUIREDÚ CERT_NONEr r z9Could not find the TLS certificate file, invalid path: {}z1Could not find the TLS key file, invalid path: {})rf rg r r ÚosÚpathÚexistsÚIOErrorÚformatÚ cert_reqsÚisdirÚca_certsÚ ca_cert_dirÚ
isinstancer Ú cert_fileÚkey_file)r2 ÚconnÚurlr8 r9 Úcert_locr, r, r- Ú cert_verifyÌ s8
zHTTPAdapter.cert_verifyc C s t }t|dd|_tt|di |_t|j|_||_|jj|_t |j
t r^|j
j d|_
n|j
|_
t
|j|| ||_| |_|S )a¶ Builds a :class:`Response <requests.Response>` object from a urllib3
response. This should not be called from user code, and is only exposed
for use when subclassing the
:class:`HTTPAdapter <requests.adapters.HTTPAdapter>`
:param req: The :class:`PreparedRequest <PreparedRequest>` used to generate the response.
:param resp: The urllib3 response object.
:rtype: requests.Response
ÚstatusNÚheaderszutf-8)r rQ Ú status_coder r r ÚencodingÚrawÚreasonrx r| ÚbytesÚdecoder Úcookiesr5 Ú
connection)r2 ÚreqÚrespÚresponser, r, r- Úbuild_response s
zHTTPAdapter.build_responseNc C sd t ||}|rDt|d}t|}|js.td| j|}|j|}n t|}|j }| j j|}|S )a Returns a urllib3 connection for the given URL. This should not be
called from user code, and is only exposed for use when subclassing the
:class:`HTTPAdapter <requests.adapters.HTTPAdapter>`.
:param url: The URL to connect to.
:param proxies: (optional) A Requests-style dictionary of proxies used on this request.
:rtype: urllib3.ConnectionPool
ÚhttpzFPlease check proxy URL. It is malformed and could be missing the host.)
r r r Úhostr& rk Úconnection_from_urlr Úgeturlr_ )r2 r| r: rh Ú proxy_urlrL r{ Úparsedr, r, r- Úget_connection% s
zHTTPAdapter.get_connectionc C s* | j j x| jj D ] }|j qW dS )z¢Disposes of any internal state.
Currently, this closes the PoolManager and any active ProxyManager,
which closes any pooled connections.
N)r_ ÚclearrL Úvalues)r2 rh r, r, r- r< @ s
zHTTPAdapter.closec C sb t |j|}t|jj}|o"|dk}d}|rDt|jj }|jd}|j}|r^| r^t|j}|S )a? Obtain the url to use when making the final request.
If the message is being sent through a HTTP proxy, the full URL has to
be used. Otherwise, we should only use the path portion of the URL.
This should not be called from user code, and is only exposed for use
when subclassing the
:class:`HTTPAdapter <requests.adapters.HTTPAdapter>`.
:param request: The :class:`PreparedRequest <PreparedRequest>` being sent.
:param proxies: A dictionary of schemes or schemes and hosts to proxy URLs.
:rtype: str
rl Frb )r r| r Úschemerf rg Úpath_urlr ) r2 r5 r: rh r Úis_proxied_http_requestÚusing_socks_proxyÚ proxy_schemer| r, r, r- Ú request_urlJ s
zHTTPAdapter.request_urlc K s dS )a" Add any headers needed by the connection. As of v2.0 this does
nothing by default, but is left for overriding by users that subclass
the :class:`HTTPAdapter <requests.adapters.HTTPAdapter>`.
This should not be called from user code, and is only exposed for use
when subclassing the
:class:`HTTPAdapter <requests.adapters.HTTPAdapter>`.
:param request: The :class:`PreparedRequest <PreparedRequest>` to add headers to.
:param kwargs: The keyword arguments from the call to send().
Nr, )r2 r5 r+ r, r, r- Ú add_headersg s zHTTPAdapter.add_headersc C s& i }t |\}}|r"t|||d< |S )a Returns a dictionary of the headers to add to any request sent
through a proxy. This works with urllib3 magic to ensure that they are
correctly sent to the proxy, rather than in a tunnelled request if
CONNECT is being used.
This should not be called from user code, and is only exposed for use
when subclassing the
:class:`HTTPAdapter <requests.adapters.HTTPAdapter>`.
:param proxy: The url of the proxy being used for this request.
:rtype: dict
zProxy-Authorization)r r( )r2 rh r rc rd r, r, r- re u s
zHTTPAdapter.proxy_headersFTc 7 C s y| j |j|}W n. tk
r@ } zt||dW Y dd}~X nX | j||j|| | j||} | j||||||d |jdkpd|jk }
t |t
ræy|\} } t | | d}W qþ t k
râ } zdj
|}
t |
W Y dd}~X qþX nt |t ròn t ||d}yZ|
s2|j|j| |j|jdddd| j|d
}n$t|d rD|j}|jtd
}yîd |jk}|j|j| d |d
x$|jj D ]\}}|j|| q|W |j xN|jD ]D}|jtt|dd
j d |jd |j| |jd q¦W |jd y|j d d}W n t k
r& |j }Y nX t j |||ddd}W n |j! Y nX W nª t"t#j$fk
r }
zt%|
|dW Y dd}
~
X nt t&k
r6 } zt |j't(rÌt |j't)sÌt*||dt |j't+ræt,||dt |j't-r t.||dt |j't/rt0||dt%||dW Y dd}~X nÐ t1k
rd } zt%||dW Y dd}~X n¢ t-k
r } zt.|W Y dd}~X nx t/t2fk
r } zVt |t/r¾t0||dn6t |t3rØt4||dn t |t5ròt6||dn W Y dd}~X nX | j7||S )a Sends PreparedRequest object. Returns Response object.
:param request: The :class:`PreparedRequest <PreparedRequest>` being sent.
:param stream: (optional) Whether to stream the request content.
:param timeout: (optional) How long to wait for the server to send
data before giving up, as a float, or a :ref:`(connect timeout,
read timeout) <timeouts>` tuple.
:type timeout: float or tuple or urllib3 Timeout object
:param verify: (optional) Either a boolean, in which case it controls whether
we verify the server's TLS certificate, or a string, in which case it
must be a path to a CA bundle to use
:param cert: (optional) Any user-provided SSL certificate to be trusted.
:param proxies: (optional) The proxies dictionary to apply to the request.
:rtype: requests.Response
)r5 N)r6 r7 r8 r9 r: zContent-Length)ÚconnectrH zrInvalid timeout {}. Pass a (connect, read) timeout tuple, or a single float to set both timeouts to the same valueF)
Úmethodr| Úbodyr ÚredirectÚassert_same_hostÚpreload_contentÚdecode_contentÚretriesr7 Ú
proxy_pool)r7 ÚHostT)Úskip_accept_encodingÚ skip_hosté zutf-8s
s 0
)Ú buffering)Úpoolr r¢ r£ )8r r| r r' r~ r r r r rx ÚtupleÚ TimeoutSauceÚ
ValueErrorrs Úurlopenr rC Úhasattrr¥ Ú _get_connÚDEFAULT_POOL_TIMEOUTÚ
putrequestrW Ú putheaderÚ
endheadersr; ÚhexÚlenÚencodeÚ getresponseÚ TypeErrorr Ú from_httplibr< r ÚsocketÚerrorr! r r r r
r" r r$ Ú _ProxyErrorr Ú _SSLErrorr r Ú
_HTTPErrorr r# Ú_InvalidHeaderr r )r2 r5 r6 r7 r8 r9 r: r{ Úer| Úchunkedr rH Úerrr Úlow_connr¨ ÚheaderrZ ÚiÚrr, r, r- r; s²
zHTTPAdapter.send)N)FNTNN)r= r> r? r@ rU ÚDEFAULT_POOLSIZErJ ÚDEFAULT_POOLBLOCKr1 rV r[ rM rk r~ r r r< r r re r; rA r, r, )r3 r- rB U s$ %4%
rB )Er@ Úos.pathro r¼ Zurllib3.poolmanagerr r Zurllib3.responser Z urllib3.utilr r r Zurllib3.util.retryr Zurllib3.exceptionsr r r
rÀ r rÁ r r
r r¾ r r r r¿ r r Úmodelsr Úcompatr r Úutilsr r r r r r r Ú
structuresr r r Ú
exceptionsr! r" r# r$ r% r& r' Úauthr( Zurllib3.contrib.socksr) Ú ImportErrorrÊ rÉ rJ r² Úobjectr/ rB r, r, r, r- Ú<module> sH $ 0