Server : Apache/2.4.62 (Unix) OpenSSL/1.0.2k-fips System : Linux server1.richineiserver.com 3.10.0-1160.119.1.el7.x86_64 #1 SMP Tue Jun 4 14:43:51 UTC 2024 x86_64 User : fdshops ( 1003) PHP Version : 8.2.21 Disable Function : NONE Directory : /lib/python2.7/site-packages/ndg/httpsclient/ |
�
P:}Pc @ s� d Z d Z d Z d Z d Z d Z d Z d d l Z d d l Z d d l Z d d l
m Z d d l Z d d l
Z
d d
l
m Z m Z m Z m Z d d l Z d d l m Z d d l m Z d d
l m Z e j e � Z d e f d � � YZ d e f d � � YZ d d d � Z d d d � Z! d d d � Z" d d d � Z# d d � Z$ d � Z% d e& f d � � YZ' d � Z( e d k r�e j) � e( � n d S( s` Utilities using NDG HTTPS Client, including a main module that can be used to
fetch from a URL.
s
R B Wilkinsons 09/12/11s2 (C) 2011 Science and Technology Facilities Councils- BSD - see LICENSE file in top-level directorys Philip.Kershaw@stfc.ac.uks $Id$i����N( t OptionParser( t HTTPHandlert HTTPCookieProcessort HTTPBasicAuthHandlert HTTPPasswordMgrWithDefaultRealm( t build_opener( t HTTPSContextHandler( t ssl_context_utilt AccumulatingHTTPCookieProcessorc B s e Z d Z d � Z e Z RS( st Cookie processor that adds new cookies (instead of replacing the existing
ones as HTTPCookieProcessor does)
c C s� d } t j | j � | j i | j | j � } | j j | � | j | � } | r� | j | � r� | j | � } d j
| | g � } | j | | � q� | j | | � n | S( s� Processes cookies for a HTTP request.
@param request: request to process
@type request: urllib2.Request
@return: request
@rtype: urllib2.Request
t Cookies ; ( t urllib2t Requestt get_full_urlt datat origin_req_hostt unverifiablet cookiejart add_cookie_headert
get_headert
has_headert joint add_unredirected_header( t selft requestt COOKIE_HEADER_NAMEt tmp_requestt new_cookiest old_cookiest merged_cookies( ( s9 /usr/lib/python2.7/site-packages/ndg/httpsclient/utils.pyt http_request s
( t __name__t
__module__t __doc__R t
https_request( ( ( s9 /usr/lib/python2.7/site-packages/ndg/httpsclient/utils.pyR s t
URLFetchErrorc B s e Z d Z RS( s Error fetching content from URL( R R R ( ( ( s9 /usr/lib/python2.7/site-packages/ndg/httpsclient/utils.pyR" > s c C sc t | | d | d | �\ } } } | rS | t j k rS | j � } | j � | St | � � d S( s� Returns data retrieved from a URL.
@param url: URL to attempt to open
@type url: basestring
@param config: SSL context configuration
@type config: Configuration
@return data retrieved from URL or None
R
t handlersN( t open_urlt httplibt OKt readt closeR" ( t urlt configR
R# t return_codet return_messaget responset return_data( ( s9 /usr/lib/python2.7/site-packages/ndg/httpsclient/utils.pyt fetch_from_urlB s
c
C s� t | | d | d | �\ } } } | t j k rr | j � } | j � t | d � } | j | � | j � n | | | t j k f S( s� Writes data retrieved from a URL to a file.
@param url: URL to attempt to open
@type url: basestring
@param config: SSL context configuration
@type config: Configuration
@param output_file: output file
@type output_file: basestring
@return: tuple (
returned HTTP status code or 0 if an error occurred
returned message
boolean indicating whether access was successful)
R
R# t w( R$ R% R& R' R( t opent write(
R) R* t output_fileR
R# R+ R, R- R. t outfile( ( s9 /usr/lib/python2.7/site-packages/ndg/httpsclient/utils.pyt fetch_from_url_to_fileS s
c C sM t | | d | d | �\ } } } | r= | t j k r= | St | � � d S( s Returns data retrieved from a URL.
@param url: URL to attempt to open
@type url: basestring
@param config: SSL context configuration
@type config: Configuration
@return: data retrieved from URL or None
@rtype: file derived type
R
R# N( R$ R% R& R" ( R) R* R
R# R+ R, R- ( ( s9 /usr/lib/python2.7/site-packages/ndg/httpsclient/utils.pyt fetch_stream_from_urlj s
c
C s� | j r d n d } | j r* | j } n t j � } t | � } | sQ g } n | j | � | j r� t d | � } t | j d | �} | j | | g � n | j
r� t t � � } | j
d d d | d | j d d | j d � | j | � n t | | j � s1| j t j i � � t j d � n9 | j rj| j t j | j � � t j d | j � n t d
| j | � }
| j } | d k r�i } n t j | | | � } d }
d } d } yj |
j | � } | j } | j }
t j t j � r-x0 t | � D] \ } } t j d | | � qWn Wn� t j k
r�} | j }
d
| j } t j t j � r�t j d | j | j � q�nW t! k
r�} d
| j" � } t j t j � r�d d l# } t j | j$ � � q�n X|
| | f S( s� Attempts to open a connection to a specified URL.
@param url: URL to attempt to open
@param config: SSL context configuration
@type config: Configuration
@param data: HTTP POST data
@type data: str
@param handlers: list of custom urllib2 handlers to add to the request
@type handlers: iterable
@return: tuple (
returned HTTP status code or 0 if an error occurred
returned message or error description
response object)
i i t
debuglevelt realmt urit usert passwds Not using proxys Configuring proxies: %st ssl_contextt s %s : %ss Error: %ss %s %si����N(% t debugt cookiet cookielibt CookieJarR t appendR R R< t extendt http_basicauthR R t add_passwordt Nonet httpautht _should_use_proxyt no_proxyR
t ProxyHandlert logt proxiesR t headersR R1 t msgt codet isEnabledFort loggingt DEBUGt enumeratet HTTPErrort Exceptiont __str__t tracebackt
format_exc( R) R* R
R# R7 t cjt cookie_handlert http_handlert
https_handlert auth_handlert openerRM R R+ R, R- t indexR? t excRW ( ( s9 /usr/lib/python2.7/site-packages/ndg/httpsclient/utils.pyR$ { sf
c C s� | d k r$ t j j d d � } n | } t j t | � � } xC g | j d � D] } | j � ^ qR D] } | j | k rh t Sqh Wt
S( s� Determines whether a proxy should be used to open a connection to the
specified URL, based on the value of the no_proxy environment variable.
@param url: URL
@type url: basestring or urllib2.Request
RI R= t ,N( RF t ost environt gett urlparset _url_as_stringt splitt stript hostnamet Falset True( R) RI t no_proxy_effectivet urlObjt ht np( ( s9 /usr/lib/python2.7/site-packages/ndg/httpsclient/utils.pyRH � s /c C sL t | t j � r | j � St | t � r/ | St d t t j f � � d S( s� Returns the URL string from a URL value that is either a string or
urllib2.Request..
@param url: URL
@type url: basestring or urllib2.Request
@return: URL string
@rtype: basestring
s Expected type %r or %rN( t
isinstanceR
R R t
basestringt TypeError( R) ( ( s9 /usr/lib/python2.7/site-packages/ndg/httpsclient/utils.pyRf � s
t
Configurationc B s) e Z d Z e d d d d d d � Z RS( s Connection configuration.
c C sC | | _ | | _ | | _ | | _ | | _ | | _ | | _ d S( s�
@param ssl_context: SSL context to use with this configuration
@type ssl_context: OpenSSL.SSL.Context
@param debug: if True, output debugging information
@type debug: bool
@param proxies: proxies to use for
@type proxies: dict with basestring keys and values
@param no_proxy: hosts for which a proxy should not be used
@type no_proxy: basestring
@param cookie: cookies to set for request
@type cookie: cookielib.CookieJar
@param http_basicauth: http authentication, or None
@type http_basicauth: tuple of (username,password)
@param headers: http headers
@type headers: dict
N( R< R> RL RI R? RD RM ( R R< R> RL RI R? RD RM ( ( s9 /usr/lib/python2.7/site-packages/ndg/httpsclient/utils.pyt __init__� s N( R R R Rj RF Rt ( ( ( s9 /usr/lib/python2.7/site-packages/ndg/httpsclient/utils.pyRs � s c C s� t d d � } | j d d d d d d d t j j d
� d d �| j d
d d d d d d d8 d d �| j d d d d d d d d8 d d �| j d d d d d d d t d d �| j d d d d d d d d8 d d �| j d d! d d" d d d d8 d d# �| j d$ d% d d d d& d t d d' �| j d( d) d d* d d+ d d8 d d, �| j d- d d. d d/ d d0 d d1 �| j � \ } } t | � d2 k r�| j d3 � n | d4 } | j
r�t j � j
t j � n | j r
t j j | j � r
| j } n d8 } | j r:t j j | j � r:| j } n d8 } | j rjt j j | j � rj| j } n d8 } | j } | j r�t j j | j � r�t | j � } | j � } | j � n d8 } | j r�| j j d5 d2 � }
n d8 }
i } | j rAxB | j D]4 } | j d5 d2 � \ }
} | j � | |
j � <qWn t j | | d8 | | | � } t | | j
d6 |
d/ | �} | j! r�t" | | | j! | � d7 \ } } t# | | � � n t$ | | � } | GHd8 S(9 sH Utility to fetch data using HTTP or HTTPS GET from a specified URL.
t usages %prog [options] urls -cs
--certificatet destt cert_filet metavart FILEt defaults ~/credentials.pemt helps4 Certificate file - defaults to $HOME/credentials.pems -ks
--private-keyt key_files3 Private key file - defaults to the certificate files -ts --ca-certificate-dirt ca_dirt PATHs% Trusted CA certificate file directorys -ds --debugt actiont
store_trueR> s Print debug information.s -ps --post-data-filet data_files POST data files -fs --fetchR3 s Output files -ns --no-verify-peert no_verify_peers& Skip verification of peer certificate.s -as --basicautht auths USER:PASSWDs HTTP authentication credentialss --headerRB RM s
HEADER: VALUEs Add HTTP header to requesti s Incorrect number of argumentsi t :RD i N(% R t
add_optionRb t patht
expanduserRF Rj t
parse_argst lent errorR> RQ t getLoggert setLevelRR R| t existsRw R} R� R� R1 R' R( t basicauthR� Rg RM t lstripRh R t make_ssl_contextRs R3 R5 t
SystemExitR/ ( t parsert optionst argsR) R| Rw R} t verify_peerR� R
RD RM Rn t keyt valR< R* R+ R, ( ( s9 /usr/lib/python2.7/site-packages/ndg/httpsclient/utils.pyt main s�
t __main__(* R t
__author__t __date__t
__copyright__t __license__t __contact__t __revision__R@ R% RQ t optparseR Rb R
R R R R Re t$ ndg.httpsclient.urllib2_build_openerR t ndg.httpsclient.httpsR t ndg.httpsclientR R� R RK R RU R" RF R/ R5 R6 R$ RH Rf t objectRs R� t basicConfig( ( ( s9 /usr/lib/python2.7/site-packages/ndg/httpsclient/utils.pyt <module> s> " "Z d