File: //usr/lib/python3/dist-packages/uaclient/http/__pycache__/__init__.cpython-310.pyc
o
��Jhi; � @ s� d dl Zd dlZd dlZd dlZd dlZd dlZd dlZd dl Z d dl
m Z m Z m
Z
mZmZmZ d dlmZmZ d dlmZmZ d dlmZmZmZmZ dZ dZ dZ d Z d
Z e�!e�"e#��Z$ed d e%fd
e e&e&f fde'fg�Z(edd e%fd
e e&e&f fde&fde e&e f fde
e fg�Z)de&de*fdd�Z+de&dee& de&dee& fdd�Z,i a-dee& d ee& ddfd d �Z.de e&e&f fd d �Z/d
ej0j1de e&e&f fd!d"�Z2 d@d#ej3d$ee% de(fd%d&�Z4d'd(� Z5d)d*� Z6 dAd#ej3d$ee% d ee& de(fd+d,�Z7dee fd-d.�Z8de&fd/d0�Z9 dAde&d$ee% dee'e&f fd1d2�Z:di ddd3fde&d4ee' d
e e&e&f d5ee& d$ee% d6e*de)fd7d8�Z; 9dBd:e&d;e&d<e&d=e&de)f
d>d?�Z<dS )C� N)�Any�Dict�List�
NamedTuple�Optional�Tuple)�error�request)� ParseResult�urlparse)�defaults�
exceptions�system�util)z169.254.169.254�metadataz[fd00:ec2::254]zhttp://archive.ubuntu.comzhttps://esm.ubuntu.comzhttp://api.snapcraft.iozhttps://api.snapcraft.io�UnparsedHTTPResponse�code�headers�body� HTTPResponse� json_dict� json_list�url�returnc C sR zt | �}W n
ty Y dS w |jdvrdS z|j W dS ty( Y dS w )NF)�https�httpT)r �
ValueError�scheme�port)r �
parsed_url� r �8/usr/lib/python3/dist-packages/uaclient/http/__init__.py�is_service_url+ s �
��r" �protocol�proxy�test_urlc
C sF |sd S t |�stj|d��tj|dd�}| dkrjt|�jdkrjzt||d�}W n4 tjy1 � tj y9 � tj
yA � t y\ } zt �
d||t|�� tj|d��d }~ww |jdkrd|S tj|d��t�| |i�}t�|�}z|�|� |W S tjt
jfy� } zt �
d||t|d t|��� tj|d��d }~ww )
N)r$ �HEAD)�methodr �� https_proxyz:Error trying to use "%s" as pycurl proxy to reach "%s": %s�� z:Error trying to use "%s" as urllib proxy to reach "%s": %s�reason)r" r
�ProxyInvalidUrlr �Requestr r � _readurl_pycurl_https_in_https�PycurlRequiredError�ProxyAuthenticationFailed�PycurlCACertificatesError� Exception�LOGr �str�ProxyNotWorkingErrorr � ProxyHandler� build_opener�open�socket�timeout�URLError�getattr)r# r$ r% �req�response�e�
proxy_handler�openerr r r! �validate_proxy< sT � ��
� ��rB �
http_proxyr) c C s� i }| r| |d< |r||d< d� tt��}dD ]}tj�|�}|r2d� tt|�d���tt����}qt �
d|� |tjd< |tjd< |rTt � |�}t �
|�}t �|� t j
dd |id
� |ad S ) aW
Globally configure pro-client to use http and https proxies.
- sets global proxy configuration for urllib
- sets the no_proxy environment variable for the current process
which gets inherited for all subprocesses
- sets module variable for use in https-in-https pycurl requests
this is retrieved later using get_configured_web_proxy
:param http_proxy: http proxy to be used by urllib. If None, it will
not be configured
:param https_proxy: https proxy to be used by urllib. If None, it will
not be configured
r r �,)�no_proxy�NO_PROXYzSetting no_proxy: %srE rF zSetting global proxy dict�extra)rG N)�join�sorted�UA_NO_PROXY_URLS�os�environ�get�set�split�unionr3 �debugr r6 r7 �install_opener�_global_proxy_dict)rC r) �
proxy_dictrE �env_var� proxy_valuer@ rA r r r! �configure_web_proxyq s0 ���
rW c C s t S �N)rS r r r r! �get_configured_web_proxy� s rY c C s dd� | � � D �S )Nc S s i | ] \}}|� � |�qS r )�lower)�.0�k�vr r r! �
<dictcomp>� s z$_headers_to_dict.<locals>.<dictcomp>)�items�r r r r! �_headers_to_dict� s ra r= r: c
C s� z t j| |d�}W n1 tjy } z|}W Y d }~n!d }~w tjy: } zt�t|j�� t j
|| j d��d }~ww |� � }t
|jt|j�|d�S )N�r: )�causer �r r r )r �urlopenr � HTTPErrorr; r3 � exceptionr4 r+ r
�ConnectivityError�full_url�readr r ra r )r= r: �respr? r r r r! �_readurl_urllib� s ����rl c C sJ t |�}t| �}|jdko t�|j� o |duo |jdk}t�d|� |S )a�
We only want to use pycurl if all of the following are true
- The target url scheme is https
- The target host is not in no_proxy
- An https_proxy is configured either via pro's config or via environment
- The https_proxy url scheme is https
urllib.request provides some helpful functions that we re-use here.
This function also returns the https_proxy to use, since it is calculated
here anyway.
r NzShould use pycurl: %r)r �_parse_https_proxyr r � proxy_bypass�hostnamer3 rQ )r) �
target_url�parsed_target_url�parsed_https_proxy�retr r r! �should_use_pycurl� s
��� rt c C st d }d }t | j�dkr| jd }t | j�dkr | jd }||kr*|r*d|v r*t�� �||kr4tj|d��tj| d��)Nr � �407�r )r? )�len�argsr
r0 r1 � PycurlError)r r �authentication_error_code�ca_certificates_error_coder �msgr r r! �_handle_pycurl_error� s
r~ c
s zdd l }W n ty t�� �w |�� }| �� �� }|dkr(|�|jd� n*|dkr4|�|j d� n |dkrK|�|j
d� | j rJ|�|j | j � nt
d�|���|�|j| �� � dd� | �� D �}t|�dkrq|�|j|� |�|jd� |�|jtj� |r�|�|j|� |r�t|�}|r�|�� nd }|�|j|� |�|j d � nt � d
� t � � }|�|j!|� i � � fd d �} |�|j"| � z|�#� W n |j$y� }
zt%|
| �� |j&|j'd
� W Y d }
~
nd }
~
ww t(|�)|j*��} |�+� } |�,� t-| � | d�S )Nr �GETTr& �POSTz5HTTP method "{}" not supported in HTTPS-in-HTTPS modec S s g | ]
\}}d � ||��qS )z{}: {}��format)r[ �name�valr r r! �
<listcomp> s �z2_readurl_pycurl_https_in_https.<locals>.<listcomp>� z1in pycurl request function without an https proxyc sF | � d�} d| vr d S | �dd�\}}|�� �� }|�� }|� |< d S )Nz
iso-8859-1�:ru )�decoderO �striprZ )� header_line�name_raw� value_rawr� �valuer` r r! � save_header( s
z3_readurl_pycurl_https_in_https.<locals>.save_header)r r{ r| rd ).�pycurl� ImportErrorr
r/ �Curl�
get_method�upper�setopt�HTTPGET�NOBODYr� �data�COPYPOSTFIELDSr r� �URL� get_full_url� header_itemsrx �
HTTPHEADER�FOLLOWLOCATION�CAINFOr �SSL_CERTS_PATH�TIMEOUTrm �geturl�PROXY� PROXYTYPEr3 �warning�io�BytesIO� WRITEDATA�HEADERFUNCTION�performr r~ � E_RECV_ERROR�E_SSL_CACERT_BADFILE�int�getinfo�
RESPONSE_CODE�getvalue�closer )
r= r: r) r� �cr' �header_str_listrr � body_outputr� r? r r r r` r! r. � s| � ���� �
����r. c C s" | s t �� �d�} | rt| �S d S )Nr )r �
getproxiesrM r r( r r r! rm J s rm c C sH | j �d�}i }|s
i }ntj�|�si }nt�t�|��}|�|g �S )N�serviceclient_url_responses) �featuresrM rK �path�exists�json�loadsr � load_file)�cfgr �response_overlay_path�response_overlayr r r! �_get_overlay_dataP s r� c
C s� t | |�}|r+|�d�}t�|d d ��}|�� dfW d � S 1 s&w Y t|�s5tj|d��t� d�
|�� t � � d�}i }|rK||d< t
||�rsttj||d �||d
�}|jd krgtj|d��t�|j�|j� d �fS tj||d �} zAt�| ��1}t�|��}|�� |j� d
�fW d � W d � W S 1 s�w Y W d � W d S 1 s�w Y W d S tjy� }
z|
jd kr�tj|d��|
jdkr�t�� �� d }
~
ww )Nr r> � file_path� rw z
URL [GET]: {}r z
If-None-Matchr` �r: r) i0 �etag�ETagi� )r� �pop�lzmar8 rj r" r
�
InvalidUrlr3 rQ r� rY rM rt r. r r- r �
ETagUnchanged�
decompressr r re r rf �VulnerabilityDataNotFound) r� r r: r� �overlay_responser> �fr) r r= r? r r r! �download_xz_file_from_url^ sV
�
�
�
���&�
��r� Tr� r' �log_response_bodyc
s� t | �s
tj| d��|r|sd}tj| |� |d�}d�� fdd�t� �D ��}t�d� |p.d| ||r7|�
d �nd �� t � � d
�}t
|| �rNt|||d ��nt||d ���jj
d d
d�} i }
g } d�j� dd�v r�tj| tjd�} t| t�ry| }
nt| t�r�| } nt�dt| �� d��fdd�t�j�D ��}d� |p�d| |�}
|r��j}|
r�|
}n| r�| }|
d� |�7 }
t�|
� t�j �j| |
| d�S )Nrw r� )r� r r' z, c s g | ]
}d � |� | ��qS �z
'{}': '{}'r� �r[ r\ r` r r! r� � s zreadurl.<locals>.<listcomp>z'URL [{}]: {}, headers: {{{}}}, data: {}r �utf-8r r� rb �ignore��errors�application/json� content-typer� ��cls� unexpected JSON response: %sc s g | ] }d � |� j| ��qS r� )r� r r� )rk r r! r� � s z&URL [{}] response: {}, headers: {{{}}}z
, data: {}�r r r r r ) r" r
r� r r- rH rI r3 rQ r� r� rY rM rt r. rl r r r� r� r �DatetimeAwareJSONDecoder�
isinstance�dict�listr� r4 r r )r r� r r' r: r� r= �sorted_header_strr) � decoded_bodyr r � json_body� debug_msg� body_to_logr )r rk r! �readurl� sj ���
�
�
�
�r� � localhost� socket_path� http_method� http_path�
http_hostnamec C s� t � t jt j�}|�| � tj�|�}||_z |�||� |� � }|�
� j ddd�}W |� � |� � n |� � |� � w i }g } d|j
�dd�v rjtj|tjd�}
t|
t�rZ|
}nt|
t�rb|
} nt�dt|
�� t|jt|j
�||| d �S )
Nr� r� r� r� r� r� r� r� r� ) r9 �AF_UNIX� SOCK_STREAM�connectr �client�HTTPConnection�sockr � getresponserj r� r� r rM r� r� r r� r� r� r� r3 r� r4 r �statusra ) r� r� r� r� r� �connrk �outr r r� r r r! �unix_socket_request� s8
�
�r� rX )NN)r� )=�
email.message�email� http.clientr r� r� �loggingr� rK r9 �typingr r r r r r �urllibr r � urllib.parser
r �uaclientr r
r r rJ � PROXY_VALIDATION_APT_HTTP_URL� PROXY_VALIDATION_APT_HTTPS_URL� PROXY_VALIDATION_SNAP_HTTP_URL� PROXY_VALIDATION_SNAP_HTTPS_URL� getLogger� replace_top_level_logger_name�__name__r3 r� r4 �bytesr r �boolr" rB rS rW rY �message�Messagera r- rl rt r~ r. rm r� r� r� r� r r r r! �<module> s� ��
�� ���
�2��
�1 ���
�����
�_���
�6���
����
�M������