3
�Pf%w � 1 @ s� d Z ddlmZ ddlZddlZddlZddlZddlZddl Z ddl
Z
ddl Z ddl Z ddl
mZ ddlmZmZmZ ddlmZmZmZmZ ydd l mZ W n$ ek
r� dZdd
lmZ Y nX y e d � W n e k
r� ed ��Y nX d
dgZ dZ ej Z ej!j"Z#e j$� Z%e j&� Z'dZ(ej)ej*ej+ej,ej-ej.ej/ej0ej1ej2ej3ej4ej5ej6ej7ej8ej9ej:ej;ej<ej=ej>ej?ej@ejAejBejCejDejEejFejGejHejIg!ZJe
jKejLejMfiZNeOe
d��r�ejPejPfeNe
jQ< eOe
d��r�ejRejRfeNe
jS< eOe
d��rejLejLfeNe
jT< eOe
d��r0ejUejUfeNe
jV< eOe
d��rNejMejMfeNe
jW< eOe
d��rjeNe
jK eNe
jX< dd
� ZYdd� ZZdd� Z[dd � Z\ej]e[�Z^ej_e\�Z`G d d � d ea�Zbe�r�d&d d �Zcn
d'd"d �Zceceb_cG d#d$� d$ea�ZddS )(aU
SecureTranport support for urllib3 via ctypes.
This makes platform-native TLS available to urllib3 users on macOS without the
use of a compiler. This is an important feature because the Python Package
Index is moving to become a TLSv1.2-or-higher server, and the default OpenSSL
that ships with macOS is not capable of doing TLSv1.2. The only way to resolve
this is to give macOS users an alternative solution to the problem, and that
solution is to use SecureTransport.
We use ctypes here because this solution must not require a compiler. That's
because pip is not allowed to require a compiler either.
This is not intended to be a seriously long-term solution to this problem.
The hope is that PEP 543 will eventually solve this issue for us, at which
point we can retire this contrib module. But in the short term, we need to
solve the impending tire fire that is Python on Mac without this kind of
contrib module. So...here we are.
To use this module, simply import and inject it::
import urllib3.contrib.securetransport
urllib3.contrib.securetransport.inject_into_urllib3()
Happy TLSing!
� )�absolute_importN� )�util� )�Security�
SecurityConst�CoreFoundation)�_assert_no_error�_cert_array_from_pem�_temporary_keychain�_load_client_cert_chain)� _fileobject)�backport_makefile� z5SecureTransport only works on Pythons with memoryview�inject_into_urllib3�extract_from_urllib3Ti @ �PROTOCOL_SSLv2�PROTOCOL_SSLv3�PROTOCOL_TLSv1�PROTOCOL_TLSv1_1�PROTOCOL_TLSv1_2� PROTOCOL_TLSc C s( t tj_tt_ttj_dt_dtj_dS )zG
Monkey-patch urllib3 with SecureTransport-backed SSL-support.
TN)�SecureTransportContextr �ssl_�
SSLContext�HAS_SNI�IS_SECURETRANSPORT� r r �%/usr/lib/python3.6/securetransport.pyr � s
c C s( t tj_tt_ttj_dt_dtj_dS )z>
Undo monkey-patching by :func:`inject_into_urllib3`.
FN)�orig_util_SSLContextr r r �orig_util_HAS_SNIr r r r r r r � s
c C sl d}�y,t j| �}|dkr tjS |j}|d }|j� }d}d}tj| j|�} t | �}
ylxf||k r�|dksr|dkr�t
j |g|�} | s�tj t
jd��|j|
||� �} || 7 }| sZ|s�tjS P qZW W nT tj k
�r }
z4|
j
}|dk o�|t
jk�r|t
jk�rtjS � W Y dd}
~
X nX ||d< ||k�r0tjS dS tk
�rf }
z|dk �rV|
|_tjS d}
~
X nX dS )zs
SecureTransport read callback. This is called by ST to request that data
be returned from the socket.
Nr z timed out)�_connection_refs�getr �errSSLInternal�socket�
gettimeout�ctypes�c_charZ from_address�
memoryviewr Z
wait_for_read�error�errno�EAGAIN� recv_into�errSSLClosedGraceful�
ECONNRESET�errSSLClosedAbort�errSSLWouldBlock� Exception�
_exception)�
connection_id� data_buffer�data_length_pointer�wrapped_socket� base_socketZrequested_length�timeoutr) Z
read_count�bufferZ buffer_viewZ readablesZ
chunk_size�er r r �_read_callback� sN
r; c
C sN d}�yt j| �}|dkr tjS |j}|d }tj||�}|j� }d}d} y`xZ| |k r�|dksf|dkr�tj |g|�}
|
s�tj
t j d��|j
|�} | | 7 } || d� }qNW W nN tj
k
r� } z0| j }|dk r�|t j kr�|t jkr�tjS � W Y dd} ~ X nX | |d< | |k�rtjS dS tk
�rH } z|dk �r8| |_tjS d} ~ X nX dS )zx
SecureTransport write callback. This is called by ST to request that data
actually be sent on the network.
Nr z timed out)r! r" r r# r$ r& � string_atr% r Zwait_for_writer) r* r+ �sendr. r/ r0 r1 r2 )
r3 r4 r5 r6 r7 Zbytes_to_write�datar8 r) �sentZ writablesZ
chunk_sentr: r r r �_write_callback� sD
r@ c @ s� e Zd ZdZdd� Zejdd� �Zdd� Zdd � Z d
d � Z
d d
� Z dd� Z dd� Z
d(dd�Zdd� Zdd� Zdd� Zdd � Zd d � Zd d � Zd)d"d#�Zd$d%� Zd&d'� ZdS )*�
WrappedSocketz�
API-compatibility wrapper for Python's OpenSSL wrapped socket object.
Note: _makefile_refs, _drop(), and _reuse() are needed for the garbage
collector of PyPy.
c C sL || _ d | _d| _d| _d | _d | _d | _d | _| j j� | _ | j j
d� d S )Nr F) r$ �context�_makefile_refs�_closedr2 � _keychain�
_keychain_dir�_client_cert_chainr% �_timeout�
settimeout)�selfr$ r r r �__init__. s zWrappedSocket.__init__c c s4 d| _ dV | j dk r0| j d }| _ | j� |�dS )a]
A context manager that can be used to wrap calls that do I/O from
SecureTransport. If any of the I/O callbacks hit an exception, this
context manager will correctly propagate the exception after the fact.
This avoids silently swallowing those exceptions.
It also correctly forces the socket closed.
N)r2 �close)rJ Z exceptionr r r �_raise_on_error@ s
z WrappedSocket._raise_on_errorc C s2 t jtt� t� }t j| j|tt��}t|� dS )a4
Sets up the allowed ciphers. By default this matches the set in
util.ssl_.DEFAULT_CIPHERS, at least as supported by macOS. This is done
custom and doesn't allow changing at this time, mostly because parsing
OpenSSL cipher strings is going to be a freaking nightmare.
N)r ZSSLCipherSuite�len�
CIPHER_SUITESZSSLSetEnabledCiphersrB r )rJ �ciphers�resultr r r � _set_ciphersU s zWrappedSocket._set_ciphersc C s |sdS t jj|�r2t|d��}|j� }W dQ R X d}tj� }z�t|�}tj| j t
j |��}t |� |srt
jd��tj||�}t |� tj|d�}t |� tj� }tj|t
j |��}t |� W d|r�tj|� |dkr�tj|� X tjtjf}|j|k�r
t
jd|j ��dS )z�
Called when we have set custom validation. We do this in two cases:
first, when cert validation is entirely disabled; and second, when
using a custom trust DB.
N�rbz Failed to copy trust referenceTz)certificate verify failed, error code: %d)�os�path�isfile�open�readr � SecTrustRefr
�SSLCopyPeerTrustrB r& �byrefr �sslZSSLErrorZ SecTrustSetAnchorCertificatesZ!SecTrustSetAnchorCertificatesOnlyZSecTrustResultTypeZSecTrustEvaluater � CFReleaser ZkSecTrustResultUnspecifiedZkSecTrustResultProceed�value) rJ �verify� trust_bundle�fZ
cert_array�trustrQ Z trust_resultZ successesr r r �_custom_validateb s@
z WrappedSocket._custom_validatec C s� t jdtjtj�| _t j| jtt�} t | � t
�4 t | �d }
x|
t krV|
d d }
q@W | t |
< W dQ R X t j
| j|
�} t | � |r�t|t�s�|jd�}t j| j|t|��} t | � | j� t j| j|�} t | � t j| j|�} t | � | s�|dk �rt j| jtjd�} t | � |�rNt� \| _| _t| j||�| _ t j | j| j �} t | � xf| j � �R t j | j�} | tj k�r~t!j"d��n(| tj#k�r�| j$||� �wPn
t | � P W dQ R X �qPW dS )z�
Actually performs the TLS handshake. This is run automatically by
wrapped socket, and shouldn't be needed in user code.
Ni���r zutf-8Tzhandshake timed out)%r ZSSLCreateContextr ZkSSLClientSideZkSSLStreamTyperB Z
SSLSetIOFuncs�_read_callback_pointer�_write_callback_pointerr �_connection_ref_lock�idr! ZSSLSetConnection�
isinstance�bytes�encodeZSSLSetPeerDomainNamerN rR ZSSLSetProtocolVersionMinZSSLSetProtocolVersionMaxZSSLSetSessionOptionZ"kSSLSessionOptionBreakOnServerAuthr rE rF r rG ZSSLSetCertificaterM Z SSLHandshaker0 r$ r8 ZerrSSLServerAuthCompletedrc ) rJ �server_hostnamer_ r` Z min_versionZ max_versionZ client_certZ
client_keyZclient_key_passphraserQ Zhandler r r � handshake� s\
zWrappedSocket.handshakec C s
| j j� S )N)r$ �fileno)rJ r r r rm � s zWrappedSocket.filenoc C s* | j dkr| j d8 _ | jr&| j� d S )Nr r )rC rD rL )rJ r r r �_decref_socketios� s
z WrappedSocket._decref_socketiosc C s& t j|�}| j||�}|d |� }|S )N)r& Zcreate_string_bufferr, )rJ Zbufsizr9 Z
bytes_readr> r r r �recv s
zWrappedSocket.recvNc
C s� | j r
dS |d krt|�}tj| j|�}tjd�}| j� � tj| j ||tj
|��}W d Q R X |t j kr�|j
dkr�tjd��n"|t jt jfkr�| j� nt|� |j
S )Nr zrecv timed out)rD rN r& r' Z from_buffer�c_size_trM r ZSSLReadrB r[ r r0 r^ r$ r8 r- ZerrSSLClosedNoNotifyrL r )rJ r9 �nbytes�processed_bytesrQ r r r r,
s
zWrappedSocket.recv_intoc C s
|| _ d S )N)rH )rJ r8 r r r rI 2 s zWrappedSocket.settimeoutc C s | j S )N)rH )rJ r r r r% 5 s zWrappedSocket.gettimeoutc
C sh t jd�}| j� �" tj| j|t|�t j|��}W d Q R X |tj krZ|j
dkrZt j d��nt
|� |j
S )Nr zsend timed out)r& rp rM r ZSSLWriterB rN r[ r r0 r^ r$ r8 r )rJ r> rr rQ r r r r= 8 s
" zWrappedSocket.sendc C s8 d}x.|t |�k r2| j|||t � �}||7 }qW d S )Nr )rN r= �SSL_WRITE_BLOCKSIZE)rJ r> Z
total_sentr? r r r �sendallI s zWrappedSocket.sendallc C s$ | j � � tj| j� W d Q R X d S )N)rM r ZSSLCloserB )rJ r r r �shutdownO s
zWrappedSocket.shutdownc C s� | j dk r�d| _| jr(tj| j� d | _| jr@tj| j� d | _| jrvtj| j� tj| j� t j
| j � d | _| _ | j j
� S | j d8 _ d S )Nr T)rC rD rB r r] rG rE r ZSecKeychainDelete�shutilZrmtreerF r$ rL )rJ r r r rL S s
zWrappedSocket.closeFc
C s� |s t d��tj� }d }d }z�tj| jtj|��}t|� |sBd S tj|�}|sTd S tj |d�}|sht
�tj |�}|szt
�t j
|�}t j|�} tj| |�}W d |r�t j|� |r�t j|� X |S )Nz2SecureTransport only supports dumping binary certsr )�
ValueErrorr rY rZ rB r& r[ r ZSecTrustGetCertificateCountZ SecTrustGetCertificateAtIndex�AssertionErrorZSecCertificateCopyDatar ZCFDataGetLengthZCFDataGetBytePtrr< r] )
rJ Z binary_formrb ZcertdataZ der_bytesrQ Z
cert_countZleafZ data_lengthr4 r r r � getpeercertf s6
zWrappedSocket.getpeercertc C s | j d7 _ d S )Nr )rC )rJ r r r �_reuse� s zWrappedSocket._reusec C s& | j dk r| j� n| j d8 _ d S )Nr )rC rL )rJ r r r �_drop� s
zWrappedSocket._drop)N)F)�__name__�
__module__� __qualname__�__doc__rK �
contextlib�contextmanagerrM rR rc rl rm rn ro r, rI r% r= rt ru rL ry rz r{ r r r r rA ' s&
>Z
(
>rA c C s | j d7 _ t| ||dd�S )Nr T)rL )rC r
)rJ �mode�bufsizer r r �makefile� s r� �rc O s d}t | ||f|�|�S )Nr )r )rJ r� � buffering�args�kwargsr r r r� � s c @ s� e Zd ZdZdd� Zedd� �Zejdd� �Zedd� �Zejd d� �Zed
d � �Z e jd d � �Z d
d� Z
dd� Z dd� Z d dd�Z
d dd�Zd dd�ZdS ) r z�
I am a wrapper class for the SecureTransport library, to translate the
interface of the standard library ``SSLContext`` object to calls into
SecureTransport.
c C s8 t | \| _| _d| _d| _d | _d | _d | _d | _d S )Nr F) �_protocol_to_min_max� _min_version� _max_version�_options�_verify�
_trust_bundle� _client_cert� _client_key�_client_key_passphrase)rJ Zprotocolr r r rK � s z SecureTransportContext.__init__c C s dS )z�
SecureTransport cannot have its hostname checking disabled. For more,
see the comment on getpeercert() in this file.
Tr )rJ r r r �check_hostname� s z%SecureTransportContext.check_hostnamec C s dS )z�
SecureTransport cannot have its hostname checking disabled. For more,
see the comment on getpeercert() in this file.
Nr )rJ r^ r r r r� � s c C s | j S )N)r� )rJ r r r �options� s z SecureTransportContext.optionsc C s
|| _ d S )N)r� )rJ r^ r r r r� � s c C s | j r tjS tjS )N)r� r\ �
CERT_REQUIREDZ CERT_NONE)rJ r r r � verify_mode� s z"SecureTransportContext.verify_modec C s |t jkrdnd| _d S )NTF)r\ r� r� )rJ r^ r r r r� � s c C s d S )Nr )rJ r r r �set_default_verify_paths� s
z/SecureTransportContext.set_default_verify_pathsc C s | j � S )N)r� )rJ r r r �load_default_certs� s z)SecureTransportContext.load_default_certsc C s |t jjkrtd��d S )Nz5SecureTransport doesn't support custom cipher strings)r r ZDEFAULT_CIPHERSrw )rJ rP r r r � set_ciphers s z"SecureTransportContext.set_ciphersNc C s |d k rt d��|p|| _d S )Nz1SecureTransport does not support cert directories)rw r� )rJ ZcafileZcapathZcadatar r r �load_verify_locations s z,SecureTransportContext.load_verify_locationsc C s || _ || _|| _d S )N)r� r� Z_client_cert_passphrase)rJ ZcertfileZkeyfileZpasswordr r r �load_cert_chain s z&SecureTransportContext.load_cert_chainFTc C sL | s
t �|st �|st �t|�}|j|| j| j| j| j| j| j| j � |S )N)
rx rA rl r� r� r� r� r� r� r� )rJ ZsockZ server_sideZdo_handshake_on_connectZsuppress_ragged_eofsrk r6 r r r � wrap_socket s
z"SecureTransportContext.wrap_socket)NNN)NN)FTTN)r| r} r~ r rK �propertyr� �setterr� r� r� r� r� r� r� r� r r r r r � s
r ���)r� )r� N)er Z
__future__r r� r& r* Zos.pathrT rv r$ r\ Z threading�weakref� r Z_securetransport.bindingsr r r Z_securetransport.low_levelr r
r r r
� ImportErrorZpackages.backports.makefiler r( � NameError�__all__r r r r r �WeakValueDictionaryr! ZLockrf rs ZTLS_AES_256_GCM_SHA384Z TLS_CHACHA20_POLY1305_SHA256ZTLS_AES_128_GCM_SHA256Z'TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384Z%TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384Z'TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256Z%TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256Z#TLS_DHE_DSS_WITH_AES_256_GCM_SHA384Z#TLS_DHE_RSA_WITH_AES_256_GCM_SHA384Z#TLS_DHE_DSS_WITH_AES_128_GCM_SHA256Z#TLS_DHE_RSA_WITH_AES_128_GCM_SHA256Z'TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHA384Z%TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384Z$TLS_ECDHE_ECDSA_WITH_AES_256_CBC_SHAZ"TLS_ECDHE_RSA_WITH_AES_256_CBC_SHAZ#TLS_DHE_RSA_WITH_AES_256_CBC_SHA256Z#TLS_DHE_DSS_WITH_AES_256_CBC_SHA256Z TLS_DHE_RSA_WITH_AES_256_CBC_SHAZ TLS_DHE_DSS_WITH_AES_256_CBC_SHAZ'TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHA256Z%TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256Z$TLS_ECDHE_ECDSA_WITH_AES_128_CBC_SHAZ"TLS_ECDHE_RSA_WITH_AES_128_CBC_SHAZ#TLS_DHE_RSA_WITH_AES_128_CBC_SHA256Z#TLS_DHE_DSS_WITH_AES_128_CBC_SHA256Z TLS_DHE_RSA_WITH_AES_128_CBC_SHAZ TLS_DHE_DSS_WITH_AES_128_CBC_SHAZ TLS_RSA_WITH_AES_256_GCM_SHA384Z TLS_RSA_WITH_AES_128_GCM_SHA256Z TLS_RSA_WITH_AES_256_CBC_SHA256Z TLS_RSA_WITH_AES_128_CBC_SHA256Z TLS_RSA_WITH_AES_256_CBC_SHAZ TLS_RSA_WITH_AES_128_CBC_SHArO ZPROTOCOL_SSLv23Z
kTLSProtocol1ZkTLSProtocol12r� �hasattrZ
kSSLProtocol2r Z
kSSLProtocol3r r ZkTLSProtocol11r r r r r r; r@ Z SSLReadFuncrd Z SSLWriteFuncre �objectrA r� r r r r r �<module> s� 95