HEX
Server: Apache
System: Linux pdx1-shared-a1-38 6.6.104-grsec-jammy+ #3 SMP Tue Sep 16 00:28:11 UTC 2025 x86_64
User: mmickelson (3396398)
PHP: 8.1.31
Disabled: NONE
$ pwd: /usr/lib/python3/dist-packages/hgext/lfs/__pycache__/
Upload Files
File: //usr/lib/python3/dist-packages/hgext/lfs/__pycache__/blobstore.cpython-310.pyc
o

�]Lbim�@s�ddlmZddlZddlZddlZddlZddlZddlZddlZddl	m
Z
ddlmZddl
mZddlmZmZmZmZmZmZmZmZmZddlmZmZdd	lm Z e�!d
�Z"Gdd�dej�Z#Gd
d�de#�Z$Gdd�dej%�Z&Gdd�de'�Z(dd�Z)Gdd�dej*j+�Z,Gdd�de'�Z-Gdd�de'�Z.Gdd�de'�Z/Gdd�de'�Z0e-e-e.e/e0d�Z1d d!�Z2d"d#�Z3d*d$d%�Z4Gd&d'�d'ej5�Z6Gd(d)�d)ej7�Z8dS)+�)�absolute_importN)�_)�getattr)�hex)	�encoding�error�httpconnection�pathutil�pycompat�url�util�vfs�worker)�
stringutil�urlutil�)�lfutils\A[a-f0-9]{64}\Zcs&eZdZ�fdd�Zddd�Z�ZS)�lfsvfscs:t�|�st�d|��tt|��|dd�|dd��S)z9split the path at first two characters, like: XX/XXXXX...sunexpected lfs path: %srrN)�_lfsre�matchr�ProgrammingError�superr�join)�self�path��	__class__��5/usr/lib/python3/dist-packages/hgext/lfs/blobstore.pyr.s
"zlfsvfs.joinNc#s��tj�|j�}tt�|��}g}tj|�|j|pd�|d�D]\�}}�|d��t��dkr<|�	�fdd�|D��qdg|fVdS)z�Yield (dirpath, [], oids) tuple for blobs under path

        Oids only exist in the root of this vfs, so dirpath is always ''.
        �)�onerrorNrcs"g|]
}t��|�r�|�qSr)rr)�.0�f��dirpathrr�
<listcomp>Gs"zlfsvfs.walk.<locals>.<listcomp>)
�osr�normpath�base�lenr	�normasprefix�walk�reljoin�extend)rrr �root�	prefixlen�oids�dirs�filesrr#rr+4s����zlfsvfs.walk�NN)�__name__�
__module__�__qualname__rr+�
__classcell__rrrrr-src@s6eZdZdd�Zdd�Zdd�Zddd	�Zd
d�ZdS)
�nullvfscC�dS�Nr�rrrr�__init__N�znullvfs.__init__cC�dS)NFr�r�oidrrr�existsQr=znullvfs.existscCsttjt�d|���)Ns%s: No such file or directory)�IOError�errno�ENOENTr
�sysstrr?rrr�readTs�znullvfs.readNcCs
dggfS)Nrr)rrr rrrr+^s
znullvfs.walkcCr9r:r)rr@�datarrr�writear=z
nullvfs.writer3)r4r5r6r<rArFr+rHrrrrr8Ms

r8cs(eZdZdZ�fdd�Zdd�Z�ZS)�
lfsuploadfilez+a file-like object that supports keepalive.cs"tt|��||d�|jj|_dS�Nsrb)rrIr<�_datarF)r�ui�filenamerrrr<hszlfsuploadfile.__init__cCr9r:rr;rrr�
_makeprogresslr=zlfsuploadfile._makeprogress)r4r5r6�__doc__r<rNr7rrrrrIesrIc@sjeZdZdZdd�Zdd�Zdd�Zdd	�Zd
d�Zdd
�Z	dd�Z
ddd�Zdd�Zdd�Z
dd�ZdS)�localz�Local blobstore for large file contents.

    This blobstore is used both as a cache and as a staging area for large blobs
    to be uploaded to the remote blobstore.
    cCsR|j�d�}t|�|_|j�dd�rt�|_nt�	|jd�}t|�|_|j|_dS)Nslfs/objects�experimentalslfs.disableusercache�lfs)
�svfsrrr
rL�
configboolr8�cachevfsr�
_usercachedir)r�repo�fullpath�	usercacherrrr<ws


zlocal.__init__cCst|�|�d�S)zgOpen a read-only file descriptor to the named blob, in either the
        usercache or the local store.�rb)�openrr?rrrr[�sz
local.opencCs$|j�|�r|j�|�S|j�|�S)a{Build the path for the given blob ``oid``.

        If the blob exists locally, the path may point to either the usercache
        or the local store.  If it doesn't, it will point to the local store.
        This is meant for situations where existing code that isn't LFS aware
        needs to open a blob.  Generally, prefer the ``open`` method on this
        class.
        )rUrArr
r?rrrr�sz
local.pathc
Cs�t��}d}|j|ddd��L}tj|dd�D]}|�|�|�|�|t|�7}q|durAt|�|krAd}t	t
|�|t|�f��t|���}	|	|krSt
t
d	�|��Wd�n1s]wY|�|�dS)
znRead the blob from the remote source in chunks, verify the content,
        and write to this local blobstore.r�wbT��
atomictemp���sizeNsXResponse length (%s) does not match Content-Length header (%d): likely server-side crashscorrupt remote lfs object: %s)�hashlib�sha256r
r�
filechunkiterrH�updater)�int�LfsRemoteErrorrr�digest�LfsCorruptionError�_linktousercache)
rr@�src�content_lengthrcra�fp�chunk�msg�realoidrrr�download�s&

�
���zlocal.downloadcCsH|j|ddd��
}|�|�Wd�n1swY|�|�dS)z�Write blob to local blobstore.

        This should only be called from the filelog during a commit or similar.
        As such, there is no need to verify the data.  Imports from a remote
        store must use ``download()`` instead.r\Tr]N)r
rHrj)rr@rGrmrrrrH�s�zlocal.writecCsTt|jt�s&|j�|�s(|j�td�|�t�	|j�
|�|j�
|��dSdSdS)a�Link blobs found in the user cache into this store.

        The server module needs to do this when it lets the client know not to
        upload the blob, to ensure it is always available in this store.
        Normally this is done implicitly when the client reads or writes the
        blob, but that doesn't happen when the server tells the client that it
        already has the blob.
        �lfs: found %s in the usercache
N)�
isinstancerUr8r
rArL�noterr�linkrr?rrr�linkfromusercache�s	 �zlocal.linkfromusercachecCsT|j�|�s&t|jt�s(|j�td�|�t�|j	�
|�|j�
|��dSdSdS)Ns lfs: adding %s to the usercache
)rUrArsr8rLrtrrrur
rr?rrrrj�s� �zlocal._linktousercacheTcCs�|j�|�s5|�|j||�}|stt�|����|kr3|j�	t
d�|�t�|j�
|�|j�
|��|S|j�	t
d�|�|�|j||�}|S)zRead blob from local blobstore.rrs%lfs: found %s in the local lfs store
)r
rA�_readrUrrbrcrhrLrtrrrur)rr@�verify�blobrrrrF�s�z
local.readcCs|�|�}|rt||�|S)z0Read blob (after verifying) from the given store)rF�_verify)rr
r@rxryrrrrw�s

zlocal._readcCs`t��}|�|��}tj|dd�D]}|�|�qWd�n1s#wY|t|���kS)zQIndicate whether or not the hash of the underlying file matches its
        name.r_r`N)rbrcr[rrdrerrh)rr@rcrmrnrrrrx�s��zlocal.verifycCs|j�|�p|j�|�S)zYReturns True if the local blobstore contains the requested blob,
        False otherwise.)rUrAr
r?rrr�hassz	local.hasN)T)r4r5r6rOr<r[rrqrHrvrjrFrwrxr{rrrrrPps 
	rPc	Cs�|}t|jt�r|j}t�|d�r5z|jjd}Wnttfy'|j}Ynwt|tj	�r3t
�|�}|St|dd�rAt
�
|j�St�|�S)zbCreate a friendly message for the given URLError to be used in an
    LfsRemoteError message.
    sreason��strerrorN)rs�reason�	Exceptionr�safehasattr�args�AttributeError�
IndexErrorr
�unicoder�
unitolocalr�
strtolocalr}r�forcebytestr)�urlerror�instr~rrr�_urlerrorreasons
�

r�c@seZdZdZdd�ZdS)�lfsauthhandleri�cCsR|�dd�}|r'|��d}|��dkr'td�}tj�|��|t�	|�||��dS)z�Enforces that any authentication performed is HTTP Basic
        Authentication.  No authentication is also acceptable.
        zwww-authenticateNr�basics,the server must support Basic Authentication)
�get�split�lowerrr�urlerr�	httperror�get_full_urlr�strfromlocal)r�reqrm�codero�headers�authreq�schemerrr�http_error_401"s�zlfsauthhandler.http_error_401N)r4r5r6�
handler_orderr�rrrrr�sr�c@sTeZdZdd�Zdd�Zdd�Zdd�Zd	d
�Zdd�Zd
d�Z	dd�Z
dd�ZdS)�
_gitlfsremotecCsr|j}||_|��\}}|�d�|_|j�dd�}|s!dt��}t�|||�|_	|j	�
t��|�dd�|_
dS)N�/rQslfs.user-agentsgit-lfs/2.3.4 (Mercurial %s)rRsretry)rL�authinfo�rstrip�baseurl�configr�version�urlmod�opener�	urlopener�add_handlerr��	configint�retry)rrWrrLr�r��	useragentrrrr<7sz_gitlfsremote.__init__cC�|�t|�|d�dS)z,Batch upload from local to remote blobstore.�uploadN��_batch�_deduplicate�r�pointers�	fromstorerrr�
writebatchC�z_gitlfsremote.writebatchcCr�)z-Batch download from remote to local blostore.�downloadNr��rr��tostorerrr�	readbatchGr�z_gitlfsremote.readbatchcCs,dd�|D�}t�t�|t�|�d���}d|j}tjjt�|�|d�}|�	dd�|�	dd�zt
�|j�
|���}|��}Wd	�n1sJwYWnYtjjy�}	z+td
�|j|ftd�|jd�}
|
�|	jtd
�||f�}ttd�t�|	�|d��d	}	~	wtjjy�}	ztd�|j}ttd�t|	�|d��d	}	~	wwzt�|�}Wnty�ttd�|�d���w|jj�r|j�d|j�t� |�!���"�}
|j�dd�#t$|
�%����d|vr�t$|ddd�d�|d<|j�dt�tj|dddd���dd�}t�&||�S) z�Get metadata about objects pointed by pointers for given action

        Return decoded JSON object like {'objects': [{'oid': '', 'size': 1}]}
        See https://github.com/git-lfs/git-lfs/blob/master/docs/api/batch.md
        cSs$g|]}t�|���|��d��qS))r@ra)r
�strurlr@ra�r!�prrrr%Qs��z/_gitlfsremote._batchrequest.<locals>.<listcomp>)�objects�	operations%s/objects/batch)rG�Acceptzapplication/vnd.git-lfs+json�Content-TypeNs=check that lfs serving is enabled on %s and "%s" is supporteds/the "lfs.url" config may be used to override %s)i��sapi=%s, action=%ssLFS HTTP error: %s��hint�
LFS error: %ss#LFS server returns invalid JSON: %s�utf-8�Status: %d
�%s
�
r�cSs|dS)Nr@r)r�rrr�<lambda>�sz-_gitlfsremote._batchrequest.<locals>.<lambda>��keyr)�z: T)�indent�
separators�	sort_keyscSst|tj�r|�d�S|S)Nr�)rsr
r��encode)�xrrr�	encodestr�s
z._gitlfsremote._batchrequest.<locals>.encodestr)'r
�bytesurl�json�dumpsr�r�r�urlreq�request�
add_header�
contextlib�closingr�r[rFr�r�rr�r�rgrr�r�r��
json_loads�
ValueErrorr�rL�	debugflag�debug�status�bytestr�info�stripr�sorted�
splitlines�rapply)rr��actionr��requestdatar�batchreq�rsp�rawjson�ex�hintsr��responser�r�rrr�
_batchrequestKs�����

������	����������

�����z_gitlfsremote._batchrequestcCs�|D]X}d|vr|dkr||�dg�vrd}n
q|�d��dd�}dd�|D�}|�|d	d
�}|rQt|dd�}d
dddd�}	|	�|d|�}
ttd�||
f��ttd�|d	��d
S)zUScans errors from objects

        Raises LfsRemoteError if any objects have an errorserrorr��actionsr�scode��cSsi|]}|��|�qSr)r@r�rrr�
<dictcomp>�sz6_gitlfsremote._checkforservererror.<locals>.<dictcomp>�oidNrMsunknownsThe object does not exists#The object was removed by the ownersValidation errorsInternal server error)r�i�i�r�sstatus code %dsLFS server error for "%s": %ss1LFS server error. Unsolicited response for oid %s)r�rrgr)rr��	responsesr�r�r��ptrmapr�rM�errorsrorrr�_checkforservererror�s6������z"_gitlfsremote._checkforservererrorcs0|�dg�}|�||���fdd�|D�}|S)z�extract objects from response of the batch API

        response: parsed JSON object returned by batch API
        return response['objects'] filtered by action
        raise if any object has an error
        sobjectscs g|]}�|�dg�vr|�qS)r��r�)r!�o�r�rrr%�sz1_gitlfsremote._extractobjects.<locals>.<listcomp>)r�r�)rr�r�r�r��filteredobjectsrr�r�_extractobjects�s
�z_gitlfsremote._extractobjectsc
Cs�|d}|d|�d�}|d|�di���}tj�t�|��}|dkr8|�|�s8tj	t
d�|t
d�d��|D]\}}	|�t�|�t�|	��q:z�z�|dkrnt|j
|�|��|_d	d
�|_|�dd�|�d
|jj�t�|j�|���b}
|
���d�}|j
}|j
jr�|�d|
j�t�|
�����}|�dd�t|�����|dkr�|�||
|�n!g}
	|
� d�}|s�n|
�!|�q�d�|
�}|r�|�d||f�Wd�n1s�wYWnTtj"j#�y}z|j
jr�|j
�d||� �f�t$t
d�t%�&|�||f��d}~wtj"j'�y6}zt
d�t�(tj)�*|��}t$t
d�t+|�|d��d}~wwW|j�rC|j�,�dSdS|j�rO|j�,�ww)aCDownload or upload a single object using basic transfer protocol

        obj: dict, an object description returned by batch API
        action: string, one of ['upload', 'download']
        localstore: blobstore.local

        See https://github.com/git-lfs/git-lfs/blob/master/docs/api/        basic-transfers.md
        r�r�shrefsheaderr��detected corrupt lfs object: %s�
run hg verifyr�cSr>)N�PUTrrrrrr���z._gitlfsremote._basictransfer.<locals>.<lambda>r�zapplication/octet-streamzContent-Lengthscontent-lengthr�r�r�r�Tr_rslfs %s response: %sNs%s: %s
s&LFS HTTP error: %s (oid=%s, action=%s)sattempted connection to %sr�)-r��itemsrr�r�r
r�rxr�Abortrr�rIrLrrG�
get_method�lengthr�r�r�r[r�r�r�r�r�r�rr�r�rqrF�appendr�r�rgrr�r�r��urllibcompat�
getfullurlr��close)r�objr��
localstorer@�hrefr�r��k�v�res�
contentlengthrL�blocksrGr�r�r�rrr�_basictransfer�s�


�


�
�������

�������z_gitlfsremote._basictransferc
s��dvrt�d�����|��}��||��}tdd�|D��}i}|D]
}|�dd�||�d�<q%td�td	�d��}	t|�d
krU�j�	td�t|�t
�|�f����fdd
�}
�j�dd�rut
�
�jd|
dt|dd�d��}n
|
t|dd�d��}�jj|	td�|d��1}|�d�d}
d}|D]\}}|
||7}
|d
7}|�|
��j�	td�|�q�Wd�n1s�wY|dkr�dkr܈j�td�|t
�|
�f�dS�dkr�j�td�|t
�|
�f�dSdSdS)N)r�r�sinvalid Git-LFS action: %scss�|]	}|�dd�VqdS)�sizerNr�)r!r�rrr�	<genexpr>0s�z'_gitlfsremote._batch.<locals>.<genexpr>rrr�s
lfs uploadingslfs downloadingr|s&lfs: need to transfer %d objects (%s)
c3s��|D]n}|�dd�}�jjr0�dkrtd�}n�dkr td�}�j�||�d�t�|�f��j}	z��|���d	|�d�fVWn+t	j
yp}z|dkrk�j�td
�t�|�|f�|d	8}WYd}~q3�d}~wwqdS)Nrrr�slfs: downloading %s (%s)
r�slfs: uploading %s (%s)
r�Tr|s%lfs: failed: %r (remaining retry %d)
)
r�rL�verboserrtr�	bytecountr�r
�socketrrr�)rnr�objsizeror�r��r�rrrr�transfer>s>�
�������z&_gitlfsremote._batch.<locals>.transferrQslfs.worker-enableg�������?rcS�
|�d�S�Nr�r��r�rrrr�`�
z&_gitlfsremote._batch.<locals>.<lambda>r�cSrrr�rrrrr�crsbytes)�unit�totalslfs: processed: %s
r�slfs: uploaded %d files (%s)
r�slfs: downloaded %d files (%s)
)rrr�r��sumr�rr)rLrtrrrTrr��makeprogressrer�)rr�rr�r�r�r�sizesr�topicrr0�progress�	processed�blobs�_oner@rrrr�*st�����
�

�������z_gitlfsremote._batchcCs>t|dd�}|r|jD]}|��t|ddd���qdSdS)Nr��	close_allcSr9r:rrrrrr��r�z'_gitlfsremote.__del__.<locals>.<lambda>)r�handlersr)rr��hrrr�__del__}s
�z_gitlfsremote.__del__N)r4r5r6r<r�r�r�r�r�r
r�r'rrrrr�6sU)NSr�c@�(eZdZdZdd�Zdd�Zdd�ZdS)	�_dummyremotez,Dummy store storing blobs to temp directory.cCs|j�d|j�}t|�|_dS)NrR)r
rrr)rrWrrXrrrr<�sz_dummyremote.__init__c	Csbt|�D]*}|j|��dd�}|j|��ddd��
}|�|�Wd�n1s)wYqdS)NT)rxr\r])r�rFr@r
rH)rr�r�r��contentrmrrrr��s���z_dummyremote.writebatchc	CsTt|�D]#}|�|��d��}|�|��|d�Wd�n1s"wYqdSrJ)r�r
r@rq)rr�r�r�rmrrrr��s���z_dummyremote.readbatchN�r4r5r6rOr<r�r�rrrrr)�s
r)c@r()	�_nullremotez&Null store storing blobs to /dev/null.cCr9r:r�rrWrrrrr<�r=z_nullremote.__init__cCr9r:rr�rrrr��r=z_nullremote.writebatchcCr9r:rr�rrrr��r=z_nullremote.readbatchNr+rrrrr,�s
r,c@s4eZdZdZdd�Zddd�Zddd�Zd	d
�ZdS)�
_promptremotez)Prompt user to set lfs.url when accessed.cCr9r:rr-rrrr<�r=z_promptremote.__init__NcC�|��dSr:��_prompt)rr�r�rLrrrr���z_promptremote.writebatchcCr/r:r0)rr�r�rLrrrr��r2z_promptremote.readbatchcCst�td���)Nslfs.url needs to be configured)rr�rr;rrrr1�sz_promptremote._promptr:)r4r5r6rOr<r�r�r1rrrrr.�s

r.)�https�httpsfilesnullNcCs&t��}|D]}|||��<q|��S)z0Remove any duplicate oids that exist in the list)r�sortdictr@�values)r��reducedr�rrrr��sr�cCs6tt�|����}||krttd�|td�d��dS)Nr�r�r�)rrbrcrhrir)r@r*rprrrrz�s
��rzcCs�|j�dd�}t�|pd�}|dur`|r|}nt�|d�r!|j}n	|j�dd�p)d}t�|�}|jdvr`|jrG|jdd	�d
krG|jd
7_|jpKdd|_t�t	|��}|j�
td�|�|j}|tvrpt
�td
�|��t|||�S)a�remotestore factory. return a store in _storemap depending on config

    If ``lfs.url`` is specified, use that remote endpoint.  Otherwise, try to
    infer the endpoint, based on the remote repository using the same path
    adjustments as git.  As an extension, 'http' is supported as well so that
    ``hg serve`` works out of the box.

    https://github.com/git-lfs/git-lfs/blob/master/docs/api/server-discovery.md
    rRsurlrNs_subtoppathspathssdefault)r4r3���r�s
.git/info/lfsslfs: assuming remote store: %s
slfs: unknown url scheme: %s)rLr�rrrr��_subtoppathr�r�bytesrtr�	_storemaprr�)rW�remote�lfsurlrr�
defaulturlr�rrrr<�s&


r<c@seZdZdS)rgN)r4r5r6rrrrrg�srgc@seZdZdZdS)riz~Raised when a corrupt blob is detected, aborting an operation

    It exists to allow specialized handling on the server side.N)r4r5r6rOrrrrri�srir:)9�
__future__rr�rCrbr�r&�rer�mercurial.i18nr�mercurial.pycompatr�mercurial.noder�	mercurialrrr�httpconnectionmodr	r
rr�rr
�vfsmodr�mercurial.utilsrr�
largefilesr�compilerrr8�httpsendfilerI�objectrPr�r��basehandlerr�r�r)r,r.r;r�rzr<�StorageErrorrgr�rirrrr�<module>sN,
 R
�	
	+
@ Telegram