HEX

File: //usr/lib/python3/dist-packages/mercurial/__pycache__/streamclone.cpython-310.pyc
o

�]Lb�z�@s�ddlmZddlZddlZddlZddlZddlmZddlm	Z	ddl
mZddlm
Z
mZmZmZmZmZmZmZmZmZddlmZdd	lmZd
d�Zdd
�ZdDdd�Zdd�Zdd�ZdEdd�Z dd�Z!dd�Z"dFdd�Z#dd�Z$d d!�Z%d"d#�Z&Gd$d%�d%e'�Z(dZ)dZ*d&Z+d'Z,d(d)�Z-d*d+�Z.ej/d,d-��Z0d.d/�Z1d0d1�Z2d2d3�Z3d4d5�Z4d6d7�Z5d8d9�Z6ej/d:d;��Z7d<d=�Z8d>d?�Z9d@dA�Z:dBdC�Z;dS)G�)�absolute_importN�)�_)�open)�
repository)
�	bookmarks�	cacheutil�error�
narrowspec�phases�pycompat�requirements�scmutil�store�util)�nodemap)�
stringutilcCs t|�}|tj8}|�|�|S)a	determine the final set of requirement for a new stream clone

    this method combine the "default" requirements that a new repository would
    use with the constaint we get from the stream clone content. We keep local
    configuration choice when possible.
    )�set�requirementsmod�STREAM_FIXED_REQUIREMENTS�update)�default_requirements�streamed_requirementsr
�r�7/usr/lib/python3/dist-packages/mercurial/streamclone.py�new_stream_clone_requirements&s

rcCs|jtj@}|S)z�the set of requirement the new clone will have to support

    This is used for advertising the stream options and to generate the actual
    stream content.)r
rr)�repo�requiredformatsrrrr3s
�rFc	Cs |j}|j}d}|jrd|j�dg�vrd}|r|sdS|r"|s"dSt|�r(dS|jr-dS|j}|dur9|�d�}|s=dSt	�}|�d�rO|�
tj�d|fS|�d�}|sa|jj
�td	��dSt	|�d
��}||j}|r�|jj
�td�d�t|���|jj
�td
��dS|}d|fS)a�Whether it is possible to perform a streaming clone as part of pull.

    ``bundle2`` will cause the function to consider stream clone through
    bundle2 and only through bundle2.

    Returns a tuple of (supported, requirements). ``supported`` is True if
    streaming clone is supported and False otherwise. ``requirements`` is
    a set of repo requirements from the remote, or ``None`` if stream clone
    isn't supported.
    Fsv2sstreamT)FNNsstream-preferreds
streamreqss=warning: stream clone requested but server has them disabled
�,sGwarning: stream clone requested but client is missing requirements: %s
�, sQ(see https://www.mercurial-scm.org/wiki/MissingRequirement for more information)
)r�remote�
canusebundle2�remotebundle2caps�get�len�heads�streamclonerequested�capabler�addr�REVLOGV1_REQUIREMENT�ui�warnr�split�	supported�join�sorted)	�pullop�bundle2rr �bundle2supported�streamrequestedr
�
streamreqs�missingreqsrrr�canperformstreamclone>sb
	
!
���
�����r6c
	Csddlm}t|�\}}|sdS|j}|j}d}|�d�r9|���}|�di���}Wd�n1s4wY|j	�
td��|���}|�di���}Wd�n1sXwY|��}	zt
|	�}
Wntyvt�td�|	��w|
dkr�t�td���|
d	kr�t�td
���|
dkr�t�td���|��}	z
tt
|	�d
d��\}}Wnttfy�t�td�|	��w|���:t||||�t|j|�|_|�|j	|j|j�|j_t�|�t� |�|r�|j!�"||�|�#�Wd�dS1s�wYdS)z�Possibly perform a legacy stream clone operation.

    Legacy stream clones are performed as part of pull but before all other
    operations.

    A legacy stream clone will not be performed if a bundle2 stream clone is
    supported.
    r��	localrepoNs	branchmapsstreaming all changes
s
stream_out�'unexpected response from remote server:soperation forbidden by server�s$locking the remote repository failedrs%the server sent an unknown error code� )$�r8r6rr r'�commandexecutor�callcommand�resultr*�statusr�readline�int�
ValueErrorr	�
ResponseError�Abort�mapr,�	TypeError�lock�	consumev1rr
�resolvestorevfsoptions�features�svfs�optionsr�writereporequirementsr�post_stream_cleanup�
_branchcaches�replace�
invalidate)
r0r8r-r
rr �
rbranchmap�e�fp�l�resp�	filecount�	bytecountrrr�maybeperformlegacystreamclone�sh	

�
�����
��


"�rZcCsFtj|jvrdS|jjdddd�sdSt�|�}|r!|j�dd�SdS)z5Whether streaming clones are allowed from the server.FsserversuncompressedT)�	untrustedsuncompressedallowsecret)r�REPO_FEATURE_STREAM_CLONErKr*�
configboolr�	hassecret)r�secretrrr�allowservergeneration�s
r`cCs|j�|�S�N)r�walk)r�matcherrrr�_walkstreamfiles��rdcs�g�d}����)�j�d�t��D]\}}}|r%��||f�||7}qt��Wd�n1s4wYt���j�dt��|f��j��jj	�����fdd�}t��||�fS)a�Emit content for version 1 of a streaming clone.

    This returns a 3-tuple of (file count, byte size, data iterator).

    The data iterator consists of N entries for each file being transferred.
    Each file entry starts as a line with the file name and integer size
    delimited by a null byte.

    The raw file data follows. Following the raw file data is the next file
    entry, or EOF.

    When used on the wire protocol, an additional line indicating protocol
    success will be prepended to the stream. This function is not responsible
    for adding it.

    This function will obtain a repository lock to ensure a consistent view of
    the store is captured. It therefore may raise LockError.
    r�	scanning
Ns%d files, %d bytes to transfer
c	3s���D]I\}}�r�j�d||f�dt�|�|fV�|ddd�� }|dkr0|�|�Vn
tj||d�D]}|Vq7Wd�n1sGwYqdS)Nssending %s (%d bytes)
s%s%d
�rbF)�	auditpath���limit)r*�debugr�	encodedir�readr�
filechunkiter)�name�sizerU�chunk��	debugflag�entriesrrLrr�emitrevlogdata"s�����z"generatev1.<locals>.emitrevlogdata)
rHr*rlrd�append�_test_sync_point_walk_1�_test_sync_point_walk_2r$rLrt)r�total_bytes�	file_typerprqrvrrsr�
generatev1�s&
�
��r|ccsl�t|�s
dVdSz	t|�\}}}Wntjy!dVYdSwdVd||fV|D]}|Vq.dS)a�Emit content for version 1 of streaming clone suitable for the wire.

    This is the data output from ``generatev1()`` with 2 header lines. The
    first line indicates overall success. The 2nd contains the file count and
    byte size of payload.

    The success line contains "0" for success, "1" for stream generation not
    allowed, and "2" for error locking the repository (possibly indicating
    a permissions error for the server process).
    s1
Ns2
s0
s%d %d
)r`r|r	�	LockError)rrXrY�itrrrrr�generatev1wireproto4s���r�UNcs@�dkrtd��t��}d�t|������fdd�}||�fS)a@Emit content for version 1 of a stream clone bundle.

    The first 4 bytes of the output ("HGS1") denote this as stream clone
    bundle version 1.

    The next 2 bytes indicate the compression type. Only "UN" is currently
    supported.

    The next 16 bytes are two 64-bit big endian unsigned integers indicating
    file count and byte count, respectively.

    The next 2 bytes is a 16-bit big endian unsigned short declaring the length
    of the requirements string, including a trailing . The following N bytes
    are the requirements string, which is ASCII containing a comma-delimited
    list of repo requirements that are needed to support the data.

    The remaining content is the output of ``generatev1()`` (which may be
    compressed in the future).

    Returns a tuple of (requirements, data generator).
    r�s.we do not support the compression argument yetrc3s��dV�Vt��\}}}�j�td�||f�t�d||�Vt�dt��d�V�dV�dks8J��jjtd�|td	�d
�}|�d�|D]
}|j	t|�d�|VqL|�
�dS)
NsHGS1swriting %d bytes for %d files
�>QQ�>Hr�r��bundle�bytes��total�unitr��step)r|r*r@r�struct�packr$�makeprogressr�	increment�complete)rXrYr~�progressrr��compressionr�requiresrr�genls&��
�
zgeneratebundlev1.<locals>.gen)rCrr.r/)rr�r
r�rr�r�generatebundlev1Ps
r�c
Cs|����|j�td�|t�|�f�|jjtd�|td�d�}|�d�t��}|�	d���|j
j|j|d��yt�
|�D]k}|��}z|�dd�\}}	t|	�}	Wnttfydt�td	�|��w|jjrv|j�d
|t�|	�f�t�|�}
|j
|
ddd
��}tj||	d�D]}|jt|�d�|�|�q�Wd�n1s�wYq?Wd�n1s�wY|jdd�Wd�n1s�wYt��|}
|
dkr�d}
|��|j�td�t�|�|
t�||
�f�Wd�dS1s�wYdS)a
Apply the contents from version 1 of a streaming clone file handle.

    This takes the output from "stream_out" and applies it to the specified
    repository.

    Like "stream_out," the status line added by the wire protocol is not
    handled by this function.
    �!%d files to transfer, %s of data
�cloner�r�r)�
expectedcountr�rr9sadding %s (%s)
�wT)�backgroundcloserjr�N��clearfilecache���MbP?�(transferred %s in %.1f seconds (%s/sec)
)rHr*r@rrrYr�r�timer�transactionrL�backgroundclosingr�xrangerAr,rBrCrGr	rDrtrlr�	decodedirror�r$�writerRr�)rrUrXrYr��start�irVrprq�path�ofprr�elapsedrrrrI�sh
	���
���
���������"�rIcCs�|�d�}|dkrt�td�|��t�d|�d��\}}t�d|�d��d}|�|�}|�d�s9t�td	���t|�d��	d
��}|||fS)Nr:r�s<only uncompressed stream clone bundles are supported; got %sr��r�rr�s@malformed stream clone bundle: requirements not properly encodedr)
rnr	rErr��unpack�endswithr�rstripr,)rUr�rXrY�requireslenr�r
rrr�readbundle1header�s(
���

��
r�cCsjt|�rt�td���t|�\}}}||j}|r't�td�d�t|����t||||�t	�
|�dS)z�Apply the content from a stream clone bundle version 1.

    We assume the 4 byte header has been read and validated and the file handle
    is at the 2 byte compression identifier.
    s2cannot apply stream clone bundle on non-empty repo�4unable to apply stream clone: unsupported format: %srN)r$r	rErr�r-r.r/rIrrO)rrUrXrYr
r5rrr�
applybundlev1�s�
��r�c@s eZdZdZdd�Zdd�ZdS)�streamcloneapplierz�Class to manage applying streaming clone bundles.

    We need to wrap ``applybundlev1()`` in a dedicated type to enable bundle
    readers to perform bundle type-specific functionality.
    cCs
||_dSra)�_fh)�self�fhrrr�__init__s
zstreamcloneapplier.__init__cCst||j�Sra)r�r�)r�rrrr�applyrezstreamcloneapplier.applyN)�__name__�
__module__�__qualname__�__doc__r�r�rrrrr�sr��s�ccCsg}|��s|�d�|S)z!list snapshot file from the stores
phaseroots)�
publishingrw)r�fnamesrrr�_walkstreamfullstorefiless
r�cCs2|\}}}}|tkr|S||||||�|��fS)z actually copy the snapshot files)�	_filefullr.)�entry�copy�vfsmap�srcrp�ftype�datarrr�_filterfull'sr�c
#sJ�g�z�fdd�}|VW�D]}t�|�qdS�D]}t�|�qw)z(return a function to temporary copy filecs4t��\}}t�|���|�tj||dd�|S)NT)�hardlink)r�mkstemp�os�closerwr�	copyfiles)r��fd�dst��filesrrr�5s


zmaketempcopies.<locals>.copyN)r�	tryunlink)r��tmprr�r�maketempcopies/s���r�cCs&t|jt|ji}|j|��vsJ�|S)z$make a (src -> vfs) map for the repo)�	_srcstorerL�	_srccache�cachevfs�vfs�values)rr�rrr�_makemapBs
�r�c#s��t|��|j���vrt�d��|jjtd�|td�d�}|�d�t	����|����fdd�|D�}dVd}|D]�\}}}}�|}	|Vt
�t|��V|t
kr[|	|�}
|}n|tkrjt|d	�}
t
�|
�j}d}zJt
�|�V|V|d
kr�|
�|�f}
nt
j|
|d�}
|
D]}|t|�7}|t|�7}|�|�|Vq�||kr�t�td�|||f��W|
��q;|
��wWd�n1s�wYWd�dSWd�dS1s�wYdS)
zactually emit the stream bundle�9repo.vfs must not be added to vfsmap for security reasonsr�r�r�rcsg|]}t|����qSr)r�)�.0rT�r�r�rr�
<listcomp>bsz_emit2.<locals>.<listcomp>Nrgrirjs=clone could only read %d bytes from %s, but expected %d bytes)r�r�r�r	�ProgrammingErrorr*r�rrr�r�
uvarintencoder$�_fileappendr�r�fstat�st_sizernrorEr�)rru�
totalfilesizer��totalbytecountr�rpr�r�r�rUrqrY�chunksrrrr�r�_emit2Os`���


�����P�r�cC�dS�z+a function for synchronisation during testsNr�rrrrrx��rxcCr�r�rr�rrrry�r�rycCs8|�|j�dus
J�g}d}d}|s|rt�|j||�}t||�D]\}}}	|	r>t}
|tj@r1t	}
|�
t||
|	f�||	7}q!t|�D]}|j
�|�r]||j
�|�j7}|�
t|t	df�qC|rx|j
�d�rx||j
�d�j7}|�
tdt	df�t�|�D]}|j�|�r�||j�|�j7}|�
t|t	df�q}||fS)a�emit a seris of files information useful to clone a repo

    return (entries, totalfilesize)

    entries is a list of tuple (vfs-key, file-path, file-type, size)

    - `vfs-key`: is a key to the right vfs to write the file (see _makemap)
    - `name`: file path of the file to copy (to be feed to the vfss)
    - `file-type`: do this file need to be copied with the source lock ?
    - `size`: the size of the file (or None)
    Nrsobsstore)�_currentlock�_lockrefr
�match�rootrdr�r�FILEFLAGS_VOLATILEr�rwr�r�rL�exists�lstatr�r�cachetocopyr�r�)r�includes�excludes�includeobsmarkersrur�rc�rl_typerprq�ftrrr�_v2_walk�s8
���r�cCs�|���,|j�d�t||||d�\}}t|||�}t|�}|dus%J�t|�Wd�n1s3wYt|�t|�||fS)a�Emit content for version 2 of a streaming clone.

    the data stream consists the following entries:
    1) A char representing the file destination (eg: store or cache)
    2) A varint containing the length of the filename
    3) A varint containing the length of file data
    4) N bytes containing the filename (the internal, store-agnostic form)
    5) N bytes containing the file data

    Returns a 3-tuple of (file count, file size, data iterator).
    rf�r�r�r�N)	rHr*rlr�r��nextrxryr$)rr�r�r�rur�r��firstrrr�
generatev2�s


�
�r�c	gs��|d}|dd�}|�.|r(t|��dVWd�n1s"wYndVWd�dSWd�dS1s>wYdS)Nrr)�nested)�ctxs�this�restrrrr��s�
����"r�cs������j�td�|t�|�f�t��}�jjtd�|td�d�}|�d�t	��}�j
|��vr:t�
d����d����fdd�|��D�}t|��gt|�D]Z}t�|d	�}	||	}
t�|�}t�|�}t�||�}
�jjr��j�d
|	|
t�|�f�|
|
d��}tj||d�D]}|jt|�d
�|�|�q�Wd�n1s�wYqTWd�n1s�wY�jdd�Wd�n1s�wYt��|}|dkr�d}�j�td�t�|j�|t�|j|�f�|��Wd�dS1�swYdS)z�Apply the contents from a version 2 streaming clone.

    Data is read from an object that only needs to provide a ``read(size)``
    method.
    r�r�r�r�rr�c3s�|]	}|��j�VqdSra)r�r*)r�r�r�rr�	<genexpr>s�zconsumev2.<locals>.<genexpr>rsadding [%s] %s (%s)
r�rjr�NTr�r�r�)rHr*r@rrrYr�r�rr�r�r�r	r�r�r��range�readexactly�uvarintdecodestreamrtrlror�r$r�rR�posr�)rrUrX�filesizer�r�r�r�r�r�r��namelen�datalenrpr�rrr�rr�r�	consumev2�sn
���
�


��������
���
$�r
cs�ddlm}�fdd�|D�}|rt�td�d�t|����t�|||�t�j	|��_	|�
�j�j	�j��j
_t���t���dS)Nrr7csg|]	}|�jvr|�qSr)r-�r��rr�rrr�1sz!applybundlev2.<locals>.<listcomp>r�r)r<r8r	rErr.r/r
rr
rJr*rKrLrMrrNrrO)rrUrXrr
r8r5rr�r�
applybundlev2.s$����
r
c
s�dg���fdd�}|D]=\}}}||}||}	|�|�}
|	�|�}tj�|�}tj�|�s4t�|�|	�|�tj|
|�d|dd���	�q�dS)NTcsd�d<td��_dS)NFrscopying)r�topicr�r�r�rr�	copy_usedHsz_copy_files.<locals>.copy_usedrF)r��no_hardlink_cb�check_fs_hardlink)
r.r�r��dirnamer�r�makedirs�
register_file�copyfiler�)
�src_vfs_map�dst_vfs_maprur�r�kr�rq�src_vfs�dst_vfs�src_path�dst_pathrrrr�_copy_filesEs(



�
rcCs2dd�|jD�}dd�|jD�}||ksJ�|����|���_t�|�}|�d�}d}tj�|�r4d}t|dddd	�\}}t	|�}	t	|�}
|j
jtd
�t
|�|td�d�}d
d�|D�}t|	|
||�}
|rwt�|�}|�d�}t�||�Wd�n1s�wY|��|
r�d}nd}|j
�|t
|�|�|�d��}|j�|�Wd�n1s�wY|jdfg}|�|���|D]>\}}z|�|�Wq�t�y}z&|jtjkr�td�}|�|�}t�|�}|||f;}|j
�|�WYd}~q�d}~wwWd�dS1�swYdS)zYcopy all content from one local repository to another

    This is useful for local clonecS�h|]	}|tjvr|�qSr�r�WORKING_DIR_REQUIREMENTSrrrr�	<setcomp>g�

�zlocal_copy.<locals>.<setcomp>cSrrr rrrrr"lr#s	bookmarksrrNTr�slinkingsfiles)rr�r�css"�|]\}}}}|||fVqdSrar)r�rr�r�rqrrrr�s� zlocal_copy.<locals>.<genexpr>slinked %d files
scopied %d files
s
localclonesundo.backupfilesserror removing %s: %s
) r
rHr�bookmarksvfsr.r�r�r�r�r�r*r�rr$rrrr�rlr�rr�rL�extend�	undofiles�unlink�OSError�errno�ENOENTr�forcebytestrr+)�src_repo�	dest_repo�src_store_requirements�dest_store_requirements�src_book_vfs�srcbookmarks�bm_countrur�r�dest_vfs_mapr�r�r��dst_book_vfs�dstbookmarks�msg�tr�
undo_files�undovfs�undofilerTr��e_msgrrr�
local_copycsv��




�
�

��'�

���$�r<)Fra)r�)<�
__future__r�
contextlibr)r�r��i18nrrr�
interfacesrr<rrr	r
rr
rrrr�revlogutilsr�utilsrrrr6rZr`rdr|rr�rIr�r��objectr�r�r�r�r�r�r��contextmanagerr�r�r�rxryr�r�r�r
r
rr<rrrr�<module>sX0
]K
8
:K

<)!
E