File: //lib/python3/dist-packages/sphinx/util/__pycache__/parallel.cpython-310.pyc
o
�$�a �
@ s d Z ddlZddlZddlZddlZddlZddlmZ ddlm Z m
Z
m Z m Z m
Z
mZ zddlZW n ey= dZY nw ddlmZ ddlmZ e�e�Zeoaejdkoaejdko`e�� d k ZG d
d � d �Z G d d
� d
�Z ddee de de de e fdd�Z dS )z�
sphinx.util.parallel
~~~~~~~~~~~~~~~~~~~~
Parallel building utilities.
:copyright: Copyright 2007-2021 by the Sphinx team, see AUTHORS.
:license: BSD, see LICENSE for details.
� N)�sqrt)�Any�Callable�Dict�List�Optional�Sequence)�SphinxParallelError)�logging�posix)� � �Darwinc @ sJ e Zd ZdZddeddfdd�Zdded ed
eddfd d �Zdd
d�Z dS )� SerialTaskszEHas the same interface as ParallelTasks, but executes tasks directly.� �nproc�returnNc C � d S �N� ��selfr r r �6/usr/lib/python3/dist-packages/sphinx/util/parallel.py�__init__* � zSerialTasks.__init__� task_func�arg� result_funcc C s, |d ur ||�}n|� }|r||� d S d S r r )r r r r �resr r r �add_task- s
�zSerialTasks.add_taskc C r r r �r r r r �join5 r zSerialTasks.join�r �NN�r N)
�__name__�
__module__� __qualname__�__doc__�intr r r r r! r r r r r ' s
r c @ sz e Zd ZdZdeddfdd�Zdeded eddfd
d �Zdd ed ed
eddfdd�Z ddd�Z
ddd�Z de fdd�Z
dS )�
ParallelTasksz1Executes *nproc* tasks in parallel after forking.r r Nc C s4 || _ i | _i | _i | _i | _i | _d| _d| _d S )Nr )r �
_result_funcs�_args�_procs�_precvs�_precvsWaiting� _pworking�_taskidr r r r r < s
zParallelTasks.__init__�pipe�funcr c
C s� z(t �� }|�� � |d u r|� }n||�}W d � n1 s w Y d}W n% tyM } zd}t�|j|�d �� }|t�� f}W Y d }~nd }~ww t � |j
� |� ||j
|f� d S )NFTr ) r
� LogCollector�collect�
BaseException� traceback�format_exception_only� __class__�strip�
format_exc�convert_serializable�logs�send) r r2 r3 r � collector�ret�failed�err�errmsgr r r �_processM s"
� ��� zParallelTasks._processr r c C st | j }| j d7 _ |pdd� | j|< || j|< t�d�\}}tj| j|||fd�}|| j|< || j|< | � � d S )Nr c S r r r )r �resultr r r �<lambda>` s z(ParallelTasks.add_task.<locals>.<lambda>F)�target�args)
r1 r+ r, �multiprocessing�Pipe�ProcessrD r- r/ � _join_one)r r r r �tid�precv�psend�procr r r r ] s
�
zParallelTasks.add_taskc C sD z| j r| �� s
t�d� | j sW d S W d S ty! | �� � w )Ng{�G�z�?)r0 rL �time�sleep� Exception� terminater r r r r! i s
� �zParallelTasks.joinc C sT t | j�D ]"}| j| �� | j�|� | j�|� | j�|� | jd8 _qd S )Nr )�listr. r- rT r+ �popr0 )r rM r r r rT s s �zParallelTasks.terminatec
C s� d}| j �� D ]D\}}|�� rK|�� \}}}|r t|� �|D ]}t�|� q | j�|�| j �|�|� | j
| � � | j �|� | j d8 _ d} nq| j
rx| j | jk rx| j
�� \}} | | j |< | j
| �� | j d7 _ | j
rx| j | jk sU|S )NFr T)r. �items�poll�recvr �logger�handler+ rV r, r- r! r0 r/ r �popitem�start)
r �
joined_anyrM r2 �excr= rE �log�newtid�newprecvr r r rL { s, �
�zParallelTasks._join_oner# r$ )r% r& r' r( r) r r r rD r r! rT �boolrL r r r r r* 9 s
r* �
� argumentsr �maxbatchr c sj t � �}|| ��|krtt|| | ����dkr d�t|��\}}|r)|d7 }� �fdd�t|�D �S )Nr r c s$ g | ]}� |� |d � � �qS r" r )�.0�i�re � chunksizer r �
<listcomp>� s $ z make_chunks.<locals>.<listcomp>)�lenr) r �divmod�range)re r rf �nargs�nchunks�restr ri r � make_chunks� s rr )rd )!r( �os�platform�sysrQ r7 �mathr �typingr r r r r r rI � ImportError�
sphinx.errorsr � sphinx.utilr
� getLoggerr% rZ �name� version_info�system�parallel_availabler r* �strr) rr r r r r �<module> s0
�
��([