o 0jM@sddlZddlmZmZddlZddlZddlmZddl m Z e Z dee effddZdd d Zd d Zeddede defddZeddefddZdS)N)AnyUnion) device_guardsizecCs$t|tr|S|drt|dddS|dr)t|dddS|dr:t|dddS|d rVt|dd d }|d rT|d S|S|drrt|dd d}|d rp|d S|S|drt|dd d}|d r|d S|Std)z Converts a size expressed as a string with digits an unit (like `"5MB"`) to an integer (in bytes). Args: size (`int` or `str`): The size to convert. Will be directly returned if an `int`. ZGIBNi@ZMIBiZKIBiGBiʚ;bMBi@BZKBizR`size` is not in a valid format. Use an integer followed by the unit, e.g., '5GB'.) isinstanceintupperendswith ValueError)rZint_sizery/var/www/html/Deteccion_Ine/venv/lib/python3.10/site-packages/paddlex/inference/models/common/transformers/distributed.pyconvert_file_size_to_ints( r32MiBccs|jtjkrt|j}n tt|}t |}| dg|t |j}t d||D]}||t |||}||t |||ffVq.dS)Nr)dtypepaddleZint8npprodshapernumelitemrreshape_dtype_byte_sizerangemin)tensor buffer_sizerZ send_sizexZ part_tensorrrr reduce_tensor7s  r%cCsN|tjkrdStdt|}|durtd|dt|d}|dS)zP Returns the size (in bytes) occupied by one parameter of type `dtype`. g?z [^\d](\d+)$Nz`dtype` is not a valid dtype: .rr )rboolresearchstrrrgroups)rZ bit_searchZbit_sizerrrrFs rFr"dstreturnc s(ztttfrtfddDWSttr,fddDWSd}tjdk}|r^rHddttj dD}nfddttj dD}d d|D}rj } d gt D]J\}d}tjdkrfd dttj dD}t jjjj|rjnd d d|rtt|D]} || || qqm ||rtd"g} |D]} t| } | |} | | q| }Wd|WS1swY|WSt jjjj|rjnd d d|WStytdw)Nc3s|] }t|VqdSNdistributed_gather.0tr,groupoffloadrr Ws z%distributed_gather..cs i|] \}}|t|qSrr/r2kvr4rr [sz&distributed_gather..r5cSsg|]}gqSrrr2_rrr dsz&distributed_gather..cg|]}tqSrrZ empty_liker=r"rrr?hcS&g|]}t|jdkr |n|dqSrNlenrr1rrrr?lsrcr@rrAr= slice_tensorrrr?wrCTF)r,r5Zsync_opZuse_calc_streamcpu(Not currently using distributed training)r tuplelisttypedictitems distributedZget_rankr get_world_sizerrr%rZ communicationstreamZgatherZranksrGappendrJnumpyrrZ concatenateZreshapeAssertionError) r"r,r5r6output_tensorsZis_dst origin_shapeindexslice_output_tensorsiZnew_output_tensorsr$r3r)r,r5r6rIr"rr0Ss              r0c sztttfrtfddDWSttr)fddDWSg}rPtdfddtt D}Wdn1sJwYnfd dtt D}d d|D}rֈj } d g|D]}| d gqrt D]D\}fd dtt D}tj |d t||D]$\}}td|||d|d<Wdn1swYqq ||D]}| |q|WSt ||WStytdw)anested all gather function with offload Args: tensor (Any): the desired tensor, list of tensor, dict of tensor to allgather. group (_type_, optional): the communication group. Defaults to None. offload (bool, optional): If True, we offload the received tensor to cpu/(numpy). Defaults to False. Raises: AssertionError: Unexpected errors. Returns: tensor list: list of all gathered tensors c3s|] }t|VqdSr.distributed_allgatherr1r5r6rrr7s  z(distributed_allgather..csi|] \}}|t|qSrr\r8r^rrr;sz)distributed_allgather..rJcr@rrAr=rBrrr?rCz)distributed_allgather..Ncr@rrAr=rBrrr?rCcSrDrErFr1rrrr?s&rcr@rrAr=rHrrr?rCr<rrrK)r rLrMrNrOrPrr rQrRrrr%Z all_gatherziprJrV) r"r5r6rWrXr$rYrZyr)r5r6rIr"rr]s\               r])r)rNF)NF)r(typingrrrUrrZpaddle.distributedrQutilsrrRZ world_sizerr*rr%rZno_gradr0r]rrrrs    N