o *╬jЩу@sRddlmZddlZddlZddДZ dddДZd eejfd dДZdS) щ)┌ListNcs$tИГdkriSЗЗЗfddД}tИГidЬ}Иdаddбdur)|dГ|dd<Иdаd dбdur?tаd dДИDГб|d <Иdаddбdure|dГ|d<tаЗfd dДИDГб}|абаб}||d<Иdаddбdurw|dГ|dd<ИdаddбdurСtjddДИDГddН|dd<Иdаddбdurйtа ddДИDГб|dd<Иdаddбdur┴tа ddДИDГб|dd<Иdаddбdur╫tа ddДИDГб|d<Иdаddбdurяtj ddДИDГddН|d<Иdаd dбduРrtаd!dДИDГб|d <Иdаd"dбduРrtаd#dДИDГба б|d$<Иdаd%dбduРr0|d%Г|d&<Иdаd'dбduРrGtаd(dДИDГб|d)<Иdаd*dбduРrX|d*Г|d+<Иdаd,dбduРrqtjd-dДИDГddН|d.<Иdаd/dбduРrКtjd0dДИDГddН|d1<Иdаd2dбduРrгtjd3dДИDГddН|d4<Иdаd5dбduРr╖d6dДИDГ|d7<Иdаd8dбduРrрtd9dДИDГГ|dd8<tjd:dДИDГtj d;Н|dd<<Иdаd=dбduРr∙tа d>dДИDГб|dd?<Иdаd@dбduРr|d@Г|ddA<tа dBdДИDГб|ddC<ИdаdDdбduРr:|dDГ|dD<tjdEdДИDГtj d;Н|dF<ИdаdGdбduРrPdHdДИDГ}||dG<ИdаdIdбduРrfdJdДИDГ}||dI<ИdаdKdбduРr{|dKГ} | |ddK<ИdаdLdбduРrР|dLГ} | |ddL<|S)Mz- convert the sample to batch tensor. rcstЗfddДИDГИИdНS)Ncsg|]}|ИСqSйrй┌.0┌sй┌keyr·k/var/www/html/Deteccion_Ine/venv/lib/python3.10/site-packages/modelscope/preprocessors/ofa/utils/collate.py┌ єz-collate_fn..merge..)┌eos_idx)┌collate_tokensrйr┌pad_idx┌samplesrr ┌merges■zcollate_fn..merge)Z nsentences┌ net_input┌sourceNrZ input_ids┌idcSsg|]}|аdбСqS)r)┌getrrrr r szcollate_fn..┌targetcs"g|] }|dаИбабабСqS)r)┌ne┌long┌sumr)rrr r s"┌ntokensZprev_output_tokensZdecoder_input_ids┌patch_imagecSєg|]}|dСqS)rrйr┌samplerrr r 'r)┌dimZpatch_images┌ patch_maskcSr)r rrrrr r *rZpatch_masks┌ code_maskcSr)r!rrrrr r .rZ code_masks┌ code_imagecSr)r"rrrrr r 1rZcode_images┌confcSr)r#rrrrr r 4r┌ref_dictcSr)r$rrrrr r 6r┌labelcSr)r%rrrrr r 8r┌labelsZconstraint_maskZconstraint_masks┌decoder_promptcSsg|]}|dабСqS)r')┌tolistrrrr r =sZdecoder_promptsZprefix_tokenZ prefix_tokens┌w_resize_ratiocSr)r)rrrrr r CrZw_resize_ratios┌h_resize_ratiocSr)r*rrrrr r FrZh_resize_ratios┌region_coordcSr)r+rrrrr r IrZ region_coordsrcSr)rrrrrr r Krr┌fbankcSr)r,rrrrr r OrcSєg|] }|dаdбСqS)r,rй┌sizerrrr r Qє)ZdtypeZfbank_length┌ fbank_maskcSr)r1rrrrr r TrZfbank_masksZ phone_itemZphone_itemscSr)Z phone_maskrrrrr r XrZphone_masks┌phone_targetcSr-)r2rr.rrrr r \r0Zphone_length┌ db_structcSr)r3rrrrr r `r┌ mask_ratiocSr)r4rrrrr r cr┌seg_col_tokens┌seg_row_tokens)┌lenr┌np┌array┌torchZ LongTensorr┌item┌stack┌catr(┌_collate_framesZtensorr)rrrr┌batchZtgt_lengthsrr3r4r5r6rrr ┌ collate_fn s┬■ r@Fщc s"tddД|DГГ}|dur|nt||Г}|dkr*||dkr*t|d|d|Г}ЗЗfddД} |dабdkrG|dаt|Г|ба|б} n$|dабd kriИd usUJВ|dаt|Г||dаdбба|б} ntВt|ГD]\}}| ||rГ| ||t|ГdЕn | |dt|ГЕГqo| S)z5Convert a list of 1d tensors into a padded 2d tensor.csєБ|]}|аdбVqdSйrNr.)r┌vrrr ┌ zєАz!collate_tokens..NrArgЪЩЩЩЩЩ╣?cs\|аб|абks JВИr'Иdur|d|d<nИ|d<|ddЕ|ddЕ<dS|а|бdS)Nщ rrA)ZnumelZcopy_)┌src┌dstйr┌move_eos_to_beginningrr ┌copy_tensorsz#collate_tokens..copy_tensorщF) ┌max┌intr┌newr7Zfill_r/┌NotImplementedError┌ enumerate) ┌valuesrrZleft_padrKZ pad_to_lengthZpad_to_multipleZ pad_to_bszr/rL┌res┌irDrrJr r os$ 8r ┌framescCs`tddД|DГГ}|dаt|Г||dаdбfб}t|ГD]\}}|||d|аdбЕf<q|S)a; Convert a list of 2D frames into a padded 3D tensor Args: frames (list): list of 2D frames of size L[i]*f_dim. Where L[i] is length of i-th frame and f_dim is static dimension of features Returns: 3D tensor of size len(frames)*len_max*f_dim where len_max is max of L[i] csrBrCr.)r┌framerrr rEвrFz"_collate_frames..rrAN)rNZ new_zerosr7r/rR)rV┌max_len┌outrUrDrrr r>Щs "r>)NFFNrAN) ┌typingr┌numpyr8r:r@r ZTensorr>rrrr ┌si °*