o "jp@s,ddlmZddlZddlZddlmZddlZddlmZddl m Z ddl m Z m Z ddlmZmZmZddlmZdd lmZd d lmZd d lmZmZmZmZd d lmZgZddZ ddZ!dfddZ"ddZ#ddZ$ddZ% dgddZ&ddZ'ddZ(d d!Z)d"d#Z*d$d%Z+d&d'Z,d(d)Z-d*d+Z.d,d-Z/d.d/Z0d0d1Z1d2d3Z2 dfd4d5Z3d6d7Z4d8d9Z5d:d;Z6dd?Z8d@dAZ9dBdCZ:GdDdEdEZ;dFdGZdLdMZ?dNdOZ@dhdQdRZAdSdTddUdVdWdXZBdYdZZCe [   \ ] [did^d_ZDd`daZEdbdcZFdddeZGdS)j) annotationsN)contextmanager) PyLayerMeta) convert_dtype)_convert_into_variablein_to_static_mode)Variablecoredefault_main_program)Value) AmpOptions) StaticPyLayer)RETURN_NO_VALUE_VAR_NAMEDygraph2StaticExceptionGetterSetterHelper UndefinedVar)to_static_variablecCs$t|tr |dkr |St||S)Nsize) isinstancerrgetattr)xattrrg/var/www/html/Deteccion_Ine/venv/lib/python3.10/site-packages/paddle/jit/dy2static/convert_operators.py convert_attr)s rcCstrat|tjr t|St|trt|St|tr6t }ddl m }| |j t|}|dur6|St|trYt }ddlm}|j |j |j}|durY|S|tjjuratS|S)Nr)_global_inplace_mapProgramTranslator)rrpaddleZTensorrrrr r current_blockZ+paddle.jit.pir_dy2static.parameter_recorderrgetprogramidr'paddle.jit.dy2static.program_translatorr get_instance _inplace_mapdescampZ auto_castconvert_auto_cast)rZ cur_blockrZnew_varrrrr convert_load4s.           r*cCsDt|ttfr |St|drt|St|drt|dr|Std)N__iter____len__ __getitem__z"X can't be convert into indexable.)rrr hasattrlist RuntimeError)rcoderrr indexable_s  r2cCs"t|ttfr t||St||S)z/unified unpack interface for paddle and python.)rrr _unpack_by_structure_paddle_unpack_by_structure_pythontarget structurerrrunpack_by_structurels  r8cCs t||S)zJTODO(xiongkun): analysis the differences between python and paddle unpack.)r3r5rrrr4ts r4cCsd|dkr|Sg}t|D]#\}}|dkr|||q t|tr,|t|||q td|S)Nr z#structure element must be 1 or list) enumerateappendrr/r8AssertionError)r6r7retidxZelerrrr3ys r3cCs<|}t|ttfrt||||||dSt||||dS)a A function representation of a Python ``while`` statement. Args: cond(Callable): A callable object that returns a boolean variable to control whether to execute the loop body. It takes ``loop_vars`` as arguments. body(Callable): A callable object that returns a tuple or list of variables with the same arguments ``loops_vars`` as ``cond`` . get_args(callable): Get all arguments that needed in true_fn and false_fn. set_args(callable): Update arguments that modified in trure_fn and false_fn. return_name_ids(list[string], optional): the returned names. push_pop_names(list[string], optional): the names on which called .append() or .pop(). Returns: A list or tuple of variables which returned by ``body``. N)rrr _run_paddle_while _run_py_while)condbodygettersetterreturn_name_idspush_pop_namespredrrrconvert_while_loops  rGcs<||}|dur dSdd||fdd|DdS)NcSst|tr tjjd|dS|S)Nfloat32)Zinitialized_list)rr/rtensor create_array)vrrrmaybe_to_tensor_arrays zB_convert_tensor_arrray_if_necessary..maybe_to_tensor_arraycsg|]}|qSrr).0rKrLrr sz7_convert_tensor_arrray_if_necessary..)r!set)Z setterhelperrEZ push_pop_varsrrNr#_convert_tensor_arrray_if_necessarys rQc st||||t||rt|nt|rt|ntBtfdd}fdd}ddD}|ddlm} | |||}||S) Ncs |}|S)zlwrap the body() and add return value for `while_loop` the args may be differ from getter(). )rPr!)argsZmutable_loop_vars)rAhelper union_namerr new_body_fns  z&_run_paddle_while..new_body_fncsS)zYcond is a zero-args function, which is not compatible with `while_loop`. r)rR)r@rr new_cond_fnsz&_run_paddle_while..new_cond_fncSs"g|] }t|ts t|n|qSr)rrr)rMvarrrrrOsz%_run_paddle_while..r while_loop)rrQrPr/r!paddle.static.nnrY) r@rArBrCrDrErUrVZ loop_varsrYr)rAr@rSrTrr>s       r>cCs. |}t|ttfrtd|sdS|q)NTz/python while pred change from bool to variable.)rrr r)r@rArBrCrFrrrr?sr?c^|tttfstfdd|S|tttfs*tfddfddStS)a A function representation of a Python ``and`` statement. Args: x_func(callable): x_func() is the left hand operand of ``and`` operator. x_func() is bool or Tensor. y_func(callable): y_func() is the right hand operand of ``and`` operator. y_func() is bool or Tensor. Returns: A python bool variable or a bool Tensor. NOTE(liym27): 1) The operands are executed sequentially according to the running logic of Python. So here the arguments should be callable. 2) If the left hand operand is False, the right hand operand should be executed. For example: a = x > 1 and y < 1 Transformed code: a = paddle.jit.dy2static.convert_logical_and(lambda:x>1, lambda:y<1) In `convert_logical_and(lambda:x>1, lambda:y<1)`, `lambda:y<1` must be run after `lambda:x>1`. And if `x>1` is False, `y<1` should NOT be run. cSNrrx_valuerrz%convert_logical_and..cr\r]rry_valuerrr`racr\r]rrr^rrr`ra)rrr _run_py_logical_and_run_paddle_logical_andx_funcy_funcrr_rcrconvert_logical_and rjcCt|}t|}t||Sr])cast_bool_if_necessaryr logical_andryrrrre  recCs"|}t|ttfr J|o|Sr]rrr rgrhr_rrrrd rdcr[)a A function representation of a Python ``or`` statement. Args: x_func(callable): x_func() is the left hand operand of ``or`` operator. x_func() is bool or Tensor. y_func(callable): y_func() is the right hand operand of ``or`` operator. y_func() is bool or Tensor. Returns: A python bool variable or a bool Tensor. NOTE(liym27): 1) The operands are executed sequentially according to the running logic of Python. So here the arguments should be callable. 2) If the left hand operand is True, the right hand operand should be executed. For example: a = x > 1 or y < 1 Transformed code: a = paddle.jit.dy2static.convert_logical_or(lambda:x>1, lambda:y<1) In `convert_logical_or(lambda:x>1, lambda:y<1)`, `lambda:y<1` must be run after `lambda:x>1`. And if `x>1` is True, `y<1` should NOT be run. cr\r]rrr^rrr`7raz$convert_logical_or..cr\r]rrrbrrr`;racr\r]rrr^rrr`;ra)rrr _run_py_logical_or_run_paddle_logical_orrfrrirconvert_logical_orrkrwcCrlr])rmr logical_orrorrrrv@rqrvcCs"|}t|ttfr J|p|Sr]rrrsrrrruFrtrucCst|ttfr t|St|S)z A function representation of a Python ``not`` statement. Args: x(bool|Tensor): Operand of ``not`` operator. Returns: A python bool variable or a bool Tensor. )rrr _run_paddle_logical_not_run_py_logical_notrrrrconvert_logical_notPs r|cCst|}t|Sr])rmrZ logical_notr{rrrryas rycCs| Sr]rr{rrrrzfrzcCs<t|ttfrt|||||||}|St||||||}|S)a  A function representation of a Python ``if/else`` statement. Args: pred(bool|Tensor): A boolean Tensor which determines whether to return the result of ``true_fn`` or ``false_fn`` . true_fn(callable): A callable to be performed if ``pred`` is true. false_fn(callable): A callable to be performed if ``pred`` is false. get_args(callable): Get all arguments that needed in true_fn and false_fn. set_args(callable): Update arguments that modified in trure_fn and false_fn. return_name_ids(list[string], optional): the returned names. push_pop_names(list[string], optional): the names on which called .append() or .pop(). Returns: ``true_fn()`` if the predicate ``pred`` is true else ``false_fn()`` . )rrr _run_paddle_cond_run_py_ifelse)rFtrue_fnfalse_fnget_argsset_argsrDrEoutrrrconvert_ifelsejs rc sXt|||t|t|}ddlm}|jddur-|dur-dnr3tnt|r;t|ntBt fdd}fdd} z t j j ||| d} Wn0ty} z$tdt| rtd t| td t| rtd t| | d} ~ wwfd d }fdd }t| ||S)zH Paddle cond API will evaluate both true_fn and false_fn codes. rrNcsB}tj}|dur}||Sr]Zsave_checkpointrPrutilsZcopy_mutable_varsr!Zrestore_checkpointZinplace_map_checkpointr<)rS init_args inplace_maprDrrTrr new_true_fns   z%_run_paddle_cond..new_true_fncsB}tj}|dur}||Sr]rr)rrSrrrDrTrr new_false_fns   z&_run_paddle_cond..new_false_fnz7Unsupported return type of true_fn and false_fn in condzDYour if/else have different return type. TODO: add link to modifty. zIncompatible return values ofzOYour if/else have different number of return value. TODO: add link to modifty. cs Sr])r!rrSrTrrr`s z"_run_paddle_cond..cs |Sr])rP)vsrrrr` )rrQrmr!r$rr%r&rPr/rstaticnnr@ Exceptionresearchstrr_recover_args_state) rFrrrrrDrErrrZ cond_outser)rrSrrrDrrTrr~sL        r~cCs|r|}|S|}|S)z; Evaluate python original branch function if-else. r)rFrrrrrDZpy_outsrrrrs rcCs t|trt|dkr|}|d}t|trXt|D]=\}}t|ttfrWt|jvrW|dkr7d|dd}n|dkrH|dd|dd}n |d|f|dd}nqt|D]\}}t|ttfrrt|jvrr|d|}q\|swdSt|dkr|dS|S|S)Nrr]r )rtuplelenr9rr rname)rZ processed_outZ align_retindexitemrrr_remove_no_value_return_vars2     rcCsV|durdSt|ttfs|g}tt||D]\}}t|tr(td||qdS)Nz_Required '{}' must be initialized both in if-else branch, but found it not initialized in '{}'.)rr/rzipr ValueErrorformat)outsnames branch_namerWrrrr_check_no_undefined_vars rcCs|dur|S|}t|}t|}||ksJ|dkr*t|ttfs%|fnt|}n|dkr1|fnt|}|||d}|||S)z Currently we support variant length of early return statement by padding _no_return_value. # TODO(dev): We shall consider to evaluate whether should support this for Python if-else? Nr )rrr/r)rrrrDrZnum_outsnum_argsZ final_outsrrrrs rcCs8t|trL|jdksJd|jtjjjtjjjfvr6|j ddkr/|jtjjjkr/|j dSt |dS|jtjjj krDt j |Stdt|t|tr|sY|ry|jdksbJd|j ddkrr|rr|j dSt |dS|rt j |Stddt|dt|tr|St|S)z Returns variable(length) from shape ops based on var.type Note: In addition to some ast transformations, some block-related operations are added in `len` transformation, such as appending `shape_op` in var.block. rzlen() of a 0-D tensor is wrongzNlen(var) only supports LoDTensor/LoDTensorArray/SelectedRows, but received %s.zBlen(var) only supports DenseTensor/DenseTensorArray/SelectedRows, z but received .)rrndimtyper VarDescVarTypeZ LOD_TENSORZ SELECTED_ROWSshaperLOD_TENSOR_ARRAYrI array_length TypeErrorr Zis_dense_tensor_typeZis_selected_row_typeZis_dense_tensor_array_type VariableTupler,rrWrrr convert_len9s@       rcGsJt|D]\}}t|ttfr |jddkr tdt|dqt|S)NrzHNot support zip(tensor, ...) when tensor.shape[0] == -1, but found args[z].shape[0] == -1 in 'zip')r9rrr rr0rr)rRiargrrr convert_zipjsrc@s*eZdZdZd ddZddZddZd S) rz this class will cause enumerate can't be wrapped by other iterator change function. this will be fixed when list is producted. VariableTuple can only deal with variables which is fixed. rcCsT||_t||_t|jttfrt|||jdtj|_ dSt |||j|_ dS)Nr ) rWrrrrr rarangeint64ragrange)selfrWstartrrr__init__|s  zVariableTuple.__init__cCs|j||j|fSr])rrW)rr=rrrr-szVariableTuple.__getitem__cCs|jSr])r)rrrrr,r}zVariableTuple.__len__N)r)__name__ __module__ __qualname____doc__rr-r,rrrrrus   rcGs&tdd|D}|rt|St|S)Ncs|] }t|ttfVqdSr]rrrMrrrr z$convert_enumerate..)anyrr9rRZ has_variablerrrconvert_enumeratesrcGstdd|D}|rAt|dkrtd|dddSt|dkr-t|d|dddSt|dkrAt|d|d|ddSt|S)Ncsrr]rrrrrrrrz convert_range..r rr)rrrrrrrrr convert_ranges   rcCsjdd}t|ttfr2t|j}||r0t|}t|D]\}}|dus)|dkr/||||<q|S|jS)z= A function representation of the shape of variable. cSstdd|DS)Ncss|]}|dkVqdS)rNrrrrrrsz6convert_shape..has_negative..)r)Z list_shaperrr has_negativesz#convert_shape..has_negativeNr)rrr r/rrr9)rrvaluesZ shape_tensorrrKrrr convert_shapes   rcCs2t|ttfs Jt|jdvrtj|dd}|S)N)boolrdtype)rrr rrrcastrrrrrmsrmcCst|ttfr4t|j}|dvsJd|j||dvs%Jd|ddddd}tj|||d S|dvs@Jd|dt ||S) N)rfloat16rHZfloat64int32rZuint8zAThe dtype of var {} is {}, which is not supported in the cast op.)rintfloatzThe casted target dtype is z), which is not supported in type casting.rrrHr) rrr rrrrrreval)rWrZ src_dtypeZcast_maprrrconvert_var_dtypes&      rcCs>t|ttfrt|d}ddlm}||S|sJ|dS)zE A function representation of a Python ``assert`` statement. rr)AssertN)rrr rrZpaddle.static.nn.control_flowr)r@messagerrrrconvert_asserts   r  FsependfileflushcGs<|D]}t|ttfrtj|qt|||||ddS)z A function representing Python ``print`` function. It will print all arguments at compile time and only print the Tensor values at runtime. rN)rrr rrZPrintprint)rrrrobjectsobjrrr convert_prints  rcGsJt|ttf}|r|jtjjjk}|r|rt|g|RSt |g|RS)a A function representation of a Python pop statement for a list or dict. Args: target(list|dict|Tensor): A variable to pop item from. *args(tuple): index or default value to parse. Returns: A item poped from target. ) rrr rr rrr_run_paddle_pop_run_python_pop)r6rRZ is_variableZis_tensor_arrayrrr convert_pops  rTO1rccsddlm}td|j}tj}|j } | } t | j } t ||||||} dVt | j } | |vr;g|| <|| | | | fdS)Nr rzopaddle.amp.auto_cast is an experimental features in auto parallel.This will take no effect in normal dy2static.)Zprogram_translatorrwarningswarnr%Z _amp_recordsrrr current_block_idxr ropsr r:)enableZcustom_white_listZcustom_black_listlevelrZ use_promoterZ amp_recordsZ main_programrr Z start_op_idxZ amp_optionsZ end_op_idxrrrr)s(      r)c st|dkr d}n|d}t|tsJfdd}fdd}tj|dkr/|}nddlm}|dgd |d }tj|}t }t |d|}|d} dd l m } | ||| |g\} }tj |d |S) Nrrcs t|Sr])r less_than)r new_array)arr_lenrrr@9s z_run_paddle_pop..condcs:tjj|d}tj|tj||t|}||fS)N)arrayr)rrI array_readZ array_writer increment)rrr)rrrrA<s  z_run_paddle_pop..body) fill_constantr r)rrvaluerX)output) rrrrrIrZ paddle.tensorrrZassign_slice_tensor_arrayrZrY) rrRr=r@rArZpop_itemtmprrrY_r)rrrr1s&         rcs8dd}ddtjjk|fdd}|S)NcSstjd}|S)NrH)rrIrJ)Z null_arrayrrrr]s z$_slice_tensor_array..true_fncSstj||g|gdgd}|S)Nr)ZstartsZendsZaxes)rslice)rrrrrrrrasz%_slice_tensor_array..false_fncs Sr]rrrrrrrrr`frz%_slice_tensor_array..)rrrr@)rrrrrrrrr\s rcGs:t|dkr|\}}|||S|r|dnd}||S)Nrrr)rpop)r6rRr=defaultrrrrks   rr])NN)r)TNNrrT)H __future__rrr contextlibrrZpaddle.autograd.py_layerrZpaddle.base.data_feederrZpaddle.base.dygraph.baserrZpaddle.base.frameworkrr r Z paddle.pirr Zpaddle.static.amp.fp16_utilsr Zpy_layerrrrrrrZvariable_trans_funcr__all__rr*r2r8r4r3rGrQr>r?rjrerdrwrvrur|ryrzrr~rrrrrrrrrrrmrrrrr)rrrrrrrs         +  ) # #  +L #1   "   +