o jU@s~ddlZddlZddlZddlmZmZddlmZm Z m Z m Z m Z m Z ddlmZmZddlmZmZgZGdddZdS) N)core unique_name)Variable_current_expected_placedefault_main_programdefault_startup_programin_dygraph_mode in_pir_mode)_global_bias_initializer_global_weight_initializer) ParamAttrWeightNormParamAttrc@seZdZdZddZeddZeddZedd Zed d Z e d d Z e ddZ d&ddZ ddZddddejjjfddZ d'ddZ d'ddZ d'ddZddZd(d d!Zd"d#Zd$d%ZdS))LayerHelperBasefloat32cCs||_||_dSN) _layer_type_name)selfname layer_typer^/var/www/html/Deteccion_Ine/venv/lib/python3.10/site-packages/paddle/base/layer_helper_base.py__init__(s zLayerHelperBase.__init__cC|jSr)rrrrrr,zLayerHelperBase.namecCrr)rrrrrr0rzLayerHelperBase.layer_typecCtSr)rrrrr main_program4rzLayerHelperBase.main_programcCrr)rrrrrstartup_program8rzLayerHelperBase.startup_programcCs ||_dSr_LayerHelperBase__dtype)clsdtyperrrset_default_dtype<s z!LayerHelperBase.set_default_dtypecCrrr )r"rrrget_default_dtype@rz!LayerHelperBase.get_default_dtypeNcCs\t|tjrtj|tdd|r|dSddSt|ttjjtj j fr&|St dt |)a The API will create a ``Variable`` object from numpy\.ndarray or Variable object. Parameters: value(ndarray): The numpy\.ndarray object that needs to be converted, it can be multi-dimension, and the data type is one of numpy\.{float16, float32, float64, int16, int32, int64, uint8, uint16}. name(str, optional): The default value is None. Normally there is no need for user to set this property. For more information, please refer to :ref:`api_guide_Name` Returns: Variable: ``Tensor`` created from the specified numpy\.ndarray object, data type and shape is the same as ``value`` . Examples: .. code-block:: python >>> import numpy as np >>> import paddle.base as base >>> with base.dygraph.guard(): ... x = np.ones([2, 2], np.float32) ... y = base.dygraph.to_variable(x) ... FNTz]The type of input value is invalid, expected type is 'ndarray' or 'Variable', but received %s) isinstancenpZndarrayreagerZTensorrrpaddlepirZOpResult TypeErrortype)rvaluerrrr to_variableDs* zLayerHelperBase.to_variablec sddddjffdd djffdd djffdd ddjffd d fd d }t|}|jd |_dgt|}|jdura||j||j<t|}|jd|_|}jjd|d|jdd} jjd|d|jdd} | | |jjd| || jdj jd|d|} j jd|d|} || | |jd} | S)NFc s|dur|jtdjdgdd}|jtdjdgdd}|jdd|id|id |jtdjd gdd}|jd d|id|id t|id |jtdjdgdd}|jdd|id|i|||durvdnddd |jd d|id|id d|id |S)N.weight_norm_normFrr# persistableZweight_norm_absabsXOut)r,inputsoutputsZweight_norm_powpowfactorr,r7r8attrsZweight_norm_sumZ reduce_sumT)dimkeep_dimZ reduce_allg?) create_varrgenerate_with_ignorable_keyjoinr append_opfloat) xoutpr=r>blockZabs_outZpow_outZsum_outr#rrrZ __norm_opqsl   z;LayerHelperBase._create_weight_normalize..__norm_opcs^|dur|jtdjdgdd}|jd|jd}|jdd|id |i||d d |S) Nr0Zweight_norm_reshapeFr2ZXshape)rr#reshape2r5shape)r6ZXShape)r,r7r<r8)r?rr@rArr#rB)rDrJrErGZx_shaperHrrZ __reshape_ops z>LayerHelperBase._create_weight_normalize..__reshape_opcsL|dur|jtdjdgdd}|jdd|id|id|id |S) Nr0Zweight_norm_transposeFr2 transposer5r6axisr;)r?rr@rArrB)rDrLrErGrHrrZ__transpose_opsz@LayerHelperBase._create_weight_normalize..__transpose_opc s|dur|jtdjdgdd}|dur#||||d|S|dkrU|jdgdgt|jd}||jdd g|d }|dg|d}||||d |S|t|jdkrdgt|jd|jd g}|d |jd g|d }|dg|d}||||d |Sttt|j}|d|d<||<|||d }|jdgdgt|jd}||jdd g|d }|dg|d}|||d } | |||d |S)z0Computes the norm over all dimensions except dimNr0r1Fr2r=rGrr)rJrG)rErJrG)rGrErG) r?rr@rArrJlenlistrange) rDrEr=rGZ out_shapereshapenormpermrKrI)_LayerHelperBase__norm_op_LayerHelperBase__reshape_op_LayerHelperBase__transpose_opr#rrrZ__norm_except_dimsH   zCLayerHelperBase._create_weight_normalize..__norm_except_dimcsd||jd}tj||d}tjjj||dur|n tj||j|gd|dur,dn|d}|S)z%Calculations for weight normalizationrM)rDyN)rDrJrN)rDrYrL) r current_blockr)dividetensormathZ_multiply_with_axisrSrJ)gvr=rTscalew)!_LayerHelperBase__norm_except_dimrrrZ__weight_normalizes  zDLayerHelperBase._create_weight_normalize..__weight_normalizeZ_gr_vr#rJZwith_initializerT)rDrEr=rGrO)r=r) r global_blockcopydeepcopyrrPr=create_parameter _to_kwargsr) rattrrJr#Z"_LayerHelperBase__weight_normalizeZ g_param_attrZ g_param_shapeZ v_param_attrZ v_param_shapeZg_paramZv_paramZw_paramr)rbrVrWrXr#rr_create_weight_normalizensr A  '           z(LayerHelperBase._create_weight_normalizeFc CsDt|}t|}|sdSt|tsJt|D]\}} | dks+Jd|d| q|s1|j}|r@d} tdur=tn|}n d} tdurJtn|}|j dur]t d |j | g|_ |dur|j durt|tjjr|tjjjkr|tjjjkr|tjjjkr|tjjjkr|tjjjkrtdn|d vrtd |r|n |n||t|tr||||} tj| | Strt |j } | rt d |j d |j!"j#d||||d |j$ddSt%rt&j'jj#d||d|j$ddS|j("j#d|||d|j$dd|j!"j#d|||d|$S)aCreate parameters for this layers. Args: attr: [ParamAttr] should be the parameter attribute for this parameter shape: shape of the parameter dtype: data type of this parameter is_bias: if this is a bias parameter default_initializer: set the default initializer for this parameter Returns created parameter Variable. NrzCExpected every dim's size to be larger than 0, but the size of the z -th dim is brar0zCan not create parameter with default initializer when dtype is not ['float16', 'float32', 'float64', 'bfloat16'] type. Set default_initializer to fit the parameter dtype!)Zfloat16rZfloat64Zbfloat16rCZint8zCan not create parameter with default initializer when dtype is not ['float16', 'float32', 'float64', 'bfloat16', 'float'] type. Set default_initializer to fit the parameter dtype!zparameter name [z] have be been used. In dygraph mode, the name of parameter can't be same.Please check the parameter attr value passed to self.create_parameter or constructor of dygraph Layers)r#rJr, stop_gradientTrerd)r#rJr,r))rgrhr Z_to_attrr& enumerater!r r rrgeneraterA initializerrVarDescVarTypeZFP32ZFP64ZFP16ZBF16ZINT8r+Z_set_default_bias_initializerZ_set_default_param_initializerZ_set_default_initializerrrlZparams_with_weight_normappendr Zdygraph_parameter_name_checker ValueErrorrrfrirjr r)r*r) rrkrJr#Zis_biasZdefault_initializerrnr,isizesuffixparamZis_usedrrrriIs                    z LayerHelperBase.create_parametercC>|s|j}|jjtd|jdg||tj j j d|dS)aGCreate a temporary variable that should be type inferred layer. Note: The default type will be set to LOD_TENSOR. However, when the var is used as operator output, its type will be updated based on operator's `VarTypeInference` implementation in infer_var_type. r0tmpFrr#rJr,r3rn) r!rrZr?rr@rArrrrrs LOD_TENSORrr#rnrJrrr"create_variable_for_type_inference  z2LayerHelperBase.create_variable_for_type_inferencecCsz|s|j}|jjtd|jdg||tj j j d|d}|jj }d|j_ t jjj|j|dd|d||_||j_ |S)aDCreate a global variable that should be type inferred layer. Note: The default type will be set to LOD_TENSOR. However, when the var is used as operator output, its type will be updated based on operator's `VarTypeInference` implementation in infer_var_type. r0r{Fr|rg)Z force_cpurE)r!rrfr?rr@rArrrrrsr}Zcurrent_block_idxr)r\ZcreationZ fill_constantrJrn)rr#rnrJoutputZsaved_block_idrrr*_create_global_variable_for_type_inferences(    z:LayerHelperBase._create_global_variable_for_type_inferencecCrz)aNCreate a temporary sparse variable that should be type inferred layer. Note: The default type will be set to SPARSE_COO. However, when the var is used as operator output, its type will be updated based on operator's `VarTypeInference` implementation in infer_var_type. r0r{Fr|) r!rrZr?rr@rArrrrrsZ SPARSE_COOr~rrr)create_sparse_variable_for_type_inferencerz9LayerHelperBase.create_sparse_variable_for_type_inferencecOs|jj|i|S)zKCreate Variable for this layers. Returns created Variable. )rrZr?)rargskwargsrrrcreate_variableszLayerHelperBase.create_variablecOs|jj|d|i|S)aM create global variable, note that there is no initializer for this global variable. Args: persistable(bool): True if it is a checkpoint value. *args: See create_var's documentation **kwargs: See create_var's documentation Returns(Variable): the created variable. r3)rrfr?)rr3rrrrrcreate_global_variables z&LayerHelperBase.create_global_variablecOs<|j|r|j|dfS|j|d|i|dfS)z Creates a global variable if not exists and returns the variable and a boolean flag which is true when it is a new variable. FrT)rrfZhas_varvarr)rrrrrrrcreate_or_get_global_variable-sz-LayerHelperBase.create_or_get_global_variablecCsPt|tsJtr|||jdS|jj|j|j|j |j d|ddS)zSet target Variable's initializer Args: var: target Variable initializer: initializer to use T)rr,r#rJr3rqN) r&rr rrfrr?rr,r#rJ)rrrqrrrset_variable_initializer7s  z(LayerHelperBase.set_variable_initializerr)FN)F)__name__ __module__ __qualname__r!rpropertyrrrr classmethodr$r%r.rlrrrrsr}rirrrrrrrrrrrr$sD       *` ~  "   r)rgnumpyr'r)rrZ frameworkrrrrr r rqr r Z param_attrr r__all__rrrrrs