o &jN@sddlZddlmZddlmZd/ddZd/ddZd0d d Zd d Z d1ddZ ddZ ddZ d2ddZ d3ddZddZd/ddZddZd d!Zd3d"d#Z $ d4d%d&Zd'd(Zd3d)d*Z $ d4d+d,Zd-d.ZdS)5N)Image)Recordc csF|D]\}}t|}ttj|||tj||ddgdVqdS)a(Package data to scalars Args: main_tag (string): Data identifier tag_scalar_dict (dict): A dict to provide multi-values with tags step (int): Step of scalar walltime (int): Wall time of scalar Return: Package with format of record_pb2.Record )tagvalue)idr timestampZ tag_valuevaluesN)itemsfloatrValueZTagValue)Zmain_tagZtag_scalar_dictstepwalltimeZsub_tagrrb/var/www/html/Deteccion_Ine/venv/lib/python3.10/site-packages/visualdl/component/base_component.pyscalarss   rcCs"t|}ttj||||dgdS)aPackage data to one scalar. Args: tag (string): Data identifier value (float): Value of scalar step (int): Step of scalar walltime (int): Wall time of scalar Return: Package with format of record_pb2.Record )rrrrr)r rr )rrr rrrrscalar,s r meta_data_tagcC&tj|d}ttj||||dgdS)aPPackage data to one meta_data. Meta data is info for one record file, include `display_name` etc. Args: tag (string): Data identifier display_name (string): Replace step (int): Step of scalar walltime (int): Wall time of scalar Return: Package with format of record_pb2.Record ) display_name)rrr meta_datar)rZMetaDatar )rrr rmetarrrr=s rc Csz!ddl}|||j}|d|\}}tt|d}W|St yUddl }t|}| }|j |dd| }WdY|S1sMwYY|Sw)zConvert image ndarray to bytes. Args: np_array (np.ndarray): Array to converte. Returns: Binary bytes of np_array. rNz.pngrawZpng)format)cv2ZcvtColorZ COLOR_BGR2RGBZimencoderZ fromarraynpuint8tobytes ImportErrorioBytesIOsavegetvalue)Znp_arrayrretbufZimg_binr Zimfprrrimgarray2bytesQs"      r'c Cs.t|tjs Jd|jddkrt|||gd}|jdkr&|jddks/|jddks/J|jd}|jd}|jd}t||}ttt ||}tj |jd||||f|j d}d}t |D].}t |D]'} ||krtn |||dd|||d|| || d|f<|d}qlqf|S)Nz*plugin error, should pass numpy array herer)dtype) isinstancerZndarrayshape concatenatendimminintceilr Zzerosr-range) IZncolsZnimgHWZnrowsZcanvasiyxrrr make_gridis.*    $  6 r<cstttksJdt|jtks#Jd|jtdkrFfdddD}||}t|}|ddd Std krlfd dd D}||}|jddkrjt|||gd}|Stdkrfd ddD}||}t |||gd}|SdS)zConvert `NCHW`, `HWC`, `HW` to `HWC` Args: tensor (np.ndarray): Value of image input_format (string): Format of image Return: Image of format `HWC`. zLYou can not use the same dimension shordhand twice. input_format: {}z_size of input tensor and input format are different. tensor shape: {}, input_format: {}r*cg|]}|qSrfind.0c input_formatrr z"convert_to_HWC..ZNCHWr)r,rr+cr=rr>r@rCrrrErFHWCcr=rr>r@rCrrrErFZHWN) lensetrr/upperZ transposer<rr0stack)ZtensorrDindexZ tensor_NCHWZ tensor_CHWZ tensor_HWCrrCrconvert_to_HWCs8         rMcCs,|dkr|dkr|d9}|tjS)zRenormalise ndarray matrix. Args: image_array(np.ndarray): Value of image Return: Matrix after renormalising. r)r)maxr2astyperr) image_arrayrrrdenormalizations  rRrGcCs@t|}t||}t|}tj|d}ttj||||dgdS)a:Package data to one image. Args: tag (string): Data identifier image_array (np.ndarray): Value of image step (int): Step of image walltime (int): Wall time of image dataformats (string): Format of image Return: Package with format of record_pb2.Record )Zencoded_image_string)rrrimager)rRrMr'rrr )rrQr rZ dataformatsZ image_bytesrSrrrrSs  rSc st}|r |j|t|dtr.g}tt|dD]|fdd|Dq|}t ||D]\}} t|ts?|g}|j tj || dq3ttj ||||dgdS)avPackage data to one embedding. Args: tag (string): Data identifier labels (list): A list of labels. hot_vectors (np.array or list): A matrix which each row is feature of labels. step (int): Step of embeddings. walltime (int): Wall time of embeddings. Return: Package with format of record_pb2.Record rcsg|]}|qSrr)rAlabelrLrrrEszembedding..)rTZvectors)rrr embeddingsr) rZ EmbeddingsZ label_metaextendr.listr5rHappendziprVZ Embeddingr ) rlabelsZ hot_vectorsr Z labels_metarrVtemprTZ hot_vectorrrUr embeddings&   r]c Cs|}t|dkrtd|dd}|jdksJddd|D}ddl}ddl}ddl}| }| |d } | d| d | |d } | |jd d t|g|R7} | | | |} |tj|dt|| dd} ttj|||| dgdS)aUPackage data to one audio. Args: tag (string): Data identifier audio_array (np.ndarray or list): audio represented by a np.array sample_rate (int): Sample rate of audio step (int): Step of audio walltime (int): Wall time of audio Return: Package with format of record_pb2.Record r)z4warning: audio amplitude out of range, auto clipped.z%input tensor should be 1 dimensional.cSsg|]}td|qS)g@)r3)rAr;rrrrEszaudio..rNwbr,<hz audio/wav) sample_rateZ num_channelsZ length_framesZencoded_audio_string content_type)rrraudior)ZsqueezeabsrOprintZclipr1r wavestructr!openZ setnchannelsZ setsampwidthZ setframeratepackrHZ writeframescloser#rZAudior ) rZ audio_arrayrcr rr rhriZfioZ wave_writerZ audio_encZ audio_stringZ audio_datarrrres<      " recCr)aPackage data to one image. Args: tag (string): Data identifier text_string (string): Value of text step (int): Step of text walltime (int): Wall time of text Return: Package with format of record_pb2.Record )Zencoded_text_string)rrrtextr)rTextr )rZ text_stringr r_textrrrrms rmcCs(tj||d}ttj||||dgdS)a\Package data to one histogram. Args: tag (string): Data identifier hist (np.ndarray or list): The values of the histogram bin_edges (np.ndarray or list): The bin edges step (int): Step of histogram walltime (int): Wall time of histogram Return: Package with format of record_pb2.Record )hist bin_edges)rrr histogramr)rZ Histogramr )rrprqr rrrrrrrr-s  rrc Cst}||_|D]J\}}|durq tj}||_t|tr+||_|j |q t|t r:||_ |j |q t|t rI||_ |j |q td|t t|fq |D]}tj} || _d| _ |j | qXttjdd||dgdS)aPackage data to one histogram. Args: name (str): Name of hparam. hparam_dict (dictionary): Each key-value pair in the dictionary is the name of the hyper parameter and it's corresponding value. The type of the value can be one of `bool`, `string`, `float`, `int`, or `None`. metric_list (list): Name of all metrics. walltime (int): Wall time of hparam. Return: Package with format of record_pb2.Record Nz1The value of %s must be int, float or str, not %srr)hparam)rrrrsr)rZHParamnamer Z HparamInfor.r3Z int_valueZ hparamInfosrYr float_valuestrZ string_valuergtypeZ metricInfosr ) rtZ hparam_dictZ metric_listrZhmkvZ hparamInfoZmetricZ metricInforrrrsAs6     rscCsnt|tr t|}t|trt|}d}|durd}tt||d}|tj}d|df}tj|||||d\}} tj|||d||d\} } t |dddddd} t | dddddd} | d| } | d| }| t || | }| t || |}| t  | t  | t  |t  |t |t d}|S) a Compute precision-recall curve data by labels and predictions. Args: labels (np.ndarray or list): Binary labels for each element. predictions (np.ndarray or list): The probability that an element be classified as true. num_thresholds (int): Number of thresholds used to draw the curve. weights (float): Multiple of data to display on the curve. Hz>N?r)rZbinsr5weightsr^)tpr&tnfn precisionrecall r.rXrarrayZint32floorrPr rrZcumsummaximumr3tolist)r[ predictionsnum_thresholdsr}_MINIMUM_COUNTbucket_indices float_labelshistogram_range tp_buckets_ fp_bucketsr~r&rrrrdatarrr compute_curvensH                rc CJt|d}t||||}t||d|d|d|d|d|d||d S) a$Package data to one pr_curve. Args: tag (string): Data identifier labels (np.ndarray or list): Binary labels for each element. predictions (np.ndarray or list): The probability that an element be classified as true. step (int): Step of pr_curve walltime (int): Wall time of pr_curve num_thresholds (int): Number of thresholds used to draw the curve. weights (float): Multiple of data to display on the curve. Return: Package with format of record_pb2.Record rr~r&rrrr) rr~r&rrrrr r)r2r pr_curve_raw)rr[rr rrr}Z prcurve_maprrrpr_curves rc C2 tj||||||d} ttj|||| dgdS)aPackage raw data to one pr_curve. Args: tag (string): Data identifier tp (list): True Positive. fp (list): False Positive. tn (list): True Negative. fn (list): False Negative. precision (list): The fraction of retrieved documents that are relevant to the query: recall (list): The fraction of the relevant documents that are successfully retrieved. step (int): Step of pr_curve walltime (int): Wall time of pr_curve num_thresholds (int): Number of thresholds used to draw the curve. weights (float): Multiple of data to display on the curve. Return: Package with format of record_pb2.Record )TPFPTNFNrr)rrrrr)rZPRCurver ) rr~r&rrrrr rZprcurverrrrs rcCsnt|tr t|}t|trt|}d}|durd}tt||d}|tj}d|df}tj|||||d\}} tj|||d||d\} } t |dddddd} t | dddddd} | d| } | d| }| t || | }| t || | }| t  | t  | t  |t  |t |t d}|S) a Compute ROC curve data by labels and predictions. Args: labels (numpy.ndarray or list): Binary labels for each element. predictions (numpy.ndarray or list): The probability that an element be classified as true. num_thresholds (int): Number of thresholds used to draw the curve. weights (float): Multiple of data to display on the curve. rzNr{r)rr|r^)r~r&rrtprfprr)r[rrr}rrrrrrrr~r&rrrrrrrrcompute_roc_curvesH                rc Cr) a)Package data to one roc_curve. Args: tag (string): Data identifier labels (numpy.ndarray or list): Binary labels for each element. predictions (numpy.ndarray or list): The probability that an element be classified as true. step (int): Step of pr_curve walltime (int): Wall time of pr_curve num_thresholds (int): Number of thresholds used to draw the curve. weights (float): Multiple of data to display on the curve. Return: Package with format of record_pb2.Record rr~r&rrrr) rr~r&rrrrr r)r2r roc_curve_raw)rr[rr rrr}Z roc_curve_maprrr roc_curve"s rc Cr)aRPackage raw data to one roc_curve. Args: tag (string): Data identifier tp (list): True Positive. fp (list): False Positive. tn (list): True Negative. fn (list): False Negative. tpr (list): true positive rate: fpr (list): false positive rate. step (int): Step of roc_curve walltime (int): Wall time of roc_curve num_thresholds (int): Number of thresholds used to draw the curve. weights (float): Multiple of data to display on the curve. Return: Package with format of record_pb2.Record )rrrrrr)rrrrr)rZ ROC_Curver ) rr~r&rrrrr rrrrrrFsr)N)rrrN)r()NrG)NN)rN)numpyrZPILrZvisualdl.proto.record_pb2rrrrr'r<rMrRrSr]rermrrrsrrrrrrrrrrs4      '  $ / -8 % *7 $