o 0jv @sddlmZmZmZmZmZddlZddlmZddl m Z ddl m Z m Z ddlmZd d lmZmZe d re$d*ee$eeffd?d@Z-d&eedAee$fdBdCZ.dNdEdFZ/ej0GdGdHdHZ1dS)O)DictListOptionalTupleUnionN)ndarray)logging)function_requires_depsis_dep_available) benchmark)check_containmentnmszopencv-contrib-python) Z figure_titleZvision_footnoteimagecharttableheaderZ header_imagefooterZ footer_imageZfootnoteZ aside_textcCs8||}||}|d|d|d|d}|dkS)z- Calculate if the polygon is convex. r)p_prevp_currp_nextv1v2crossrrt/var/www/html/Deteccion_Ine/venv/lib/python3.10/site-packages/paddlex/inference/models/layout_analysis/processors.py is_convex/s rcCsJ|tj|}|tj|}tt||dd}t|}t|S)z2 Calculate the angle between two vectors. gg?)nplinalgnormclipdotZarccosdegrees)rrZunit_v1Zunit_v2Zdot_prodZ angle_radrrrangle_between_vectors9s   r&cCs@|tj||tj|}|tj|}|||}|S)zH Calculate the new point based on the direction of two vectors. )r r!r")rrrZdistancedir_vecZp_newrrrcalc_new_pointEs  r)-333333?c st|}t|}||9}g}t|D]7}||d|||||d|}} } || | | } } t|| | } t| | }||| || | dqddt|D}t|rg}|dg}tdt|D]6}||||ddks||d|dkr||dkr|||qgt|dkr| |||g}qgt|dkr| |t|dkr|ddkr|d|dkrd|vr|d|vr̈ |n |fddt|D}g}tt|D]t}||}||dt|}||tj ||||}||krY||krt t|d|nt t|d|t td|rYtt||d}t|krD| qt|| fd dt|Dqtt|}g}|D]e}||}||} |d rt|d |dkr|d tj |d }|d tj |d }||}|tj |}tj |d tj |d d}|t| ||qd|t| qd|S)Nr)indexranglerrcSsg|] \}}|ds|qS)rr.0iinforrr fz+extract_custom_vertices..rrcs0g|]\}}|ds|vr|ddkr|qS)rr-xrr.)preserve_concaverrr2scsg|] }t|qSr)intr/r0) intermediatesteprrr2r3rr-rr)r arraylenrangerr&append enumeratesetextendupdater!r"listr7ceilsortedabstuple)polygonmax_allowed_distZsharp_angle_threshZmax_dist_ratiopolynZ point_infor0rrrrrZis_convex_pointr-Zconcave_indicesgroupsZ current_groupZ kept_pointsZ final_pointsidxZ current_idxZnext_idxdistZ num_neededresr1Zv1_normZv2_normr(dr)r9r6r:rextract_custom_verticesOs  ,                      $rQMbp?Tc Csnt|tjtj\}}|sdSt|tjd}|t|d}t||d}|} t | } |r5t | |} | S)z Postprocess mask by removing small noise. Args: mask (ndarray): The input mask of shape [H, W]. epsilon_ratio (float): The ratio of epsilon. Returns: ndarray: The output mask after postprocessing. N)keyT) cv2Z findContoursZ RETR_EXTERNALZCHAIN_APPROX_SIMPLEmaxZ contourAreaZ arcLengthZ approxPolyDPZsqueezer Z atleast_2drQ) maskrIZ epsilon_ratioZextract_customZcnts_ZcntepsilonZ approx_cntpolygon_pointsrrr mask2polygons   rZc Cs|dd|dd}}|jdd\}}g}t|dddf|dddf} tt|D]} || ddftj\} } } }| | || }}t|| ddf}|dks]|dkrc||q0t t t | |t t | |gd|}t t t | |t t ||gd|}|| |d|d|d|df}|j dkst |dkr||q0tj|tj||ftjd}|| d kr|}n| }t||}|durt|dkr|t| | g}|t|| ddf||t|dkr|d ndd q0|S) uE 修改后的提取函数：auto 模式下信任几何决策 rrrNr r) interpolation333333?r4boxrHlayout_shape_modeprevious_polygon)shaperUr=r<astyper int32_rect_from_boxr>r#r7roundsizesumrTresizeZuint8Z INTER_NEARESTrZr;_normalize_layout_polygon)boxesmasks scale_ratior`Zscale_wZscale_hZh_mZw_mrYZ max_box_wr0x_miny_minx_maxy_maxZbox_wZbox_hrectZx_sZy_sZcroppedZ resized_maskrIrHrrrextract_polygon_points_by_maskssN$  ""&    rsc CsNg}t||D]\}}|t|dd||t|dkr|dnddq|S)Nrr[rr4r^)zipr>rjr<)rkrYr`Znormalized_pointsrHr_rrr!normalize_polygon_points_by_boxes s  rucCsBt|tj\}}}}tj||g||g||g||ggtjdS)NZdtype)r asarrayrcrdr;float32)r_rnrorprqrrrres rec Cst|}|dur |Stj|tjd}|jdkr|dd}t|dkr%|S|dkr+|S|dkr1|St|}|dkrA|dur?|S|S|d kr|}|dur|}t ||d d }|d kr^|S|} t | |d d } d } |durxt ||dd } | dkr| dkr|S|St d)Nrvrr4rrrrrJquadautounionmodegffffff?rsmallg?g{Gz?zAlayout_shape_mode must be one of ['rect', 'poly', 'quad', 'auto']) rer rwrxndimreshaper<convert_polygon_to_quadtolistcalculate_polygon_overlap_ratio ValueError) r_rHr`rarrryZ rect_listZ quad_listZ iou_rect_quadZ poly_listZ iou_poly_quadZiou_prerrrrj%sR   rjc Cs|dus t|dkr dStj|tjd}t|jdkr!|dd}t|}t|}|j dd}t |dddf|d|dddf|d}t |}||}|dddf|dddf}t |}tj || dd}|S) z Convert polygon to minimum bounding rectangle (quad). Args: polygon (ndarray): The polygon points of shape [N, 2]. Returns: quad (ndarray): The 4-point quad, clockwise from top-left, or None if invalid. Nr rvrr4rr)Zaxis)r<r r;rxrbrrTZ minAreaRectZ boxPointsmeanZarctan2argsortZargminZroll) rHZpointsZmin_rectrycenterZanglesZsorted_indicesZsumsZ top_left_idxrrrrbs    4   rrklabelsimg_sizerYreturncCsg}|\}}t|D]e\}}|dd\} } } } ttd| } ttd| } tt|| } tt|| } | | ks<| | kr=q t|d|t|dt|d| | | | g|dd} |durj||}|durfq || d<|| q |S)ae Restructure the given bounding boxes and labels based on the image size. Args: boxes (ndarray): A 2D array of bounding boxes with each box represented as [cls_id, score, xmin, ymin, xmax, ymax]. labels (List[str]): A list of class labels corresponding to the class ids. img_size (Tuple[int, int]): A tuple representing the width and height of the image. polygon_points (ndarray): A 2D array of polygon points with each point represented as [x, y]. Returns: Boxes: A list of dictionaries, each containing 'cls_id', 'label', 'score', and 'coordinate' keys. rNrr)Zcls_idlabelscore coordinateorderrY)r?r7rUminfloatr>)rkrrrYZbox_listwhrMr_xminyminxmaxymaxrOZ polygon_pointrrrrestructured_boxess.    rc Cs|dur|St|trng}|D]Y}|\}}}}}} ||vrc||\} } ||} | |} | | }| | }|| d}|| d}||d}||d}||d}||d}|||||||gq||qt|S|dddf|dddf}|dddf|dddf}||d}||d}|dddf|d}|dddf|d}||d}||d}||d}||d}t|dddf|dddf||||f}|S)a] Expand bounding boxes from (x1, y1, x2, y2) format using an unclipping ratio. Parameters: - boxes: np.ndarray of shape (N, 4), where each row is (x1, y1, x2, y2). - unclip_ratio: tuple of (width_ratio, height_ratio), optional. Returns: - expanded_boxes: np.ndarray of shape (N, 4), where each row is (x1, y1, x2, y2). Nrrr rr) isinstancedictr>r r;Z column_stack)rkZ unclip_ratioZexpanded_boxesr_Zclass_idrx1y1x2y2Z width_ratioZ height_ratiowidthheightZnew_wZnew_hZcenter_xZcenter_yZnew_x1Znew_y1Znew_x2Znew_y2widthsZheightsrrr unclip_boxessF                   &rcCs|js|d}|S)Nr)Zis_validbuffer)rJrrr make_valids rr{polygon1polygon2r}c Cszddlm}Wn tytdw||}||}t|}t|}||j}||j}|dkr8||S|dkrGt|j|j}||S|dkrVt|j|j} || St d|)a Calculate the overlap ratio between two polygons. Args: polygon1 (List[Tuple[int, int]]): First polygon represented as a list of points. polygon2 (List[Tuple[int, int]]): Second polygon represented as a list of points. mode (str, optional): Overlap calculation mode. Defaults to "union". Returns: float: Overlap ratio value between 0 and 1. rPolygonPlease install Shapely library.r{r~largezUnknown mode: ) shapely.geometryr ImportErrorr intersectionarear{rrUr) rrr}rZpoly1Zpoly2rr{Z small_areaZ large_arearrrrs(   rcCs*tt|\}}}}t||||}|S)zCalculate bounding box area)maprrF)Zbboxrrrrrrrrcalculate_bbox_areasrbbox1bbox2c Cst|}t|}t|d|d}t|d|d}t|d|d}t|d|d}td||}td||}||} t|} t|} |dkrY| | | } n|dkrdt| | } n|dkrot| | } ntd|d | dkr}d S| | S) a Calculate the overlap ratio between two bounding boxes using NumPy. Args: bbox1 (np.ndarray, list or tuple): The first bounding box, format [x_min, y_min, x_max, y_max] bbox2 (np.ndarray, list or tuple): The second bounding box, format [x_min, y_min, x_max, y_max] mode (str): The mode of calculation, either 'union', 'small', or 'large'. Returns: float: The overlap ratio value between the two bounding boxes rrrr r{r~rz Invalid mode z-, must be one of ['union', 'small', 'large'].g)r r;maximumminimumrr) rrr}Z x_min_interZ y_min_interZ x_max_interZ y_max_interZ inter_widthZ inter_heightZ inter_areaZ bbox1_areaZ bbox2_areaZref_arearrrcalculate_overlap_ratios.   r src_boxesr`csdd|D}ttt|D]}||d\}}}}||||}} |dks-| dkr2|t|dt|D]} |vsE| vrFq;t||d|| dd} ||ddksd|| ddkr| d kr||ddkru||| ddkr| q;| d kr|d krd ||vrt||d || d d} | d krq;t||d} t|| d}||d|| dh}|hd @rt|dkrd|vs|hd krq;| |kr| q;|q;qfddt|D}|S)a% Remove overlapping boxes from layout detection results based on a given overlap ratio. Args: boxes (Dict[str, List[Dict]]): Layout detection result dict containing a 'boxes' list. Returns: Dict[str, List[Dict]]: Filtered dict with overlapping boxes removed. cSsg|] }|ddkr|qS)r referencer)r/r_rrrr2Vr3z filter_boxes..rr[rr~rZinline_formula?gffffff?rrrY>rrrZsealrcsg|] \}}|vr|qSrr)r/rMr_Zdropped_indexesrrr2r3)r@r=r<addrrrr?)rr`rkr0rrrrrrjZ overlap_ratioZpoly_overlap_ratioZ box_area_iZ box_area_jrZ out_boxesrrr filter_boxesJsR      &rskip_order_labelscCs<d}|D]}|d}||vr||d<|d7}qd|d<q|S)a? Update the 'order_index' field of each box in the provided list of boxes. Args: boxes (List[Dict]): A list of boxes, where each box is represented as a dictionary with an 'order_index' field. Returns: None. The function updates the 'order_index' field of each box in the input list. rrrNr)rkrZ order_indexr_rrrrupdate_order_indexs   r2cCszddlm}Wn tytdw||}tdd|D}tdd|D}t|D](} ||| } } | || |} } || | | | }||rVt| t| fSq.t|t|fS)NrrrcSg|]}|dqSrrr/prrrr2z'find_label_position..cSr)rrrrrrr2r)rrrrr=Z intersectsr7)r_rYZtext_wZtext_hZ max_shiftrrJZmin_xZmin_yZdyrrrrZ label_rectrrrfind_label_positions    rcsHeZdZdZ ddeeedeeeddffdd Z   dd e d e eefd e e e fd eed ee e e e e fe fdee ee fdee deedeee defddZ       ddee dee d ee e e fd eed ee e e e e ffdeedeedeedeeedeefddZZS)LayoutAnalysisProcesszSave Result Transform This class is responsible for post-processing detection results, including thresholding, non-maximum suppression (NMS), and restructuring the boxes based on the input type (normal or rotated object detection). Nr scale_sizercst||_||_dS)aInitialize the DetPostProcess class. Args: threshold (float, optional): The threshold to apply to the detection scores. Defaults to 0.5. labels (Optional[List[str]], optional): The list of labels for the detection categories. Defaults to None. layout_postprocess (bool, optional): Whether to apply layout post-processing. Defaults to False. N)super__init__rr)selfrr __class__rrrs  zLayoutAnalysisProcess.__init__rzrkr threshold layout_nmslayout_unclip_ratiolayout_merge_bboxes_moderlr`rYc +s|dkrddt|ddddft|ddddf<t|tr[|dddf|k|dddfdk@} || ddf}durK| dfdurZfd d t| Dnt|trg} durig} durog} t|dddfD]y}||dddf|k}dur|dddf|k}durfd d t |dddf|kdD}| t|d }|dddf|k|dddfdk@}dur||}| |dur| d d t ||D| ||qz| rt| ntg}dur| r t| ntgdur| |rNt|ddddfddd}t||}dur@fdd |DdurNfdd |Dd}|r4t|dkr4|jddvr4|d|dkrnd}nd}d|jvr||jdnd}|d|d}g}g}g}t|D]y\}}|dd\}}}} }!}"||krtd|}td| } t|d|!}!t|d|"}"|!||"| }#|#||kr| |dur| |dur| |q| |dur| |dur| |qt|dkr!|}dur}dur!}t|}dur-|dur4||r9d|jvrC|jdnd}$t|tr|dvsWJd||dkr]nt|ddddf|$\|dkr|dk}durfdd tDn|dkr|dkdkB}durfdd tDnt|tr9tjt|td |D]X\}%}&|&dvsJd|&|&dkrӐq|&dkrt|ddddf|$|%|&d!\dkMq|&dkrt|ddddf|$|%|&d!\dkdkBMq|}dur)fd"d tDdur9fd#d tD|jdkrDtgS|jdd$krt|ddd%f |dddff}'||'}(|(ddddf}dur~fd&d |'D})|)durfd'd |'D|jdd%krt|dddf}'||'}(|(ddddf}durfd(d |'D})|)durˇfd)d |'Ddurdurd*d t |j |D}*t!|t|*|n durt"|||r.t|tr||f}n%t|t#t$frt|dksJd+nt|trn t%d,t&|d-t'||}|jddkrA t(||j|}|S t%d.|jd)/a Apply post-processing to the detection boxes. Args: boxes (ndarray): The input detection boxes with scores. img_size (tuple): The original image size. Returns: Boxes: The post-processed detection boxes. rrNrr[rrr4.csg|] \}}|r|qSrr)r/r0keeprYrrr2s z/LayoutAnalysisProcess.apply..cg|]}|qSrrr8rrrr2srcSsg|]\}}|r|qSrr)r/rJrrrrr2s r]g\(\?)Ziou_sameZiou_diffcrrrr8rlrrr2rcrrrr8rrrr2rT)r[g= ףp=?g(\?rZformula)r{rr~z\The value of `layout_merge_bboxes_mode` must be one of ['union', 'large', 'small'], but got r{rcs g|] \}}|dkr|qSrrr/r0rV)contained_by_otherrrr2es  r~cs,g|]\}}|dk|dkBr|qS)rrrr)rcontains_otherrrr2ms  rvr|cg|] \}}|r|qSrrr keep_maskrrr2r3crrr)r/r0rJrrrr2s  rrcrrrr8rrrr2rcrrrr8rrrr2rcrrrr8rrrr2rcrrrr8rrrr2rcSsg|]\}}||qSrr)r/rsrrrr2sz0The length of `layout_unclip_ratio` should be 2.zqThe type of `layout_unclip_ratio` must be float, Tuple[float, float] or Dict[int, Tuple[float, float]], but got .z1The shape of boxes should be 6 or 10, instead of ))r rfrcr7rrr?runiquewheregetr>rArtZvstackr;Z concatenaterr<rbrr,rUrstrrZonesboolitemsrgZlexsortrrrsrurGrCrtyperr)+rrkrrrrrrlr`rYZ expect_boxesZcategory_filtered_boxesZcategory_filtered_masksZ category_filtered_polygon_pointsZcat_idZcategory_boxesZcategory_masksZcategory_polygon_pointsZcategory_thresholdZselected_indicesZfilter_large_imageZ area_thresZ image_indexZimg_areaZfiltered_boxesZfiltered_masksZfiltered_polygon_pointsrMr_Z label_indexrrrrrZbox_areaZ formula_indexZcategory_indexZ layout_modeZ sorted_idxZ sorted_boxesZ sorted_masksrmr)rrrrlrYrapplys0 (           $                                     (         zLayoutAnalysisProcess.apply batch_outputsdatasfilter_overlap_boxesrc  Csg} tt||D]`\} \} } |}d| vr| d}d}n"d| vr'd}| d}nd}| dkr:|dvr:td|dd}d}|j| d | d |||||||d }|rWt||}| dur]| nt} t|| }| |q | S) aApply the post-processing to a batch of outputs. Args: batch_outputs (List[dict]): The list of detection outputs. datas (List[dict]): The list of input data. Returns: List[Boxes]: The list of post-processed detection boxes. rlNrYrrr)rrrzzcThe model you are using does not support polygon output, but the layout_shape_mode is specified as z, which will be set to 'rect'rkZ ori_img_sizer) r?rtr warningrrSKIP_ORDER_LABELSrr>)rrrrrrrr`rrZoutputsrMdataoutputZcurrent_layout_shape_moderlrYrkrrr__call__sH     zLayoutAnalysisProcess.__call__)NN)NrzN)NNNNNNN)__name__ __module__ __qualname____doc__rrrr7rrrrrrrBoxesrr __classcell__rrrrrs          r)r')r*r+)rRT)N)r{)r)2typingrrrrrnumpyr rutilsr Z utils.depsr r Zutils.benchmarkr Zobject_detection.processorsrrrTrrr7rNumberrrr&r)rQrZrsrurerjrrrrrrrrCrGrrrrZtimeitrrrrrs      g ; =!  -:  &  1 >