o $jJ@sddlmZddlmZmZddlZddlZddlm Z m Z m Z mZddlmZddlmZddlmZddlmZmZdd lmZmZmZdd lmZdd lmZm Z dd l!m"Z"m#Z#m$Z$dd l%m&Z&ddl'm(Z(ddl)m*Z*m+Z+ddl,m-Z-m.Z.erddl/m0Z0ddl1m2Z2m3Z3m4Z4m5Z5m6Z6ddl7m8Z8ddl)m9Z9m:Z:dPddZ;dQd!d"ZdTd3d4Z?dUd6d7Z@dVd=d>ZAGd?d@d@ZBdWdDdEZCdXdHdIZDdYdLdMZEdZdNdOZFdS)[) annotations) TYPE_CHECKINGcastN)NaTalgos internalslib)NA)cache_readonly)find_stack_level)ensure_dtype_can_hold_nafind_common_type)is_1d_only_ea_dtype is_scalarneeds_i8_conversion) concat_compat)ExtensionDtype SparseDtype)is_valid_na_for_dtypeisnaisna_all)ensure_wrapped_if_datetimelike) ArrayManager)ensure_block_shape new_block_2d) BlockManager make_na_array)Sequence) ArrayLikeAxisIntDtypeObj Manager2DShape)Index)BlockBlockPlacementmgrslist[ArrayManager]axes list[Index] concat_axisrreturnr!cCs4|dkr |d||S|dksJ|d||S)z Concatenate array managers into one. Parameters ---------- mgrs_indexers : list of (ArrayManager, {axis: indexer,...}) tuples axes : list of Index concat_axis : int Returns ------- ArrayManager r)Zconcat_verticalconcat_horizontal)r&r(r*r.]/var/www/html/Deteccion_Ine/venv/lib/python3.10/site-packages/pandas/core/internals/concat.py_concatenate_array_managersFs r0copyboolcs|o|dk}t|ddtrt|||}t|||S|dkr-t|||}|d||St|dkrt|ddjdkrt|ddjdjt j t j fvrtt fdd|Drtt|dkrtt dd|D}t||}t|f|St|||}t|dkr|d}|jdd} || _| St|} g} | D]c\} } | d}|j}t| rdd | D}|jst j|dd }nt|jrt|dd d }t|d d}nt|dd }t|}|jj|jk}nt| |d}d}|r|j|| d}nt|| d}| |qtt | |S)z Concatenate block managers into one. Parameters ---------- mgrs_indexers : list of (BlockManager, {axis: indexer,...}) tuples axes : list of Index concat_axis : int copy : bool Returns ------- BlockManager rc3s|] \}}t|VqdSN)_is_homogeneous_mgr.0mgr_ first_dtyper.r/ z'concatenate_managers..r,cs|]}t|VqdSr3)lenr6xr.r.r/r;F)deepcSg|]}|jjqSr.)blockvaluesr6Zjur.r.r/ z(concatenate_managers..axisTrJZea_compat_axis)ndim)r1) placement) isinstancer_maybe_reindex_columns_na_proxyr0r-r>nblocksblocksdtypenpfloat64Zfloat32alltuple_concat_homogeneous_fastpathrr1r(_get_combined_planrD_is_uniform_join_units is_extension concatenaterrrrrE_concatenate_join_unitsZmake_block_same_classrappend) mgrs_indexersr(r*r1 needs_copyr&shapenbr7outZ concat_planrRrN join_unitsunitblkvalsrEZfastpathbr.r9r/concatenate_managers^s\               rir_0list[tuple[BlockManager, dict[int, np.ndarray]]]r`list[BlockManager]c Csbg}|D]*\}}|D]\}}|j|||||ddddd}q |r)|s)|}||q|S)z Reindex along columns so that all of the BlockManagers being concatenated have matching columns. Columns added in this reindexing have dtype=np.void, indicating they should be ignored when choosing a column's final dtype. FT)rJr1Z only_sliceZ allow_dupsZ use_na_proxy)itemsZreindex_indexerr1r^)r(r_r`Znew_mgrsr7indexersiindexerr.r.r/rPs    rPr7rr:r cCs<|jdkrdS|jd}|jjr|jjjdksdS|j|kS)zC Check if this Manager can be treated as a single ndarray. r,Fr)rQrRmgr_locs is_slice_likeas_slicesteprS)r7r:rfr.r.r/r4s   r4rar"np.dtyper$c Cs tdd|Dr&dd|D}t|j}tt|d}t||}|Stj||d}|tj kr6t j }nt j }d}|D]8\} } | j d} || } d| vrc|| jdj| d|dd|| fn| jdj|dd|| f<|| 7}q=tt|d}t||}|S) zl With single-Block managers with homogeneous dtypes (that can already hold nan), we avoid [...] css|]\}}| VqdSr3r.)r6r8rmr.r.r/r;z/_concat_homogeneous_fastpath..cSsg|] \}}|jdjjqS)r)rRrETr5r.r.r/rGsz0_concat_homogeneous_fastpath..rrSr,N)rVrTr\rv libinternalsr%sliceremptyrUlibalgosZtake_2d_axis0_float64_float64Ztake_2d_axis0_float32_float32rarRrE) r_rar:ZarrsZarrbprbZ take_funcstartr7rmZmgr_lenendr.r.r/rXs2         rX+list[tuple[BlockPlacement, list[JoinUnit]]]cCsg}|djd}dd|D}t|}t|D]-\}\}}g}t|D]\} } || } t| || |d} t| } || q%|||fq|S)NrcSsg|]}|jqSr.)blknos)r6r7r.r.r/rG/sz&_get_combined_plan..)max_len)rarxZget_concat_blkno_indexers enumerate_get_block_for_concat_planJoinUnitr^)r&ZplanrZ blknos_listpairsindrr|Z units_for_bpkr7blknorbrer.r.r/rY(s  rYr|r%rintrcCsx|j|}t|t|jkr|jjr|jjjdkr|}|S|j|j}t ||}t |t r5| |}|S| |}|S)Nr,)rRr>rprqrrrsZblklocsrorZmaybe_indices_to_slicerOryZslice_block_columnsZtake_block_columns)r7r|rrrfrbZax0_blk_indexerZslcr.r.r/rBs     rc@sPeZdZdddZddd Zdd dZedddZedddZdddZ dS)rrDr$r+NonecCs ||_dSr3)rD)selfrDr.r.r/__init___s zJoinUnit.__init__strcCst|jdt|jdS)N())type__name__reprrD)rr.r.r/__repr__bszJoinUnit.__repr__rSr r2cs|jsdS|j}|jjdkrdS|jtkr'|j}tfdd|jddDS|j}|t ur5|jkr5dS|t ur?t r?dSt |S)z Check that we are all-NA of a type/dtype that is compatible with this dtype. Augments `self.is_na` with an additional check of the type of NA values. FVTc3s|]}t|VqdSr3)rr?rwr.r/r;sruz,JoinUnit._is_valid_na_for..K)order) is_narDrSkindobjectrErVZravel fill_valuerr rr)rrSrfrEna_valuer.rwr/_is_valid_na_fores   zJoinUnit._is_valid_na_forcCs|j}|jjdkr dS|jsdS|j}|jdkrdSt|jtr"dS|jdkr9|d}t |r3t |s5dSt |S|dd}t |rGt |sIdSt dd|DS)NrTFrr,csr=r3)r)r6rowr.r.r/r;rAz!JoinUnit.is_na..) rDrSrZ _can_hold_narEsizerOrrMrrrrV)rrfrEvalr.r.r/rs&     zJoinUnit.is_nacCs|j}|jjdkr dSdS)z{ Will self.is_na be True after values.size == 0 deprecation and isna_all deprecation are enforced? rTFrDrSr)rrfr.r.r/)is_na_after_size_and_isna_all_deprecations z2JoinUnit.is_na_after_size_and_isna_all_deprecation empty_dtypercCs|dur|jjjdkr|jjS|}||r<|jj}|tdkr4ttj|jj}|jr4|ddur4d}t ||jj |S|jjS)Nrr)rr) rDrSrrErrTrZndarrayrrra)rr upcasted_narZ blk_dtyperEr.r.r/get_reindexed_valuess zJoinUnit.get_reindexed_valuesN)rDr$r+r)r+r)rSr r+r2)r+r2)rr r+r) r __module__ __qualname__rrrr rrrr.r.r.r/r^s      rrdlist[JoinUnit]rcst|\}tdd|D}t|fdd|D}tdd|Dr;dd|D}t|ddd }t|d }nt|d d }|krS|jkrStjd tt d|S)zB Concatenate values from several join units along axis=1. cs|] }|jjjdkVqdSrNrr6rer.r.r/r;r<z*_concatenate_join_units..csg|] }|jdqS)rr)rrFrr.r/rGs z+_concatenate_join_units..css|]}t|jVqdSr3rrSr6tr.r.r/r;rucSs*g|]}t|jr |n|dddfqS)rNrrr.r.r/rGs rTrKrLr,rIaThe behavior of DataFrame concatenation with empty or all-NA entries is deprecated. In a future version, this will no longer exclude empty or all-NA columns when determining the result dtypes. To retain the old behavior, exclude the relevant entries before the concat operation.) stacklevel) _get_empty_dtypeany_dtype_to_na_valuerrrSwarningswarn FutureWarningr )rdr1Zempty_dtype_futurehas_none_blocksZ to_concatZ concat_valuesr.rr/r]s*       r]rSrcCsrt|tr|jS|jdvr|dS|jdvr|dS|jdkr#dS|jdvr/|s,dStjS|jdkr7tjSt) z2 Find the NA value to go with this dtype. ZmMrfcNaNrhNiuO)rOrrrrrTnanNotImplementedError)rSrr.r.r/rs        rSequence[JoinUnit]tuple[DtypeObj, DtypeObj]cCstdd|Dr|djj}||fStdd|D}dd|D}t|s/dd|D}t|}|r9t|}|}t|t|krgdd|D}t|sUd d|D}t|t|krgt|}|rgt|}||fS) z Return dtype and N/A values to use when concatenating specified units. Returned N/A value may be None which means there was no casting involved. Returns ------- dtype cSrCr.)rDrSrFr.r.r/rGrHz$_get_empty_dtype..rcsrrrrr.r.r/r;r<z#_get_empty_dtype..cSg|] }|js|jjqSr.)rrDrSrr.r.r/rGscS"g|] }|jjjdkr|jjqSrrrr.r.r/rG cSrr.)rrDrSrr.r.r/rG*s cSrrrrr.r.r/rG0r)rZdtypes_all_equalrDrSrr>r r )rdrrZdtypesrSZ dtype_futureZ dtypes_futurer.r.r/rs4 rcsX|djjjdkr dStfdd|Do+tfdd|Do+tdd|DS)z Check if the join units consist of blocks of uniform type that can be concatenated using Block.concat_same_type instead of the generic _concatenate_join_units (which uses `concat_compat`). rrFc3s"|] }t|jtuVqdSr3)rrDrFfirstr.r/r;Hs z)_is_uniform_join_units..c3s,|]}|jjjkp|jjjdvVqdS)ZiubNrrFrr.r/r;Ks   css |] }|j p |jjVqdSr3)rrDr[rFr.r.r/r;Us)rDrSrrV)rdr.rr/rZ<s    rZ)r&r'r(r)r*rr+r!)r(r)r*rr1r2r+r!)r(r)r_rjr`r2r+rk)r7rr:r r+r2)rar"r:rtr+r$)r&rkr+r) r7rr|r%rrrrr+r$)rdrr1r2r+r)rSr rr2)rdrr+r)rdrr+r2)G __future__rtypingrrrnumpyrTZ pandas._libsrrr{rrxrZpandas._libs.missingr Zpandas.util._decoratorsr Zpandas.util._exceptionsr Zpandas.core.dtypes.castr r Zpandas.core.dtypes.commonrrrZpandas.core.dtypes.concatrZpandas.core.dtypes.dtypesrrZpandas.core.dtypes.missingrrrZpandas.core.constructionrZ#pandas.core.internals.array_managerrZpandas.core.internals.blocksrrZpandas.core.internals.managersrrcollections.abcrZpandas._typingrrr r!r"Zpandasr#r$r%r0rirPr4rXrYrrr]rrrZr.r.r.r/sD            l " /  k . .