o &jIH @stddlZddlZddlZddddddddddd Zd d ZGd d d eZGd ddeZGdddeZeZ dS)Ni dii,i') scalarimage histogram embeddingsaudiopr_curve roc_curve meta_datatexthyper_parameterscCs|ddd|S)N%_)replace)tagZsub_tagr]/var/www/html/Deteccion_Ine/venv/lib/python3.10/site-packages/visualdl/server/data_manager.py add_sub_tag!src@seZdZdZd"ddZeddZddZd d Zd d Z d dZ ddZ ddZ ddZ ddZddZddZddZddZdd Zd!S)# ReservoirzA map-to-arrays dict, with deterministic Reservoir Sampling. Store each reservoir bucket by key, and each bucket is a list sampling with reservoir algorithm. rcsF|dks |t|krtd|_tfdd_t_dS)aCreates a new reservoir. Args: max_size: The number of values to keep in the reservoir for each tag, if max_size is zero, all values will be kept in bucket. seed: The seed to initialize a random.Random(). num_item_index: The index of data to add. Raises: ValueError: If max_size is not a nonnegative integer. r%Max_size must be nonnegative integer.cstjtdS)N)max_sizerandom_instance)_ReservoirBucket _max_sizerandomRandomrseedselfrr;s z$Reservoir.__init__..N) round ValueErrorr collections defaultdict_buckets threadingLock_mutex)rrrrrr__init__,s  zReservoir.__init__cCs8|jt|jWdS1swYdS)zxReturn all keys in self._buckets. Returns: All keys in reservoir buckets. :return: N)r(listr%keysrrrrr+?s $zReservoir.keyscCs||jvr dSdS)zDetermine if key exists. Args: key: Key to determine if exists. Returns: True if key exists in buckets.keys, otherwise False. TF)r%r+rkeyrrr_exist_in_keysJs zReservoir._exist_in_keyscC|d|}||S)a2Determine if run_tag exists. For usage habits of VisualDL, actually call self._exist_in_keys() Args: run: Identity of one tablet. tag: Identity of one record in tablet. Returns: True if run_tag exists in buckets.keys, otherwise False. /)r/rrunrr.rrr exist_in_keysU zReservoir.exist_in_keyscCs&|j}||vr td||j|jS)NKey %s not in buckets.keys())r+KeyErrorr%num_items_indexrr.r+rrr_get_num_items_indexds  zReservoir._get_num_items_indexcCr0)Nr1)r:r2rrrget_num_items_indexjs  zReservoir.get_num_items_indexcCsP|j}|j||vrtd||j|jWdS1s!wYdS)zGet items with tag "key" Args: key: Key to finding bucket in reservoir buckets. Returns: One bucket in reservoir buckets by key. r6N)r+r(r7r%itemsr9rrr _get_itemsns    $zReservoir._get_itemscCr0)a%Get items with tag 'run_tag' For usage habits of VisualDL, actually call self._get_items() Args: run: Identity of one tablet. tag: Identity of one record in tablet. Returns: One bucket in reservoir buckets by run and tag. r1)r=r2rrr get_items}r5zReservoir.get_itemscC<|j|j||WddS1swYdS)aAdd a new item to reservoir buckets with given tag as key. If bucket with key has not yet reached full size, each item will be added. If bucket with key is full, each item will be added with same probability. Add new item to buckets will always valid because self._buckets is a collection.defaultdict. Args: key: Tag of one bucket to add new item. item: New item to add to bucket. N)r(r%add_itemrr.itemrrr _add_item"zReservoir._add_itemcCr?aAdd a new scalar item to reservoir buckets with given tag as key. If bucket with key has not yet reached full size, each item will be added. If bucket with key is full, each item will be added with same probability. Add new item to buckets will always valid because self._buckets is a collection.defaultdict. Args: key: Tag of one bucket to add new item. item: New item to add to bucket. N)r(r%add_scalar_itemrArrr_add_scalar_itemrDzReservoir._add_scalar_itemcCr?rE)r(r%add_scalars_itemrArrr_add_scalars_itemrDzReservoir._add_scalars_itemcCs|d|}|||dS)a"Add a new item to reservoir buckets with given tag as key. For usage habits of VisualDL, actually call self._add_items() Args: run: Identity of one tablet. tag: Identity of one record in tablet. item: New item to add to bucket. r1N)rCrr3rrBr.rrrr@s zReservoir.add_itemcCsx|ddkr|d|}|||dS|ddkr3|dt||jjd|}|||dStd|d)a)Add a new scalar item to reservoir buckets with given tag as key. For usage habits of VisualDL, actually call self._add_items() Args: run: Identity of one tablet. tag: Identity of one record in tablet. item: New item to add to bucket. one_valuevaluer1 tag_valuezNot scalar type:N)Z WhichOneofrGrrMrrIr"rJrrrrFs zReservoir.add_scalar_itemcCs:|j|j|WddS1swYdSN)r(r%cut_tailr-rrr _cut_tails"zReservoir._cut_tailcCs|d|}||dS)aPop the last item in reservoir buckets. Sometimes the tail of the retrieved data is abnormal 0. This method is used to handle this problem. Args: run: Identity of one tablet. tag: Identity of one record in tablet. r1N)rPr2rrrrOs zReservoir.cut_tailN)r)__name__ __module__ __qualname____doc__r)propertyr+r/r4r:r;r=r>rCrGrIr@rFrPrOrrrrr%s$      rc@sReZdZdZdddZddZddZd d Zed d Z ed dZ ddZ dS)rzs*S@ [