o "j@sDddlZddlmZdaddZddZdd Zd d Zd d ZdS)N) ParametercCstduo ttdddkS)NZPADDLE_TRAINERS_NUM1)__parallel_ctx__clz__intosgetenvr r c/var/www/html/Deteccion_Ine/venv/lib/python3.10/site-packages/paddle/distributed/parallel_helper.py_is_data_parallel_modesr cCstduS)Nrr r r r _is_parallel_ctx_initializedsrcCstdusJd|adS)Nz-ParallelContext can only be initialized once.r )Zccl_parallel_contextr r r _set_parallel_ctx"s rcCstdusJdtdS)Nz&ParallelContext should be initialized.)rinitr r r r _init_parallel_ctx*s  rcCs@ddlm}|D]}|jrqt|tr|jr||dddqdS)Nr) broadcastrT)Zsync_op) distributedrZis_distributed isinstancerZ trainable) parametersrparamr r r _broadcast_parameters2s r) rZ frameworkrrr rrrrr r r r s