o i e@s6dZddlZddlZddlZddlZGdddZdS)z0Steps per execution autotuning for Keras engine.Nc@sreZdZdZ   dddZddZed d Zejd d Zd d Z ddZ ddZ ddZ ddZ ddZdS)StepsPerExecutionTuneraSteps per execution tuner class. Args: optimizer: The optimizer used for training/evaluation/prediction. Used to measure iterations and global throughput (`optimizer.iterations`/second). spe_variable: A `tf.Variable` representing the `steps_per_execution` variable used during training/evaluation/prediction. Must be updatable with `spe_variable.assign`. interval: Optional int, the amount of seconds to wait between calls to measure throughput and tune `spe_variable`. Defaults to 5. change_spe_interval: Optional int, the number of throughput measurements before tuning. Defaults to 10. change_threshold: Optional float, the percent different in throughput to trigger a `steps_per_execution` change. For example, `0.1` triggers changes if throughput ()  皙?cCs2||_||_||_||_||_t|_d|_dSN) optimizer_steps_per_executionintervalchange_spe_intervalspe_change_threshold threadingEventsteps_per_execution_stop_eventthread)selfr spe_variabler r change_thresholdrZ/var/www/myenv/lib/python3.10/site-packages/keras/src/engine/steps_per_execution_tuning.py__init__+s  zStepsPerExecutionTuner.__init__cCs@|jr |jr |jS|tj|jdd|_|j|jS)zStarts steps per execution tuning thread. Returns a `threading.Thread` which will run every `self.interval` seconds to measure throughput and tune steps per execution. T)targetdaemon)ris_alive _begin_tuningr Thread"_steps_per_execution_interval_callstartrrrrr;s zStepsPerExecutionTuner.startcCs|jS)z>Settable attribute representing`steps_per_execution` variable.)rrrrrsteps_per_executionJsz*StepsPerExecutionTuner.steps_per_executioncCs|j|||_dSr)rassigninit_spe)rvaluerrrrOs  cCs2|js||j|j|jrdSdSr)ris_set_measure_and_tunewaitr rrrrrTs z9StepsPerExecutionTuner._steps_per_execution_interval_callcCsZt|_|jj|_|j|_|j|jd|_ g|_ d|_ d|_ d|_ d|_dS)N) iteration time_secsrT)time start_timer iterationsnumpyinit_iterationsritemr spe_last_loggedrgsps avg_rgspsprev_avg_rgspsspe_tune_last_action_addspe_measurement_countrrrrrYs  z$StepsPerExecutionTuner._begin_tuningcCs|js |jdSdS)z(Stops steps per execution tuning thread.N)rr"setrrrrstopgs zStepsPerExecutionTuner.stopcCs2d}|jddkr d}|j|jdko|jo| S)NFrT)r.r2r )repoch_boundaryrrr _should_tunelsz#StepsPerExecutionTuner._should_tunec Cst|jt|j|_d|j|j}d|j|j}|jr#d}d}nd}d}|j}|jj d}| }|j|kr@||}n|j|krO||}|j |_n|}||krX|}n|dkr_|j }|j t||j|_dS)aChanges the steps per execution using the following algorithm. If there is more than a 10% increase in the throughput, then the last recorded action is repeated (i.e. if increasing the SPE caused an increase in throughput, it is increased again). If there is more than a 10% decrease in the throughput, then the opposite of the last action is performed (i.e. if increasing the SPE decreased the throughput, then the SPE is decreased). g?g?rN)sumr.lenr/r r0r1rdtypemaxr*r,r rnpround) rfast_thresholdslow_thresholdrepeat_action_multopposite_action_multr spe_limit current_spenew_sperrr_tunews.        zStepsPerExecutionTuner._tunecCs|jd7_|jj}t}||jd||jd}|j|t|j|j kr3|j d|dkr<||_ dS||jd<||jd<z| rR| WdSWdStyctdYdSw)Nr8r%r&rz,Steps per execution autotuner failed to run.)r2rr)r*r'r-r.appendr:r popr(r7rF RuntimeErrorlogging exception)r cur_iteration cur_time_secs recent_gspsrrrr#s,         z(StepsPerExecutionTuner._measure_and_tuneN)rrr)__name__ __module__ __qualname____doc__rrpropertyrsetterrrr4r7rFr#rrrrrs"    *r)rRrJr r'r*r=rrrrrs