o i e@s<dZddlZddlmmZddlmZGdddZ dS)z:Utility object to handler partial batches for TPUStrategy.N)backendc@s8eZdZdZddZddZddZdd Zd d Zd S) PartialBatchPaddingHandlerzBA container that holds info about partial batches for `predict()`.cCsd|_td|_||_dS)Nr)padded_batch_sizetfzeros padding_mask output_shape)selfrr ]/var/www/myenv/lib/python3.10/site-packages/keras/src/engine/partial_batch_padding_handler.py__init__s  z#PartialBatchPaddingHandler.__init__cCsJt|ttfr |d}tj|sJdd}tjt||dddS)z>Returns the number of elements in a potentially partial batch.rcSs*ddtj|D}|std|dS)NcSsg|] }t|r|qSr )r is_tensor).0xr r r 's  z\PartialBatchPaddingHandler.get_real_batch_size.._find_any_tensor..z(Cannot find any Tensor in features dict.r)rnestflatten ValueError)batch_featurestensorsr r r _find_any_tensor&s  zHPartialBatchPaddingHandler.get_real_batch_size.._find_any_tensorint64)dtype) isinstancetuplelistrrrrcastshape)r dataset_batchrr r r get_real_batch_sizesz.PartialBatchPaddingHandler.get_real_batch_sizecCsD||}|j|}tjt|t|gdd}tj||gddS)z?Calculate and cache the amount of padding required for a batch.raxis)rrr concatenateronesr)r rroriginal_batch_size missing_countmaskr r r update_mask2s  z&PartialBatchPaddingHandler.update_maskcsJfddt|dkr|dSg}|D] }||qt|S)z@Pads the batch dimension of a tensor to the complete batch size.csi}t|tr|D] \}}|||<q |St|j}|dks#Jj|}td|ggddgg|d}t ||dS)z>Helper function to pad nested data within each batch elements.rconstant) rdictitemslenrrrrstackrpad)batchpadded_dict_batchkeyvaluerankr%padding_padr r r r6>s   z2PartialBatchPaddingHandler.pad_batch.._padr(r)r,appendr)r dataset_batch_elementsbatch_elements batch_elementr r5r pad_batch;s  z$PartialBatchPaddingHandler.pad_batchc Cst|j}t|jdksJt|jdkr7tj|t|dt|dd}|jddkr5tj |dd}|Sg}t t|jD]}||}tj|t|dt|dd}| t |q@|S)z;Removes prediction output that corresponds to padded input.r(Nrr ) r get_valuerr,rrnptakenonzerosqueezeranger7)r prediction_resultr prediction predictionsir r r apply_maskXs* z%PartialBatchPaddingHandler.apply_maskN) __name__ __module__ __qualname____doc__r rr'r;rFr r r r rs r) rJnumpyr=tensorflow.compat.v2compatv2r keras.srcrrr r r r s