i$8dZddlmZdZdZdZGddeZy) zC A library written in CUDA Python for generating reduction kernels ) from_dtype cX ddlmjd| tdzttzjd fdjd fdjd fd fd }j|S) NrcudaT)devicecjj}|tz}|tz}||ddf}|||<jtdz}|r5||kr||} ||||z||<j|dz}|r4yy)z8 Compute reduction within a single warp N) threadIdxx _WARPSIZEsyncwarp) sm_partialsinittidwarpidlaneidsm_thiswidtholdr reduce_ops q/Volumes/fast/ai/experiments/voice-extract-mac/.venv/lib/python3.12/site-packages/numba/cuda/kernels/reduction.pyinner_warp_reductionz1_gpu_reduce_factory..inner_warp_reductions nn !yfai( Q~fo"+C%1H"I MMO aKE c jj} jj} jj} jj}|||zz}|j }||z} ||} t || z|| D]} | || }  j ||  j|dkr+||df||dzdf||df< j|dk(r|d|d||<yy)a Partially reduce `arr` into `partials` using `sm_partials` as working space. The algorithm goes like: array chunks of 128: | 0 | 128 | 256 | 384 | 512 | block-0: | x | | | x | | block-1: | | x | | | x | block-2: | | | x | | | The array is divided into chunks of 128 (size of a threadblock). The threadblocks consumes the chunks in roundrobin scheduling. First, a threadblock loads a chunk into temp memory. Then, all subsequent chunks are combined into the temp memory. Once all chunks are processed. Inner-block reduction is performed on the temp memory. So that, there will just be one scalar result per block. The result from each block is stored to `partials` at the dedicated slot. r rrr)r rN) r rblockIdxblockDimgridDimsizerange syncthreadsr)arrpartialsrrblkidblkszgridszstartstopsteptmpirrrs rdevice_reduce_full_blockz5_gpu_reduce_factory..device_reduce_full_block(s*nn  eem#xxv~%jut|T40ACQ(C1 [#.  7"+KQ,?,7a ,C#EKQ  MMO !8' D(9;t;LMHUO rczjj}jj}jj}|tz}|tz}|j }jj}||} | |||f<j |dztz|kr || n=|dk(r8||ddf} |tz} td|| z D]} | d| | | d<j |dk(r=|tzdz tz} |d}td| D]} ||| df}|||<yy)z This computes reduction on `arr`. This device function must be used by 1 threadblock only. The blocksize must match `arr.size` and must not be greater than 128. r rNr)r rrr rr"r$r#)r%r&rrr'r(rrr"valuerbaser.num_active_warpsresultrrrs rdevice_reduce_partial_blockz8_gpu_reduce_factory..device_reduce_partial_block_sPnn   !yxxnnC&+ FFN#  QJ) #d * e 4{%fai0 )q$+.A!*71:wqz!BGAJ/  !8 % 1A 5)C  &F1./"6;q!t+<=0%HUO rc8jj}jjt f }j j k(r |||n ||||r0|dk(r*j jdk(r |d||d<yyyy)aJ Perform reductions on *arr* and writing out partial reduction result into *partials*. The length of *partials* is determined by the number of threadblocks. The initial value is set with *init*. Launch config: Blocksize must be multiple of warpsize and it is limited to 4 warps. )dtyperN)r rsharedarray _NUMWARPSr r) r%r&ruse_initrrrr/r5 inner_sm_size max_blocksizenbtypers rgpu_reduce_block_stridedz5_gpu_reduce_factory..gpu_reduce_block_stridedsnnkk''M(B.4(6 ==??m + $S(K @ 'X{ C qT]]__%9#HQK6HQK&:8r)numbarjitrr:) fnr>r?rr/r5r<rr=rs ` @@@@@@@r_gpu_reduce_factoryrC s%%b)IMM )M XXTX( XXTX4N4Nl XXTX)%)%V77, 88, --rc(eZdZdZiZdZdZddZy)ReducezCreate a reduction object that reduces values using a given binary function. The binary function is compiled once and cached inside this object. Keeping this object alive will prevent re-compilation. c||_y)z :param functor: A function implementing a binary operation for reduction. It will be compiled as a CUDA device function using ``cuda.jit(device=True)``. N)_functor)selffunctors r__init__zReduce.__init__s   rc|j|f}||jvr|j|}|St|jt|}||j|<|S)N)rG_cacherCr)rHr7keykernels r_compilezReduce._compiles[mmU" $++ [[%F ) 58IJF%DKK  rNcddlm}|jdk7r td||d|}|jj |}|j dkr|S|j|j}ttz}|j |z|z} |j | z } t| |ztdz} | } | r| dz } |j| |j} | r|| ||f|d| | d| |d| r|d| |f|| d| | d|| | j dkDr|d| |f| | |d ||ddj| dd| y| dS) a'Performs a full reduction. :param arr: A host or device array. :param size: Optional integer specifying the number of elements in ``arr`` to reduce. If this parameter is not specified, the entire array is reduced. :param res: Optional device array into which to write the reduction result to. The result is written into the first element of this array. If this parameter is specified, then no communication of the reduction output takes place from the device to the host. :param init: Optional initial value for the reduction, the type of which must match ``arr.dtype``. :param stream: Optional CUDA stream in which to perform the reduction. If no stream is specified, the default stream of 0 is used. :return: If ``res`` is specified, ``None`` is returned. Otherwise, the result of the reduction is returned. rrr zonly support 1D arrayNr )shaper7TF)stream) r@rndim TypeErrorr7typer"rOr:rmin device_arraycopy_to_device)rHr%r"resrrRrrN blocksize size_full size_partial full_blockct partials_sizer&s r__call__zReduce.__call__s(  88q=34 4  et*Cyy~~d# 88a<Ksyy) ) XX*i7 xx)+ 9 19q=A %  Q M$$= $J  3F<F2 3C O4<]l4K4848 :  +F1lF* +C O,4\],C,00<,< > ==1  ,F1mV+ ,Xxu M ? G " "8BQ< " ? A; r)NNrr)__name__ __module__ __qualname____doc__rLrJrOr_rrrErEs F IrrEN)rcnumba.np.numpy_supportrrr:rCobjectrErdrrrgs0.  U.pbVbr