o /iD @sLdZddlZddlZddlZddlZddlZddlZddlZddlZddl m Z m Z m Z ddl mZmZmZmZmZmZmZddlmZddlmZerdddlmZdd lmZdd lmZdd lm Z ed Z!ed e"dZ#ee#e$fZ%e&e'Z(de)ee$ffddZ*de ee!de+e!fddZ,dee-e$fde$fddZ.ddde/ee-e$fefde0de/e$effddZ1de$dedeffd d!Z2de$de3d"fd#d$Z4de$de3d%fd&d'Z5de$de3d(fd)d*Z6d+e$de$fd,d-Z7d.e$de$fd/d0Z8dejfd1d2Z9d3Z:d4ejde$fd5d6Z;d7e$dejfd8d9ZZ>ed:d%de+d%fd?d>Z>ed:ed%e$e ed%e$ffde+ed%e$ffd@d>Z>ed:e e#de+e#fdAd>Z>ed:e#de+e#fdBd>Z>dCd>Z>de?fdDdEZ@dide3fdFdGZAdHee-e$fdejfdIdJZBdKeee?eCe$fdee?fdLdMZDdNdOde)e?e?e?ffdPdQZEdRdSZFdTe e!dUe?de e e!ddffdVdWZGdidXe$dYee?de$fdZd[ZH did\ee$d]ed^e/eefdYee?dee$f d_d`ZIdae ee$d(fde+e$fdbdcZJdae ee$d(fdedOfdddeZKdfe$de)e$e$ffdgdhZLdS)jz Miscellaneous helper functions. The formatter for ANSI colored console output is heavily based on Pygments terminal colorizing code, originally by Georg Brandl. N) GeneratorIterableSequence) TYPE_CHECKINGAnyCallableOptionalTypeVarUnionoverload) ResponseError)TimeoutFormatError)RedisJobQueueWorker_T_O)boundreturncCst|r |j|jfSt|st|r d|jd|jfSt|t r+dt |fSt |s9t |dr9|dfSt d|)aResolve a function reference into instance and function name components. Args: func: The function reference to resolve - can be a method, function, builtin, string path, or callable class instance. Returns: A tuple of (instance, func_name) where: - instance: The object instance (for methods/callable instances) or None - func_name: The string representation of the function name/path Raises: TypeError: If func is not a valid callable or string reference. N.__call__z*Expected a callable or a string, but got: )inspectismethod__self____name__ isfunction isbuiltin __module__ __qualname__ isinstancestras_textisclasshasattr TypeError)funcr+H/var/www/html/flask_server/venv/lib/python3.10/site-packages/rq/utils.pyresolve_function_reference1s    r-lstcCsdd|DS)zExcludes `None` values from a list-like object. Args: lst (list): A list (or list-like) object Returns: object (list): The list without None values cSsg|]}|dur|qSNr+).0itemr+r+r, Uszcompact..r+)r.r+r+r,compactLs r3vcCs2t|tr |dSt|tr|Stdt|)zConverts a bytes value to a string using `utf-8`. Args: v (Union[bytes, str]): The value (bytes or string) Raises: ValueError: If the value is not bytes or string Returns: value (str): The decoded string zutf-8zUnknown type %r)r$bytesdecoder% ValueErrortype)r4r+r+r,r&Xs  r&F) decode_valueshr9cCs0|r tdd|DStdd|DS)aDecodes the Redis hash, ensuring that keys are strings Most importantly, decodes bytes strings, ensuring the dict has str keys. Args: h (Dict[Any, Any]): The Redis hash decode_values (bool): If True, also decode values to strings using as_text(). Defaults to False. Returns: Dict[str, Any]: The decoded Redis data (Dictionary) When decode_values=True, returns Dict[str, str] css$|] \}}t|t|fVqdSr/r&r0kr4r+r+r, ys"z$decode_redis_hash..css |] \}}t||fVqdSr/r;r<r+r+r,r>zs)dictitems)r:r9r+r+r,decode_redis_hashls rAname.c Cs|d}|dd|dg}}d}t|r9z d|}t|}Wnty4|d|Ynwt|s|durQzt|WSt yPt d|wd|}t ||r`t ||S|}d|}zt ||}Wn t d|t ||st d|t ||S)a#Returns an attribute from a dotted path name. Example: `path.to.func`. When the attribute we look for is a staticmethod, module name in its dotted path is not the last-before-end word E.g.: package_a.package_b.module_a.ClassA.my_static_method Thus we remove the bits from the end of the name until we can import it Args: name (str): The name (reference) to the path. Raises: ValueError: If no module is found or invalid attribute name. Returns: Any: An attribute (normally a Callable) rNrzInvalid attribute name: zInvalid attribute name: %s) splitlenjoin importlib import_module ImportErrorinsertpop __builtins__KeyErrorr7r(getattr) rB name_bitsmodule_name_bitsattribute_bitsmodule module_nameattribute_nameattribute_owner_nameattribute_ownerr+r+r,import_attribute}s<              rWrcCHt|}t|tstd|ddlm}t||s"td||S)z.Import a worker class from a dotted path name.zInvalid worker class: r r)rWr$r8r7workerr issubclass)rBclsrr+r+r,import_worker_class   r\rcCrX)z+Import a job class from a dotted path name.zInvalid job class: r r)rWr$r8r7jobrrZ)rBr[rr+r+r,import_job_classr]r_rcCrX)z-Import a queue class from a dotted path name.zInvalid queue class: r r)rWr$r8r7queuerrZ)rBr[rr+r+r,import_queue_classr]ra config_pathcCsftjj|vp |d}|s|S|}|dr|dd}|tjjr)|dd}|tjjd}|S)a"Normalize configuration path to dotted module path format. Converts file paths like 'directory/config_file.py' or 'directory.config_file' to dotted module paths like 'directory.config_file' for use with importlib.import_module(). Args: config_path: Either a file path (e.g., 'app/cron_config.py', 'app/cron_config') or a dotted module path (e.g., 'app.cron_config') Returns: A dotted module path suitable for importlib.import_module() Examples: normalize_config_path('app/cron_config.py') -> 'app.cron_config' normalize_config_path('app/cron_config') -> 'app.cron_config' normalize_config_path('app.cron_config') -> 'app.cron_config' normalize_config_path('/abs/path/to/config.py') -> 'abs.path.to.config' z.pyNr r)ospathsependswith startswithreplace)rb is_file_path normalizedr+r+r,normalize_config_paths   rl file_pathcCs<tj|std|dtj|std|d|S)amValidate that an absolute file path exists and points to a file. Args: file_path: The absolute file path to validate Returns: The same file path if validation passes (for chaining) Raises: FileNotFoundError: If the file does not exist IsADirectoryError: If the path points to a directory instead of a file Examples: validate_absolute_path('/path/to/config.py') # Returns '/path/to/config.py' validate_absolute_path('/path/to/missing.py') # Raises FileNotFoundError validate_absolute_path('/path/to/directory') # Raises IsADirectoryError z!Configuration file not found at ''z7Configuration path points to a directory, not a file: ')rdreexistsFileNotFoundErrorisfileIsADirectoryError)rmr+r+r,validate_absolute_path s  rscCstjtjjS)zReturn now in UTC)datetimenowtimezoneutcr+r+r+r,ru%sruz%Y-%m-%dT%H:%M:%S.%fZdtcCs|ttSr/)strftimer&_TIMESTAMP_FORMAT)rxr+r+r, utcformat-sr{stringcCsDz tj|t}Wntytj|d}Ynw|jtjjdS)Nz%Y-%m-%dT%H:%M:%SZ)tzinfo)rtstrptimerzr7rirvrw)r|parsedr+r+r,utcparse1s  robjcCst|to t|t S)zReturns whether the obj is an iterable, but not a string Args: obj (Any): _description_ Returns: bool: _description_ )r$rr%rr+r+r,is_nonstring_iterable:s rcCdSr/r+rr+r+r,ensure_job_listFrcCrr/r+rr+r+r,rHrcCrr/r+rr+r+r,rJrcCrr/r+rr+r+r,rLrcCrr/r+rr+r+r,rNrcCs"t|trt|tst|S|gS)zWhen passed an iterable of objects, convert to list, otherwise, it returns a list with just that object in it. Args: obj (Any): _description_ returns: List: _description_ )r$rr%listrr+r+r,rRs" cCsttS)zKReturns current UTC timestamp Returns: int: _description_ )calendartimegmru utctimetupler+r+r+r,current_timestampasrcCs(|dur t||St|trt|S|S)aGet a backend class using its default attribute name or an override Args: holder (_type_): _description_ default_name (_type_): _description_ override (_type_, optional): _description_. Defaults to None. Returns: _type_: _description_ N)rNr$r%rW)holder default_nameoverrider+r+r, backend_classjs   rdate_strcCs*|stdt|trt|St|S)Nz#Empty string or bytestring provided)r7r$r5rr6)rr+r+r, str_to_date}s   rtimeoutc Cst|tjsP|durPzt|}|WStyOt|tsJ|dd|dd}}ddddd}z t|||}Wn ttfyLtdwYnw|durXt|SdS) zGTransfer all kinds of timeout format to an integer representing secondsNrCiQi<r )dr:mszTimeout must be an integer or a string representing an integer, or a string with format: digits + unit, unit can be "d", "h", "m", "s", such as "1h", "23m".) r$numbersIntegralintr7r%lowerrMr)rdigitunit unit_secondr+r+r, parse_timeouts$  r connectionrcCsz.rr)r ) rNr%inforDrEappendsetattrtupler )r version_str version_partsr+r+r, get_versions       rcCs | | S)zCeiling division. Returns the ceiling of the quotient of a division operation Args: a (_type_): _description_ b (_type_): _description_ Returns: _type_: _description_ r+)abr+r+r,ceildivs ra_list segment_sizeccs.tdt||D] }||||Vq dS)zSplits a list into multiple smaller lists having size `segment_size` Args: a_list (Sequence[Any]): A sequence to split segment_size (int): The segment size to split into Yields: list: The splitted listed rN)rangerE)rrrr+r+r, split_lists rdata max_lengthcCs,|dur|St||kr|d|dS|S)aTruncate arguments with representation longer than max_length Args: data (str): The data to truncate max_length (Optional[int], optional): The max length. Defaults to None. Returns: truncated (str): The truncated string Nz...)rE)rrr+r+r,truncate_long_strings  r func_nameargskwargscsZ|durdSfdd|D}fdd|D}|t|7}d|}|d|dS)a Returns a string representation of the call, formatted as a regular Python function invocation statement. If max_length is not None, truncate arguments with representation longer than max_length. Args: func_name (str): The function name args (Any): The function arguments kwargs (Dict[Any, Any]): The function kwargs max_length (int, optional): The max length. Defaults to None. Returns: str: A string representation of the function call. Ncsg|] }ttt|qSr+r&rrepr)r0argrr+r,r2sz#get_call_string..cs,g|]\}}|dttt|qS)=rr<rr+r,r2s,z, ())r@sortedrF)rrrrarg_list list_kwargsr+rr,get_call_strings  rqueues_or_namescCsDddlm}g}|D]}t||r||jq |t|q |S)z;Given a iterable of strings or queues, returns queue namesr r)r`rr$rrBr%)rrnames queue_or_namer+r+r, parse_namess  rcCs.ddlm}|D] }t||r|jSqdS)z7Given a list of strings or queues, returns a connectionr rN)r`rr$r)rrrr+r+r,get_connection_from_queuess   r composite_keycCsD|d}t|dkrtd|t|ddfS|\}}||fS)zMethod returns a parsed composite key. Args: composite_key (str): the composite key to parse Returns: tuple[str, str]: tuple of job id and the execution id :r z4Composite key must contain job_id:execution_id, got r)rDrEwarningswarnDeprecationWarning)rresultjob_id execution_idr+r+r,parse_composite_keys  rr/)M__doc__rrtrGrloggingrrdrcollections.abcrrrtypingrrrrr r r redis.exceptionsr exceptionsrredisrr^rr`rrYrrobjectrr%ObjOrStr getLoggerrloggerrr-rr3r5r&r?boolrArWr8r\r_rarlrsrurzr{rrrrrrrfloatrrrrrrrrrr+r+r+r,s$         45+  6 $ (   ""