g3fiKUdZddlmZddlZddlZddlZddlmZmZm Z m Z m Z m Z ddl mZmZmZddlmZddlmZmZmZmZddlmZdd lmZmZmZmZmZdd l m!Z!m"Z"dd l#m$Z$dd l%m&Z&m'Z'dd l(m)Z)m*Z*m+Z+m,Z,ddl-m.Z.erddl/m0Z0m1Z1ddl%m2Z2m3Z3ne4ezdzZ1Gdde$dZ5Gdde$dZ6gdZ7gdZ8dZ9eddZ:de;d< d/dZ d3d!Z?dddddd" d4d#Z@d5d$ZA d1 d6d%ZB d1 d7d&ZCd8d'ZD d9d(ZEed)ZFed*ZGGd+d,eZHe d:d-ZI d;d.ZJy)z&_set_config_context..s"!'?;shandlersparent) rAsetgetgetattrnextrun_mapr5rr)config config_tokencurrent_contextr4rCtracerruns r._set_config_contextrVs-008LOjj- - -$YF FM F#*9j"#E   F NN&&s='9: :S :-/h_-  ((r-c #ZKt}|jt|\}} ||jtj||jt dddddddy#|jtj||jt dddddddwxYww)zSet the child Runnable config + tracing context. Args: config: The config to set. Yields: The config context. N)rK project_namer2r3enabledclient)rrUrVrAresetr)rQctxrR_s r.set_config_contextr^s .Cgg16:OL!   )//>   $     )//>   $    s$B+A)>B+)?B((B+c  tgidti}tjx}rW|j t d|j Dcic]"\}}|||tvr|jn|$c}}|_|j t d|j Dcic]*\}}|#|tvr||tvr|jn|,c}}|,|j D]\}}|tvs|||d|<|jdij D]N\}}|jdrt|ttttfs9||dvsA|dk7sG||d|<P|Scc}}wcc}}w)zEnsure that a config is a dict with all keys present. Args: config: The config to ensure. Returns: The ensured config. N)r2r3r4r:r;r1r;__r3api_key)r1DEFAULT_RECURSION_LIMITrArMupdateritems COPIABLE_KEYScopy CONFIG_KEYS startswithrFr5r9floatbool)rQempty var_configkvkeyvalues r. ensure_configrqs  /  E/2244z4  !+ 0 0 21}1 #5qvvx1<    !' 1}k)91 #5qvvx1<  LLN -DAq # +,n%a( -ii399;+ Ut$53UD"9:5,,y %*E* c "+ L=s 'F(/F c |dkrd|}t|t|tr+t||k7rdt|d|d}t|t|trt t t |S|dkDrt|tr|jdtjdtd td |jDcic]\}}|dk7s ||c}}}t|Dcgc]}|r t |n t |c}St|Dcgc] }t |c}Scc}}wcc}wcc}w) azGet a list of configs from a single config or a list of configs. It is useful for subclasses overriding batch() or abatch(). Args: config: The config or list of configs. length: The length of the list. Returns: The list of configs. Raises: ValueError: If the length of the list is not equal to the length of the inputs. rzlength must be >= 0, but got ztt|jdg|jdxsgz|d<y|dk(r-i|jdi|jdxsi|d<|dk(r|jd}|d}t|tra||j |d<t|tr ||z|d<|j }|D]}|j |d||d<7|;||j |d<Rt|tr1|j }|D]}|j |d||d<|j||d<|dk(r|dtk7s|d|d<|tvr||||j ||<||xs|j|||<|S) zMerge multiple configs into one. Args: *configs: The configs to merge. Returns: The merged config. c38K|]}|t|ywrE)rq)rGcs r.rIz merge_configs..`sF =#Fsr3r2r;r4T)inheritr:) rMsortedrLrFryrf add_handlermergerbre)configsbaserQrobase_callbacksthese_callbacksmngrcallbacks r. merge_configsrTsuDGWF291 9Cj $hhz2.$zz*-3$Z %, 60B0HbIJ V &(hh~r2(zz.17R(^$ #!%+!6"("5ot4%-,;,@,@,B[)#ND9,:_,L[) .224(7EH ,,Xt,DE,0[)$0%-,;,@,@,B[)#ND9.335(6EH ,,Xt,DE,0[)-;,@,@,Q[)))+,0GG.45F.GD*+ %&+*A"3K,,.S "3K8488C=S c1 929f Kr-c t|r&|t||j|d<n||d<|t|r||d<||fi|S)aCall function that may optionally accept a run_manager and/or config. Args: func: The function to call. input: The input to the function. config: The config to pass to the function. run_manager: The run manager to pass to the function. **kwargs: The keyword arguments to pass to the function. Returns: The output of the function. r4rQ run_managerrr get_childr funcinputrQrkwargss r.call_func_with_variable_argsrs^,d  "+Fk>S>S>UVF8 %F8 #6t#< +}    r-c t|r&|t||j|d<n||d<|t|r||d<||fi|S)aAsync call function that may optionally accept a run_manager and/or config. Args: func: The function to call. input: The input to the function. config: The config to pass to the function. run_manager: The run manager to pass to the function. **kwargs: The keyword arguments to pass to the function. Returns: The output of the function. rrQrrrs r.acall_func_with_variable_argsrs^0d  "+Fk>S>S>UVF8 %F8 #6t#< +}    r-ctj|jd|jd|jdS)z|Get a callback manager for a config. Args: config: The config. Returns: The callback manager. r4r2r3inheritable_callbacksinheritable_tagsinheritable_metadata)r configurerMrQs r.get_callback_manager_for_configrs;  $ $$jj5F+#ZZ 3 r-ctj|jd|jd|jdS)zGet an async callback manager for a config. Args: config: The config. Returns: The async callback manager. r4r2r3r)rrrMrs r.%get_async_callback_manager_for_configrs; ) )$jj5F+#ZZ 3 r-PTcPeZdZdZ dfd Z dfd ZxZS)ContextThreadPoolExecutorz?ThreadPoolExecutor that copies the context to the child thread.c vt|tdtt j |g|i|S)aSubmit a function to the executor. Args: func: The function to submit. *args: The positional arguments to the function. **kwargs: The keyword arguments to the function. Returns: The future for the function. Callable[..., T])supersubmitrrrrU)selfrargsr __class__s r.rz ContextThreadPoolExecutor.submits; w~ #W\^-?-?%W%WPV%W X  r-ctt|dDcgc] }tc}dfd }t||g|i|Scc}w)a9Map a function to multiple iterables. Args: fn: The function to map. *iterables: The iterables to map over. timeout: The timeout for the map. chunksize: The chunksize for the map. Returns: The iterator for the mapped function. rcFjjg|SrE)poprU)rcontextsfns r. _wrapped_fnz2ContextThreadPoolExecutor.map.._wrapped_fn(s!%8<<>%%b040 0r-)rrreturnr)rrxrrrz)rr iterablesrr]rrrs ` @r.rzzContextThreadPoolExecutor.mapsX"-2#il2C,DEqLNE 1w{     FsA )rCallable[P, T]rP.argsrP.kwargsrz Future[T])rrrz Iterable[Any]rrrz Iterator[T])r(r)r*r+rrz __classcell__)rs@r.rrsaI       (  "      r-rc#K|xsi}t|jd5}|dddy#1swYyxYww)zlGet an executor for a config. Args: config: The config. Yields: The executor. r8) max_workersN)rrM)rQexecutors r.get_executor_for_configr2sB\rF "JJ01  s">2 >;>c HKdfd }|t|trRtjj dt dt tj|d{Stjj ||d{S707w)a,Run a function in an executor. Args: executor_or_config: The executor or config to run in. func: The function. *args: The positional arguments to the function. **kwargs: The keyword arguments to the function. Returns: The output of the function. cF iS#t$r }t|d}~wwxYwrE) StopIteration RuntimeError)excrrrs r.wrapperz run_in_executor..wrapperWs2 ((( ( (C '  (s  Nr)rr) rFr{asyncioget_running_looprun_in_executorrrrrU)executor_or_configrrrrs ``` r.rrEs$(!Z0BD%I--/??  #W\^-?-?%I J   ))+;;rs," XXCC%@@L'R =Ls T!I 6Ye6r   @JT@< )  )? )F  82j+: <+:FI+:+:b-1"&"&*.' !'*' '  '  '(''T?R6:! L!  !  !3!! !R;?! ! ! !8!!!D   $cN CL1 21 h !$$"Y8"Y "Y "Y "Y  "Yr-