3fi6dZddlmZddlZddlmZmZddlmZm Z ddl m Z ddl m Z ddlmZdd lmZdd lmZdd lmZdd lmZdd lmZddlmZmZmZmZmZm Z ddl!m"Z"ddl#m$Z$ddl%m&Z&ddl'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1ddl2m3Z3Gddee Z4dddd d$dZ5d%dZ6d&dZ7de8ee8eddd d'dZ9e ddd de8ee8eddf d(d!Z:de8ee8edddd" d)d#Z;y)*z@LLM Chain for turning a user text query into a structured query.) annotationsN)CallableSequence)Anycast) deprecated)OutputParserException)BaseLanguageModel)BaseOutputParser)parse_and_check_json_markdown)BasePromptTemplate)FewShotPromptTemplate)Runnable) Comparator ComparisonFilterDirective OperationOperatorStructuredQuery)override)LLMChain) get_parser) DEFAULT_EXAMPLESDEFAULT_PREFIXDEFAULT_SCHEMA_PROMPTDEFAULT_SUFFIXEXAMPLE_PROMPTEXAMPLES_WITH_LIMITPREFIX_WITH_DATA_SOURCESCHEMA_WITH_LIMIT_PROMPTSUFFIX_WITHOUT_DATA_SOURCEUSER_SPECIFIED_EXAMPLE_PROMPT) AttributeInfoc^eZdZUdZded< eddZe d d dZy) StructuredQueryOutputParserz-Output parser that parses a structured query.r ast_parsec  ddg}gd}t||}|dt|ddk(rd|d<|ddk(s|dsd|d<n|j|d|d<|jds|j ddt d i|j Dcic] \}}||vs ||c}}Scc}}w#t$r}d|d |}t||d}~wwxYw) Nqueryfilter)r(r)limitr NO_FILTERr*z Parsing text z raised following error: ) r lenr&getpopritems Exceptionr ) selftext expected_keys allowed_keysparsedkvemsgs m/var/www/auto_recruiter/arenv/lib/python3.12/site-packages/langchain_classic/chains/query_constructor/base.pyparsez!StructuredQueryOutputParser.parse2s 4$h/M7L24GFg&#fWo*>!*C"%wh;.fX6F#'x #'>>&2B#Cx ::g& 7D)"$*LLNHDAqa<6G1a4H H 4"4&(DQCHC',! 3 4s0BB6 B0%B0*B60B66 C?CCNc`|r dfd }ntj}||S)ajCreate a structured query output parser from components. Args: allowed_comparators: allowed comparators allowed_operators: allowed operators allowed_attributes: allowed attributes fix_invalid: whether to fix invalid filter directives Returns: a structured query output parser chtdtj|}t|S)NFilterDirective | Noneallowed_comparatorsallowed_operatorsallowed_attributes)rrr=fix_filter_directive) raw_filterfilter_directiverDrBrCs r<r&z>StructuredQueryOutputParser.from_components..ast_parse]s<#',L&&z2$ ,$(;&7'9 rA)r&)rFstrreturnr@)rr=)clsrBrCrD fix_invalidr&s ``` r<from_componentsz+StructuredQueryOutputParser.from_componentsGs>(   #$7"3#5e  Y''rH)r4rIrJr)NNNF) rBSequence[Comparator] | NonerCSequence[Operator] | NonerDSequence[str] | NonerLboolrJr%) __name__ __module__ __qualname____doc____annotations__rr= classmethodrMr-rHr<r%r%,ss7S 44(<@7;37! '(8'(5'(1 '(  '( % '('(rHr%rAc |s|s|r|s|St|tr$|r|j|vry|r|j|vry|St|tr|r|j |vry|j Dcgc]}|tdt||||}}|syt|dk(r1|j tjtjfvr|dSt |j |S|Scc}w)ahFix invalid filter directive. Args: filter: Filter directive to fix. allowed_comparators: allowed comparators. Defaults to all comparators. allowed_operators: allowed operators. Defaults to all operators. allowed_attributes: allowed attributes. Defaults to all attributes. Returns: Fixed filter directive. NrrAr)operator arguments) isinstancer comparator attributerrZr[rrEr.rANDOR)r)rBrCrDargargss r<rErErs&!$59K  &*% 6#4#4foo(,, 1LL7N__   M+  s."C-ci}|D]!}t|}|||jd<#tj|dj ddj ddS)Nnameindent{{{}}})dictr0jsondumpsreplace)info info_dictsii_dicts r<_format_attribute_inforts_J 0a)/ 6::f%&0 ::j + 3 3C > F FsD QQrHcg}t|D]Y\}\}}tj|djddjdd}|dz||d}|j |[|S) zConstruct examples from input-output pairs. Args: input_output_pairs: Sequence of input-output pairs. Returns: List of examples. rerfrhrirjrkrY)rr user_querystructured_request) enumeratermrnroappend)input_output_pairsexamplesrr_inputoutputrwexamples r<construct_examplesrsH();< ! FF JJva ( 0 0d ; C CC N Q "4    ! OrHFr{rBrC enable_limit schema_promptc >|rtnt}|xs|}t|} |jdj |dj |} |r_t |dt rLt|}t} tj| || } tjt|dz} nR|xs|rtnt}t} tj| } t!jt|dz|| } t#d t%|| d g| | d |S) aCreate query construction prompt. Args: document_contents: The contents of the document to be queried. attribute_info: A list of AttributeInfo objects describing the attributes of the document. examples: Optional list of examples to use for the chain. allowed_comparators: Sequence of allowed comparators. allowed_operators: Sequence of allowed operators. enable_limit: Whether to enable the limit operator. schema_prompt: Prompt for describing query schema. Should have string input variables allowed_comparators and allowed_operators. kwargs: Additional named params to pass to FewShotPromptTemplate init. Returns: A prompt template that can be used to construct queries. z | )rBrCr)schemacontent attributesrY)rr)r)rrrrr()r{example_promptinput_variablessuffixprefixr-)r rrtformatjoinr\tuplerr"rr!r.rrrrrrlist)document_contentsattribute_infor{rBrCrrkwargsdefault_schema_prompt attribute_strrrrrs r<get_query_constructor_promptrs/:%1 6K":%:M*>:M  ! !!JJ':;**%67"FJx{E2%h/6(//%$  ,22S]Q5FG #/ 5E (&&f5&&(ma%$  ! h%      rHz0.2.13load_query_constructor_runnablez1.0)since alternativeremovalc t|||||||} |D cgc]#} t| tr | jn| d%} } tj ||| } | | _td|| | d|Scc} w)a^Load a query constructor chain. Args: llm: BaseLanguageModel to use for the chain. document_contents: The contents of the document to be queried. attribute_info: Sequence of attributes in the document. examples: Optional list of examples to use for the chain. allowed_comparators: Sequence of allowed comparators. Defaults to all `Comparator` objects. allowed_operators: Sequence of allowed operators. Defaults to all `Operator` objects. enable_limit: Whether to enable the limit operator. schema_prompt: Prompt for describing query schema. Should have string input variables allowed_comparators and allowed_operators. **kwargs: Arbitrary named params to pass to LLMChain. Returns: A LLMChain that can be used to construct queries. rrdrA)llmprompt output_parserr-)rr\r#rdr%rMrr) rrrr{rBrCrrrrainforDrs r<load_query_constructor_chainr sF*/+!#F$ ! 6 E&MI0??/+-@M )F  RF- R6 RRs(A/)r{rBrCrrrLc t||f|||||d| } |D cgc]#} t| tr | jn| d%} } tj ||| |} | |z| zScc} w)aLoad a query constructor runnable chain. Args: llm: BaseLanguageModel to use for the chain. document_contents: Description of the page contents of the document to be queried. attribute_info: Sequence of attributes in the document. examples: Optional list of examples to use for the chain. allowed_comparators: Sequence of allowed comparators. Defaults to all `Comparator` objects. allowed_operators: Sequence of allowed operators. Defaults to all `Operator` objects. enable_limit: Whether to enable the limit operator. schema_prompt: Prompt for describing query schema. Should have string input variables allowed_comparators and allowed_operators. fix_invalid: Whether to fix invalid filter directives by ignoring invalid operators, comparators and attributes. kwargs: Additional named params to pass to FewShotPromptTemplate init. Returns: A Runnable that can be used to construct queries. rrd)rBrCrDrL)rr\r#rdr%rM)rrrr{rBrCrrrLrrrrDrs r<rrFsF* /+!#   F$ ! 6 E&MI0??/+- @M C<- ''s(A#) r)r@rBrNrCrOrDrPrJr@)rpSequence[AttributeInfo | dict]rJrI)rzzSequence[tuple[str, dict]]rJz list[dict])rrIrrr{Sequence | NonerBSequence[Comparator]rCSequence[Operator]rrQrBasePromptTemplate | NonerrrJr )rr rrIrrr{z list | NonerBrrCrrrQrrrrrJr)rr rrIrrr{rrBrrCrrrQrrrLrQrrrJr)rslF" .*;<:L5A-'1H   LC("2?"CC(R8<37/3 5 "5551 5 - 5  5pR6!%05j0A,1(O/3@@2@ @ . @ * @@-@@@F 1 !05j0A,1(O/32S 2S2S32S 2S . 2S * 2S2S-2S2S2S  2St!%05j0A,1(O/37( 7(7(37(  7( . 7(*7(7(-7(7(7(7(rH