3fiZ*ddlZddlZddlmZddlmZmZddlmZddl m Z ddl m Z ddl mZddlmZdd lmZdd lmZdd lmZdd lmZej2eZGd de eeZedgdZdeedeefdZ GddeZ!y)N)Sequence)#AsyncCallbackManagerForRetrieverRunCallbackManagerForRetrieverRun)Document)BaseLanguageModel)BaseOutputParser)BasePromptTemplate)PromptTemplate) BaseRetriever)Runnable)override)LLMChainc0eZdZdZededeefdZy)LineListOutputParserz"Output parser for a list of lines.textreturncj|jjd}ttd|S)N )stripsplitlistfilter)selfrliness f/var/www/auto_recruiter/arenv/lib/python3.12/site-packages/langchain_classic/retrievers/multi_query.pyparsezLineListOutputParser.parses* ""4(F4'((N)__name__ __module__ __qualname____doc__r strrrrrrrs), )#)$s)))rrquestionaYou are an AI language model assistant. Your task is to generate 3 different versions of the given user question to retrieve relevant documents from a vector database. By generating multiple perspectives on the user question, your goal is to help the user overcome some of the limitations of distance-based similarity search. Provide these alternative questions separated by newlines. Original question: {question})input_variablestemplate documentsrcZt|Dcgc]\}}||d|vs|c}}Scc}}w)N) enumerate)r'idocs r_unique_documentsr,-s,' 2 OFAsc2A6NC OO Os''cPeZdZUdZeed<eed<dZeed<dZ e ed< dZ eed < e e d dfded ed ede d zd ed df dZde ded eefdZde ded ee fdZdee ded eefdZde ded eefdZde ded ee fdZdee ded eefdZdeed eefdZy )MultiQueryRetrieverzGiven a query, use an LLM to write a set of queries. Retrieve docs for each query. Return the unique union of all retrieved docs. retriever llm_chainTverboser parser_keyFinclude_originalNllmpromptrc<t}||z|z}||||S)aRInitialize from llm using default template. Args: retriever: retriever to query documents from llm: llm for query generation using DEFAULT_QUERY_PROMPT prompt: The prompt which aims to generate several different versions of the given user query parser_key: DEPRECATED. `parser_key` is no longer used and should not be specified. include_original: Whether to include the original query in the list of generated queries. Returns: MultiQueryRetriever )r/r0r3)r)clsr/r4r5r2r3 output_parserr0s rfrom_llmzMultiQueryRetriever.from_llm?s00-. SL=0 -  rquery run_managercK|j||d{}|jr|j||j||d{}|j |S7L7w)Get relevant documents given a user query. Args: query: user query run_manager: the callback handler to use. Returns: Unique union of relevant documents from all generated queries N)agenerate_queriesr3appendaretrieve_documents unique_unionrr:r;queriesr's r_aget_relevant_documentsz,MultiQueryRetriever._aget_relevant_documents_se..ukBB  NN5 !227KHH   ++ CIs!A)A%6A)A'A)'A)r$cK|jjd|id|jid{}t|jtr|dn|}|j rt jd||S7Iw)zGenerate queries based upon user input. Args: question: user query run_manager: the callback handler to use. Returns: List of LLM generated queries that are similar to the user input r$ callbacksconfigNrGenerated queries: %s)r0ainvoke get_child isinstancerr1loggerinforr$r;responsers rr>z%MultiQueryRetriever.agenerate_queriestsz//  "!6!6!890  %/t~~x$H h << KK/ 7  s3BA?A BrCcKtjfd|Dd{}|Dcgc] }|D]}| c}}S7cc}}ww)zRun all LLM generated queries. Args: queries: query list run_manager: the callback handler to use Returns: List of retrieved Documents c3xK|]1}jj|dji3yw)rFrGN)r/rJrK).0r:r;rs r z:MultiQueryRetriever.aretrieve_documents..sC  &&')>)>)@A's7:N)asynciogather)rrCr;document_listsdocsr+s` ` rr@z'MultiQueryRetriever.aretrieve_documentssU '~~ %   !/?$?3??? @s A A A AA A c|j||}|jr|j||j||}|j |S)r=)generate_queriesr3r?retrieve_documentsrArBs r_get_relevant_documentsz+MultiQueryRetriever._get_relevant_documentssN''{;  NN5 !++G[A   ++rc|jjd|id|ji}t|jtr|dn|}|j rt jd||S)zGenerate queries based upon user input. Args: question: user query run_manager: run manager for callbacks Returns: List of LLM generated queries that are similar to the user input r$rFrGrrI)r0invokerKrLrr1rMrNrOs rrZz$MultiQueryRetriever.generate_queriessl>>((  "!6!6!89) %/t~~x$H h << KK/ 7 rcg}|D]@}|jj|d|ji}|j|B|S)zRun all LLM generated queries. Args: queries: query list run_manager: run manager for callbacks Returns: List of retrieved Documents rFrG)r/r^rKextend)rrCr;r'r:rXs rr[z&MultiQueryRetriever.retrieve_documentss]  #E>>((#[%:%:%<=)D   T "  # rr'ct|S)zGet unique Documents. Args: documents: List of retrieved Documents Returns: List of unique retrieved Documents )r,)rr's rrAz MultiQueryRetriever.unique_unions!++r)rrr r!r __annotations__r r1boolr2r"r3 classmethodDEFAULT_QUERY_PROMPTrr r9rrrrDr>r@rr\rZr[rAr#rrr.r.1s GTJO"d"Q &:!%!&     #  $J       >,,9 , h ,*9 c .@c@9@ h @2,,4 , h ,*4 c .c4 h . ,d8n ,h ,rr.)"rUloggingcollections.abcrlangchain_core.callbacksrrlangchain_core.documentsrlangchain_core.language_modelsrlangchain_core.output_parsersrlangchain_core.promptsr langchain_core.prompts.promptr langchain_core.retrieversr langchain_core.runnablesr typing_extensionsr langchain_classic.chains.llmr getLoggerrrMrr"rrer,r.r#rrrss$.<:583-&1   8 $)+DI6)&LF P(!3PXP,-,r