3fi0dZddlmZddlZddlZddlZddlZddlmZm Z m Z m Z m Z ddl Z ddlmZddlmZddlmZmZddlmZGd d eZGd d eZy) z(Wrapper around LLMRails vector database.) annotationsN)AnyIterableListOptionalTuple)Document) Embeddings) VectorStoreVectorStoreRetriever)FieldceZdZdZ d d dZd dZ d ddZ d ddZ d ddZ d ddZ e d dd Z dd Z y)LLMRailsaKImplementation of Vector Store using LLMRails. See https://llmrails.com/ Example: .. code-block:: python from langchain_community.vectorstores import LLMRails vectorstore = LLMRails( api_key=llm_rails_api_key, datastore_id=datastore_id ) Nc4|xstjjd|_|xstjjd|_|jt j dtj|_ ||_ d|_ y)zInitialize with LLMRails API.LLM_RAILS_DATASTORE_IDLLM_RAILS_API_KEYNz,Can't find Rails credentials in environment.zhttps://api.llmrails.com/v1) osenvironget _datastore_id_api_keyloggingwarningrequestsSession_session datastore_idbase_url)selfrapi_keys h/var/www/auto_recruiter/arenv/lib/python3.12/site-packages/langchain_community/vectorstores/llm_rails.py__init__zLLMRails.__init__"so *URZZ^^>2E#F == OOJ K ((* (5 cd|jiS)z=Returns headers that should be attached to each post request.z X-API-KEY)r)rs r!_get_post_headerszLLMRails._get_post_headers1sT]]++r#c g}|D]}ttj}|jj |j d|j d||dd|j}|jdk7rCtjd|d|jd |jd |j|cS|j||S) zRun more texts through the embeddings and add to the vectorstore. Args: texts: Iterable of strings to add to the vectorstore. Returns: List of ids from adding the texts into the vectorstore. /datastores/z/text)nametextT)jsonverifyheadersz%Create request failed for doc_name =  with status code , reason , text )struuiduuid4rpostrrr% status_codererrorreasonr)append)rtexts metadataskwargsnamesr)doc_nameresponses r! add_textszLLMRails.add_texts5s #D4::<(H}}))==/d.@.@-AG&5..0 *H##s* ;H:EW++,Ihoo5Fg}}o'  LL "% #( r#c @g}|D]w}tjj|stjd|d<|j dtjj |t|dffy|jj|jd|jd|d|j}|jd k7rJtjd |jd |jd |jd |jyy)a LLMRails provides a way to add documents directly via our API where pre-processing and chunking occurs internally in an optimal way This method provides a way to use that API in LangChain Args: files_list: Iterable of strings, each representing a local file path. Files could be text, HTML, PDF, markdown, doc/docx, ppt/pptx, etc. see API docs for full list Returns: List of ids associated with each of the files indexed zFile z does not exist, skippingfilerbr'z/fileT)filesr+r,r-z&Create request failed for datastore = r.r/r0F)rpathexistsrr6r8basenameopenrr4rrr%r5r7r))r files_listr:r;rCrAr>s r! add_fileszLLMRails.add_files[s& OD77>>$' dV+DEF LL&277#3#3D#94d;K"LM N  O==%%}}o\$*<*<)=U C**, &    3 & MM89K9K8LM$$,$8$8#98??BST (  r#cD|jj|j|jd|jdt j ||dd}|jdk7r@tjdd|jd |jd |jd gS|j d }|Dcgc]D}t|d |djDcic] \}}|dk7r||c}}|ddfF}}}}|Scc}}wcc}}}w)agReturn LLMRails documents most similar to query, along with scores. Args: query: Text to look up documents similar to. k: Number of Documents to return. Defaults to 5 Max 10. alpha: parameter for hybrid search . Returns: List of Documents most similar to the query and score for each. r'z/search)kr) )r,urldatatimeoutr-zQuery failed %sz(code r/z , details )resultsr)metadatascore) page_contentrR)rr4r%rrr*dumpsr5rr6r7r)r items) rqueryrKr>rQxkeyvaluedocss r!similarity_search_with_scorez%LLMRails.similarity_search_with_scoresC==%%**,==/d.@.@-AI!U34 &    3 & MM!--.i7H ==/$  I--/),   !"6+,J-*=*=*?&C'>U * g&        s$D*D<DDc ^|j||}|Dcgc]\}}| c}}Scc}}w)aReturn LLMRails documents most similar to query, along with scores. Args: query: Text to look up documents similar to. k: Number of Documents to return. Defaults to 5. Returns: List of Documents most similar to the query )rK)r\)rrWrKr;docs_and_scoresdoc_s r!similarity_searchzLLMRails.similarity_searchs1;;EQ;G"12Q222s )c 8|di|}|j||S)aConstruct LLMRails wrapper from raw documents. This is intended to be a quick way to get started. Example: .. code-block:: python from langchain_community.vectorstores import LLMRails llm_rails = LLMRails.from_texts( texts, datastore_id=datastore_id, api_key=llm_rails_api_key ) )r?)clsr9 embeddingr:r; llm_railss r! from_textszLLMRails.from_textss#,M&M E"r#c tdd|i|S)N vectorstorerc)LLMRailsRetriever)rr;s r! as_retrieverzLLMRails.as_retrievers zLLMRailsRetriever.s ar#)default_factoryrn search_kwargsc:|jj|y)zZAdd text to the datastore. Args: texts (List[str]): The text N)rir?)rr9s r!r?zLLMRailsRetriever.add_textss ""5)r#N)r9rqrmNone)rvrwrxry__annotations__r rr?rcr#r!rjrjs%!0@AM4A *r#rj)ry __future__rr*rrr2typingrrrrrrlangchain_core.documentsr langchain_core.embeddingsr langchain_core.vectorstoresr r pydanticr rrjrcr#r!rsH."  77-0IP={P=f*,*r#