3fiUddlmZddlmZddlmZmZmZmZm Z m Z ddl Z ddl m Z ddlmZmZddlmZddlmZmZd Zd ed <Gd d eZy)) annotations)deepcopy)AnyDictListOptionalSequenceUnionN) Callbacks)BaseDocumentCompressorDocument)get_from_dict_or_env) ConfigDictmodel_validatorzhttps://api.jina.ai/v1/rerankstr JINA_API_URLceZdZUdZdZded< dZded< dZd ed < dZd ed < d Z d ed< e ddZ e de ddZdddd ddZ d ddZy) JinaRerankz0Document compressor that uses `Jina Rerank API`.Nrsession Optional[int]top_nzjina-reranker-v1-base-enrmodel Optional[str] jina_api_key langchain user_agentTforbid)arbitrary_types_allowedextrabefore)modect|dd}|jdd}tj}|jj d|dd|d||d <|S) z,Validate that api key exists in environment.r JINA_API_KEYrrzBearer identityzapplication/json) AuthorizationzAccept-Encodingz Content-typez user-agentr)rgetrequestsSessionheadersupdate)clsvaluesrrrs r/var/www/auto_recruiter/arenv/lib/python3.12/site-packages/langchain_community/document_compressors/jina_rerank.pyvalidate_environmentzJinaRerank.validate_environment#sk,FNNS ZZ k: ""$#*<.!9#- 2(   $y )rrmax_chunks_per_docct|dk(rgS|Dcgc] }t|tr |jn|"}}|xs |j}||dkDr|n |j }||||d}|j jt|j} d| vrt| d| d} g} | D]} | j| d| dd| Scc}w) aReturns an ordered list of documents ordered by their relevance to the provided query. Args: query: The query to use for reranking. documents: A sequence of documents to rerank. model: The model to use for re-ranking. Default to self.model. top_n : The number of results to return. If None returns all results. Defaults to self.top_n. max_chunks_per_doc : The maximum number of chunks derived from a document. r)query documentsrr)jsonresultsdetailindexrelevance_score)r9r:) len isinstancer page_contentrrrpostrr6 RuntimeErrorappend) selfr5r4rrr2docdocsdatarespr7 result_dictsress r.rerankzJinaRerank.rerank5s& y>Q INW GJ 3 9C  s B  #-5194::  ||  !  $& D tH~. .y/  C    \'*+<'=  ; s%Ccg}|j||D]W}||d}t|jt|j}|d|jd<|j |Y|S)aU Compress documents using Jina's Rerank API. Args: documents: A sequence of documents to compress. query: The query to use for compressing the documents. callbacks: Callbacks to run during the compression process. Returns: A sequence of compressed documents. r9)metadatar:)rHr r=rrJr@)rAr5r4 callbacks compressedrGrBdoc_copys r.compress_documentszJinaRerank.compress_documentsisy" ;;y%0 (CCL)C 0 08CLL;QRH367H3IH  / 0   h '  ( r0)r-rreturnr) r5z$Sequence[Union[str, Document, dict]]r4rrrrrr2rrOzList[Dict[str, Any]])N)r5Sequence[Document]r4rrKzOptional[Callbacks]rOrP)__name__ __module__ __qualname____doc__r__annotations__rrrrr model_configr classmethodr/rHrNr0r.rrs:GS3E=(+E3+%"&L-&!J!< $L (#$* $!,02722  2  2*2 2p*. %'   r0r) __future__rcopyrtypingrrrrr r r(langchain_core.callbacksr langchain_core.documentsr r langchain_core.utilsrpydanticrrrrUrrXr0r.r`s9"==.E503 c3q'qr0