3fijddlZddlZddlmZddlmZmZmZmZm Z ddl m Z ddl m Z Gdde Zy)N)Path)DictIteratorListOptionalUnion)Document) BaseLoaderceZdZdZddeeefdeefdZe dede eeffdZ de e fdZd ej d edeefd Zd ed ede fdZd ed edefdZd edededefdZy)SlackDirectoryLoaderz#Load from a `Slack` directory dump.Nzip_path workspace_urlcrt||_||_|j|j|_y)a)Initialize the SlackDirectoryLoader. Args: zip_path (str): The path to the Slack directory dump zip file. workspace_url (Optional[str]): The Slack workspace URL. Including the URL will turn sources into links. Defaults to None. N)rr r_get_channel_id_mapchannel_id_map)selfr rs r/var/www/auto_recruiter/arenv/lib/python3.12/site-packages/langchain_community/document_loaders/slack_directory.py__init__zSlackDirectoryLoader.__init__s.X *"66t}}Ereturnc@tj|d5} |jdd5}tj|}dddDcic] }|d|d c}cdddS#1swY)xYwcc}w#t $ricYcdddSwxYw#1swYyxYw)z?Get a dictionary mapping channel names to their respective IDs.rz channels.jsonNnameid)zipfileZipFileopenjsonloadKeyError)r zip_filefchannelschannels rrz(SlackDirectoryLoader._get_channel_id_maps__Xs + x ]]?C8,A#yy|H,FNO76O   ,,O         sKBA:A) A: A5A:)A2 . A:: BBBBBc#dKtj|jd5}|jD]c}t |j j }|s%|jds7|j||}|D]}|j||e dddy#1swYyxYww)z8Load and return documents from the Slack directory dump.rz.jsonN) rrr namelistrparentrendswith _read_json_convert_message_to_document)rr! channel_path channel_namemessagesmessages r lazy_loadzSlackDirectoryLoader.lazy_load&s __T]]C 0 WH ( 1 1 3 W #L188== #((1#xFH#+W"??VVW  W W W Ws#!B0AB$+/B$ B0$B-)B0r! file_pathc|j|d5}tj|}ddd|S#1swYSxYw)z"Read JSON data from a zip subfile.rN)rrr)rr!r0r"datas rr)zSlackDirectoryLoader._read_json2s9 ]]9c * a99Qr<r=s rr9z*SlackDirectoryLoader._get_message_metadataLsLKKb) {{62&)),iH#"   rr<r>c|jrC|jj|d}|jd|d|jddzS|d|d|S)a@ Get the message source as a string. Args: channel_name (str): The name of the channel the message belongs to. user (str): The user ID who sent the message. timestamp (str): The timestamp of the message. Returns: str: The message source. r5z /archives/z/p.z - )rrr8replace)rr,r<r> channel_ids rr?z(SlackDirectoryLoader._get_message_sourceXsu   ,,00rBJ%%&j =y((b1234  #^3tfC {; ;r)N)__name__ __module__ __qualname____doc__rstrrrr staticmethodrrrr r/rrrdictr)r*r9r?rrr r s- FsDy!1 F(3- FdtCH~ W8H- W7??stDz   +.  (  T      <<3<3rPs( 88-@`<:`