3fidZddlZddlmZmZmZmZddlmZm Z m Z m Z ddl m Z ddlmZedZej"eZGdd eZGd d eZy) a Langchain Runnables to screen user prompt and/or model response using Google Cloud Model Armor. Prerequisites ------------- Before using Model Armor Runnables, ensure the following steps are completed: - Select or create a Google Cloud Platform project. - You can do this at: https://console.cloud.google.com/project - Enable billing for your project. - Instructions: https://cloud.google.com/billing/docs/how-to/modify-project#enable_billing_for_a_project - Enable the Model Armor API in your GCP project. - See: https://cloud.google.com/security-command-center/docs/get-started-model-armor - Grant the `modelarmor.user` IAM role to any user or service account that will use the Model Armor runnables. - Authentication: - Your application or environment must be authenticated and have the necessary permissions to access the Model Armor service. - You can authenticate using several methods described here: https://googleapis.dev/python/google-api-core/latest/auth.html - Create Model Armor Template: - You must create a Model Armor template for prompt and response sanitization. You may use a single template for both, or separate templates as needed. - Refer to the guide: Create and manage Model Armor templates (https://cloud.google.com/security-command-center/docs/get-started-model-armor) - The Template IDs must be provided when initializing the respective runnables. - To manage Model Armor templates, the `modelarmor.admin` IAM role is required. N)AnyOptionalTypeVarcast)DataItemModelArmorClientSanitizeModelResponseRequestSanitizeUserPromptRequest)RunnableConfig)ModelArmorSanitizeBaseRunnableTc >eZdZdZ d dedeedeededef dZ y) ModelArmorSanitizePromptRunnablez6`Runnable` to sanitize user prompts using Model Armor.Ninputconfig fail_openkwargsreturnc t|j|}tjd|jt t |j jtt jt t|jt t|jt t|jt|}|j}||n |j}|j!|||s:|r-tjd|tj#d|St%d|S) adSanitize a user prompt using Model Armor. Args: input: The user prompt to sanitize. Can be `str`, `BaseMessage`, `BasePromptTemplate`, list of messages, or any object with string conversion. config: A config to use when invoking the `Runnable`. fail_open: If `True`, allows unsafe prompts to pass through. Returns: Same type as input (original input is always returned). Raises: ValueError: If the prompt is flagged as unsafe by Model Armor and `fail_open` is `False`. z8Starting prompt sanitization request with template id %stext)nameuser_prompt_datarequestrz;Found following unsafe prompt findings from Model Armor: %sz6Continuing for unsafe prompt as fail_open flag is truez(Prompt flagged as unsafe by Model Armor.)_extract_inputloggerinfo template_idrrclientsanitize_user_promptr template_pathstrprojectlocationrsanitization_resultrevaluatewarning ValueError) selfrrrrcontentresultsanitization_findingseffective_fail_opens m/var/www/auto_recruiter/arenv/lib/python3.12/site-packages/langchain_google_community/model_armor/runnable.pyinvokez'ModelArmorSanitizePromptRunnable.invoke:s.%%e, F    & 4II-%33dll+dmm,d../ "*w!7 J  !' : :,5+@idnn}}W&;F}K" Q)WX !!KLL NN __name__ __module__ __qualname____doc__r rr boolrr1r2r0rr7sK@ ,0$( 77(7D> 7  7 7r2rc >eZdZdZ d dedeedeededef dZ y) "ModelArmorSanitizeResponseRunnablez7`Runnable` to sanitize LLM responses using Model Armor.Nrrrrrc h|j|}tjd|jt t |j jtt jt t|jt t|jt t|jt|}|j}|j|||sD|j r-tjd|tj#d|St%d|S) aGSanitize an LLM response using Model Armor. Args: input: The model response to sanitize. Can be `str`, `BaseMessage`, list of messages, or any object with string conversion. config: A config to use when invoking the `Runnable`. fail_open: If `True`, allows unsafe responses to pass through. Returns: Same type as input (original input is always returned). Raises: ValueError: If the response is flagged as unsafe by Model Armor and `fail_open` is `False`. z@Starting model response sanitization request with template id %sr)rmodel_response_datarrz=Found following unsafe response findings from Model Armor: %sz8Continuing for unsafe response as fail open flag is truez*Response flagged as unsafe by Model Armor.)rrrr rrr!sanitize_model_responser r#r$r%r&rr'r(rr)r*)r+rrrrr,r-r.s r0r1z)ModelArmorSanitizeResponseRunnable.invokews,%%e, N    & 4LL0%33dll+dmm,d../ %-'$: M  !' : :}}W&;F}K~~ S)N  !!MNN r2r3r4r:r2r0r<r<tsKA ,0$( 55(5D> 5  5 5r2r<)r8loggingtypingrrrrgoogle.cloud.modelarmor_v1rrr r langchain_core.runnables.configr 4langchain_google_community.model_armor.base_runnabler r getLoggerr5rrr<r:r2r0rFsb D// ; CL   8 $:'E:z8)G8r2