o vi'2&@sdZddlZddlmZmZddlZddlmZmZddl m Z ddl m Z m Z mZedd Zed d Zeeejd d fZeeeejd d fZeeeejd d fZd eddfddZe  dSdede ddfddZejddddddddddddedeeejdd fdeeejdd fdeeejdd fdeeejd d fd!eeejd"d fd#eeejd$d fd%eeejd&d fded'eeeejd(d fde d)eeejd*d fd+eeejd,d fd-eeeejd.d fd/eeeejd0d fd1eeeejd2d fddf"d3dZejdd   dTdeeejdd fdedede ddf d4d5Z dUde ddfd6d7Zejddeejd8d9d:d;eejedZ e              dVdededeeeejdd fdeeeejdd fdeeeejd d fd!eeeejd"d fdeeeejd?d fd@eeeejdAd fd'eeeejd(d fd)eeeejd*d fd+eeeejd,d fd-eeeejd.d fd/eeeejd0d fd1eeeejd2d fde ddf dBdCZ!e  D dWdededEee"ejdFdGd fde ddf dHdIZ#e  dSdedede ddfdJdKZ$e  D dWdededLee"ejdMdNd fde ddf dOdPZ%e  dSdedede ddfdQdRZ&dS)Xz2CLI commands for Hugging Face Inference Endpoints.N) AnnotatedOptional)InferenceEndpointInferenceEndpointScalingMetric)HfHubHTTPError)TokenOpt get_hf_api typer_factoryz(Manage Hugging Face Inference Endpoints.)helpz.Interact with the Inference Endpoints catalog.zEndpoint name.z_The namespace associated with the Inference Endpoint. Defaults to the current user's namespace.endpointreturncCsttj|jddddS)NTindent sort_keys)typerechojsondumpsraw)r rf/home/air/biblejyuku/back/venv/lib/python3.10/site-packages/huggingface_hub/cli/inference_endpoints.py_print_endpoint#sr namespacetokenc Cst|d}z |j||d}Wnty+}ztd|tj|jjd|d}~wwttj ddd|Did d d dS) z6Lists all Inference Endpoints for the given namespace.r)rrzListing failed: codeNitemscSsg|]}|jqSr)r).0r rrr 6szls..rTr) r list_inference_endpointsrrrExitresponse status_coderr)rrapi endpointserrorrrrls's r)deploy)name)rtaskr min_replica max_replicascale_to_zero_timeoutscaling_metricscaling_thresholdr+repozeThe name of the model repository associated with the Inference Endpoint (e.g. 'openai/gpt-oss-120b'). frameworkz@The machine learning framework used for the model (e.g. 'vllm'). acceleratorz?The hardware accelerator to be used for inference (e.g. 'cpu'). instance_sizezNThe size or type of the instance to be used for hosting the model (e.g. 'x4'). instance_typezYThe cloud instance type where the Inference Endpoint will be deployed (e.g. 'intel-icl').regionzTThe cloud region in which the Inference Endpoint will be created (e.g. 'us-east-1').vendorzVThe cloud provider or vendor where the Inference Endpoint will be hosted (e.g. 'aws').r,zCThe task on which to deploy the model (e.g. 'text-classification').r-zVThe minimum number of replicas (instances) to keep running for the Inference Endpoint.r.zRThe maximum number of replicas (instances) to scale to for the Inference Endpoint.r/zFThe duration in minutes before an inactive endpoint is scaled to zero.r0z!The metric reference for scaling.r1zeThe scaling metric threshold used to trigger a scale up. Ignored when scaling metric is not provided.cCst| d}|jdid|d|d|d|d|d|d|d |d |d | d | d | d| d|d|d| }t|dS)z3Deploy an Inference Endpoint from a Hub repository.rr+ repositoryr3r4r5r6r7r8rr,rr-r.r0r1r/Nr)r create_inference_endpointr)r+r2r3r4r5r6r7r8rr,rr-r.r/r0r1r&r rrrr*=sF V       c Csht|d}z |j||||d}Wnty-}ztd|tj|jjd|d}~wwt|dS)z4Deploy an Inference Endpoint from the Model Catalog.r)repo_idr+rrzDeployment failed: rN) r &create_inference_endpoint_from_catalogrrrr#r$r%r)r2r+rrr&r r(rrrdeploy_from_catalogs   r=c Cstt|d}z|j|d}Wnty*}ztd|tj|jjd|d}~wwttj d|iddddS) List available Catalog models.rzCatalog fetch failed: rNmodelsrTr) r list_inference_catalogrrrr#r$r%rr)rr&r?r(rrr list_catalogs rAz list-catalogr>T)r+r hiddencatalogc Cft|d}z |j|||d}Wnty,}ztd|tj|jjd|d}~wwt|dS)z+Get information about an existing endpoint.rr+rrzFetch failed: rN) r get_inference_endpointrrrr#r$r%rr+rrr&r r(rrrdescribe  rHzBThe machine learning framework used for the model (e.g. 'custom').revisionzrThe specific model revision to deploy on the Inference Endpoint (e.g. '6c0e6080953db56375760c0471a8c5f2929baf11').cCs~t|d}z|j|||||||||| | | | | |d}Wnty8}ztd|tj|jjd|d}~wwt|dS)zUpdate an existing endpoint.r)r+rr9r3rJr,r4r5r6r-r.r/r0r1rzUpdate failed: rN) r update_inference_endpointrrrr#r$r%r)r+rr2r4r5r6r3rJr,r-r.r/r0r1rr&r r(rrrupdates2 O  rLFyesz--yeszSkip confirmation prompts.c Cs|std|d}||krtdtjddt|d}z |j|||dWntyF}ztd|tj|jjd|d }~wwtd |d d S) z)Delete an Inference Endpoint permanently.zDelete endpoint 'z'? Type the name to confirm.zAborted.rrrrEzDelete failed: Nz Deleted 'z'.) rpromptrr#r delete_inference_endpointrr$r%)r+rrMr confirmationr&r(rrrdeleteTs    rQc CrD)zPause an Inference Endpoint.rrEzPause failed: rN) r pause_inference_endpointrrrr#r$r%rrGrrrpauseorIrSfail_if_already_runningz--fail-if-already-runningzWIf `True`, the method will raise an error if the Inference Endpoint is already running.c Csjt|d}z |j|||| d}Wnty.}ztd|tj|jjd|d}~wwt|dS)zResume an Inference Endpoint.r)r+rr running_okzResume failed: rN) r resume_inference_endpointrrrr#r$r%r)r+rrTrr&r r(rrrresumes   rWc CrD)z$Scale an Inference Endpoint to zero.rrEzScale To Zero failed: rN) r scale_to_zero_inference_endpointrrrr#r$r%rrGrrr scale_to_zerorIrY)NN)NNN)N)NNNNNNNNNNNNNN)NFN)'__doc__rtypingrrr$huggingface_hub._inference_endpointsrrhuggingface_hub.errorsr _cli_utilsrr r ie_cli catalog_appstrArgumentNameArgOptionNameOpt NamespaceOptrcommandr)intfloatr*r=rA add_typerrHrLboolrQrSrWrYrrrrs      . &-.45;AGMS l     !'-39?EKL g