{bj7%SSKJr SSKJrJr SSKJr SSKJr SSK J r J r SSK J r SSKJrJrJr \R$"\5r00000000000000S.r\\\\\44\S '\S \\\4S \\\44S j5r\S \\S \\4S j5rS \\\4\\-S \\\4\\-4Sjr"SS5r"SS\5r"SS\5r"SS\5r\"SS9S\S \S4Sj5rS\S\S \4Sjr g)) lru_cache)Anyoverload) constants)InferenceProviderMapping) MimeBytesRequestParameters)ChatCompletionInputMessage)build_hf_headers get_tokenlogging)cerebrascohere deepinfrazfal-aiz fireworks-aigroqz hf-inferencenscaleovhcloud replicatescalewaytogether wavespeedzzai-org!HARDCODED_MODEL_INFERENCE_MAPPINGobjreturncgNrs ڨ/tmp/claude-0/-home-danvics-docker-quiz/c1e0577a-e42c-4a3d-b1ea-3edd61103a4e/scratchpad/stt/lib/python3.13/site-packages/huggingface_hub/inference/_providers/_common.py filter_noner *s8;cgrrrs rr r ,s.1r!c[U[5(aL0nUR5H4up#UcM [U[[45(a [ U5nX1U'M6 U$[U[5(a9UVs/sH+n[U[[45(a [ U5OUPM- sn$[ S[ U535es snf)NzExpected dict or list, got ) isinstancedictitemslistr ValueErrortype)rcleanedkvs rr r 0s#t"$IIKDAy!dD\**NAJ  #tNQRc*Qt "="= A1DcRR 249+> ??Ss;2Cc\rSrSrSrS\S\S\SS4SjrSS .S \S \\\4S \S \S-S\S-S\\\4S-S\ 4Sjjr S"S\ \-S\ S-S\4Sjjr S\S-S\4Sjr S \S-S\4SjrS \\\4S\\\4S-S\S-S\\\44SjrS \S\S\\\44SjrS\S\S\4SjrS\S\4SjrS\S\S\4SjrS \S \S\S\S-4SjrS \S \S\S\S-S\S-4 S jrS!rg)#TaskProviderHelperAz.Base class for task-specific provider helpers.providerbase_urltaskrNc(XlX0lX lgr)r0r2r1)selfr0r1r2s r__init__TaskProviderHelper.__init__Ds   r!) extra_payloadinputs parametersheadersmodelapi_keyr7c URU5nURU5nURX55nURXWR5nUR XUS9n U b[ U [U=(d 055n URXXv5n U bU b [S5eU cU c [S5eURX9U 5n [UURURU U U S9$)z Prepare the request to be sent to the provider. Each step (api_key, model, headers, url, payload) can be customized in subclasses. )provider_mapping_infoz8Both payload and data cannot be set in the same request.z2Either payload or data must be set in the request.)urlr2r;jsondatar:) _prepare_api_key_prepare_mapping_info_prepare_headers _prepare_url provider_id_prepare_payload_as_dictrecursive_merger _prepare_payload_as_bytesr(_normalize_headersr r2) r4r8r9r:r;r<r7r>r?payloadrAnormalized_headerss rprepare_request"TaskProviderHelper.prepare_requestIs ''0!% : :5 A''9)J)JK//Zo/p  %g{=;NB/OPG--fBWg  4#3WX X ?t|QR R"44WtL '33&   r!responserequest_paramscU$)zr Return the response in the expected format. Override this method in subclasses for customized response handling.r)r4rOrPs r get_responseTaskProviderHelper.get_response~s r!cXUc [5nUc[SURS35eU$)zRReturn the API key to use for the request. Usually not overwritten in subclasses.z)You must provide an api_key to work with z$ API or log in with `hf auth login`.)r r(r0r4r<s rrB#TaskProviderHelper._prepare_api_keys: ?kG ?;DMM?Jno r!c Uc[SURS35e[RUR05RU5(a[URU$Sn[ U5H!nURUR:XdMUn O Uc[SUSURS35eUR UR :wa6[SUSUR SURSUR S3 5eUR S :Xa&[RSUS URS 35 UR S :Xa&[RS USURS35 U$)zZReturn the mapped model ID to use for the request. Usually not overwritten in subclasses.Nz+Please provide an HF model ID supported by .zModel z is not supported by provider z is not supported for task z and provider z. Supported task: stagingz! is in staging mode for provider z. Meant for test purposes only.errorz,Our latest automated health check on model 'z' for provider 'z<' did not complete successfully. Inference call might fail.) r(r0rget!_fetch_inference_provider_mappingr2statusloggerwarning)r4r;provider_mappingmappings rrC(TaskProviderHelper._prepare_mapping_infos =J4==/YZ[\ \ - 0 0 C G G N N4T]]CEJ J8?G4==0#* @  #veW,J4==/YZ[\ \  DII -:499+^TXTaTaSbc##3#8#8"9<   " "i / NN@Ono   " "g - NN>ugEUVZVcVcUde--  r!rKrAcUR5VVs0sHupEUcM UR5U_M nnnURS5c)UbURbURUS'U$UbSUS'U$s snnf)zjNormalize the headers to use for the request. Override this method in subclasses for customized headers. z content-typezapplication/json)r&lowerr[ mime_type)r4r:rKrAkeyvaluerLs rrJ%TaskProviderHelper._normalize_headerssDK==?h?ZSV[0ciik50?h  ! !. 1 9DNN$>59^^">2"!$5G">2!! is A6A6c0[US9EUE$)zgReturn the headers to use for the request. Override this method in subclasses for customized headers. )token)r )r4r:r<s rrD#TaskProviderHelper._prepare_headerss >"1=W==r! mapped_modelcURU5nURX!5nURS5SURS53$)zNReturn the URL to use for the request. Usually not overwritten in subclasses./)_prepare_base_url_prepare_routerstriplstrip)r4r<rlr1routes rrETaskProviderHelper._prepare_urlsI))'2##L://#&'qc):(;<cg)zReturn the payload to use for the request, as a dict. Override this method in subclasses for customized payloads. Only one of `_prepare_payload_as_dict` and `_prepare_payload_as_bytes` should return a value. Nrr4r8r9r>s rrG+TaskProviderHelper._prepare_payload_as_dictsr!cg)zReturn the body to use for the request, as bytes. Override this method in subclasses for customized body data. Only one of `_prepare_payload_as_dict` and `_prepare_payload_as_bytes` should return a value. Nr)r4r8r9r>r7s rrI,TaskProviderHelper._prepare_payload_as_bytessr!)r1r0r2r)__name__ __module__ __qualname____firstlineno____doc__strr5rr%r rMbytesrRrBrrCrrJrDrErorprGrI__static_attributes__rr!rr.r.As 8!!!3!4!043 3 cN 3  3 Tz 3 t3 CH~,3  3 p48 $, *D0   d s # 3:# :R# J "CH~ "04S#X0E "MVY]M] " c3h ">>s>tCH~>=C=s=s= ! ! !3'+D\     8  d{  T  r!r.c z^\rSrSrSrS\S\4U4SjjrS\S\S\4S jrS \\ \ -S \ S \ S\ S -4Sjr Sr U=r$)BaseConversationalTaskiz Base class for conversational (chat completion) tasks. The schema follows the OpenAI API format defined here: https://platform.openai.com/docs/api-reference/chat r0r1c">[TU]XSS9 g)Nconversationalr0r1r2superr5r4r0r1 __class__s rr5BaseConversationalTask.__init__ s (DTUr!rlr<rcg)Nz/v1/chat/completionsrrs rrp%BaseConversationalTask._prepare_route s%r!r8r9r>Nc [URUS.UR5VVs0sHupEUS:wdM XE_M snnE5$s snnf)N)r;messagesr;)r rFr&)r4r8r9r>rfrgs rrG/BaseConversationalTask._prepare_payload_as_dictsX.::" 1;0@0@0BU0B*#cWn:3:0BU   Vs A A r)rrrrrrr5rpr'r%r rrGr __classcell__rs@rrrsw VVV&3&&& T667   8     r!rcV^\rSrSrSrU4SjrS\S\4SjrS\S-S\4S jr S r U=r $) AutoRouterConversationalTaski$a Auto-router for conversational tasks. We let the Hugging Face router select the best provider for the model, based on availability and user preferences. This is a special case since the selection is done server-side (avoid 1 API call to fetch provider mapping). c">[TU]SSS9 g)Nautozhttps://router.huggingface.co)r0r1r)r4rs rr5%AutoRouterConversationalTask.__init__,s &3RSr!r<rc\URS5(d [S5eUR$)rvrwz>Cannot select auto-router when using non-Hugging Face API key.)rxr(r1rUs rro.AutoRouterConversationalTask._prepare_base_url/s+ !!%((]^ ^== r!r;Nc8Uc [S5e[SUUSSS9$)z In auto-router, we don't need to fetch provider mapping info. We just return a dummy mapping info with provider_id set to the HF model ID. zPlease provide an HF model ID.rliver)r0 hf_model_id providerIdr]r2)r(r)r4r;s rrC2AutoRouterConversationalTask._prepare_mapping_info9s1 ==> >'!   r!r) rrrrrr5rrorrCrrrs@rrr$s>T!!! 3: :R  r!rc n^\rSrSrSrS\S\4U4SjjrS\S\S\4S jrS \S \ S \ S\ S -4Sjr Sr U=r $)BaseTextGenerationTaskiJz Base class for text-generation (completion) tasks. The schema follows the OpenAI API format defined here: https://platform.openai.com/docs/api-reference/completions r0r1c">[TU]XSS9 g)Nztext-generationrrrs rr5BaseTextGenerationTask.__init__Ps (DUVr!rlr<rcg)Nz/v1/completionsrrs rrp%BaseTextGenerationTask._prepare_routeSs r!r8r9r>Nc<[SU0UESUR0E5$)Npromptr;)r rFrs rrG/BaseTextGenerationTask._prepare_payload_as_dictVs'Hfg gGEZEfEfghhr!r)rrrrrrr5rprr%rrGrrrs@rrrJsl WWW!3!!!ii'+iD\i iir!rN)maxsizer;rcxSSKJn U"5RUS/S9nURnUc[ SU35eU$)z3 Fetch provider mappings for a model from the Hub. r)HfApiinferenceProviderMapping)expandz$No provider mapping found for model )huggingface_hub.hf_apir model_infoinference_provider_mappingr()r;rryr`s rr\r\\sM - 7  e-G,H  ID66?wGHH r!dict1dict2c 0UEUR5VVs0sHGup#UX ;a:[X[5(a#[U[5(a[XU5OU_MI snnE$s snnfr)r&r$r%rH)rrrfrgs rrHrHjs}    $kkm  ,   EJ!=!=*UTXBYBY!U3 ,    sAA*)! functoolsrtypingrrhuggingface_hubrrr!huggingface_hub.inference._commonrr :huggingface_hub.inference._generated.types.chat_completionr huggingface_hub.utilsr r r get_loggerrr^rr%r__annotations__r r'r.rrrr\rHrr!rrs %;JaFF   H % +U!4T#7O2O-P(P#Q2 ;T#s(^;S#X; ; 1T#Y1491 1@T#s(^d3i/@DcNT#Y4N@"@@F / @# #9# Li/i$ 4 S T:T5U   4   r!