Skip to content

huggingface_hub: Instrument AsyncInferenceClient #5846

@ericapisani

Description

@ericapisani

The integration only wraps sync InferenceClient.text_generation and InferenceClient.chat_completion. The AsyncInferenceClient has identical methods as async coroutines and is completely uninstrumented. Every other major AI integration (OpenAI, Anthropic, LangChain) instruments both sync and async variants.

Metadata

Metadata

Assignees

No one assigned
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions