Skip to main content

Huggingface

Type: conversation.huggingface

Status: alpha

Reference: https://docs.dapr.io/reference/components-reference/supported-conversation/hugging-face/

Example​

apiVersion: cra.diagrid.io/v1beta1
kind: Component
metadata:
  name: <name>
spec:
  type: conversation.huggingface
  version: v1
  metadata:
    # API key for Huggingface.
    - name: key
      value: | 
        **********
    # A time-to-live value for a prompt cache to expire. Uses Golang durations (Optional)
    #- name: cacheTTL
    #  value: "10m"
    # The Huggingface LLM to use. Defaults to meta-llama/Meta-Llama-3-8B (Optional)
    #- name: model
    #  value: "meta-llama/Meta-Llama-3-8B"

Authentication profiles​

Available authentication profiles:

  • API Key

API Key​

Authenticate using an API key

key (string)​

Required - API key for Huggingface.

Example value:

**********

Metadata​

cacheTTL (string)​

A time-to-live value for a prompt cache to expire. Uses Golang durations

Example value: 10m

model (string)​

The Huggingface LLM to use. Defaults to meta-llama/Meta-Llama-3-8B

Example value: meta-llama/Meta-Llama-3-8B