Skip to main content
Version: User Guides (Cloud)

FAQ: Pipelines

How can Zilliz Cloud Pipelines enhance my semantic search capabilities?

Contents​

FAQs​

How can Zilliz Cloud Pipelines enhance my semantic search capabilities?​

Pipelines help create high-quality vector embeddings, which serve as the foundation for relevant semantic search results.

Which Zilliz Cloud Product Tiers are Pipelines available in?​

Zilliz Cloud Pipeline is available on all tiers as long as you have created a cluster on GCP us-west1.

Which embedding model does Zilliz Cloud Pipelines use?​

The text doc ingestion and search pipelines support various embedding models.

  • For English:

    • zilliz/bge-base-en-v1.5

      Released by BAAI, this state-of-the-art open-source model is hosted on Zilliz Cloud and co-located with vector databases, providing good quality and best network latency. This is the default embedding model.

    • voyageai/voyage-2

      Hosted by Voyage AI. This general purpose model excels in retrieving technical documentation containing descriptive text and code. Its lighter version voyage-lite-02-instruct ranks top on MTEB leaderboard.

    • voyageai/voyage-code-2

      Hosted by Voyage AI. This model is optimized for software code, providing outstanding quality for retrieving software documents and source code.

    • voyageai/voyage-large-2

      Hosted by Voyage AI. This is the most powerful generalist embedding model from Voyage AI. It supports 16k context length (4x that of voyage-2) and excels on various types of text including technical and long-context documents.

    • openai/text-embedding-3-small

      Hosted by OpenAI. This highly efficient embedding model has stronger performance over its predecessor text-embedding-ada-002 and balances inference cost and quality.

    • openai/text-embedding-3-large

      Hosted by OpenAI. This is OpenAI's best performing model. Compared to text-embedding-ada-002, the MTEB score has increased from 61.0% to 64.6%.

  • For Chinese:

    • zilliz/bge-base-zh-v1.5

      Released by BAAI, this state-of-the-art open-source model is hosted on Zilliz Cloud and co-located with vector databases, providing good quality and best network latency. This is the default embedding model.

How is Zilliz Cloud Pipelines charged?​

Currently, Zilliz Cloud Pipelines is free to use. You only need to pay for the cluster usage.

Can I use Zilliz Cloud Pipelines standalone?​

No, you must be a Zilliz Cloud vector database customer to access the Pipelines functionalities.

What data sources are supported by Ingestion Pipelines?​

Currently, Ingestion Pipelines support local files and files stored on AWS S3 and Google Cloud Storage. We are actively working to expand support for additional data sources in the future.

What document file formats are supported by Pipelines?​

Supported file formats include .txt, .pdf, .md, .html, .epub, .csv, .doc, .docx, .xls, .xlsx, .ppt, .pptx. When running an Ingestion pipeline, you can either upload a local file or use an S3 presigned URL or a GCS signed URL.