Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Current state: Accepted

ISSUE: https://github.com/milvus-io/milvus/issues/15604

PRs: 

Keywords: bulk load, import

Released: with Milvus 2.1 

Authors:  

Summary

Import data by a shortcut to get better performance compared with insert(). 


Motivation

Typically, it cost several 5~6 hours to insert one billion entities with 128-dimensional vectors. We need a new interface to do bulk load for the following purposes:

  1. copy a collection from one Milvus 2.0 server to another.
  2. import data from json format files
  3. import data from numpy format files
  4. import data from Milvus 1.x to Milvus 2.0

Design Details


SDK Interfaces



RPC Interfaces



Internal machinery



Test Plan