You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In order to control memory usage of querynode's raw data search service, we no longer copy the raw data to the interim index and bruteforce methods. 1. a offset base interim index
ivf_flat_nm(no memory): with fp16/bf16/fp32 in IP/L2 metric, bin1 in hamming/jaccard;
More Simd support for fp16/bf16;
More Simd support for fp16/bf16/bin1->fp32;
async build index;
iterator support for all data type;
ivf flat cc range search opt: use a small max_empty_result_buckets value(default = 2) may lead a empty result(knn search(topk1000)->mask topk 1000 deleted-> use topk=1000 as radius ->empty range search result)
if metric = l2: pass a bucket if abs(q->centroids - bucket radius) > radius;
if metric = ip: pass a bucekt if abs(q->centroids + bucket radius) < radius;
more ut/e2e tests;
2. bruteforce search with zero copy:
More Simd support for fp16/bf16;
remove all (fp16/bf16->fp32) conversion, and use fp16/bf16 directly to do brute force;
iterator support for binary type;
more ut/e2e tests;
3. milvus part
Milvus support ivf flat nm as interimin index;
update mmap config;
data relayout;
more ut/e2e tests;
The text was updated successfully, but these errors were encountered:
In order to control memory usage of querynode's raw data search service, we no longer copy the raw data to the interim index and bruteforce methods.
1. a offset base interim index
use a small max_empty_result_buckets value(default = 2) may lead a empty result(knn search(topk1000)->mask topk 1000 deleted-> use topk=1000 as radius ->empty range search result)
if metric = l2: pass a bucket if abs(q->centroids - bucket radius) > radius;
if metric = ip: pass a bucekt if abs(q->centroids + bucket radius) < radius;
2. bruteforce search with zero copy:
3. milvus part
The text was updated successfully, but these errors were encountered: