Milvus Project Roadmap and Time Schedule
...
Time | Note | ||||
---|---|---|---|---|---|
2.2 | 2022.10.28 | Stable | 2.2.33.0 | 2023.28.823 | Stable |
2.34 | 20232024.2.28 | Experiment | |||
2.4 | 2023.6.30 | Stable | |||
08 | Under development | ||||
3.0 | -RC12023 | 2024. | 84.30 | Experiment | |
3.0-GA | 2023.10.30 | Stable |
detailed features
...
2.2
- Refactor Segment Assignment in Query coord
- Support Disk ANN Index
- Support RBAC
- Support BulkInsert Data
- Support Rate Limiter → Memory protection, Insertion/Search throughput
- Support collection level data TTL
- Primary/Backup coordinator
- Refine and fully tested pymilvus, java and go SDK.
- Release birdwatcher, milvus meta inspect and hacking tool
- Better Monitoring, collection level DML metrics supported
2.2.3
1. Rolling Upgrade
2. Resource group for querynode physical isolation
3. BulkInsert any sized data.
4. Performance optimization
5. Dynamic config change
2.3
- Refactor On Disk Data format
- Performance Improving on both memory/disk index
- Faster failure recovery speed.
- Merge Index coordinator/ Data coordinator into 1 role
- Integrate with new vector search engine, Knowhere 2.0
- Support Range Search
- Refine Alias functionality
- Backup support
- Dynamic Partition load/release
- Incremental data subscription
- Milvus benchmark tool
- Fully tested Restful API
- SQL support - count
- Intergated with Huggingface, OpenAI, Paddle paddle
2.4
- Support GPU index
- Support ScaNN Index
- Refactor Scalar Execution engine with Velox
- Better Hybrid search speed
- Better streaming data search performance
- Better Query pagination
- Improve multi memory replica availability
- Integrate with more inference generation system
- Tracing
- Support offline deployment
- SQL support - search,insert, delete, query
- Segment mmap load for memory index
- Index parameter optimization tool
- Compaction optimization
3.0
- Full SQL Support
- Modify collection schema dynamically - add column, remove column
- Support more datatype,map,list...
- Remove Datanode, all compaction/bulkload functionality moved into indexnode, streaming functionalities moved into log node
- Primary/Backup milvus cluster
- Support entity Update
- GPU index build
- Fully tested Cpp/Rust API
- New Milvus bootcamp
...
Under Design |
Welcome to the Milvus Roadmap! Our journey is an ongoing adventure in improving and evolving Milvus, and we're excited to share with you our achievements, our upcoming plans, and our vision for the future. This roadmap is not just a list of features; it's a reflection of our commitment to innovation and community collaboration. We invite you to explore, provide feedback, and join us in shaping Milvus' future!
Roadmap
Category | Milvus 2.3.x (Achieved in recent releases) | Milvus 2.4.0(End of CY23 release) | Roadmap(3.0) |
Scalability and Performance | Growing Index ScaNN Index | Bulk Insert Optimazation Scalar Fields Index Holds More Collections/Partitions | Inverted Index for JSON GPU Acceleration Full test for 10 billion+ vectors |
Ease of Use | Cluster Rolling Update Delete by Expression Upsert | Support More Datatypes | Add/Delete Collection Fields Support SQL Syntax Upgrade SDK |
Enterprise Offering | RBAC Partition Key | Accesslog Enhancement Compaction Optimization | CDC for Online/Cross-Cloud Migration |
AI-augment Capability Designed features for AI applications | Dynamic Schema | Group By for Grouping Requests Multi-Vectors(beta) Sparse Vector(beta) | Scenario-oriented Vector Search Patterns Spark Connector for large scale data processing Multi-Vectors GA Sparse Vector GA |
Notes:
Our roadmap is dynamic and adapts based on new learnings and community feedback.
Community engagement is highly encouraged. To provide feedback or raise issues, visit Milvus GitHub.
Detailed information on recent releases, please refer to release notes.
How to Contribute
As an open-source project, Milvus thrives on community contributions. Here's how you can be a part of our journey.
Share Feedback
Issue Reporting: Encounter a bug or have a suggestion? Open an issue on our GitHub page.
Feature Suggestions: Have ideas for new features or improvements? We'd love to hear them!
Code Contributions
Pull Requests: Contribute directly to our codebase. Whether it's fixing bugs, adding features, or improving documentation, your contributions are welcome.
Development Guide: Check our Contributor's Guide for guidelines on code contributions.
Spread the Word
Social Sharing: Love Milvus? Share your use cases and experiences on social media and tech blogs.
Star Us on GitHub: Show your support by starring our GitHub repository.