Add batch import functionality to Weaviate CLI & Add your own data from a local JSON file

[Shah91n]

New Features:

• Add batch import functionality to Weaviate CLI
• Add your own data by enabling batching directly from a local JSON file.

Example Usage:

weaviate-cli batch insert --collection <collection_name> --path <path_to_json_file> --vectorizer <vectorizer_name> --replication-factor <replication_factor>

Sample JSON:

Changes

• batch.py: Implements CLI commands for batch operations, allowing users to create collections dynamically and insert data in bulk from JSON files.
• batch_manager.py: Handles the core logic for batch operations, including collection creation with advanced configuration (e.g., vectorizers, shards) and robust batch insertion with schema inference and validation.

[orca-security-eu]

Orca Security Scan Summary

Status	Check	Issues by priority
Passed	Infrastructure as Code	0   0   0   0	View in Orca
Passed	Secrets	0   0   0   0	View in Orca
Passed	Vulnerabilities	0   0   0   0	View in Orca

[weaviate-git-bot]

To avoid any confusion in the future about your contribution to Weaviate, we work with a Contributor License Agreement. If you agree, you can simply add a comment to this PR that you agree with the CLA so that we can merge.

beep boop - the Weaviate bot 👋🤖

PS:
Are you already a member of the Weaviate Slack channel?

[orca-security-eu]

Orca Security Scan Summary

Status	Check	Issues by priority
Passed	Infrastructure as Code	0   0   0   0	View in Orca
Passed	SAST	0   0   0   0	View in Orca
Passed	Secrets	0   0   0   0	View in Orca
Passed	Vulnerabilities	0   0   0   0	View in Orca