Crates.io | meilisearch-importer |
lib.rs | meilisearch-importer |
version | 0.2.1 |
source | src |
created_at | 2024-03-26 10:59:58.833674 |
updated_at | 2024-03-26 15:17:08.176579 |
description | A tool to import massive datasets into Meilisearch by sending them in batches |
homepage | |
repository | https://github.com/meilisearch/meilisearch-importer |
max_upload_size | |
id | 1186194 |
size | 57,743 |
The most efficient CLI tool to import massive CSVs, NSJSON or JSON (array of objects) into Meilisearch.
This tool has been tested with multiple datasets from hundreds of thousand documents to some with more than forty millions documents. The progress bar is very handy in this case.
You can download the latest version of this tool on the release page.
It's straightforward to create a project on the Cloud and send your documents into it.
If you cannot send your dataset directly from the website by drag-and-dropping it, this tool is perfect for you. You can send them by running the following command:
meilisearch-importer \
--url 'https://ms-************.sfo.meilisearch.io'
--index crunchbase \
--primary-key uuid \
--api-key 'D2jkS***************' \
--files ./dataset/organizations.csv
This tool is also useful when you want to test Meilisearch locally. The only mandatory parameters to define are the URL, the index name and your dataset.
However, you can also increase the batch size to make meilisearch index faster.
meilisearch-importer \
--url 'http://localhost:7700'
--index movies \
--files movies.json \
--batch-size 100MB