What is going to replace the DataImportHandler in Solr 9.0?

Question

The latest documentation (8.8) for Apache Solr says that the Data Import Handler is deprecated is going to be removed in future versions. It only lists a third-party plugin maintained on Github, and no other native alternative to import data from relational databases. Am I missing something or has Solr dropped native support for this?

Answer 1

Data import handler will still be there, but as a contrib package.

I'll do what I did before data import handler existed and write a separate program. I prefer Python, where reading a database and sending JSON updates is pretty simple.

Be sure to batch the updates.

Answer 2

Alternative solr DIH https://github.com/saro-lab/solr-db-importer

I made an alternative program to DIH and released the source code and manual.

Answer 3

I want to implement your solr-sb-importer But it seems stay stuck at running. I suspect the loading of the schema is not working http://localhost:8983/solr/succesboeken_sb/sb-schema I get: Exception in thread "main" org.springframework.web.client.HttpClientErrorException$NotFound: 404 Not Found: "

Searching for Solr?
You must type the correct path.
Solr will respond.

"

while excecuting: java -jar solr-db-importer-1.4.jar

I am using Solr 9.1.0

Have you encountered this before?

Answer 4

I am using Apache NiFi to index bulk data to Solr. It is a quick and easy implementation. Here's the link to the template you can import and use directly. In this flow I am indexing chunks of JSON data to Solr.

https://github.com/AyanF/NiFi-flows/blob/master/Index_Json_Chunks_to_Solr_.xml

The json chunks are data imported from another Solr instance.