how to load csv data from object store(which can be accessed only using url) into kafka topic and also is there any time interval to load each row?

Question

I have to load csv data from object store(which can be accessed only using url) into kafka topic. how can i load this csv data to topic in kafka ?please explain the steps. and also is there any time interval to load?.I tried spooldir connector via rest api but could not figure out how to provide url..

spooldir config:

{"connector.class":"com.github.jcustenborder.kafka.connect.spooldir.SpoolDirCsvSourceConnector",
"topic":"spooldir-testing-topic",
"input.path":"",//here how to provide url instead of path?
"finished.path": "<finished path>",
"error.path": "<>error path",
"input.file.pattern":".*\\.csv",
"schema.generation.enabled":"true",
"csv.first.row.as.header":"true",
"tasks.max":"1",
"halt.on.error":"false"}

1)how to provide url instead of path? 2)how to provide time interval between each row of csv? ex:n rows in n seonds?

Answer 1

Spooldir connector assumes local filesystem access, only.

You're going to need a different connector/solution, including possibly writing your own Connector class