elasticsearch provides the ingest mechanism to transform documents while they are indexed. The processory can transform fields, add and remove fields from indexed documents. For the rare cases it is possible to even write your own transform plugin. I cannot however find any possibilty to produce mutiple output documents for a single input document. Is this somehow possible using the ingest module in elastic? I would like to split a single document into multiple documents. Does it always have to be a one-to-one relation between the input and transformed document?
elasticsearch split document ingest processor
1.7k Views Asked by paweloque At
1
There are 1 best solutions below
Related Questions in ELASTICSEARCH
- How does Elasticsearch do attribute filtering during knn (vector-based) retrieval?
- Elastic python to extract last 1hr tracing
- Elastic search not giving result when Hyphen is used in search text
- FluentD / Fluent-Bit: Concatenate multiple lines of log files and generate one JSON record for all key-value from each line
- Elasticsearch functional_score with parameter of type string array as input not working
- Elasticsearch - cascading http inputs from Airflow API
- AWS Opensearch - Restore snapshot - Failed to parse object: unknown field [uuid] found
- cluster block exception for system index of kibana
- What settings are best for elasticsearch query to find full word and half word
- OpenSearch - Bulk inserting Million rows from Pandas dataframe
- unable access to kibana
- PySpark elastic load fail with error SparkContext is stopping with exitCode 0
- How to use query combined to KNN with ElasticSearch?
- Facing logstash compatibility issues
- If the same document is ingested at two different times, how to have the same id in Elasticsearch
Related Questions in TRANSFORMATION
- Can't use panel with transformation as source panel
- How can I get the inverse Transformation of in 2D
- Camera rotation to direction vector
- Transform a JSON array by Jolt into a new JSON object and keep objects separate
- Power Bi, colums to rows
- Jolt Transformation - keep JSON structure even if object is empty
- How can I apply image registration to images and their annotations with opencv?
- How to reshape this database in Excel or R
- Can you create custom VS Code snippets variables?
- how to do Transformation in vtklinewidget
- ADF Flatten transformation - can't select unroll by
- Reverse function to obtain original input values
- Delay observed between two moving sublayers
- transform data set in R from stacked months and years for multiple sites to sites with columns of year-month
- Jolt transform from a Map<Person, list<Property>, List<Feature>> to Map<Property, Map<Feature, List<Person>>>
Related Questions in INGEST
- Salesforce Bulk API v2 retries
- Read the smb file using pyspark
- Elasticsearch shared field name for different fields
- Grok processor in ingest pattern adds escaped double quotes on save
- KDB Q Ingestion
- If the file is deleted, delete from the ElasticSearch index
- Accessing metadata fields within ingestpipeline.yml set's processor in Elasticsearch
- NoAliveNodes Elasticsearch-PHP (Ingest-Attachment)
- How to add ingest node to k8s cluster with bitnami/elasticsearch helm chart
- Use Ingestion Pipeline to split between two indexes
- How to inject pdf into elasticsearch
- Azure Data Explorer oneclick Ingest from blob container (UI)
- Azure Synapse Copy pipeline for ingesting complex XML
- Elasticsearch ingest pipelines to extract log level as Field:Value
- How to get the local day of week from timestamp in elasticsearch
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular # Hahtags
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
Ingest node can only transform documents that are indexed but not suitable for what you are trying to achieve. You need to instead look at Logstash split filter plugin and see if it works for your use case - https://www.elastic.co/guide/en/logstash/current/plugins-filters-split.html