My Apache NiFi instance just hangs on the "Computing FlowFile lineage..." for a specific flow. Others work, but it won't show the lineage for this specific flow for any data files. The only error message in the log is related to an error in one of the processors, but I can't see how that would affect the lineage, or stop the page from loading.
Apache NiFi instance hangs on the "Computing FlowFile lineage..." window
360 Views Asked by The Shoe Shiner At
1
There are 1 best solutions below
Related Questions in APACHE-NIFI
- How to split a flow file json in nifi
- Nifi queryrecord compare regex using rpath on first level of record
- How to compare two csv files line by line in apachi nifi flow file using groovy script
- Apache nifi Invoke Http with url containing %2F
- localhost 8443 refused to connect
- Apache NIFI: Unable to write flow content
- Copy/Merge multiple HDFS files using Nifi Processor
- How to count the number of records of a JSON object using JOLT
- Jolt to remove the slashes and extract the nested json
- Customize Apache Nifi Frontend
- Apache NIFI getMongo An unexpected error has occurred: The specified data reference URI is not valid
- Filter JSON Array to Keep Only the Entry with the Latest Date/Time Using Jolt
- How to get hold of input file from a flowfile?
- How to let Airflow know that a Ni-Fi pipeline involving multiple flows is complete
- Creating connection from RouteOnAttribute to GetFile
Related Questions in DATAFLOW
- Issue Pickling Dataflow Pipeline on Airflow
- How to convert SQL rows to an array of json objects in Azure Data Factory?
- Dataflow doesn’t create an empty partition when writing to a Bigquery time-unit column partition
- how to save logs from c++ binary in beam python?
- Google cloud data flow exmaple
- Apache Beam: WriteToFiles Based on Filename
- DataflowRunner "Cannot convert GlobalWindow to apache_beam.utils.windowed_value._IntervalWindowBase" using SlidingWindows yet DirectRunner works?
- Use apache beam arguments within the pipeline
- Pass/Refer a SQL file in Apache Beam instead of string
- Can not pass varible to region in MKCoordinateRegion in swift
- Dataflow- dynamic create disposition Apache Beam
- Read CSV to a class Dataflow Java from GCS
- Dataflow Job extracting meta information
- Output multiple tuples at same time in apache beam pipeline
- Dataflow WindowIntoBatches WithShardedKey error (Python)
Related Questions in DATA-LINEAGE
- ODI 12c Data Lineage Query with Source, Staging, Target table column details
- Data Lineage in Unity Catalog is not shown in lineage tab in databricks
- How is marquez aware of the structure that airflow sets up?
- BigQueryInsertJobOperator data_lineage doesn't work on Google Cloud Composer with tableDefinitions
- Salesforce API, extract lineage
- data lineage and provenance of airflow pipeline
- How to login to Collibra from AWS EC2 instance?
- PySpark OpenLineage configuration
- Is it possible to find the queries in BigQuery triggered by "looker studio"/ "data studio" using INFORMATION_SCHEMA.JOBS_BY_PROJECT?
- How to convert an arbitrary SQL statement to column level lineage information via an open source solution?
- How can you create lineage between Power BI datasets and Databricks sql warehouse
- How to inject inlets and outlets parameters in Airflow PythonOperator executable function
- BigQuery Data Lineage using AuditLogs, PubSub, Dataflow, ZetaSQL and Data Catalog
- How to generate DBT data lineage graphs in client's production environment?
- How to get metadata from Talend Data Management Platform?
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular # Hahtags
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
This was related to two things...
1) I was using the older (but default) provenance repository, which didn't perform well, resulting in the lag in the UI. So I needed to change it...
2) Fixing #1 exposed the second issue, which was that the EnforceOrder processor was generating hundreds of provenance events per file, because I was ordering on a timestamp, which had large gaps between the values. This is apparently not a proper use case for the EnforceOrder processor. So I'll have to remove it and find another way to do the ordering.