I am getting the error Set current project to spark-parent (in build file:/C:/cygwin64/spark-current/spark-2.1.1/) while trying to build spark. Is there an option "-Dcurrent" or some sbt switch that I can set to facilitate this or do I need to touch a build file? I have my environment variable at the proper location for %SPARK_HOME% so that's not the problem. I'm also working on a windows system but am doing it with cygwin.
Set current project in sbt - spark build issue
824 Views Asked by uh_big_mike_boi At
1
There are 1 best solutions below
Related Questions in APACHE-SPARK
- Spark .mapValues setup with multiple values
- Where do 'normal' println go in a scala jar, under Spark
- How to query JSON data according to JSON array's size with Spark SQL?
- How do I set the Hive user to something different than the Spark user from within a Spark program?
- How to add a new event to Apache Spark Event Log
- Spark streaming + kafka throughput
- dataframe or sqlctx (sqlcontext) generated "Trying to call a package" error
- Spark pairRDD not working
- How to know which worker a partition is executed at?
- Using HDFS with Apache Spark on Amazon EC2
- How to create a executable jar reading files from local file system
- How to keep a SQLContext instance alive in a spark streaming application's life cycle?
- Cassandra spark connector data loss
- Proper way to provide spark application a parameter/arg with spaces in spark-submit
- sorting RDD elements
Related Questions in BUILD
- Ionic cordova build
- Force GHC using local files
- RPM spec files with rpmbuild can have errors
- (automake, libtool) build fails in automake when using same source file name in different directory
- Backup strategy for build tool hosted on Azure VM
- include typescript file in output result build with TFS
- Android Build failed at ':app:dexDebug' with exception ( library and app project )
- GNU make - depend only on file existence and not modification time
- Error code 31 returned from mt.exe when building C++ projects in Visual Studio 2013
- IONIC FRAMEWORK Build Xcode Error :(
- Jenkins - Stage before "Source Code Management"
- Python: Trouble with dill installation
- Execution failed for task 'app:mergeDebugResources' Crunching Cruncher....png failed
- Android: Execution failed for task ':app:processDebugResources'
- Change assets urls to cdn adding absolute path in Grunt
Related Questions in SBT
- How to create a executable jar reading files from local file system
- sbt multi-module project: inter-dependency of integration tests
- How to avoid stack trace with sys.error(message)
- hot swap in sbt project without play-plugin
- sbt add plugin error
- How to combine crossProject and dependsOn
- How to use jnaerator in a sbt project
- how to get control-c to kill only the running process and not sbt itself?
- Intellij not respecting some options in build.sbt
- Docker: getcwd: cannot access parent directories
- How to abstract with SBT?
- SBT PublishM2 do not refresh snapshot jar in local maven repo
- With SBT how do I sequence tasks from plugin before running a test
- sbt stuck at Getting org.scala-sbt sbt 0.13.8 ... on Mac OS X Yosemite with Java 8 and scala 2.11.6
- How should I do that logging in sbt project?
Related Questions in APACHE-SPARK-2.0
- Spark Kafka Streaming job failing due to InvalidClassException
- Apache Spark | java.lang.AssertionError: assertion failed
- Spark Unit Testing
- createOrReplaceTempView does not work on empty dataframe in pyspark2.0.0
- Spark 2.0 ALS Recommendation how to recommend to a user
- How to persist a DataFrame to a Hive table?
- Dynamic Allocation for Spark Streaming
- How to convert RDD of dense vector into DataFrame in pyspark?
- reducebykey and aggregatebykey in spark Dataframe
- Parsing json in spark
- is there any google/aws services to move data from google store to s3
- Zeppelin 6.5 + Apache Kafka connector for Structured Streaming 2.0.2
- Getting a distinct count from a dataframe using Apache Spark
- What are the various join types in Spark?
- Checkpointing With NOT Serializable
Related Questions in SBT-BUILDINFO
- What is buildInfoPackage in sbt-buildinfo?
- IntelliJ Idea sbt managed source file
- sbt-buildinfo plugin: How can I add the java version in effect at compile time to the generated BuildInfo.scala?
- How to access SBT settings from Java code in PlayFramework?
- How to disable buildNumber increment in specific configurations?
- Can I access my Scala app's name and version (as set in SBT) from code?
- How to get Eclipse to resolve BuildInfo in an sbt / Scala/ BuildInfo project
- sbt: generating shared sources in cross-platform project
- Conditional multi projects builds using sbt
- How to not watch a file for changes in Play Framework
- How can I ask sbt-buildinfo to run only at (re)load time and not compile time?
- Generate build info source file in Maven project (similar to SBT Buildinfo)
- sbt-buildinfo generated object cannot be referenced
- IntelliJ Idea can't resolve symbol that inside Scala managed sources (sbt-buildinfo)
- Can the runtime of a Heroku app know it's commit id?
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
So I was in the wrong direction. I was using the sbt script incorrectly for the most part. Looking at the spark dev tools I just needed an additional parameter like "build/abt compile"