python - Running spark-submit from pycharm -
i trying figure out how develop apache-spark program in pycharm. have followed article in link. define spark_home , add pyspark python path well. there no error in importing pyspark modules , autocomplete works fine.
however error on defining sparkcontext when run program in pycharm.
error: must specify primary resource (jar or python or r file) run --help usage or --verbose debug output ... ... exception: java gateway process exited before sending driver port number
i managed run program on terminal submit-spark. need change configuration on pycharm or there anyway run submit-spark instead of python in pycharm?
if fine terminal submit-spark
can add run configuration you. otherwise can see configuration in edit run/debug configurations
window well. this post in particular can there.
Comments
Post a Comment