install ipython in Cloudera VM using pip
I am practicing pyspark in Cloudera VM, and pyspack need be launched by ipython. In all the old Cloudera VM guide, it use easy_install to install ipython, but it does not work in Virtualbox 5.2.0 r118431 and later. And will get the error :
After that, launch spack by ipython:
____ __
/ __ /__ ___ _____/ /__
_\ \/ _ \/ _ ` / __/ '_ /
/__ / .__ /\_ , /_/ /_ /\_\ version 1.6.0
/_/
Using Python version 2.6.6 (r266:84292, Jul 23 2015 15:22:56)
SparkContext available as sc, HiveContext available as sqlContext.
In [1]: sc.version
Out[1]: u'1.6.0'
$sudo easy_install ipython==1.2.1 ... error: Could not find suitable distribution for Requirement.parse('ipython==1.2.1')The solution for this is to use pip to install ipython. But by default, pip is not installed in cloudera VM, and pip can not be installed by eacy_install as well. And after some search, I noticed cloudera has yum installed, and yum can install pip:
$sudo yum install python-pip ... $which pip /usr/bin/pipNow ipython can be installed b pip:
$sudo pip install ipython=1.2.1 ...Succesfully installled ipython-1.2.1
After that, launch spack by ipython:
$PYSPARK_DRIVER_PYTHON=ipython pyspark
...
Welcome to____ __
/ __ /__ ___ _____/ /__
_\ \/ _ \/ _ ` / __/ '_ /
/__ / .__ /\_ , /_/ /_ /\_\ version 1.6.0
/_/
Using Python version 2.6.6 (r266:84292, Jul 23 2015 15:22:56)
SparkContext available as sc, HiveContext available as sqlContext.
In [1]: sc.version
Out[1]: u'1.6.0'
I would like to thank you for your nicely written post, its informative and your writing style encouraged me to read it till end. Thanks
ReplyDeleteselenium Training in chennai
amazon web services Training in chennai
Block Chain Training in velachery
Thanks for sharing!
ReplyDeleteThank you very much, this solved my problem! Minor fix though- in this line, you need to add a second =
ReplyDelete$sudo pip install ipython=1.2.1
needs to be $sudo pip install ipython==1.2.1
Thank you very much, this solved my problem.
DeleteGreat Article… I love to read your articles because your writing style is too good, its is very very helpful for all of us. Do check | Get trained by an expert who will enrich you with the latest updates.
ReplyDeleteGerman Classes in Chennai
Java Training in Chennai
German Training in Chennai
german classes chennai
Java Training center in Chennai
Java Certification course in Chennai
Very useful information, Keep posting more blog like this, Thank you.
ReplyDeleteAir hostess training in Chennai
Air Hostess Training Institute in chennai
cabin crew training institute in chennai
cabin crew training chennai
This was an excellant blog. Thanks to the admin for sharing this useful information.
ReplyDeleteIELTS Institute in Mumbai
Best IELTS Coaching Classes in Mumbai
IELTS Coaching Center in Mumbai
Best IELTS Classes in Mumbai
IELTS Coaching near me
IELTS Course in Mumbai
IELTS Training Institute in Mumbai
information
ReplyDeleteinformation
ReplyDeleteVery interesting post! Thanks for sharing your experience suggestions.
airport ground staff training courses in chennai
airport ground staff training in chennai
ground staff training in chennai
Very nice posts. this could not be explained better. Thanks for sharing, Keep up the good work.
ReplyDeletePython training in kalyan nagar
Java Training in Kalyan Nagar
Very nice posts. this could not be explained better. Thanks for sharing, Keep up the good work.
ReplyDeletedevops training in Bangalore
SalesForce developer Training in Bangalore
AWS training in Bangalorer
Data Analytics Training in Bangalore
Very nice posts. this could not be explained better. Thanks for sharing, Keep up the good work.
ReplyDeletePython training in Bellandur
Java Training in Bellandur
BluePrism training in Bellandurr
Selenium Training in Bellandur
And indeed, I’m just always astounded concerning the remarkable things served by you. Some four facts on this page are undeniably the most effective I’ve had.
ReplyDeleteDotnet Training in Chennai |Best Dotnet Training course in Chennai
Android Training in Chennai |Best Android Training course in Chennai
CCNA Training in Chennai | Best CCNA Training course in Chennai
MCSE Training in Chennai |Best MCSE Training course in Chennai
Embedded Systems Training in Chennai |Best Embedded Systems Training course in Chennai
This comment has been removed by the author.
ReplyDeletesuper blogggssss...!
ReplyDeleteinternship in chennai for ece students
internships in chennai for cse students 2019
Inplant training in chennai
internship for eee students
free internship in chennai
eee internship in chennai
internship for ece students in chennai
inplant training in bangalore for cse
inplant training in bangalore
ccna training in chennai
Hi, thank you very much for new information, i learned something new. Very well written.It was so good to read and use full to improve knowledge.
ReplyDeleteAWS training in chennai | AWS training in annanagar | AWS training in omr | AWS training in porur | AWS training in tambaram | AWS training in velachery
Thanks for the Incredible Blogs about JAVA...Appreciated for your Efforts.To explore more about JAVA Visit here
ReplyDeleteJava training in chennai | Java training in annanagar | Java training in omr | Java training in porur | Java training in tambaram | Java training in velachery
Great post! I am see the great contents and step by step read really nice information.I am gather this concepts and more information. It's helpful for me my friend. Also great blog here with all of the valuable information you have.
ReplyDeleteJava Training in Chennai
Java Training in Velachery
Java Training in Tambaram
Java Training in Porur
Java Training in Omr
Java Training in Annanagar
This comment has been removed by the author.
ReplyDeleteI finally found great post here.I will get back here. I just added your blog to my bookmark sites. thanks.Quality posts is the crucial to invite the visitors to visit the web page, that's what this web page is providing.Software Testing Training in Chennai
ReplyDeleteSoftware Testing Training in Velachery
Software Testing Training in Tambaram
Software Testing Training in Porur
Software Testing Training in Omr
Software Testing Training in Annanagar
I would like to thank you for your nicely written post, its informative and your writing style encouraged me to read it till end. Thanks
ReplyDeleteDigital Marketing Training in Chennai
Digital Marketing Training in Velachery
Digital Marketing Training in Tambaram
Digital Marketing Training in Porur
Digital Marketing Training in Omr
Digital Marketing Training in Annanagar
First You got a great blog .I will be interested in more similar topics. i see you got really very useful topics, i will be always checking your blog thank
ReplyDeleteBlockchainTraining in Bangalore
Iam so thrilled because of finding your alluring website here.Actually i was searching for Manage Web Hosting & C-Panel.Your blog is so astounding and informative too..Iam very happy to find such a creative blog. Iam also find another one by mistake while am searching the same topicMobile Marketing.Thank you soo much.
ReplyDeletesmm panel
ReplyDeleteSMM PANEL
İş ilanları blog
instagram takipçi satın al
HTTPS://WWW.HİRDAVATCİBURADA.COM/
https://www.beyazesyateknikservisi.com.tr
Servis
tiktok jeton hilesi
üsküdar samsung klima servisi
ReplyDeletetuzla mitsubishi klima servisi
tuzla daikin klima servisi
çekmeköy toshiba klima servisi
çekmeköy beko klima servisi
ataşehir beko klima servisi
maltepe lg klima servisi
kadıköy lg klima servisi
maltepe alarko carrier klima servisi