install ipython in Cloudera VM using pip

I am practicing pyspark in Cloudera VM, and pyspack need be launched by ipython. In all the old Cloudera VM guide, it use easy_install to install ipython, but it does not work in Virtualbox 5.2.0 r118431 and later. And will get the error :
$sudo easy_install ipython==1.2.1
...
error: Could not find suitable distribution for Requirement.parse('ipython==1.2.1')
The solution for this is to use pip to install ipython. But by default, pip is not installed in cloudera VM, and pip can not be installed by eacy_install as well. And after some search, I  noticed cloudera has yum installed, and yum can install pip:
$sudo yum install python-pip
...
$which pip
/usr/bin/pip
Now ipython can be installed b pip:
$sudo pip install ipython=1.2.1
...
Succesfully installled ipython-1.2.1

After that, launch spack by ipython:
$PYSPARK_DRIVER_PYTHON=ipython pyspark
...
Welcome to
      ____                       __
     / __ /__  ___ _____/  /__
    _\ \/ _   \/  _  ` /  __/    '_ /
   /__ / .__ /\_ ,  /_/  /_ /\_\   version 1.6.0
       /_/

Using Python version 2.6.6 (r266:84292, Jul 23 2015 15:22:56)
SparkContext available as sc, HiveContext available as sqlContext.

In [1]: sc.version
Out[1]: u'1.6.0'

Comments

  1. I would like to thank you for your nicely written post, its informative and your writing style encouraged me to read it till end. Thanks
    selenium Training in chennai


    amazon web services Training in chennai


    Block Chain Training in velachery

    ReplyDelete
  2. Thank you very much, this solved my problem! Minor fix though- in this line, you need to add a second =

    $sudo pip install ipython=1.2.1

    needs to be $sudo pip install ipython==1.2.1

    ReplyDelete
  3. Great Article… I love to read your articles because your writing style is too good, its is very very helpful for all of us. Do check | Get trained by an expert who will enrich you with the latest updates.
    German Classes in Chennai
    Java Training in Chennai
    German Training in Chennai
    german classes chennai
    Java Training center in Chennai
    Java Certification course in Chennai

    ReplyDelete
  4. Very nice posts. this could not be explained better. Thanks for sharing, Keep up the good work.

    Python training in kalyan nagar
    Java Training in Kalyan Nagar

    ReplyDelete
  5. This comment has been removed by the author.

    ReplyDelete
  6. Hi, thank you very much for new information, i learned something new. Very well written.It was so good to read and use full to improve knowledge.

    AWS training in chennai | AWS training in annanagar | AWS training in omr | AWS training in porur | AWS training in tambaram | AWS training in velachery



    ReplyDelete
  7. Great post! I am see the great contents and step by step read really nice information.I am gather this concepts and more information. It's helpful for me my friend. Also great blog here with all of the valuable information you have.
    Java Training in Chennai

    Java Training in Velachery

    Java Training in Tambaram

    Java Training in Porur

    Java Training in Omr

    Java Training in Annanagar

    ReplyDelete
  8. This comment has been removed by the author.

    ReplyDelete
  9. I finally found great post here.I will get back here. I just added your blog to my bookmark sites. thanks.Quality posts is the crucial to invite the visitors to visit the web page, that's what this web page is providing.Software Testing Training in Chennai

    Software Testing Training in Velachery

    Software Testing Training in Tambaram

    Software Testing Training in Porur

    Software Testing Training in Omr

    Software Testing Training in Annanagar

    ReplyDelete
  10. First You got a great blog .I will be interested in more similar topics. i see you got really very useful topics, i will be always checking your blog thank
    BlockchainTraining in Bangalore

    ReplyDelete
  11. Iam so thrilled because of finding your alluring website here.Actually i was searching for Manage Web Hosting & C-Panel.Your blog is so astounding and informative too..Iam very happy to find such a creative blog. Iam also find another one by mistake while am searching the same topicMobile Marketing.Thank you soo much.

    ReplyDelete

Post a Comment

Popular posts from this blog

install postgreSQL in ubuntu 16.04

timestamp with 16, 13 and 10 digits to Qlik date