This part of the documentation covers the installation of newspaper. The first step to using any software package is getting it properly installed.
Installing newspaper is simple with pip. However, you will run into fixable issues if you are trying to install on ubuntu.
If you are on Debian / Ubuntu, install using the following:
Python development version, needed for Python.h:
$ sudo apt-get install python-dev
lxml requirements:
$ sudo apt-get install libxml2-dev libxslt-dev
For PIL to recognize .jpg images:
$ sudo apt-get install libjpeg-dev zlib1g-dev libpng12-dev
Install the distribution via pip:
$ pip install newspaper
Download NLP related corpora:
$ curl https://raw.githubusercontent.com/codelucas/newspaper/master/download_corpora.py | python2.7
If you are on OSX, install using the following, you may use both homebrew or macports:
$ brew install libxml2 libxslt $ brew install libtiff libjpeg webp little-cms2 $ pip install newspaper $ curl https://raw.githubusercontent.com/codelucas/newspaper/master/download_corpora.py | python2.7
Otherwise, install with the following:
NOTE: You will still most likely need to install the following libraries via your package manager
- PIL:
libjpeg-devzlib1g-devlibpng12-dev - lxml:
libxml2-devlibxslt-dev - Python Development version:
python-dev
$ pip install newspaper $ curl https://raw.githubusercontent.com/codelucas/newspaper/master/download_corpora.py | python2.7
Newspaper is actively developed on GitHub, where the code is always available.
You can clone the public repository:
git clone git://github.com/codelucas/newspaper.git
Once you have a copy of the source, you can embed it in your Python package, or install it into your site-packages easily:
$ pip install -r requirements.txt $ python setup.py install
Feel free to give our testing suite a shot:
$ python tests/unit_tests.py