You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.rst
+14-14Lines changed: 14 additions & 14 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -5,9 +5,9 @@ Intro
5
5
-----
6
6
7
7
Goose was originally an article extractor written in Java that has most
8
-
recently (aug2011) been converted to a `scala project <https://github.com/GravityLabs/goose>`_.
8
+
recently (Aug2011) been converted to a `scala project <https://github.com/GravityLabs/goose>`_.
9
9
10
-
This is a complete rewrite in python. The aim of the software is to
10
+
This is a complete rewrite in Python. The aim of the software is to
11
11
take any news article or article-type web page and not only extract what
12
12
is the main body of the article but also all meta data and most probable
13
13
image candidate.
@@ -16,22 +16,22 @@ Goose will try to extract the following information:
16
16
17
17
- Main text of an article
18
18
- Main image of article
19
-
- Any Youtube/Vimeo movies embedded in article
19
+
- Any YouTube/Vimeo movies embedded in article
20
20
- Meta Description
21
21
- Meta tags
22
22
23
-
The python version was rewritten by:
23
+
The Python version was rewritten by:
24
24
25
25
- Xavier Grangier
26
26
27
27
Licensing
28
28
---------
29
29
30
30
If you find Goose useful or have issues please drop me a line. I'd love
31
-
to hear how you're using it or what features should be improved
31
+
to hear how you're using it or what features should be improved.
32
32
33
-
Goose is licensed by Gravity.com under the Apache 2.0 license, see the
34
-
LICENSE file for more details
33
+
Goose is licensed by Gravity.com under the Apache 2.0 license; see the
34
+
LICENSE file for more details.
35
35
36
36
Setup
37
37
-----
@@ -70,13 +70,13 @@ pass goose a Configuration() object. The second one is to pass a
70
70
configuration dict.
71
71
72
72
For instance, if you want to change the userAgent used by Goose just
73
-
pass:
73
+
pass:
74
74
75
75
::
76
76
77
77
>>> g = Goose({'browser_user_agent': 'Mozilla'})
78
78
79
-
Switching parsers : Goose can now be use with lxml html parser or lxml
79
+
Switching parsers : Goose can now be used with lxml html parser or lxml
80
80
soup parser. By default the html parser is used. If you want to use the
81
81
soup parser pass it in the configuration dict :
82
82
@@ -87,8 +87,8 @@ soup parser pass it in the configuration dict :
87
87
Goose is now language aware
88
88
---------------------------
89
89
90
-
For example scrapping a Spanish content page with correct meta language
91
-
tags
90
+
For example, scraping a Spanish content page with correct meta language
91
+
tags:
92
92
93
93
::
94
94
@@ -114,7 +114,7 @@ configuration :
114
114
u'Importante golpe a la banda terrorista ETA en Francia. La Guardia Civil ha detenido en un hotel de Macon, a 70 kil\xf3metros de Lyon, a Izaskun Lesaka y '
115
115
116
116
Passing {'use\_meta\_language': False, 'target\_language':'es'} will
117
-
force as configuration will force the spanish language
117
+
forcibly select Spanish.
118
118
119
119
120
120
Video extraction
@@ -146,7 +146,7 @@ Goose in Chinese
146
146
Some users want to use Goose for Chinese content. Chinese word
147
147
segmentation is way more difficult to deal with than occidental
148
148
languages. Chinese needs a dedicated StopWord analyser that need to be
149
-
passed to the config object
149
+
passed to the config object.
150
150
151
151
::
152
152
@@ -202,7 +202,7 @@ Known issues
202
202
------------
203
203
204
204
- There are some issues with unicode URLs.
205
-
- Cookie handling : Some websites need cookie handling. At the moment the only work around is to use the raw_html extraction. For instance ;
205
+
- Cookie handling : Some websites need cookie handling. At the moment the only work around is to use the raw_html extraction. For instance:
0 commit comments