Skip to content

Commit 64e6301

Browse files
committed
korean test case
1 parent 51c5de8 commit 64e6301

4 files changed

Lines changed: 887 additions & 4 deletions

File tree

goose_extractor.egg-info/PKG-INFO

Lines changed: 20 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -10,9 +10,26 @@ Description: Python-Goose - Article Extractor |Build Status|
1010
===============================================
1111

1212
Try to add Korean support for Goose.
13-
I loved Goose so far and only used for English articles so far.
14-
Now, I realized that Goose supports Chinese.
15-
I am Korean, so why not try to add Korean support?
13+
14+
Example:
15+
16+
Goose in Korean
17+
----------------
18+
19+
Right now, it is not utilizing stopword correctly because of
20+
UnicodeDecodeError: 'ascii' codec can't decode byte 0xea in position 0: ordinal not in range(128)
21+
However, it is working right now.
22+
::
23+
24+
>>> from goose import Goose
25+
>>> from goose.text import StopWordsKorean
26+
>>> url='http://news.donga.com/3/all/20131023/58406128/1'
27+
>>> g = Goose({'stopwords_class':StopWordsKorean})
28+
>>> article = g.extract(url=url)
29+
>>> print article.cleaned_text[:150]
30+
경기도 용인에 자리 잡은 민간 시험인증 전문기업 ㈜디지털이엠씨(www.digitalemc.com).
31+
14년째 세계 각국의 통신·안전·전파 규격 시험과 인증 한 우물만 파고 있는 이 회사 박채규 대표가 만나기로 한 주인공이다.
32+
그는 전기전자·무선통신·자동차 전장품 분야에
1633

1734

1835

0 commit comments

Comments
 (0)