This repository contains sphinx styles Kenneth Reitz uses in most of
-his projects. It is a derivative of Mitsuhiko’s themes for Flask and Flask related
-projects. To use this style in your Sphinx documentation, follow
-this guide:
-
-
put this folder as _themes into your docs folder. Alternatively
-you can also use git submodules to check out the contents there.
Inspired by requests for its simplicity and powered by lxml for its speed; newspaper
-is a Python 2 library for extracting & curating articles from the web.
-
Newspaper wants to change the way people handle articleextraction with anew,moreprecise
-layerofabstraction.
-
Newspaper utilizes lxml and caching for speed. Also, everything is in unicode
-
>>> importnewspaper
-
->>> cnn_paper=newspaper.build('http://cnn.com')# ~15 seconds
-
->>> forarticleincnn_paper.articles:# filters urls
->>> printarticle.url
-
-u'http://www.cnn.com/2013/11/27/justice/tucson-arizona-captive-girls/'
-u'http://www.cnn.com/2013/12/11/us/texas-teen-dwi-wreck/index.html'
-u'http://www.cnn.com/2013/12/07/us/life-pearl-harbor/'
-...
-
->>> printcnn_paper.size()# number of articles
-3100
-
->>> printcnn_paper.category_urls()
-[u'http://lifestyle.cnn.com', u'http://cnn.com/world', u'http://tech.cnn.com' ...]
-
->>> printcnn_paper.feed_urls()
-[u'http://rss.cnn.com/rss/cnn_crime.rss', u'http://rss.cnn.com/rss/cnn_tech.rss', ...]
-
-first_article = cnn_paper.articles[0]
-
-first_article.download()
-
->>> printfirst_article.html# html fetched from download()
-u'<!DOCTYPE HTML><html itemscope itemtype="http://...'
-
->>> printcnn_paper.articles[7].html# won't work, only downloaded 5 articles
-u''
-
->>> first_article.parse()# parse html for body txt, authors, title..
-
->>> printfirst_article.text
-u'Three sisters who were imprisoned for possibly...'
-
->>> printfirst_article.top_img
-u'http://some.cdn.com/3424hfd4565sdfgdg436/
-
->>> printfirst_article.authors
-[u'Eliott C. McLaughlin', u'Some CoAuthor']
-
->>> printfirst_article.title
-u'Police: 3 sisters imprisoned in Tucson home'
-
-
->>> first_article.nlp()# must be on an already parse()'ed article
-
->>> printfirst_article.summary
-u'...imprisoned for possibly a constant barrage...'
-
->>> printfirst_article.keywords
-[u'music', u'Tucson', ... ]
-
->>> printcnn_paper.articles[100].nlp()# fail, not been downloaded yet
-Traceback (...
- ...
-ArticleException: You must parse an article before you try to..
-
-
->>> # some other news-source level functionality
-
->>> printcnn_paper.brand
-u'cnn'
-
->>> printcnn_paper.description
-u'CNN.com delivers the latest breaking news and information on the latest...'
-
-
->>> # a few hopefully useful easter eggs:
-
->>> newspaper.hot()[:5]
-['Ned Vizzini', Brian Boitano', Crossword Inventor', 'Alex and Sierra', 'Claire Davis']
-
->>> newspaper.popular_urls()
-['http://slate.com', 'http://cnn.com', 'http://huffingtonpost.com', ...]
-
-^ just a few friendly suggestions if you forget the popular news sites!
-
-
-
IMPORTANT
-
Unless told not to in the constructor via the is_memo_articles param (default true),
-newspaper automatically caches all category, feed, and article urls.
-This is both to avoid duplicate articles and for speed.
-
Suppose the above code has already been run on the cnn domain once. Previous
-article urls are cached and dupes are removed so we only get new articles.
-
->>> importnewspaper
-
->>> cnn_paper=newspaper.build('http://cnn.com')
->>> cnn_paper.size()
-60 # since we last ran build(), cnn published 60 new articles!
-
->>> # If you'd like to opt out of memoization, init newspapers with
-
->>> cnn_paper2=newspaper.build('http://cnn.com',is_memo=False)
->>> cnn_paper2.size()
-3100
-
-
-
Alternatively, you may use newspaper’s lower level Article api.
-
>>> fromnewspaperimportArticle
-
->>> article=Article('http://cnn.com/2013/11/27/travel/weather-thanksgiving/index.html')
->>> article.download()
-
->>> printarticle.html
-u'<!DOCTYPE HTML><html itemscope itemtype="http://...'
-
->>> article.parse()
-
->>> printarticle.text
-u'The purpose of this article is to introduce...'
-
->>> printarticle.authors
-[u'Martha Stewart', u'Bob Smith']
-
->>> printarticle.top_img
-u'http://some.cdn.com/3424hfd4565sdfgdg436/
-
->>> printarticle.title
-u'Thanksgiving Weather Guide Travel ...'
-
->>> article.nlp()
-
->>> printarticle.summary
-u'...and so that's how a Thanksgiving meal is cooked...'
-
->>> printarticle.keywords
-[u'Thanksgiving', u'holliday', u'Walmart', ...]
-
-
-
nlp() is expensive, as is parse(), make sure you actually need them before calling them on
-all of your articles! In some cases, if you just need urls, even download() is not necessary.
-
Newspaper stands on the giant shoulders of lxml, nltk, and requests. Newspaper also uses much of
-goose‘s code internally.
$ pip install newspaper
-
-### IMPORTANT ###
-# If you KNOW for sure you will use the natural language features, nlp(), you must
-# download some seperate nltk corpora below, it may take a while!
-
-$ curl https://raw.github.com/codelucas/newspaper/master/download_corpora.py | python2.7
- Please activate JavaScript to enable the search
- functionality.
-
-
-
- From here you can search these documents. Enter your search
- words into the box below and click "search". Note that the search
- function will automatically search for all of the words. Pages
- containing fewer words won't appear in the result list.
-
Boomer & Craig were thrilled to welcome an American Hero into the Allstate Studio, as Kelly Malloy (pictured next to Boomer, along with a couple of friends) stopped-by and was given the royal treatment she deserved…
Some traders found Wednesday's Fed statementto be a bit gloomier than expected.
One reason may be the addition of concern about Europe: "there are significant downside risks to the economic outlook, including strains in global financial markets."
-
-
-
The Fed did launch much anticipated "operation twist" with a twist—it is also taking direct aim at mortgages. The Fed said it would replace $400 billion in short-term Treasurys (3-years or less) to the same amount of longer term securities—with durations of 6- to 30-years.
But it also said it would reinvest the runoff from its maturing mortgage securities back into the mortgage market. Take alook hereat the Fed's statement and how it was changed from the August statement, courtesy of Ian Lyngen, senior Treasury strategist at CRT Capital.
\ No newline at end of file
diff --git a/newspaper/packages/python-goose-documents/tests/data/extractors/test_cnbc1.json b/newspaper/packages/python-goose-documents/tests/data/extractors/test_cnbc1.json
deleted file mode 100644
index a4d63208..00000000
--- a/newspaper/packages/python-goose-documents/tests/data/extractors/test_cnbc1.json
+++ /dev/null
@@ -1,12 +0,0 @@
-{
- "url": "http://www.cnbc.com/id/44613978",
- "expected": {
- "meta_description": "The Fed launched much anticipated \"operation twist\" with a twist\u2014it is also taking direct aim at mortgages. The Fed also warned of significant downside economic risks. Check out how it changed its statement.",
- "domain": "www.cnbc.com",
- "final_url": "http://www.cnbc.com/id/44613978",
- "meta_keywords": "Bonds,Economy,Interest Rates,Economy (Global),Banking,Economic Measures,Debt,Central Banks,Ben Bernanke,Federal Reserve,Currencies,Investment Strategy,Top Blogs",
- "cleaned_text": "Some traders found Wednesday's Fed statement to be a bit gloomier than expected.",
- "meta_favicon": "http://media.cnbc.com/i/CNBC/CNBC_Images/mobile_images/cnbc_iphone_icon.png",
- "meta_lang": null
- }
-}
\ No newline at end of file
diff --git a/newspaper/packages/python-goose-documents/tests/data/extractors/test_cnet.html b/newspaper/packages/python-goose-documents/tests/data/extractors/test_cnet.html
deleted file mode 100644
index dfebd057..00000000
--- a/newspaper/packages/python-goose-documents/tests/data/extractors/test_cnet.html
+++ /dev/null
@@ -1,688 +0,0 @@
-
-
- Verizon shows off iPad TV app and more | Signal Strength - CNET News
-
-
-
-
-
-
-
-
-
Verizon Fios TV subscribers will be able to watch live TV on an iPad using a new app due to come out sometime next year.
-(Credit:
-Marguerite Reardon/CNET)
-
-
NEW YORK--Verizon Communications is prepping a new live TV streaming app for
-tablet PCs like the
-Apple iPad, a move that could eventually eliminate the need for a home set-top box and set the stage for true "TV everywhere" viewing.
-
At a demonstration at the home of Verizon CIO Shaygan Kheradpir, Verizon executives showed off a slew of new features for its Fios TV service, including the live TV streaming application on an iPad.
-
-
The new app allows Fios TV subscribers to stream live TV from their service onto an iPad over a home Wi-Fi connection. Initially, the service will work only in the home. But Kheradpir said that eventually the service could be offered as part of Verizon's TV-anywhere strategy, allowing people to access live TV anywhere they are using a username and password to authenticate the service.
-
"We built Fios TV as a cloud computing product," Kheradpir said. "The set-top box function is all done in software, and we simply redirect the broadcast TV signal to another screen. And because the set-top function is in software we can implement the functionality in devices."
-
Kheradpir said that the iPad is a perfect device for the application because of its elegant design. The large touch screen is big enough for comfortable TV viewing. And the device also turns on and off quickly, unlike many laptops, which take several minutes to boot up and shut down.
-
-
-
Verizon CIO Shaygan Kheradpir shows off a new app that allows people to watch live TV on an Apple iPad.
-(Credit:
-Marguerite Reardon/CNET)
-
-
-
Eventually the app will be available for other tablet PCs as well as other connected devices, such as laptops and mobile phones.
-
"We have to start the engineering somewhere." Kheradpir. "And the iPad is an ideal device for this."
-
-
Kheradpir told journalists at the demonstration that the app is technically ready to go, but the company must wait until it has signed deals with content providers before it will go live with the service. The company is currently negotiating with several major cable and broadcast TV providers, such as Time Warner, to hammer out programming agreements.
-
"The engineering work is done," he said. "Now we have to work with the ecosystem and the content community to come up with equations that work for everyone."
-
The agreements that Verizon and other paid TV services make to offer certain TV channels as part of its service are for TV viewing only. Traditionally, content providers have negotiated separate agreements to stream live broadcasts on other devices, such as mobile phones.
-
Shawn Strickland, vice president of Fios product management for Verizon, said the company doesn't intend to pay content providers more to make programming available on multiple devices in the home. But he admitted that every negotiation with every provider is different.
-
Kheradpir made the argument that content providers actually benefit from allowing their programming to be viewed in this way. He used his own family as an example. He said that he and his wife watch CNN television all the time. But his 18-year-old daughter doesn't usually watch the cable station live. Instead, she checks the CNN Web site online in her bedroom on her laptop. Once Kheradpir started testing the new iPad app at home, his daughter altered her behavior.
-
"Now she takes the iPad to her room and watches the live CNN TV stream," he said. "So now CNN has won her back as a TV viewer instead of someone who only goes to the Web site."
-
Verizon executives said the new application will likely be available next year. But Kheradpir didn't rule out offering the new service sometime in 2010.
-
-Reducing the number of set-top boxes While there's no doubt the application extends where TV can be viewed, it also demonstrates how to cut down on the number of set-top boxes used in the home. Executives admitted that the set-top box won't go away entirely anytime soon, but as more functionality is pushed into the Verizon service cloud and more devices are equipped with software to render video signals on any device, there will eventually be less need for such devices.
-
-
"This is more economical for us," said Strickland. "We don't have to spend the capital to put boxes everywhere."
Kheradpir said eventually this will be unnecessary.
-
"The FCC is trying to solve a problem that doesn't exist anymore," he said. "They are 20 years behind. The world has moved on. We are way ahead of what they are thinking with what we have done with the software."
-
Verizon is nearing the end of its $23 billion project to wire two-thirds of its territory with fiber to the home connections. The company now has 3.8 million customers for Fios Internet and about 3.2 million for Fios TV, according to the company's second-quarter results. The infrastructure makes service available to roughly 18 million people, and Verizon is now in the process of expanding its customer base within the existing territories where it has built the network.
-
-
-
The new streaming app for Verizon Fios TV will eventually allow subscribers to watch live TV and video on demand on any device, anywhere.
In an effort to compete with over-the-top Internet offerings and some offerings from competitors such as Comcast, Verizon will soon offer movie purchase and rental options and a three-screen or "Flexview" option that allows subscribers to view digital rights-protected video content to be shown on up to five other devices.
-
Standard-definition and high-definition movies can be bought or rented for between $2 to $18. Files that consumers own, they will own for life, even if they leave the Fios TV service. Most video rentals expire within 48-hours after the first playback.
-
Verizon is also allowing subscribers to store their own personal content, such as pictures, video, and music in the cloud with the option to listen or view the content anywhere there is an Internet connection using a Fios app.
-
At launch, the movie and personal content apps will be accessed on a number of platforms, including Mac and PC computers, as well as mobile-phone platforms Google
-Android, Research In Motion, and Windows Mobile. An app for the iPhone is coming, but Verizon executives said they are unsure when the app will be approved and available.
-
-
The video and personal media can be streamed over Wi-Fi, 3G, and 4G networks, regardless of provider. The only limitation is that the service is available on up to five devices at any given time. But executives said they have made it easy to authorize and de-authorize devices to accommodate usage on many devices. And if the company finds that more device authorizations are needed, it will eventually bump up the number.
-
These services will be offered to Verizon Fios TV customers later this year at no additional charge.
-
Correction 8/29/10 7:05 a.m. PDT:A previous version of this story misstated Shaygan Kheradpir's title. He is Chief Information Officer for Verizon Communications.
Marguerite Reardon has been covering the telecom beat for more than a decade and knows more about wireless and IP networking than she cares to admit. She has been a senior writer for CNET News since 2003, covering all things wireless and broadband related from iPhone launches to major telephone company mergers to IPTV developments. She often appears as an expert on news networks, including CNBC, MSNBC, NPR, and the BBC. Maggie loves visiting CNET's headquarters in San Francisco, but she's an East Coaster at heart, living and working in Manhattan.
Russian engineers are trying to find out what caused an unmanned Soyuz rocket to shut down before reaching orbit, sending 2.9 tons of space station cargo crashing back to Earth.
In part three of a behind-the-scenes look at the development of Microsoft's new phone software, Ina Fried takes a look at Redmond's massive testing operation.
Known mainly as an innovative games platform, the San Francisco start-up's first product is aimed at fulfilling a 20-year-old vision of computers being everywhere and on every surface.
Apple CEO Steve Jobs steps down as CEO of the iconic electronics company he co-founded. Jobs has asked Apple's board to put chief operating officer Tim Cook in his place.
SpectraWatt, which had hoped to improve solar-cell manufacturing, files for Chapter 11 bankruptcy protection, citing production problems and market conditions.
Democrats to use Social Security against GOP this fall
By Ed Hornick, CNN
Democratic National Committee Chairman Tim Kaine says Democrats will continue to highlight their role in Social Security.
STORY HIGHLIGHTS
The Social Security Act was signed into law on August 14, 1935
DNC Chairman Tim Kaine says Democrats will tout the program this fall
Republicans have called for a revamp of the program, including privatization
Washington (CNN) -- Democrats pledged Friday to not only keep Social Security in place, but use the historic program against Republicans ahead of the midterm election.
"We will continue to highlight the Democratic Party's role in strengthening it and the Republican Party's role in opposing it," said Democratic National Committee Chairman Tim Kaine."So that is one of the themes for the fall: It's critical to elect Democrats who will stand with the president to protect Social Security."
He said that President Obama and Democrats across the country are "very dedicated to preserving this wonderful program," and that the party opposes privatization or other "misguided schemes that will undermine or threaten Social Security."
Saturday is the 75th anniversary of the Social Security Act, signed into law by President Franklin Roosevelt on August 14, 1935. Many Republicans have opposed the social program since its inception. In recent times, Republicans such as former President Bush have called for the program to be privatized. That push was rejected.
The House Democratic Leadership recently gave rank-and-file members talking points to help them plan events around the anniversary. A House Democratic source provided to CNN a memo laying out the key messages, which include:
• "Republicans promise once again to privatize and cut your Social Security -- turning it over to the whims of Wall Street.
• "Social Security has been, for 75 years, a bedrock promise. You've earned it with a lifetime of hard work, and it should be there for you and future generations.
• If Republicans had succeeded, seniors would have lost trillions more in the stock market meltdown of the Bush recession -- instead, no one lost a penny in Social Security.
• Democrats are working to strengthen Social Security. But Social Security is not the cause of our budget deficits."
Besides the message, the fight by Democrats to keep the country's Social Security program in place is getting personal.
James Roosevelt Jr., the grandson of FDR and DNC member, spoke on Friday's conference call and said of his grandfather: "What he created then was a tremendous legacy for this country. It was the most successful government program. It was and it still is and it will continue to be that this country has ever seen."
He said that Social Security was something that his grandfather viewed as a key part of his legacy "just like universal health care is going to be a key part of President Obama's legacy."
Roosevelt, who served as associate commissioner for retirement policy under President Clinton, blasted recent Republican claims that the program is in trouble.
"There's a lot of scare talk out there from Republicans like Congressman Paul Ryan and Newt Gingrich and people like that about Social Security going bankrupt," he said. "In fact, it's very actuarially sound. ... It's in good shape. People can count on it as they counted on it."
House Minority Leader John Boehner said in a statement marking the 75th anniversary that while the law has served the needs of millions of Americans seniors, the Social Security and Medicare Trustees have "repeatedly warned Congress and the American people that reforms are necessary or future benefits will be threatened."
He added that Republicans are "committed to protecting Social Security and preserving this invaluable program for current and future generations of retirees."
Boehner is under fire for indicating in late June that the retirement age should be raised to 70 for those who have at least 20 years left before retirement as a possible way to finance the ongoing wars.
"We need to look at the American people and explain to them that we're broke," he told the Pittsburgh Tribune-Review. "If you have substantial non-Social Security income while you're retired, why are we paying you at a time when we're broke? We just need to be honest with people."
On NBC's "Meet The Press" this past Sunday, Boehner was asked if Republicans would be campaigning on raising the retirement age.
"I think it's time for the American people to have an adult conversation about the problems that we face," he said. "But we also know that these programs are, are unsustainable in their current form. ... I think we need to bring Democrats and Republicans together in order to solve this problem."
Both Democrats and Republicans know the importance of senior citizens when it comes to elections; they come out to the polls more than any other age group.
An NBC News/ Wall Street Journal Poll from June showed just how important -- and popular -- keeping the current Social Security program is. Sixty-six percent of those surveyed said they had reservations or were concerned about privatization or phasing the program out.
And that may be why Democrats are jumping on one Republican candidate for Senate whose position on Social Security changed over time.
Sharron Angle, a Tea Party favorite running against Democratic Sen. Harry Reid in Nevada, recently released a television ad saying that she wants save Social Security.
"We have a contract with our seniors who have put into Social Security in good faith," She said in the ad. "I'd like to save Social Security by locking the lock box, putting the money back into the trust fund so the government can no longer raid our retirement."
But her position on the program has changed since she became the Republican Senate candidate. In her primary race, Angle said that Medicare and Social Security needed to be phased out with a privatized plan put into place.
Reid's campaign hit back hard, saying that her "newfound zeal for Social Security is particularly disingenuous given that Sharron Angle is on the record voicing her opposition to government programs like it. The truth -- as we celebrate Social Security's 75th anniversary -- is that if Sharron Angle had her way there would be no 76th."
الأحد، 04 آب/اغسطس 2013، آخر تحديث 02:21 (GMT+0400)
-
دمشق، سوريا (CNN) -- أكدت جهات سورية معارضة أن فصائل مسلحة معارضة لنظام الرئيس بشار الأسد وعلى صلة بـ"الجيش الحر" تمكنت من السيطرة على مستودعات للأسلحة بريف دمشق تضم كميات من الصواريخ ومضادات الدروع، في الوقت الذي حض فيه الائتلاف الوطني السوري المعارض الفصائل الكردية والإسلامية المتقاتلة في شمالي البلاد إلى "ضبط النفس."
وقال المرصد السوري لحقوق الإنسان، وهو هيئة معارضة مقرها لندن، إن مقاتلين من لواء الاسلام - جبهة النصرة- كتيبة التوحيد- قوات المغاوير - كتائب شهداء القلمون، وعدة كتائب أخرى، سيطروا على ثلاثة مستودعات للذخيرة بالقرب من بلدة قلدون في منطقة القلمون بريف دمشق.
-
وبحسب المرصد فقد اغتنم مقاتلو الكتائب المقاتلة أسلحة مضادة للدروع وصواريخ أرض- أرض (غراد) وذخائر أخرى متنوعة, كما تجددت الاشتباكات بين مقاتلين من الكتائب المقاتلة من طرف والقوات النظامية ومسلحين من اللجان الشعبية التابعة لها من الطائفة الشيعية من طرف آخر في منطقة السيدة زينب.
-
وفي محافظة الحسكة شمال شرقي البلاد، أفاد المرصد عن اشتباكات دارت بعد منتصف ليل الجمعة - السبت، في محيط بلدة تل حلف قرب مدينة رأس العين بين و"حدات حماية الشعب" الكردية، ومقاتلي ما يعرف بـ"الدولة الإسلامية في العراق والشام" وجبهة النصرة وبعض الكتائب المقاتلة من طرف آخر.
-
ولم ترد تقارير حول الخسائر البشرية، في في حين دارت اشتباكات عنيفة بين الطرفين في وقت متأخر من ليل الجمعة، في قرية التويمية، الواقعة بين منطقة أصفر ونجار وقرية مشرافة في جنوب مدينة راس العين، إثر محاولة مقاتلي الجبهة و"الدولة الإسلامية" التقدم باتجاه المدينة.
-
أما الائتلاف الوطني السوري المعارض، فقد دعا في بيان له كافة الكتائب والفصائل المقاتلة في الشمال السوري إلى "ضرورة الوعي بأهمية المرحلة الراهنة، وبضبط النفس والتحلي بالحكمة لضمان سلامة المدنيين وإخلاء سبيل أي أشخاص موقوفين أو معتقلين."
-
وشدد الائتلاف على "ضرورة الابتعاد عن الأعمال الاستفزازية بكافة أشكالها، ويحذر كل من يستغل المرحلة الراهنة لتطبيق أجندات سياسية، وترك القرار للشعب السوري الحر ليختار مصيره بملء إرادته" في بيان يأتي بالترافق مع الحديث عن كون تلك المواجهات مقدمة لولادة حكومة تدير المناطق التي يقطنها الأكراد في سوريا بشكل مستقل.
-
-
-
ترحب شبكة CNN بالنقاش الحيوي والمفيد، وكي لا نضطر في موقع CNN بالعربية إلى مراجعة التعليقات قبل نشرها. ننصحك بمراجعة إرشادات الاستخدام للتعرف إليها جيداً. وللعلم فان جميع مشاركاتك يمكن استخدامها، مع اسمك وصورتك، استنادا إلى سياسة الخصوصية بما يتوافق مع شروط استخدام الموقع.
-
الآراء الواردة أدناه لا تعبر عن رأي موقع CNN بالعربية، بل تعكس وجهات نظر أصحابها فقط.
Importante golpe a la banda terrorista ETA en Francia. La Guardia Civil ha detenido en un hotel de Macon, a 70 kilómetros de Lyon, a Izaskun Lesaka y Joseba Iturbe. Lesaka es la jefa del aparato militar de la banda terrorista que sustituyó a Mikel Kabikoitz Carrera Sarobe, alias 'Ata'. Forma parte de la facción más 'dura' de la banda desde que se produjo el enfrentamiento entre Txeroki, Ata y Thierry.
-
En la operación, que contaba con la colaboración de un equipo de élite de la policía gala (RAID), también ha sido detenido Joseba Iturbe . Ambos llevaban viviendo al menos una semana en el hotel y en el momento de la detención iban armados. Los efectivos policiales también se han incautado de un coche robado.
-
Iturbe es el lugarteniente de la jefa del aparato militar, además de su pareja. El historial criminal de este miembro de ETA está marcado por su implicación en el atentado de la T4. En el proceso, fue puesto en libertad provisional a pesar de que estuvo en el comando que puso una bomba en Castellón. A raíz de su puesta en libertad por falta de pruebas huyó a Francia para formar parte de la cúpula de la banda.
-
Izaskun Lesaka utilizaba hoteles y casas rurales como su escondite habitual en el país vecino. Bajo su mando se encontraba el control de todos los zulos y las armas de la organización. Lesaka era una importante dirigente de la banda circunscrita al aparato militar aunque desde el anuncio del cese definitivo de la violencia su posición en el organigrama de la banda se sitúa también en el área política. De hecho, se le atribuye junto a David Pla e Iratxe Sorzabal, ser los máximos responsables de la banda y estar detrás de la redacción y lectura de los últimos comunicados de ETA.
-
Esta operación se produce tan solo unos días después del arresto también en Francia de Saúl Curto López, quien fue arrestado en el centro de Francia a bordo de un coche. A este terrorista, que portaba matrículas falsas, se le encuadra en el aparato logístico de la banda y el Ministerio del Interior dijo de él que era el responsable de los zulos de la banda criminal.
-
La 'literaria'
-
El nombre de Izaskun Lesaka Argüelles apareció en la documentación incautada al dirigente Ibon Fernández Iradi, alias 'Susper', como presunta responsable del subaparato de captación de ETA, informa Europa Press. Varios de los detenidos en una operación contra la infraestructura de la banda en el País Vasco y Navarra el 16 de noviembre de 2004 mantuvieron 'citas orgánicas' con ella. Pero en los últimos años experimentó un importante ascenso en la organización fruto de las sucesivas detenciones de sus máximos dirigentes.
-
A Lesaka se la conoce como 'La Literaria' por redactar los comunicados de la banda terrorista, entre ellos se le atribuye la elaboración del texto emitido poco antes de la campaña veraniega de 2009.
-
Nacida el 5 de enero de 1975 en Pamplona, su carrera delictiva se inicia a la temprana edad de 16 años cuando ya asistía a manifestaciones de Gestoras y visitaba a presos de ETA. Poco después, se unió al talde de Jarrai de su pueblo de Burlada (Navarra) y ejerció de interventora electoral de Herri Batasuna en 1993 y 1994.
-
Antes de ser juzgada por su militancia al entramado de Jarrai y Segi, Lesaka pasó a la clandestinidad. Desde 2004, acumula dos órdenes de búsqueda y captura dictadas por la Audiencia Nacional mientras que la Justicia francesa la condenó en rebeldía a cuatro años de prisión por labores de reclutamiento.
-
En todo este tiempo, Lesaka se habría escondido en México y Francia, desempeñando diversas labores de responsabilidad en ETA. Las fuerzas de seguridad sospechan de su posible participación en la campaña de atentados en Mallorca en la que fueron asesinados los guardias civiles, las últimas víctimas mortales de ETA en España.
-
Los investigadores situaron en septiembre de 2010 a Lesaka al frente del aparato militar, destacando su perfil violento, su obsesión por la seguridad de las estructuras.
-
Lesaka, también conocida como 'Ane', fue condenada en rebeldía el 15 de junio de 2007 por el Tribunal Correccional de París a cuatro años de prisión, la misma pena que dictó contra Oihane Garmendia Marín, alias 'Alazne', por pertenecer en 2002 a Arrantzale, el aparato de captación de ETA.
En unas horas saldrán los amiguetes de Bildu diciendo que las deteciones no son la solución, que prolongan el "conflicto", que el Estado no da "pasos".... debe ser que en vez de detenerlos hay que hacerles una fiesta, felicitarlos y pagarles unas vacaciones en el Caribe.
La detención de la jefa del aparato militar de una organización que ja no tiene actividad militar... es como para abrir la portada del diario? Que lo han dejado...que no os conviene, porque contra ETA vivíais mejor...porque teníais a la izquierda abertzale ilegalizada...y la mayoría del parlamento alterada...pero aunque ETA os convenía, se ha acabado y cuanto antes os deis cuenta mejor para todos...Por cierto, es bueno que hayan detenido a una tía que tiene que responder ante la ley de sus crímenes...pero de aquí a decir que es la primera noticia de portada....
Los recortes pasan factura a los pacientes. De diciembre de 2010 a junio de 2012 las listas de espera para operarse aumentaron un 125%. Hay más ciudadanos aguardando y durante más tiempo, porque el plazo de demora media también ha crecido: de 32 a 72 días, según los datos de 10 comunidades autónomas —las únicas que no se han negado a aportar la información— que ha analizado EL PAÍS. Pero si hay un dato particularmente grave e indicativo del deterioro de la situación es que la cifra de ciudadanos que llevan más de seis meses esperando para pasar por el quirófano se ha disparado un 178%. En junio de este año, 27.662 personas habían sobrepasado los 180 días de demora que las comunidades se comprometieron en 2003 a no rebasar nunca. Los decretos en los que algunas lo habían plasmado —que permitían al ciudadano acudir a un centro privado con cargo a la sanidad pública si superaba esa línea roja— se han convertido ahora en papel mojado.
Está claro que ninguna comunidad puede presumir de sus listas de espera, pero la situación es particularmente sonrojante en Extremadura y en Castilla-La Mancha. Los ciudadanos de estas dos comunidades esperan para someterse a una operación 43 y 58 días más de media, respectivamente —hasta los 109 y 107 días—, que hace un año y medio. Además, Extremadura ha pasado en ese tiempo de tener 290 personas aguardando más de seis meses para operarse a registrar más de 1.000. En la comunidad gobernada por María Dolores de Cospedal, 7.132 pacientes han rebasado ya ese plazo, frente a los siete contabilizados en diciembre de 2010, según los datos reflejados en la web de la Consejería de Sanidad castellano-manchega. Y otras autonomías van camino de seguir su ejemplo. En Canarias —que se ha negado a aportar la información sobre cuántos días esperan sus ciudadanos para pasar por el quirófano—, esa lista roja tenía en junio 3.800 pacientes más que un año y medio antes.
-
Las cifras son tan malas que ningún responsable de las autonomías que salen peor paradas ha querido comentarlos. Tampoco las que —como La Rioja o Aragón— han eludido aportar información han optado por explicar cómo está la situación. Y mientras la espera se agrava, el Ministerio de Sanidad —que recibe el recuento de las comunidades semestralmente— guarda silencio. Una portavoz del departamento que dirige Ana Mato expone que aún desconocen los datos de junio, aunque matiza que si efectivamente han empeorado “se seguiría la tendencia iniciada hace dos años, con el Gobierno anterior”. Y remarca que el Ejecutivo de José Luis Rodríguez Zapatero decidió dejar de dar a conocer las listas de espera muchos meses antes de dejar el poder.
-
-
-
El plazo de demora media para una intervención crece de 32 a 72 días
-
-
Unos datos que, por otra parte, siempre han sido opacos. Desde que en 2004 se empezaron a publicar las listas de espera quirúrgica, Sanidad se ha negado a revelar la situación por comunidades autónomas. El pacto de silencio, al que Gobierno y autonomías llegaron en el Consejo Interterritorial de Sanidad —y que más tarde alcanzaría a los inaugurados recuentos sobre la espera para pruebas diagnósticas y consultas externas—, provoca que solo se den a conocer de manera unificada los totales nacionales. Eso evita la transparencia y las comparaciones de los ciudadanos de una comunidad a otra.
-
Imposible bucear, pues, en las últimas cifras hechas públicas por el ministerio (de diciembre de 2011), que ya mostraban un preocupante incremento en las listas de espera quirúrgica. En ese momento, en 16 comunidades —Madrid fue expulsada del recuento al contabilizar a los pacientes de otra forma— había ya 459.885 pacientes en espera. Y casi el 10% de ellos llevaba más de seis meses en la lista. Se vislumbraba entonces la situación de agravamiento actual, cuando se constata el completo fracaso del decreto de 2011 aprobado por el Ministerio de Sanidad que establecía que para operaciones de cataratas, corazón, prótesis de cadera y de rodilla ese plazo de seis meses no podía superarse.
-
-
-
El plazo para una radiografía o una resonancia es cada vez mayor
-
-
Se sobrepasa y no en pocas ocasiones. Que se lo digan a Salvador G. Tena, de 67 años, que tras más de 12 meses en lista de espera acaba de pasar por una operación cardiaca en el hospital Bellvitge de Barcelona. A Tena, a quien le diagnosticaron problemas graves de corazón gracias a los exámenes realizados tras una encefalitis vírica, le habían dicho que tendría que esperar unos tres meses para que le cambiasen un trozo de la vena aorta por una mecánica y para someterse a un by-pass. “Esos tres meses se multiplicaron por cuatro. Yo ya estaba advertido, mi médico me había dicho que tenía que tomarlo con calma, pero no pensé que tanta”, explica Tena, que ahora está encantado con el resultado de la operación.
-
Quizá gracias al decreto y a que muchos de los pacientes cardiacos se tratan de manera preferente, la cirugía de corazón no es la que registra peores cifras. En cambio, aquellos que tienen que someterse a una intervención por la fisura de un hueso, la reconstrucción de nariz tras una fractura, una hernia inguinal o una operación de juanetes pueden llegar a esperar más. La especialidad de cirugía plastica —en el Hospital de Albacete, por ejemplo, la espera media está en 197 días—, traumatología o cirugía torácica son las que requieren mayor espera.
-
José Luis Vera lleva 10 meses aguardando para ser operado de próstata en un hospital extremeño. Lo que esperaba que fuera cosa de un par de meses se está extendiendo. “Ya no sé si me van a llamar. Pregunto a mi médico de cabecera, pero me dice que no desespere, que todo llegará”, dice este hombre de 76 años. Se alegra de que su patología no sea muy grave. “Si llego a tener algo peor me muero antes de que llegue la operación. Estos recortes van a acabar con nosotros”, critica.
-
-
-
Salvador Tena esperó más de un año para una operación cardiaca
-
-
Y es que el hachazo de más de 5.000 millones que las comunidades han dado a sus presupuestos para sanidad desde 2010 —partidas que luego en muchos casos han sido aún más esquilmados en revisiones posteriores— se está notando. La falta de medios, de personal y de camas se traduce en un aumento del tiempo de demora tanto en las listas de espera quirúrgica como en la de pruebas diagnósticas. El número de pacientes en espera para una radiografía, una ecografía o una resonancia ha aumentado un 4%, según el análisis de EL PAÍS. Mucho más en Baleares o en Extremadura. La lista de espera para la consulta con el especialista, sin embargo, se reduce. Aunque esto es solo un espejismo: en algunas comunidades muchos pacientes están en un limbo administrativo porque las agendas de los médicos especialistas que tienen que verles están cerradas; con lo cual, como no se pueden apuntar, no empieza a correr el tiempo que permanecen en espera. Sobre el papel, por tanto, no cuentan.
-
Carmen Flores, presidenta de la organización Defensor del Paciente, asegura que cada día recibe quejas sobre esa “manipulación”. “La situación es tremenda. Hay gente desesperada porque está en lista de espera y no le llaman, y otros a quienes ni siquiera les dejan entrar”, expone. Es justo esto lo que le ocurre a Laura Martínez, que lleva desde abril con un volante para el servicio de Dermatología del Hospital de Albacete que no puede hacer efectivo. “Cada vez que voy al centro de salud para que me den cita me dicen que vuelva la semana siguiente, que las listas están cerradas. Y así llevo seis meses. ¿No deberían por ley decirme cuándo me van a atender? No estoy diciendo que sea mañana, pero al menos que me den alguna fecha...”, se queja.
-
Estas triquiñuelas no se utilizan solo para aligerar las listas de espera de los especialistas. Para que las cifras no sigan engordando, las regiones no incluyen en ellas, por ejemplo, los casos de aquellos pacientes que han rechazado ser intervenidos en centros privados. Fórmulas para disimular una realidad complicada. También existen casos como el de Madrid, que maquilla sus datos de manera descarada. Esta comunidad ha inventado un sistema de cómputo a medida donde un paciente solo entra en espera tras la visita con el anestesista, una trampa que le permite ganar unos 30 días de media.
-
-
-
El presidente de los médicos advierte de que la demora causa más gastos futuros
-
-
El aumento de las listas de espera no solo es un problema para quienes las sufren. El estado de los enfermos se agrava con el paso del tiempo, lo que supone intervenciones más complicadas y peores posoperatorios. “La demora genera más listas de espera, porque provoca incapacidades temporales, más gastos en personal, en medicamentos y en pruebas diagnósticas. Las medidas de teórico ahorro que las comunidades están aplicando afectan mucho a este campo y van a provocar un gasto duplicado e inevitable el día de mañana” apunta el presidente de la Organización Médica Colegial, Juan José Rodríguez Sendín, muy preocupado por la situación.
-
Sendín cree que hace falta un mecanismo de choque para ponerle cota a ese crecimiento en la demora, espoleado ahora más por la falta de medios. “Esto es lo más importante que Sanidad tiene ahora encima de la mesa. Y debería buscar garantías efectivas de tiempos máximos para que los pacientes reciban el servicio. El Gobierno no solo debe analizar qué prestaciones ofrece el sistema de salud, como se va a estudiar ahora con la revisión de la cartera básica de servicios, sino también cuándo”, lanza. “Y la unificación debería ser total”, dice.
-
Esa desigualdad entre regiones y falta de garantías de la que habla el presidente de los médicos se refleja en los datos. Los vascos esperan, de media, 48 días para entrar en quirófano mientras que los catalanes aguardan 125. El desequilibrio también se reflejaba en el último informe de la Defensora del Pueblo. En ese documento queda claro que las listas de espera son la principal causa de insatisfacción de los ciudadanos con la sanidad pública. En el último barómetro sanitario del ministerio (de 2011), el porcentaje de personas que creen que las listas de espera han empeorado ha pasado en un año del 11,71% al 18,17%.
-
Con información de Paloma Marín, Maryem Castillo y Elena G. Sevillano.
-
-
-
-
Un alto muro de opacidad
-
¿Son un secreto de Estado las listas de espera? No deberían serlo, pero la realidad es que el pacto de silencio entre las administraciones sanitarias para impedir que estos datos sean públicos y comparables por territorios (incluso por hospitales) ha cubierto de opacidad un termómetro imprescindible del sistema de salud. Un grupo de periodistas de este periódico se ha dedicado a intentar recopilar la información que deberían facilitar las comunidades autónomas. El retrato de la situación resultante no es del todo completo por la información que se niega, la que se da de forma sesgada o la que no es comparable con los datos de los demás.
-
Y es que, a pesar de que los datos que las autonomías tienen que recopilar sobre sus listas de espera está regulado por decreto (el 605/2003), no todos los hacen público. La Rioja, por ejemplo, se ha negado a revelar el número total de pacientes en espera para operarse y, menos aún, de aquellos que llevan más de 180 días en la lista. Variable que tampoco Cataluña —que envuelta en la preparación de sus elecciones ha preferido también callar los datos de 2012— desvela. En cambio, esa es la única cifra aportada por Aragón.
-
También es complicado estudiar la evolución dentro de una misma comunidad. Ejemplo extremo de ello es Madrid. Al guiarse por su propio sistema de cómputo, no se puede comparar su situación con otras regiones y tampoco con sus datos anteriores. Una portavoz de la Consejería de Sanidad, que dirige Javier Fernández Lasquetty, asegura que no se guardan, sino que los documentos con los datos de listas de espera “se reescriben unos sobre otros”. Menos mal que existen las hemerotecas.
-
-
-
-
-
-
-
-
-
NOTICIAS RELACIONADAS
-Selección de temas realizada automáticamente con
-
-Streaming and downloading TV content to mobiles is nice, but we enjoy watching TV... on the TV, and Verizon had plenty of that to talk about today as well. Due in Q4 along with its FlexView app for mobile VOD access, version 1.9 of its FiOS TV guide software will finally add a 16x9 HDTV-filling guide to those Motorola boxes and it looks like many of our suggestions (and yours, according to Director of Product Management Joe Ambeault) made it in. Beyond a fresh coat of paint (although, with animated transitions, highly customizable viewing and browsing options and 3D-ish elements it's shaping up to be a very nice fresh coat of paint), the real meat is in the enhanced DVR features.
-
-
-New updates include support for external storage (up to 1TB eSATA per DVR), automatic DVD-style chaptering on recordings, and an undelete button to bring back mistakenly removed recordings. Also freshened is its MoCA-powered multiroom setup that now shows all recordings from any box or external storage all in one list. About the only thing we can find missing from the new software is any sort of support for conflict resolution across DVRs or using all tuners as a pool, but it's otherwise robust, with each box handling up to 4 streams (2 in, 2 out) at once, and 7 connected devices (6 boxes plus one router) per home. Check out a couple more screens after the break, though skipping directly to house shopping in FiOS-connected neighborhoods may make for more efficient use of your time.
-
-
Now that we've thrown 'em off the trail, use the form below to get in touch with the people at Engadget. Please fill in all of the required fields because they're required.
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
\ No newline at end of file
diff --git a/newspaper/packages/python-goose-documents/tests/data/extractors/test_engadget.json b/newspaper/packages/python-goose-documents/tests/data/extractors/test_engadget.json
deleted file mode 100644
index 7f5a6b9f..00000000
--- a/newspaper/packages/python-goose-documents/tests/data/extractors/test_engadget.json
+++ /dev/null
@@ -1,34 +0,0 @@
-{
- "url": "http://www.engadget.com/2010/08/18/verizon-fios-set-top-boxes-getting-a-new-hd-guide-external-stor/",
- "expected": {
- "meta_description": "Streaming and downloading TV content to mobiles is nice, but we enjoy watching TV... on the TV, and Verizon had plenty of that to talk",
- "domain": "www.engadget.com",
- "final_url": "http://www.engadget.com/2010/08/18/verizon-fios-set-top-boxes-getting-a-new-hd-guide-external-stor/",
- "meta_keywords": "",
- "cleaned_text": "Streaming and downloading TV content to mobiles is nice",
- "tags": [
- "img 1.9",
- "external storage",
- "chaptering",
- "verizon",
- "esata",
- "Motorola",
- "multiroom",
- "gui",
- "Set-topBox",
- "set-top box",
- "1.9",
- "fios",
- "Android coverage by humans",
- "Img1.9",
- "moca",
- "fios tv",
- "ExternalStorage",
- "FiosTv",
- "FiOS TV",
- "dvr"
- ],
- "meta_favicon": "http://www.blogsmithmedia.com/www.engadget.com/media/favicon.ico",
- "meta_lang": null
- }
-}
\ No newline at end of file
diff --git a/newspaper/packages/python-goose-documents/tests/data/extractors/test_espn.html b/newspaper/packages/python-goose-documents/tests/data/extractors/test_espn.html
deleted file mode 100644
index 04de0d3e..00000000
--- a/newspaper/packages/python-goose-documents/tests/data/extractors/test_espn.html
+++ /dev/null
@@ -1,932 +0,0 @@
-
-
-
-
-Florida, Alabama grandstanding? Urban Meyer, Nick Saban take stands on agents - ESPN
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
If you believe what college football coaches have said about sports agents lately, they rank somewhere between salmonella and the crusted-up bug juice on car windshields.
Florida coach Urban Meyer explained this week he chose to close Florida's first few practices to the public and the media because he was concerned about the "scumbags" who had access to his players. And prior to Meyer's strong rebuke, Alabama coach Nick Saban compared agents to "pimps" at SEC media days.
My, my, the air is thick with hypocrisy and grandstanding.
Cliff Welch/Icon SMI Maurkice Pouncey denies that he took money from an agent while still playing for Florida.
Certainly there seems to be a rash of high-profile college football programs being investigated for alleged incidents involving agents and college football players, but I hope I'm not the only one who is greeting these tirades against naughty agents with a healthy degree of skepticism.
Is Meyer suddenly concerned about who has access to Gators practices because the NCAA is looking into whether Maurkice Pouncey accepted $100,000 from the representative of a sports agent while a Gator, or is he closing practices because, like most college football coaches, he is a control freak and uses any excuse he can to close ranks?
I covered Saban when he coached at Michigan State and when he was with the Miami Dolphins, and he treats his football program with secrecy and limited access akin to the Pentagon. So I have a hard time believing Saban didn't have ulterior motives when he banned NFL scouts from his practices until after the preseason.
Saban, Meyer and other coaches claim they are speaking out against agents and squeezing the NFL strictly out of concern for their players, but their intensified interest seems convoluted.
I'm aware that agents swindle kids all the time, telling the athletes what they want to hear and positioning themselves so that they can influence those athletes as much as possible. Agents aren't magnanimous. Their goal is to make as much money off a college player as they can.
But it's the same with a lot of college football coaches.
Besides, how dare some of these coaches question agents' ethics when they routinely break their own contracts? And most coaches employ agents who quietly shop them for jobs so they can either move on to a better program or have leverage for a raise.
Saban calling agents "pimps" is the epitome of the velour hat calling out the floor-length mink. I want a lecture from Saban on unethical agent behavior about as much as I want Lane Kiffin to give me a sermon on loyalty.
Stephen Chernin/Getty ImagesShouldn't suitcases of cash, or a big check, have been returned along with the Heisman if rules were broken?
"I don't think it's anything but greed that's creating it right now on behalf of the agents," Saban said at the SEC media days. "The agents that do this -- and I hate to say this, but how are they any better than a pimp?"
No one would know more about running game on folks than Saban, considering the way he bailed on Michigan State, LSU and the Miami Dolphins.
Saban, Meyer and Ohio State's Jim Tressel recently participated in a conference call with NFL commissioner Roger Goodell and expressed their concerns about agents and also pushed for the NFL to do more to police agents' behavior with players.
But if those coaches really wanted to move the conversation forward, they would discuss the lack of financial compensation for their players with the NCAA or chastise a system that negates Reggie Bush's Heisman Trophy, yet allows USC to keep every dime it earned off of Bush's collegiate brilliance. If Meyer, Saban and Tressel truly want to be advocates for their players and are that concerned about shady agents, then they need to champion sanctions that will severely punish coaches when their players break the rules.
But I don't expect them to go there because that could possibly threaten their own livelihoods, force them into an adversarial position with their peers or undermine the grasp they have on their programs.
College athletes aren't vulnerable to agents because those agents are visible at practices. They're vulnerable because when they survey the landscape, they see coaches such as Saban, Tressel and Meyer making millions of dollars a year, schools erecting multimillion-dollar buildings on campus and alumni writing blank checks, and then they realize their scholarships only account for a microscopic portion of a larger financial pie.
It's easy for coaches like Meyer and Saban to launch a smear campaign against agents because when they leave the practice field, they get in their expensive cars and drive to their palatial homes.
Agents sometimes exploit college athletes, but that's far from the real issue. College football has become a hustle. It's just too bad no one is willing to be truthful about who is really hustling whom.
Jemele Hill can be reached at jemeleespn@gmail.com.
Apr. 8: President Obama signs the New START treaty with Russian President Dmitry Medvedev at the Prague Castle.
-
-
-
Russia's announcement that it will help Iran get nuclear fuel is raising questions about what President Obama calls the "better-than- ever" relationship between Russia and the U.S. after the two former Cold War adversaries recently signed a nuclear reduction treaty.
-
-
Obama also recently declared his Russian counterpart, Dmitri Medvedev, would help the U.S. "secure strong, tough sanctions on Iran."
-
-
But Moscow announced Friday it will start loading fuel into Iran's first and only nuclear power plant next Saturday, giving Tehran a boost as it struggles with international sanctions and highlighting differences between Moscow and Washington over pressuring the Islamic Republic to give up activities that could be used to make nuclear arms.
-
-
Uranium fuel shipped by Russia will be loaded into the Bushehr reactor on August 21, beginning a process that will last about a month and end with the reactor sending electricity to Iranian cities, Russian and Iranian officials said Friday.
-
-
While the UN nuclear watchdog and U.S. officials say the Bushehr reactor is not a proliferation risk, Russia's decision to supply the fuel calls into question why Iran is enriching uranium in the first place.
-
-
"It quite clearly I think underscores that Iran does not need its own enrichment capability if its intentions as it states are for a peaceful program," White House spokesman Robert Gibbs said.
-
-
If Russia carries out its plan, it will end years of foot-dragging on Bushehr. While Moscow signed a $1 billion contract to build the plant in 1995, its completion has been put off for years.
-
-
Moscow has cited technical reasons for the delays. But Bushehr has also been an ideal way to gain leverage with both Tehran and Washington.
-
-
Delaying the project has given Russia continued influence with Tehran in international attempts to have it stop uranium enrichment -- a program Iran says it needs to make fuel for an envisaged reactor network but which also can be used to create fissile warhead material. The delays also have served to placate the U.S., which opposes rewarding Iran while it continues to defy the U.N. Security Council with its nuclear activities.
-
-
After Russia said in March that Bushehr would be launched this year, U.S. Secretary of State Hillary Rodham Clinton said that until Iran reassures the world it is not trying to build a nuclear weapon, "it would be premature to go ahead with any project at this time."
-
-
Formally, the U.S. has no problem with Bushehr.
-
-
Although at first opposed to Russian participation in the project, Washington and its allies agreed to remove any reference to it in the first set of Security Council sanctions passed in 2006 in exchange for Moscow's support for those penalties. Three subsequent sanctions resolutions also have no mention of Bushehr.
-
-
Still, the U.S. sees the Russian move as a false signal to Tehran as Washington strives to isolate Iran politically and economically to force it to compromise on enrichment.
-
-
In Washington, State Department spokesman P.J. Crowley said Bushehr "does not represent a proliferation risk. ... However, Bushehr underscores that Iran does not need its own indigenous enrichment capability. The fact that Russia is providing fuel is the very model the international community has offered Iran."
-
-
Russia, in turn, argues that the Bushehr project is essential for persuading Iran to cooperate with the U.N. nuclear watchdog and fulfill its obligations under international nuclear nonproliferation agreements.
-
-
Crowley added: "Our views on the Bushehr project should not be confused with the world's fundamental concerns with Iran's overall nuclear intentions, particularly its pursuit of uranium enrichment, and Iran's willful violation of its international obligations."
-
-
Russian officials did not say why they had decided to move ahead with loading fuel into the Bushehr plant now. But the move could have been triggered in part by Moscow's desire show the Iranians it can act independently from Washington after its decision to support the fourth set of U.N. sanctions in June and its continued refusal to ship surface-to-air missile systems that it agreed to provide under a 2007 contract to sell the S-300s.
-
-
The sophisticated S-300 anti-aircraft missiles would significantly boost Iran's ability to defend against airstrikes. Israel and the United States have strongly objected to the deal.
-
-
Russia has walked a fine line on Iran for years. One of six world powers leading international efforts to ensure Iran does not develop a nuclear weapon, it has strongly criticized the U.S. and the European Union for following up with separate sanctions after the latest U.N. penalties -- which Moscow supported -- were passed.
-
-
"We expect Iran to meet established international norms and practices to ensure the safe operation of the reactor under full safeguards monitoring" by the IAEA, Crowley said.
Gun control advocates are looking for new options, including some tech strategies. On Wednesday, seven measures failed in the U.S. Senate, including an amendment that would have expanded background checks. Some gun control advocates are now looking in new directions. So-called 'smart guns' are firearms that only authorized users can fire. But so far, there's not a single one on the market in the U.S.
-
-
To view this content, Javascript must be enabled and Adobe Flash Player must be installed.
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
diff --git a/newspaper/packages/python-goose-documents/tests/data/extractors/test_get_canonical_url.json b/newspaper/packages/python-goose-documents/tests/data/extractors/test_get_canonical_url.json
deleted file mode 100644
index 12ca6956..00000000
--- a/newspaper/packages/python-goose-documents/tests/data/extractors/test_get_canonical_url.json
+++ /dev/null
@@ -1,22 +0,0 @@
-{
- "url": "http://www.marketplace.org/shows/marketplace-tech-report/marketplace-tech-friday-april-19-2013",
- "expected": {
- "meta_description": "Gun control advocates are looking for new options, including some tech strategies. On Wednesday, seven measures failed in the U.S. Senate, including an amendment that would have expanded background checks. Some gun control advocates are now looking in new directions. So-called 'smart guns' are firearms that only authorized users can fire. But so far, there's not a single one on the market in the U.S.",
- "domain": "www.marketplace.org",
- "final_url": "http://www.marketplace.org/shows/marketplace-tech-report/marketplace-tech-friday-april-19-2013",
- "meta_keywords": "",
- "cleaned_text": "Gun control advocates are looking for new options, including some tech strategies. On Wednesday",
- "tags": [
- "SOPA",
- "PIPA",
- "online privacy",
- "Tech",
- "sensors",
- "guns",
- "CISPA"
- ],
- "canonical_link": "http://www.marketplace.org/shows/marketplace-tech-report/marketplace-tech-friday-april-19-2013",
- "meta_favicon": "http://www.marketplace.org/sites/default/themes/sitetheme/favicon.ico",
- "meta_lang": null
- }
-}
\ No newline at end of file
diff --git a/newspaper/packages/python-goose-documents/tests/data/extractors/test_gizmodo1.html b/newspaper/packages/python-goose-documents/tests/data/extractors/test_gizmodo1.html
deleted file mode 100644
index ad0fb982..00000000
--- a/newspaper/packages/python-goose-documents/tests/data/extractors/test_gizmodo1.html
+++ /dev/null
@@ -1,74 +0,0 @@
-
-
-
- The Gear and Apps You Need to Survive the Next Semester
Technology - from handheld gadgets to systems too large to see.
Okay, this is it. Back to school, again. Whether it's your first college semester or you can see graduation on the horizon, these tools will make the next few months infinitely more bearable.
-
S
-
-
Take Note
-
This isn't 2003; you no longer need to carry a cumbersome spiral-bound notebook that will either get lost/torn/burned by your psycho ex the week before finals (thanks again Kate!) orfilled with leaky pens and mechanical pencil graphite. Instead, load up one of these apps onto your laptop (Mac, Windows) and share your notes among your devices and classmates.
-
Evernote (Android, iOS, Win, Mac) is the BMOC of note-taking programs. It seamlessly distributes pictures, text, and video between your computer and mobile devices, allows you to clip web data, organize, and then share it. EverNote is freemiumware; coughing up the extra $45 a year nets you added security systems, offline notes, and increased storage capacity.
Simplenote (iOS only) is a dedicated, bare-bones iOS app. It only allows you to take text notes and is ad-supported unless you fork over $20 a year for the premium version.
Extensive Notes (Android) is free note-taking app with more features than you'll know what to do with. It converts measurements, logs appointments, generates passwords, scans bar codes, and a litany of other things in addition to taking notes and making to-do lists.
-
If you've got an older Android tablet or phone, be sure to upgrade the stock keyboard with SwiftKey 3 (Android). The $4 investment is well worth the time it'll save you. And if you're unlucky enough to be stuck with an 8 am class this term, you'll do well to bring an audio recorder like the Zoom Q2HD or iQ5 in case you doze off.
-
-
S
-
Write It Right
-
Don't be that guy. Write your term papers like you actually live in the 21st century. Microsoft Office and Google Drive are solid choices for Windows and Android, both offering a wide range of functionality from their respective software suites.
-
Google's offering is free, though, while Office will run you $80 for a 4-year subscription. Still,that's a pretty good deal compared to the $140 it would cost for you to keep it beyond your college years. Windows users should also check out an incredibly helpful text-editing app—especially for those studying the computer sciences—called Notepad++ (Win).
-
There's nothing stopping an Apple user from employing Google Drive in the browser, of course, but if you're looking for a dedicated, local text editor, take a look at iA Writer ($1 iPad, iPhone, Mac), an elegant and understated text editor that forces you to focus on the writing, not self-editing, and Editorial ($5 iOS), which automates many basic typing functions so that text-editing on a tablet isn't the nightmare it once was. And if neither of these are to your liking, find one that is. Text Expander ($5 iOS, Mac) is another text-automation program but works in a variety of other platforms, allowing you to set custom shortcuts for commonly used phrases, scripts, and animated GIFs.
-
-
S
-
Read on the Cheap
-
Textbook sales have got to be one of the biggest scams on a college campus. You shell out hundreds of dollars for them, use them for 12 weeks, and then sell them back for pennies on the dollar. And with tuition costs steadily rising around the country, this mandatory reaming doesn't sit well with many. So instead, buy a Kindle Fire HD, or install the Kindle app (Android, iOS) on your own tablet and hope that your classes are listed on Amazon's Textbook Rental service. Since that's really what you're doing anyway, just renting them.
-
-
-
S
-
Be a Math Blaster
-
What, you thought you were through with math just because you passed your SAT? Not a chance. Even the most liberal of liberal arts programs often have a math requirement, which means if you're not numerically inclined you're going to need a helping hand. Most lectures you can probably get away with using one of these mobile apps:
-
Quick Graph ($3 unlocked, iOS) offers a huge array of computational and visualization features, including VGA output for sharing your groundbreaking equation with the rest of the class.
Free Graphing Calculator (Free, iOS) offers a full graphing scientific calculator with unit conversion and data-tabling functions.
Algeo (free - Android) is a simple yet powerful android calculator app designed specifically to assist with common algebra and calculus problems including symbolic differentiation, definite integrals, and Taylor-series calculations.
Mathlab Graphing Calculator ($5 unlocked, Android) is built to match, and in some cases exceed, the capabilities of dedicated scientific graphing calculators. For $5, it's worth trying out, especially if it means you can forgo the purchase of a handheld unit.
-
-
S
-
Habla Something Other Than English
-
Unless you passed your AP language requirements, get set for remedial foreign language studies. Rote memorization, huzzah! Of course you could always spice up your language lessons with some supplemental online courses. They're free and they're way more fun than vocabulary flashcards. Your two best options are going to be:
-
Duolingo, which is a crowd-sourced learning platform that delivers a semester's worth of college-level learning in a fraction of the time.
Live Mocha, which offers you the option to pay for lessons in cash or earn them by assisting and tutoring other students. Never pass up free tutoring.
-
-
S
-
Share Your Media
-
It's great that you've got your notes synced between your devices, but what about the rest of your documents, music, movies, and pirated GoT episodes? Depending on your platform, Google Drive,iCloud, and SkyDrive are the official options for Android, Apple, and Microsoft, respectively. Dropbox (Android, iOS) and simply Box(Android, iOS, Win 8) clients should be on your system no matter what platform you prefer—you can never have enough free storage.
-
If you're looking for a hardware solution for your sharing needs, give the SanDisk Connect a look. For $50 - $100, depending on storage and streaming capacity, these wireless USB drives can not only act as remote hard drives but also as streaming media servers, allowing you and up to six other people watch your ill-gotten HBO originals.
-
-
S
-
Tune Up
-
The best way to churn our papers and alienate roommates is the crank the volume up to 11. Here's what you'll need to make all your favorite obscure bands shine.
-
If you've got a lot of Apple products in your life, you'll want to look at the Pioneer XW-SMA3 portable speakers; you'll be able to do your music justice in your room or in the quad. If bluetooth on a budget is more your speed, check the $80 Soundfreaq Sound Spot.
-
Conversely, if your roommate isn't a big fan of Death Metal, you should probably pick up a pair of headphones instead. The Harmon Kardon CL is a quality-made headphone but is a bit pricey for a college student's budget at $200 a pop. The Sol Republic Tracks deliver slightly lesser sound compared to the HKs but are half their price as well.
-
Now all you need to do is figure out how to keep your electronic menagerie charged throughout the day and you might just make it through this semester with minimal brain damage. [Technology Guide - FastCo - LifeHackTop Image: Creativa, Notes Image: wavebreakmedia / Shutterstock, Text Editors: Taiga, Dorm Room: Vasin Lee, Readers: Kyle Wagner , Reference: Dmitry Elagin, Maths:Mathlab, Language: racorn]
-
-
\ No newline at end of file
diff --git a/newspaper/packages/python-goose-documents/tests/data/extractors/test_gizmodo1.json b/newspaper/packages/python-goose-documents/tests/data/extractors/test_gizmodo1.json
deleted file mode 100644
index 140e8c9e..00000000
--- a/newspaper/packages/python-goose-documents/tests/data/extractors/test_gizmodo1.json
+++ /dev/null
@@ -1,12 +0,0 @@
-{
- "url": "http://gizmodo.com/the-gear-and-apps-you-need-to-survive-the-next-semester-1141460933",
- "expected": {
- "meta_description": "Okay, this is it. Back to school, again. Whether it's your first college semester or you can see graduation on the horizon, these tools will make the next few months infinitely more bearable.",
- "domain": "gizmodo.com",
- "final_url": "http://gizmodo.com/the-gear-and-apps-you-need-to-survive-the-next-semester-1141460933",
- "meta_keywords": "How-2, mobile, apps, education, back to school, productivity, Gizmodo",
- "cleaned_text": "Okay, this is it. Back to school, again. Whether it's your first college semester or you can see graduation on the horizon, these tools will make the next few months infinitely more bearable.\n\nThis isn't 2003; you no longer need to carry a cumbersome spiral-bound notebook that will either get lost/torn/burned by your psycho ex the week before finals (thanks again Kate!) or filled with leaky pens and mechanical pencil graphite. Instead, load up one of these apps onto your laptop (Mac, Windows) and share your notes among your devices and classmates.\n\nIf you've got an older Android tablet or phone, be sure to upgrade the stock keyboard with SwiftKey 3 (Android). The $4 investment is well worth the time it'll save you. And if you're unlucky enough to be stuck with an 8 am class this term, you'll do well to bring an audio recorder like the Zoom Q2HD or iQ5 in case you doze off.\n\nDon't be that guy. Write your term papers like you actually live in the 21st century. Microsoft Office and Google Drive are solid choices for Windows and Android, both offering a wide range of functionality from their respective software suites.\n\nGoogle's offering is free, though, while Office will run you $80 for a 4-year subscription. Still,that's a pretty good deal compared to the $140 it would cost for you to keep it beyond your college years. Windows users should also check out an incredibly helpful text-editing app\u2014especially for those studying the computer sciences\u2014called Notepad++ (Win).\n\nThere's nothing stopping an Apple user from employing Google Drive in the browser, of course, but if you're looking for a dedicated, local text editor, take a look at iA Writer ($1 iPad, iPhone, Mac), an elegant and understated text editor that forces you to focus on the writing, not self-editing, and Editorial ($5 iOS), which automates many basic typing functions so that text-editing on a tablet isn't the nightmare it once was. And if neither of these are to your liking, find one that is. Text Expander ($5 iOS, Mac) is another text-automation program but works in a variety of other platforms, allowing you to set custom shortcuts for commonly used phrases, scripts, and animated GIFs.\n\nTextbook sales have got to be one of the biggest scams on a college campus. You shell out hundreds of dollars for them, use them for 12 weeks, and then sell them back for pennies on the dollar. And with tuition costs steadily rising around the country, this mandatory reaming doesn't sit well with many. So instead, buy a Kindle Fire HD, or install the Kindle app (Android, iOS) on your own tablet and hope that your classes are listed on Amazon's Textbook Rental service. Since that's really what you're doing anyway, just renting them.\n\nWhat, you thought you were through with math just because you passed your SAT? Not a chance. Even the most liberal of liberal arts programs often have a math requirement, which means if you're not numerically inclined you're going to need a helping hand. Most lectures you can probably get away with using one of these mobile apps:\n\nUnless you passed your AP language requirements, get set for remedial foreign language studies. Rote memorization, huzzah! Of course you could always spice up your language lessons with some supplemental online courses. They're free and they're way more fun than vocabulary flashcards. Your two best options are going to be:\n\nIt's great that you've got your notes synced between your devices, but what about the rest of your documents, music, movies, and pirated GoT episodes? Depending on your platform, Google Drive, iCloud, and SkyDrive are the official options for Android, Apple, and Microsoft, respectively. Dropbox (Android, iOS) and simply Box (Android, iOS, Win 8) clients should be on your system no matter what platform you prefer\u2014you can never have enough free storage.\n\nIf you're looking for a hardware solution for your sharing needs, give the SanDisk Connect a look. For $50 - $100, depending on storage and streaming capacity, these wireless USB drives can not only act as remote hard drives but also as streaming media servers, allowing you and up to six other people watch your ill-gotten HBO originals.\n\nThe best way to churn our papers and alienate roommates is the crank the volume up to 11. Here's what you'll need to make all your favorite obscure bands shine.\n\nIf you've got a lot of Apple products in your life, you'll want to look at the Pioneer XW-SMA3 portable speakers; you'll be able to do your music justice in your room or in the quad. If bluetooth on a budget is more your speed, check the $80 Soundfreaq Sound Spot.\n\nConversely, if your roommate isn't a big fan of Death Metal, you should probably pick up a pair of headphones instead. The Harmon Kardon CL is a quality-made headphone but is a bit pricey for a college student's budget at $200 a pop. The Sol Republic Tracks deliver slightly lesser sound compared to the HKs but are half their price as well.\n\nNow all you need to do is figure out how to keep your electronic menagerie charged throughout the day and you might just make it through this semester with minimal brain damage. [Technology Guide - FastCo - LifeHack Top Image: Creativa, Notes Image: wavebreakmedia / Shutterstock, Text Editors: Taiga, Dorm Room: Vasin Lee, Readers: Kyle Wagner , Reference: Dmitry Elagin, Maths: Mathlab, Language: racorn]",
- "meta_favicon": "http://kinja.com/assets/images/logos/favicons/gizmodo.ico",
- "meta_lang": "en"
- }
-}
\ No newline at end of file
diff --git a/newspaper/packages/python-goose-documents/tests/data/extractors/test_guardian1.html b/newspaper/packages/python-goose-documents/tests/data/extractors/test_guardian1.html
deleted file mode 100644
index fd2fbb1c..00000000
--- a/newspaper/packages/python-goose-documents/tests/data/extractors/test_guardian1.html
+++ /dev/null
@@ -1,57 +0,0 @@
-Kristen Wiig has had the kind of summer one might imagine to be life-changing. For four years, she andAnnie Mumolo, her friend and co-writer, slaved over a comedy script commissioned by Judd Apatow about a woman whose best friend is getting married. It was the 38-year-old's first lead in a film, and her first full-length script to be produced. As an indication of how it played with audiences, I watched it on a plane last month with a friend who, during the scene in which the bride squats in the street to relieve herself after a bad kebab, laughed so long and hard a woman passing in the aisle leant over and said, "What are you watching?"
-
-Wiig smiles when I tell her this. "Proud," she says, of the day they filmed the shitting-in-the-street scene. "A proud moment."
-
-We are in the tearoom of a fashionable hotel in Tribeca, the Manhattan neighbourhood where Wiig lives. Before Bridesmaids, she was known to US audiences as a long-running cast member of Saturday Night Live and elsewhere for scene-stealing cameos in films such as Ghost Town and Knocked Up.
-
-That the film, by midsummer, had grossed more than $150m in the US and outstripped not only all of Apatow's other films, but every "R-rated female comedy" in history, puts Wiig in the zone of woman of the moment, although she chafes against this, with its implication that before Bridesmaids she was an ingenue.
-
-"In most ways my life hasn't changed," she says. "I know that's a boring answer. People want to hear that I bought all gold, fur…" She allows a perfectly timed beat. "I would never wear fur."
-
-But hasn't she had to turn down lots of offers?
-
-"I mean. Yes, no. It feels weird to say that; you don't want to be like, 'Everyone wants me!' I mean. I guess Bridesmaids was definitely the biggest role I've ever had. And the fact that I co-wrote it and everything. But, um…" Wiig, who is slight, with very straight hair and an eager tilt to her body language, looks mortified. "It's not like I have boxes of scripts arriving at my door."
-
-Her understatement is fuelled perhaps by the inevitable and awkward comparisons she has gained with other women in her business, as if the culture can sustain only a couple at a time. Wiig has been getting "the new Tina Fey" quite a lot – Fey was head writer at SNL when Wiig joined – although the comparison is faulty. Wiig is an actor first and a comedian second, and with a film directed by Sean Pennin the pipeline and another, Imogene, in which she stars alongside Annette Bening and Matt Dillon, wants to develop her career away from comedy. "People always call me a comedian. And I don't really see myself like that. I guess I just consider myself an actor who does comedy. But who wants to do other things as well."
-
-It took her a long time to get here. After growing up in upstate New York, she went to university in Arizona and studied art before dropping out after the first year and going to LA to try to make it as an actor. Arizona is a notorious party college, but Wiig says all of that was out of her system by the time she left high school, where she had a few shaky years. "I was not that good a student because I was very… social. I cared more about going out with my friends. I didn't quite realise the importance of school. But then when I went to college I took it much more seriously, because I enjoyed it."
-
-How social was she? Suspended?
-
-"Um. Not for more than a couple of days. There were suspensions." Her expression fixes. "That's the past." Before the spotlight was so firmly on her, Wiig talked publicly about her minor-league acts of teenage hooliganism, including being caught underage drinking at a Grateful Deadgig, skipping school and, what she called the worst of it, smashing pot plants on a neighbour's porch, which she feels terrible about. As she entered her 20s her parents were still worried, she says, and then when she kicked in her degree and told them she wanted to be an actor, "probably the most worried they could be".
-
-"Yes. Also, they didn't want me to get disappointed. They would always mention the numbers – do you know how many people are trying to do what you're doing? Your chances are really slim. And they're right. Technically. But when you're 20, you're like, why can't you just support me?! Can't you be proud that I'm trying to go after my dream?" She pulls a whiny face and tilts her head. "But they came around quickly when they saw how happy it made me. They would come and see me in the horrible little shows that I was in."
-
-Wiig hadn't any great sense of being funny when she was growing up. Her dad, she says, tells a lot of jokes. Her mother is funny, but "mom funny, where she isn't trying to be funny, but is". Before retiring, her father ran a marina on one of the lakes upstate in New York (the name Wiig is from his Norwegian heritage). Her mother was an artist. Even after all these years, they haven't quite shed the sense of precariousness around their daughter's life; when she tells them she's in a movie, her mother will say tentatively, "Is that something we can see in theatres?" Wiig smiles and says, "They're still getting used to the idea that I'm working and it's OK."
-
-With good reason. Wiig was 11 years in LA before she got the call from Saturday Night Live, during which time her income was erratic. She had arrived in the city with no professional contacts and a nagging sense of insurmountable competition. "I was incredibly intimidated and had no experience. I felt very scared and unsure and I didn't have any résumé, and everyone around me was very beautiful and young and I thought, oh, maybe I should work in a store and enjoy the weather. But I started taking improv classes and that's what got me started."
-
-Improv was something she had never heard of before. But when she turned up to watch a gig one day at the Groundlings, the famous LA improv troupe with alumni such as Lisa Kudrow, Conan O'Brienand Will Ferrell, something resonated. The idea of standing on stage and making up stuff was, she says, less scary to her than the notion of saying lines, with the lurking fear there was a right and a wrong way to say them. With improvisation, there was no right and wrong: "You can't mess it up and you can't forget your lines."
-
-Her enthusiasm wouldn't pay the bills, however, and Wiig worked at a series of day jobs, including at a floral design studio for a couple of years, and as a waitress in the refectory at Universal Studios. Now and then she'll run into someone on a TV show or a movie, and wonder where she knows them from. "And then I'll remember: oh yeah, I used to serve you Cobb salad."
-
-There were many long, dark nights of the soul. "Oh my God, every month, yeah, because you don't have a lot of money coming in. When I look back, it was one of the best times of my life, because you're so in it with your friends. But you do have those moments when you're like: have I given it a try, should I stop, should I quit? But, no. You have a family there, you have a space to put shows on. I would rather be doing what I love and living above a garage – which I did – than not."
-
-The call came in 2005. Wiig flew to New York for the first of several auditions with the Saturday Night Live creators. The audition format was standup, which she had never done before, and in front of a terrifying panel includingLorne Michaels, the legendary SNL producer, and Tina Fey. Wiig was required to unveil a range of characters of her own creation that might be suitable for the sketch show and, quivering up there alone on stage, she fully expected to be met with silence. When she heard a few laughs, she gathered strength, got through it and was called back for a second audition. After which, nothing. And then the new season started. "So I thought, right, pretty clear – thanks for coming. And then after the third show I got a call saying I was hired, come in…"
-
-Wiig joined the show at a time when it was undergoing a cultural transition. Fey was the first female head writer and has written about the formally macho culture of the show – men pissing in jars by their desks, etc, which she put to comic use in 30 Rock. It was tough, she says, walking into a workplace where everyone knew each other: "Kind of like going into someone's living room for a party and they are really comfortable and have their shoes off and are sitting on the couch and I walk in and am a little dressed up and don't know where to stand? They were all very welcoming and nice but I knew I wasn't at that place yet where I could take my shoes off."
-
-She was excited to be working with the likes of Fey, Amy Poehlerand Rachel Dratch, although Wiig is reluctant to describe the still testosterone-heavy environment at SNL as off-putting. "I mean, I mean, merely by numbers there are more men that work there, but I don't consider it… I don't even think about it. Men work there, women work there, we have a lot of amazing female writers on staff right now… There are more men, but I don't think anyone really…"
-
-Was she a fan of Fey's before she joined the show?
-
-"Um. I've watched the show since I was born. I mean I definitely admire all the stuff that she's accomplished, especially coming from SNL and being head writer, and then doing 30 Rock and all these movies and her book, I mean it's definitely something where you go, oh, that can happen. Someone can do that. She's done it. She deserves it."
-
-To date, Bridesmaids has earned in the region of $286m worldwide; it doesn't need the qualifier "best female comedy" since it outgrossed Apatow's entire back catalogue, including Anchorman and The 40-Year-Old Virgin. Still, Wiig does not claim feminist dividends for the film – that it allowed women actors to be as gross on screen as men. She says when she and Mumolo were writing the shitting-in-the-street scene ("Can that be the title of the piece?"), it wasn't with an eye on levelling the playing field, nor was there much discussion of whether the market would tolerate that kind of vulgarity from women. No. "I think when you are doing anything creative and you think, 'What are the critics going to think?' instead of what you want to express, it can get a little muddy, and – I'm talking so seriously about this shitting-in-the-street – but with that in particular we were like, oh, this is a fun way to end the scene, and Annie used to do an impression of someone slowly realising they were shitting their pants, kind of slowly going down on to the ground. She would just do it as a joke, and it would always make me laugh really hard. She took it to a whole new level."
-
-Apatow had approached Wiig and asked her to write a script for him after they worked together on Knocked Up, in which she played a small pivotal role as Katherine Heigl's bitchy boss. In her five minutes on screen, Wiig managed to communicate brilliantly the gap between what her character was saying and thinking. She and Mumolo first conceived of Bridesmaids not as a wedding movie per se, but as a movie about friendship. "I mean, it's called Bridesmaids, I get that. But it's about women who, when they reach that age, whether it's in their 30s or not, thought they were supposed to be somewhere else. That's where we started from. And the fact that Annie had been to seven weddings in two years. And that she had friends who were marrying money and she'd showed up at the country club for the bridal shower with her wing mirrors duct-taped to her car, and at the end of the night had to crawl through her window because the front door would always swell when it was hot out. But if it's your best friend, you don't want to be complaining…"
-
-On paper at least, it didn't look too promising, with the generic title and the number of lame wedding movies in a seemingly exhausted genre. Apatow's name raised suspicions, too, about the use to which certain characters would be put, especially that of Megan, played by Melissa McCarthy, who looked like the inevitable one-fat-girl-in-the-group and the obvious butt of fat-girl jokes. In fact, McCarthy is the other break-out star of the film, and "the character that didn't care what anybody else thought. It was a lesson my character needed to learn. She doesn't care what anyone thinks, she's in her own world, but is generous and sweet. We wanted to have that opposite look on life, the character who seems at first like there was nothing she could say that would help, but…"
-
-The writing of the dialogue was relatively easy, says Wiig, compared with figuring out what should happen in each scene, and the film went through countless draft versions, crammed in around other work commitments, so that Mumolo, for example, would fly out to Mexico where Wiig was filming, to work on it for a weekend. In early drafts, the women ended up in Vegas, but that got chucked out when, over the four years of writing, it was used up in other wedding films such as The Hangover.
-
-Apart from the fact that it is very funny, Bridesmaids ultimately works because it has a kind of sweet sincerity and the friendship between the two lead characters seems real. It bemuses Wiig that the film has widely been described as "raunchy". It's really not raunchy. "Raunchy means like Porky's," she says and smiles. "Which is my next movie; it's going to be a Porky's prequel."
-
-After six years in New York, Wiig is finally at home in the city. It was tough in the early days, she says, and when friends came to visit she would burst into tears as they left. ("I was so embarrassed. I thought, oh my God, they're going to go back and say, 'Kristen's not good. She is noooot coping well.'") If accounts are to be believed, she was briefly married to an actor called Hayes Hargrove and currently lives with her partner, a film-maker called Brian Petsos, but she responds to even the mildest question about her domestic life with a frozen smile. She would, of course, rather talk about acting, and her success in her first lead role – "I felt like I had to do a good job or no one would ever invite me to the party again" – has, despite her scrupulous modesty, been rewarded with the kind of films she always hoped she'd walk into. In the Sean Penn film The Comedian, which is still in the early stages of production, Wiig will co-star with Robert De Niro. It will be the real test of whether she is leading lady material, and whether she can carry a film without jokes. "I don't really think about it," says Wiig. "When you're in it, you're in it."
-
-In the meantime, she has sketches to write and shoot as part of the gruelling schedule of Saturday Night Live. After the interview, she is due in at the office for the weekly writing night, when everyone is required to be in at 4pm and stay until the following morning. Wiig is riding so high at the moment that when, as we leave, I ask her to confirm her age, I'm surprised when she grimaces. Yes, she says, she's 38. Why the face? Under her breath, like a dangerous heresy, she says, "I feel like women are asked their age more than men." And she snaps on a smile and leaves the restaurant.
\ No newline at end of file
diff --git a/newspaper/packages/python-goose-documents/tests/data/extractors/test_guardian1.json b/newspaper/packages/python-goose-documents/tests/data/extractors/test_guardian1.json
deleted file mode 100644
index dc79a6aa..00000000
--- a/newspaper/packages/python-goose-documents/tests/data/extractors/test_guardian1.json
+++ /dev/null
@@ -1,15 +0,0 @@
-{
- "url": "http://www.guardian.co.uk/film/2011/nov/18/kristen-wiig-bridesmaids",
- "expected": {
- "meta_description": "From working as a waitress to starring in hit film Bridesmaids: Kristen Wiig tells Emma Brockes how it happened",
- "domain": "www.guardian.co.uk",
- "final_url": "http://www.guardian.co.uk/film/2011/nov/18/kristen-wiig-bridesmaids",
- "meta_keywords": "Kristen Wiig,Film,Culture,Film",
- "cleaned_text": "Kristen Wiig has had the kind of summer one might imagine to be life-changing. For four years, she andAnnie Mumolo, her friend and co-writer, slaved over a comedy script commissioned by Judd Apatow about a woman whose best friend is getting married. It was the 38-year-old's first lead in a film, and her first full-length script to be produced. As an indication of how it played with audiences, I watched it on a plane last month with a friend who, during the scene in which the bride squats in the street to relieve herself after a bad kebab, laughed so long and hard a woman passing in the aisle leant over and said, \"What are you watching?\"\n\nWiig smiles when I tell her this. \"Proud,\" she says, of the day they filmed the shitting-in-the-street scene. \"A proud moment.\"\n\nWe are in the tearoom of a fashionable hotel in\u00a0Tribeca, the Manhattan neighbourhood where\u00a0Wiig lives. Before Bridesmaids, she was known to US audiences as a long-running cast member of Saturday Night Live and elsewhere for scene-stealing cameos in films such as Ghost\u00a0Town and Knocked Up.\n\nThat the film, by midsummer, had grossed more than $150m in the US and outstripped not only all of Apatow's other films, but every \"R-rated female comedy\" in history, puts Wiig in the zone of woman of the moment, although she chafes against this, with its implication that before Bridesmaids she was an ingenue.\n\n\"In most ways my life hasn't changed,\" she says. \"I know that's a boring answer. People want to hear that I bought all gold, fur\u2026\" She allows a perfectly timed beat. \"I would never wear fur.\"\n\nBut hasn't she had to turn down lots of offers?\n\n\"I mean. Yes, no. It feels weird to say that; you don't want to be like, 'Everyone wants me!' I mean. I guess Bridesmaids was definitely the biggest role I've ever had. And the fact that I co-wrote it and everything. But, um\u2026\" Wiig, who is slight, with very straight hair and an eager tilt to her body language, looks mortified. \"It's not like I have boxes of scripts arriving at my door.\"\n\nHer understatement is fuelled perhaps by the inevitable and awkward comparisons she has gained with other women in her business, as if the culture can sustain only a couple at a time. Wiig has been getting \"the new Tina Fey\" quite a lot \u2013 Fey was head writer at SNL when Wiig joined \u2013 although the comparison is faulty. Wiig is an actor first and a comedian second, and with a film directed by Sean Pennin the pipeline and another, Imogene, in which she stars alongside Annette Bening and Matt Dillon, wants to develop\u00a0her career away from comedy. \"People always call me a comedian. And I don't really see myself like that. I guess I just consider myself an actor who does comedy. But who wants to do other things as well.\"\n\nIt took her a long time to get here. After growing up in upstate New York, she went to university in Arizona and studied art before dropping out after the first year and going to LA\u00a0to try to make it as an actor. Arizona is a notorious party college, but Wiig says all of that was out of her system by the time she left high school, where she had a few shaky years. \"I was not that good a student because I was very\u2026 social. I cared more about going out with my friends. I\u00a0didn't quite realise the importance of school. But then when I went to college I took it much more seriously, because I enjoyed it.\"\n\nHow social was she? Suspended?\n\n\"Um. Not for more than a couple of days. There were suspensions.\" Her expression fixes. \"That's the past.\" Before the spotlight was so firmly on her, Wiig talked publicly about her minor-league acts of teenage hooliganism, including being caught underage drinking at a Grateful Deadgig, skipping school and, what she called the worst of it, smashing pot plants on a neighbour's porch, which she feels terrible about. As she entered her 20s her parents were still worried, she says, and then when she kicked in her degree and told them she wanted to be an actor, \"probably the most worried they could be\".\n\n\"Yes. Also, they didn't want me to get disappointed. They would always mention the numbers \u2013 do you know how many people are trying to do what you're doing? Your chances are really slim. And they're right. Technically. But when you're 20, you're like, why can't you just support me?! Can't you be proud that I'm trying to go after my dream?\" She pulls a whiny face and tilts her head. \"But they came around quickly when they saw how happy it made me. They would come and see me in the horrible little shows that I was in.\"\n\nWiig hadn't any great sense of being funny when she was growing up. Her dad, she says, tells a lot of jokes. Her mother is funny, but \"mom funny, where she isn't trying to be funny, but is\". Before retiring, her father ran a marina on one of the lakes upstate in New York (the name Wiig is from his Norwegian heritage). Her mother was an artist. Even after all these years, they haven't quite shed the sense of precariousness around their daughter's life; when she tells them she's in a movie, her mother will say tentatively, \"Is that something we can see in theatres?\" Wiig smiles and says, \"They're still getting used to the idea that I'm working and it's OK.\"\n\nWith good reason. Wiig was 11 years in LA before she got the call from Saturday Night Live, during which time her income was erratic. She had arrived in the city with no professional contacts and a nagging sense of insurmountable competition. \"I was incredibly intimidated and had no experience. I felt very scared and unsure and I didn't have any r\u00e9sum\u00e9, and everyone around me was very beautiful and young and I\u00a0thought, oh, maybe I should work in a store and enjoy the weather. But I started taking improv classes and that's what got me started.\"\n\nImprov was something she had never heard of before. But when she turned up to watch a gig one day at the Groundlings, the famous LA improv troupe with alumni such as Lisa Kudrow, Conan O'Brienand Will Ferrell, something resonated. The idea of standing on stage and making up stuff was, she says, less scary to her than the notion of saying lines, with the lurking fear there was a right and a wrong way to say them. With improvisation, there was no right and\u00a0wrong: \"You can't mess it up and you can't forget your lines.\"\n\nHer enthusiasm wouldn't pay the bills, however, and Wiig worked at a series of day jobs, including at a floral design studio for a couple of years, and as a waitress in the refectory at Universal Studios. Now and then she'll run into someone on a TV show or a movie, and wonder where she knows them from. \"And then I'll remember: oh yeah, I\u00a0used to serve you Cobb salad.\"\n\nThere were many long, dark nights of the soul. \"Oh my God, every month, yeah, because you don't have a lot of money coming in. When I\u00a0look back, it was one of the best times of my life, because you're so in it with your friends. But you do have those moments when you're like: have I given it a try, should I stop, should I quit? But, no. You have a family there, you have a space to put shows on. I would rather be doing what I love and living above a garage \u2013 which I did \u2013 than not.\"\n\nThe call came in 2005. Wiig flew to New York for the first of several auditions with the Saturday Night Live creators. The audition format was standup, which she had never done before, and in front of a terrifying panel includingLorne Michaels, the legendary SNL producer, and Tina Fey. Wiig was required to unveil a range of characters of her own creation that might be suitable for the sketch show and, quivering up there alone on stage, she fully expected to be met with silence. When she heard a few laughs, she gathered strength, got through it and was called back for a second audition. After which, nothing. And then the new season started. \"So I thought, right, pretty clear \u2013 thanks for coming. And then after the third show I got a call saying I was hired, come in\u2026\"\n\nWiig joined the show at a time when it was undergoing a cultural transition. Fey was the first female head writer and has written about the formally macho culture of the show \u2013 men pissing in jars by their desks, etc, which she put to comic use in 30 Rock. It was tough, she says, walking into a workplace where everyone knew each other: \"Kind of like going into someone's living room for a party and they are really comfortable and have their shoes off and are sitting on the couch and I walk in and am a little dressed up and don't know where to stand? They were all very welcoming and nice but I knew I wasn't at that place yet where I could take my shoes off.\"\n\nShe was excited to be working with the likes of\u00a0Fey, Amy Poehlerand Rachel Dratch, although\u00a0Wiig is reluctant to describe the still testosterone-heavy environment at SNL as off-putting. \"I mean, I mean, merely by numbers there are more men that work there, but I don't consider it\u2026 I don't even think about it. Men work there, women work there, we have a lot of amazing female writers on staff right now\u2026 There are more men, but I don't think anyone really\u2026\"\n\nWas she a fan of Fey's before she joined the\u00a0show?\n\n\"Um. I've watched the show since I was born. I mean I definitely admire all the stuff that she's accomplished, especially coming from SNL and being head writer, and then doing 30 Rock and all\u00a0these movies and her book, I mean it's definitely something where you go, oh, that can\u00a0happen. Someone can do that. She's done it. She deserves it.\"\n\nTo date, Bridesmaids has earned in the region of $286m worldwide; it doesn't need the qualifier \"best female comedy\" since it outgrossed Apatow's entire back catalogue, including Anchorman and The 40-Year-Old Virgin. Still, Wiig does not claim feminist dividends for the film \u2013 that it allowed women actors to be as gross on screen as men. She says when she and Mumolo were writing the shitting-in-the-street scene (\"Can that be the title of the piece?\"), it wasn't with an eye on levelling the playing field, nor was there much discussion of whether the market would tolerate that kind of vulgarity from women. No. \"I think when you are doing anything\u00a0creative and you think, 'What are the critics going to think?' instead of what you want to express, it can get a little muddy, and \u2013 I'm talking so seriously about this shitting-in-the-street \u2013 but with that in particular we were like, oh, this is a fun way to end the scene, and Annie used to do an impression of someone slowly realising they were shitting their pants, kind of\u00a0slowly going down on to the ground. She\u00a0would just do it as a joke, and it would always make me laugh really hard. She took it to a whole new level.\"\n\nApatow had approached Wiig and asked her to write a script for him after they worked together on Knocked Up, in which she played a small pivotal role as Katherine Heigl's bitchy boss. In\u00a0her five minutes on screen, Wiig managed to communicate brilliantly the gap between what her character was saying and thinking. She and Mumolo first conceived of Bridesmaids not as a wedding movie per se, but as a movie about friendship. \"I mean, it's called Bridesmaids, I get that. But it's about women who, when they reach that age, whether it's in their 30s or not, thought they were supposed to be somewhere else. That's where we started from. And the fact that Annie had been to seven weddings in two years. And that she had friends who were marrying money and she'd showed up at the country club for the bridal shower with her wing mirrors duct-taped to her car, and at the end of the night had to crawl through her window because the front door would always swell when it was hot out. But if it's your best friend, you don't want to be\u00a0complaining\u2026\"\n\nOn paper at least, it didn't look too promising, with the generic title and the number of lame wedding movies in a seemingly exhausted genre. Apatow's name raised suspicions, too, about the use to which certain characters would be put, especially that of Megan, played by Melissa McCarthy, who looked like the inevitable one-fat-girl-in-the-group and the obvious butt of fat-girl jokes. In fact, McCarthy is the other break-out star of the film, and \"the character that didn't care what anybody else thought. It was a lesson my character needed to learn. She doesn't care what anyone thinks, she's in her own world, but is generous and sweet. We wanted to have that opposite look on life, the character who seems at first like there was nothing she could say that would help, but\u2026\"\n\nThe writing of the dialogue was relatively easy, says Wiig, compared with figuring out what should happen in each scene, and the film went through countless draft versions, crammed in around other work commitments, so that Mumolo, for example, would fly out to Mexico where Wiig was filming, to work on it for a weekend. In early drafts, the women ended up in Vegas, but that got chucked out when, over the four years of writing, it was used up in other wedding films such as The Hangover.\n\nApart from the fact that it is very funny, Bridesmaids ultimately works because it has a kind of sweet sincerity and the friendship between the two lead characters seems real. It bemuses Wiig that the film has widely been described as \"raunchy\". It's really not raunchy. \"Raunchy means like Porky's,\" she says and smiles. \"Which is my next movie; it's going to be a Porky's prequel.\"\n\nAfter six years in New York, Wiig is finally at home in the city. It was tough in the early days, she says, and when friends came to visit she would burst into tears as they left. (\"I was so embarrassed. I thought, oh my God, they're going to go back and say, 'Kristen's not good. She is noooot coping well.'\") If accounts are to be believed, she was briefly married to an actor called Hayes Hargrove and currently lives with her partner, a film-maker called Brian Petsos, but she responds to even the mildest question about her domestic life with a frozen smile. She would, of course, rather talk about acting, and her success in her first lead role \u2013 \"I felt like I had to do a good job or no one would ever invite me to the party again\" \u2013 has, despite her scrupulous modesty, been rewarded with the kind of films she always hoped she'd walk into. In the Sean Penn film The Comedian, which is still in the early stages of production, Wiig will co-star with Robert De Niro. It will be the real test of whether she is leading lady material, and whether she can carry a film without jokes. \"I don't really think about it,\" says Wiig. \"When you're in it, you're in it.\"\n\nIn the meantime, she has sketches to write and shoot as part of the gruelling schedule of Saturday Night Live. After the interview, she is due in at the office for the weekly writing night, when everyone is required to be in at 4pm and stay until the following morning. Wiig is riding so high at the moment that when, as we leave, I ask her to confirm her age, I'm surprised when she grimaces. Yes, she says, she's 38. Why the face? Under her breath, like a dangerous heresy, she says, \"I feel like women are asked their age more than men.\" And she snaps on a smile and leaves the restaurant.",
- "tags": [
- "Kristen Wiig"
- ],
- "meta_favicon": "/favicon.ico",
- "meta_lang": "en"
- }
-}
\ No newline at end of file
diff --git a/newspaper/packages/python-goose-documents/tests/data/extractors/test_huffingtonPost2.html b/newspaper/packages/python-goose-documents/tests/data/extractors/test_huffingtonPost2.html
deleted file mode 100644
index 24b84d35..00000000
--- a/newspaper/packages/python-goose-documents/tests/data/extractors/test_huffingtonPost2.html
+++ /dev/null
@@ -1,6411 +0,0 @@
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
- Alabama Workers Leave State As Immigration Law Takes Effect
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
- Alabama Workers Leave State As Immigration Law Takes Effect
-
-
-
-
-
-
-
-
-
-
-
-
-
-
- In a Monday, Oct. 3, 2011 photo, Juan Gonzalez sorts tomatoes in Steele, Ala.. Only a few of farm owner Leroy Smith's field workers showed up for work after Alabama's new immigration law took effect last week. Hispanic workers and their children are fleeing Alabama or going into hiding because of the state's strict new immigration law, which will surely deal a significant blow to the state's economy and may slow the rebuilding of Tuscaloosa and other tornado-damaged cities.
-
MONTGOMERY, Ala. -- Alabama's strict new immigration law may be backfiring. Intended to force illegal workers out of jobs, it is also driving away many construction workers, roofers and field hands in the country legally who do backbreaking jobs that Americans generally won't.
-
-
The vacancies have created a void that will surely deal a blow to the state's economy and could slow the rebuilding of Tuscaloosa and other tornado-damaged cities.
-
Employers believe they can carry on because of the dismal economy, but when things do turn around, they worry there won't be anyone around to hire. Many legal Hispanic workers are fleeing the state because their family and friends don't have the proper papers and they fear they will be jailed.
-
-
Rick Pate, the owner of a commercial landscaping company in Montgomery, lost two of his most experienced workers, who were in the country legally. He spent thousands of dollars training them to install irrigation systems at places like the Hyundai plant.
-
-
"They just feel like there is a negative atmosphere for them here. They don't feel welcome. I don't begrudge them. I'd feel nervous, too," Pate said.
-
-
While it's not clear how many of an estimated 185,000 Hispanic people in the state have fled, one estimate figured as much one-fourth of the commercial building work force had left since the law was upheld last week, said Bill Caton, president of Associated General Contractors of Alabama. Commercial construction is a more than $7 billion-a-year industry in Alabama.
-
-
Legislators said the law would help legal residents suffering from nearly 10 percent unemployment.
-
-
One of the bill's authors, Republican Sen. Scott Beason, said he expected short-term problems, but he has received "thank you" calls from two people who replaced illegal immigrants who fled their jobs. Beason predicts that trickle will become a rush.
-
-
"We have the best law in the country and I stand by what we've done," Beason said.
-
-
Some farmers disagreed.
-
-
On Chandler Mountain in north Alabama, tomato farmer Lana Boatwright said only eight of the 48 Hispanic workers she needed for harvest showed up after the law took effect. Those who did were frightened.
-
-
"My husband and I take them to the grocery store at night and shop for them because they are afraid they will be arrested," she said.
-
-
Farmer Chad Smith said his family farm stands to lose up to $150,000 because there are not enough workers to pick tomatoes spoiling in the fields.
-
-
"We will be lucky to be in business next year," he said.
-
-
The financial toll will vary by area, and experts said it's too early to make predictions.
-
-
The law allows police to detain people indefinitely if they are suspected of being in the country illegally and requires schools to check the status of new students when they enroll. Those elements make it perhaps the toughest law in nation.
-
-
The law targets employers by forbidding drivers from stopping along a road to hire temporary workers. It also bars businesses from taking tax deductions for wages paid to illegal workers and makes it a crime for an illegal immigrant to solicit work. A federal judge has temporarily blocked those sections of the law so she can study them more.
-
-
Cristian Gonzalez, an illegal immigrant from Mexico, is a stay-at-home mother of four who lives in a mobile home in suburban Birmingham with her husband. They sneaked across the border in 2009 and planned to save money and eventually return to their home country.
-
-
"We're afraid to go to Walmart. I'm afraid to walk the kids up there to get the bus. I am afraid to drive," Gonzalez said.
-
-
Her husband worked as a brick mason and cook, but was recently unemployed. Now they have decided they probably will return to Mexico.
-
-
"We're just trying to be here one more year, but with this law ..." she said, her voice trailing off as she shook her head.
-
-
In Tuscaloosa, there is still a lot of rebuilding to be done after Alabama's killer tornadoes in April. Without the Hispanic workers to help out, it will take even longer for neighborhoods to be fixed up. Blake Corder, the president of the Home Builders Association of Tuscaloosa, noted that the workers had left the area and he even lost a few renters in the past week.
-
-
Likewise, schools are worried about their students who have suddenly stopped showing up for class. Out of 34,000 Hispanic students, 2,285 were absent Monday. That number increased from Friday by a few hundred.
-
-
The figures show seven out of every 100 Hispanic children were out of school, even though state school officials have tried to assure parents that they won't release their names to police and that no child will be denied an education due to legal status.
-
-
At Gonzalez' mobile home community, driveways were full of cars and trucks at midday Tuesday, a time when most residents used to be at work. A resident who didn't want to be identified out of fear of the law said people are afraid to venture out during daylight.
-
-
"People are just not going to work. They don't want to be arrested," the woman said.
-
-
Builders have complained they can't find replacement workers and delays in projects are expected. Once the economy picks up and construction returns to normal, the impact will increase, said Russell Davis, executive vice president of the Home Builders Association of Alabama.
-
-
"There is going to be a void. No question," Davis said.
-
-
___
-
-
Associated Press writers Jay Reeves in Birmingham, Ala., and Dave Martin in Steele, Ala., contributed to this report.
- MONTGOMERY, Ala. -- Alabama's strict new immigration law may be backfiring. Intended to force illegal workers out of jobs, it is also driving away many construction workers, roofers and field hands in...
-
- MONTGOMERY, Ala. -- Alabama's strict new immigration law may be backfiring. Intended to force illegal workers out of jobs, it is also driving away many construction workers, roofers and field hands in...
-
- Mohamed Ali Muflahi, the first person arrested under Alabama's strict new immigration law, is actually residing in the United States legally, his attorney proved on...
-
- BIRMINGHAM, Ala. -- Hispanic students have started vanishing from Alabama public schools in the wake of a court ruling that upheld the state's tough new...
-
- By Brian Lawson Religion News Service HUNTSVILLE, Ala. (RNS) A federal judge jolted the national immigration debate on Wednesday (Sept. 28) by approving most parts...
-
- BIRMINGHAM, Ala. (AP) -- Police in Alabama are getting ready to enforce what is considered by many as the toughest immigration law in the nation....
-
- BIRMINGHAM, Ala. — A federal judge refused Wednesday to block key parts of a closely watched Alabama law that is considered the strictest state effort...
-
-
- (AP) BIRMINGHAM, Ala. — A federal judge is set to rule on lawsuits challenging the constitutionality of Alabama's tough new law on undocumented immigration. U.S....
-
- BIRMINGHAM, Ala. -- A federal judge temporarily blocked enforcement of Alabama's new law cracking down on illegal immigration, ruling Monday that she needed more time...
- To reply to a Comment:
-
- Click "Reply" at the bottom of the comment; after being approved your comment will appear directly underneath the comment you replied to.
-
-
-
- I just paid $785.00 for passports for me, the wife and three kids to go on a cruise on Thanksgiving.
-
-
-I'm thinking we should have just went to Mexico instead. Heck who needs a passport to get back....
-
-Thanks Homeland Security.
-
-
- Told ya! White people will NOT work the long hrs./less pay like these hispanics do in the field picking, Construction an etc........ All this unfair bill did is destroy farmers who needed pickers,put more bussines's out of business an slowed the recovery from the hard hit disastor state of Alabama. In short these LEGAL IMMIGRANTS will carry their anger to other states an vote AGAINST the Republican/T.P candidates an this anger will carry accross America like a plegue. Than all of u can just keep on laughing thinking this is a real hoot/joke!
-
-
- Congratulations Alabama! You asked for it....and NOW you got it! Try to find some of your goober citizens to take these jobs!
-
-
-BTW, enjoy those $10 tomatoes!
-
-
- When this law backfires, perhaps the farmers and companies that will be lacking worjers can call on the Republicans to send their sons and daughters to work in all the places that don't have workers as a result of this law!
-
-
- good to get rid of them. now the "americans" on unemployment and food stamps can step up a nd get a job, weather they like it or not.. wages? they get what they get.
-
-
- UpNorthGuyWI
-
-1204 Fans Become a fan
-2 minutes ago (7:12 PM)
-If illegal they shouldn't be here. Goodbye.
-_____________________________________________
-
-YOU YOURSELF is NOT an American citizen. SO WHY ARE YOU HERE Canadian ?
-
-
- Well if the Occupy Wall Street people have their demands met , these jobs will be filled..........."Another policy that must be instituted is raise the minimum wage to twenty dollars an hr."
-
-
- Phil, are the "vital workers" legal citizens"? If not, what is your point? So you think to get the work done, we should keep allowing illegals to capitalize on our system? Are u that dumb or just so ideologically blind?
-
-
- When I was sixteen in the 1950's, I worked with a crew in tobacco fields cutting and splitting the stalks and warehousing them for drying. The pay was 50 cents an hour, about equivalent to the $7.00 dollar an hour minimum wage today adjusted for inflation. This gave me and other kids in the crew some pocket spending money, but certainly not real money to support a family (which none of us of course had to do). The all-knowing big-ego Tea Party people should try their hand at farm work at minimum wage for two years (as their only source of income) and see how much fun it is! Its easy to talk about "others" doing the work, but try it yourself and you may actually learn something about reality.
-
-
- Everyone likes to compare to the Depression in the 30's; in that era people were ashamed to take money without working for it, now they are ashamed to take a job "below" them and would rather take the money without working.
-
-
-
-
-
-
-
-
\ No newline at end of file
diff --git a/newspaper/packages/python-goose-documents/tests/data/extractors/test_huffingtonPost2.json b/newspaper/packages/python-goose-documents/tests/data/extractors/test_huffingtonPost2.json
deleted file mode 100644
index 5f8f6d67..00000000
--- a/newspaper/packages/python-goose-documents/tests/data/extractors/test_huffingtonPost2.json
+++ /dev/null
@@ -1,12 +0,0 @@
-{
- "url": "http://www.huffingtonpost.com/2011/10/06/alabama-workers-immigration-law_n_997793.html",
- "expected": {
- "meta_description": "MONTGOMERY, Ala. -- Alabama's strict new immigration law may be backfiring. Intended to force illegal workers out of jobs, it is also driving away many construction workers, roofers and field hands in the country legally who do backbreaking jobs that Americans generally won't.",
- "domain": "www.huffingtonpost.com",
- "final_url": "http://www.huffingtonpost.com/2011/10/06/alabama-workers-immigration-law_n_997793.html",
- "meta_keywords": "alabama, workers, leave, state, as, immigration, law, takes, effect, business",
- "cleaned_text": "MONTGOMERY, Ala. -- Alabama's strict new immigration law may be backfiring.",
- "meta_favicon": "/favicon.ico",
- "meta_lang": "en"
- }
-}
diff --git a/newspaper/packages/python-goose-documents/tests/data/extractors/test_issue24.html b/newspaper/packages/python-goose-documents/tests/data/extractors/test_issue24.html
deleted file mode 100644
index 80ae7b93..00000000
--- a/newspaper/packages/python-goose-documents/tests/data/extractors/test_issue24.html
+++ /dev/null
@@ -1,22 +0,0 @@
-
-
-
- Paragraph Order Test
-
-
-
-
- TextNode 1 - The Scala supported IDE is one of the few pain points of developers who want to start using Scala in their Java project. On existing long term project developed by a team its hard to step in and introduce a new language that is not supported by the existing IDE. On way to go about it is to hid the fact that you use Scala from the Java world by using one way dependency injection. Still, if you wish to truly absorb Scala into your existing java environment then you'll soon introduced cross language dependencies.
-
- Most of our team is using Eclipse as the main IDE, its incrimental compilation in Java with its tight JUnit integration are great for fast TDD programming. Unfortunately the Eclipse Scala plugin is not there yet, it may hangs the IDE and messes up Java compilation - especially in large (more then 1000 source files) Java/Scala projects. Though the plugin is getting better over time some developers would find the plugin as a majore drag on their productivity.
- For developers who do not write Scala at all or rather edit Scala with other editors, you can use this alternate path which lets them work on their Java or Scala code without messing with the plugin.
-
Paragraph 1 - The Following script is using the Fast Scala Compiler (fsc). The fsc is a compilation server which always run in the background, as in a warm scalac always ready to receive new work. Is will reduce compilation time dramatically.
- The classpath for compilation is taken from the Eclipse project .classpath file. You may take the source directory from there as well if you wish (exercise to the reader).
- The params are not passed to the fsc in the command line since in my project's case the line is too long for the OS to handle. The alternative is to put it into a file and let fsc handle it for you.
-
- TextNode 2 - As you may know, kaChing is an test driven engineering organization. Test driven is not an option, its a must. We move fast and push code to production few dozens of times a day in a five minutes release cycle, so we must have high confidence in our code.
- In complex systems there is no end to testings, each test system is an another line of defense which eventually gets broken but the more you have, the less chances bugs will reach production. We do not have QA team and do not want to have one, the reasoning is that if a human is involved in testing then there is a higher chance of missing things and you simply can't test all the site dozens of times a day.
-
Paragraph 2 - In the next few weeks we are adding a new rule from the "not critical" list every few days. The goal is to have all the rules we think are important without the common "its to noisy, lets ignore it" approche. Only after we're done with that we're going to add the next static analysis tool to build. The good thing about these tools and hudson is that you can run them in parallel to the unit/integration tests, on another machine, so they won't slow down the overall release cycle.
-
-
-
\ No newline at end of file
diff --git a/newspaper/packages/python-goose-documents/tests/data/extractors/test_issue24.json b/newspaper/packages/python-goose-documents/tests/data/extractors/test_issue24.json
deleted file mode 100644
index 64a7e0d4..00000000
--- a/newspaper/packages/python-goose-documents/tests/data/extractors/test_issue24.json
+++ /dev/null
@@ -1,12 +0,0 @@
-{
- "url": "http://danielspicar.github.com/goose-bug.html",
- "expected": {
- "meta_description": "",
- "domain": "danielspicar.github.com",
- "final_url": "http://danielspicar.github.com/goose-bug.html",
- "meta_keywords": "",
- "cleaned_text": "TextNode 1 - The Scala supported IDE is one of the few pain points of developers who want to start using Scala in their Java project. On existing long term project developed by a team its hard to step in and introduce a new language that is not supported by the existing IDE. On way to go about it is to hid the fact that you use Scala from the Java world by using one way dependency injection. Still, if you wish to truly absorb Scala into your existing java environment then you'll soon introduced cross language dependencies. Most of our team is using Eclipse as the main IDE, its incrimental compilation in Java with its tight JUnit integration are great for fast TDD programming. Unfortunately the Eclipse Scala plugin is not there yet, it may hangs the IDE and messes up Java compilation - especially in large (more then 1000 source files) Java/Scala projects. Though the plugin is getting better over time some developers would find the plugin as a majore drag on their productivity. For developers who do not write Scala at all or rather edit Scala with other editors, you can use this alternate path which lets them work on their Java or Scala code without messing with the plugin.\n\nParagraph 1 - The Following script is using the Fast Scala Compiler (fsc). The fsc is a compilation server which always run in the background, as in a warm scalac always ready to receive new work. Is will reduce compilation time dramatically. The classpath for compilation is taken from the Eclipse project .classpath file. You may take the source directory from there as well if you wish (exercise to the reader). The params are not passed to the fsc in the command line since in my project's case the line is too long for the OS to handle. The alternative is to put it into a file and let fsc handle it for you.\n\nTextNode 2 - As you may know, kaChing is an test driven engineering organization. Test driven is not an option, its a must. We move fast and push code to production few dozens of times a day in a five minutes release cycle, so we must have high confidence in our code. In complex systems there is no end to testings, each test system is an another line of defense which eventually gets broken but the more you have, the less chances bugs will reach production. We do not have QA team and do not want to have one, the reasoning is that if a human is involved in testing then there is a higher chance of missing things and you simply can't test all the site dozens of times a day.\n\nParagraph 2 - In the next few weeks we are adding a new rule from the \"not critical\" list every few days. The goal is to have all the rules we think are important without the common \"its to noisy, lets ignore it\" approche. Only after we're done with that we're going to add the next static analysis tool to build. The good thing about these tools and hudson is that you can run them in parallel to the unit/integration tests, on another machine, so they won't slow down the overall release cycle.",
- "meta_favicon": "",
- "meta_lang": null
- }
-}
\ No newline at end of file
diff --git a/newspaper/packages/python-goose-documents/tests/data/extractors/test_issue25.html b/newspaper/packages/python-goose-documents/tests/data/extractors/test_issue25.html
deleted file mode 100644
index 3a5fe60d..00000000
--- a/newspaper/packages/python-goose-documents/tests/data/extractors/test_issue25.html
+++ /dev/null
@@ -1,2710 +0,0 @@
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
- Institutes get behind IFRS big bang -
-
- 26 Sep 2011 -
-
-
- Accountancy Age
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
ACCA said a speedy jump would facilitate trade and the transfer of skills, warning an extended convergence period could diminish the comparability of accounts and affect the quality of global standards.
-
-
-
Head of financial reporting Richard Martin said US regulator the SEC "will ultimately want to see a consistent reporting base", but questioned the proposed convergence timescale of seven years.
-
Seven-year itch
-
A protracted transfer could undermine the quality of global standards and attraction for preparers and users of accounts, he warned, by allowing irregularities to creep in.
-
Some slow-and-steady advocates have argued that the US's huge pool of domestic companies would suffer unnecessarily if forced to drop US GAAP, reaping none of the benefits of international comparability.
-
Martin disagreed, questioning how many companies would choose to remain resolutely closed to foreign investment, even if their current shareholders are all American Pie.
-
And accounting standards are not just about what companies want. Investors are interested in cross-border comparison and IFRS should be the facilitator, even if businesses themselves have no global aspirations.
-
Comparable questions
-
-
America argues that even with a long lead time to IFRS, pressure for comparability would keep standards on the straight and narrow, avoiding the drift some commentators fear.
-
Dr Nigel Sleigh-Johnson, head of financial reporting at the ICAEW, is unconvinced. He warned gradual change could "result in a rather incoherent and complex accounting framework", saying rapid adoption would minimise market disruption and be "easier for everyone".
-
Big bang advocates point to countries like Canada and Australia as evidence of the strategy's success. However, the vast majority of adopters spend a few years settling in to the standards, often debating or implementing regional variations.
-
Much of the IFRS Interpretations Committee's time is spent helping new converters work through contentious issues, and it is rare that a seamless switch sees countries merrily accept IFRS without a backward glance.
-
It could be argued that the US's proposed convergence period is simply an official version of this adaptation process, one that all nations go through, but others are too compliant to suggest.
-
Nevertheless, it is undoubted that a fast switch to IFRS allows companies to gather together financial metrics and restate key figures all at once, potentially reaping greater benefits from comparability.
-
At what price change?
-
Countries that adapt IFRS to their own needs could lose the advantage of global standards, Martin suggested, as each minor change introduces a host of unanswerable questions for the investor.
-
How important is the variation? What are its implications? Each layer of disparity takes accounts further from the goal of global comparability.
-
-
Ultimately, the success or otherwise of a US switch to IFRS depends upon commitment to comparability. If the US insists on a long convergence window and ultimately arrives at the same place as other IFRS users, it will fulfil the goal of global standards - albeit a little late.
-
If, however, slow convergence brings with it a slew of nips and tucks that result in the bastardisation of IFRS, no one will have won, and least of all US businesses.
Last time I checked, there was NO decision that we will implement IFRS! There is a significant number of CPAs and organizations in the USA that do NOT support IFRS! Why do we need to change our GAAP? It isn't like IFRS makes anything better and this promotion of IFRS by various groups should NOT influence our decision. My clients are quite content with GAAP and do NOT plan to go to IFRS. IFRS is nothing more than busy work and change for the sake of change. Enough already!
-
- Posted by:
- Florida CPA, 27 Sep 2011 | 15:22
-
-
-
-
-
- Get Real
-
-
-
The US is about 25% of the world economy. While the rest of the world has not made an agreement we are the major influence but when they have then we are the minority. Or does anyone think we are not a part of the world? IFRS is not perfect but we can have a big influence if we partake but none if we remain isolated. Even if we try to reject IFRS it will have an increasing influence in the USA which will accelerate in the years ahead. US GAAP has a lot to offer and we need to offer it - it will be considered and we will all be better off. The Internationalization of our Public companies cannot be held back so we will have to prepare IFRS FinStats anyway. The aim is to have one set of standards! The Accountancy profession is leading this one and they are responding to what users want. Clients may not want to produce Financials at all but then where would we be?
US GAAP has evolved over years and is most suited for the American businesses and its reporting. It is accepted around the world as valid and applicable principles of accounting. Change to IFRS is preposterous. There are huge implications with the change and it will be many years before public will begin to understand and accept IFRS. America has been a market maker and a leader and its US GAAP is ably supported by FASB and enforced by SEC. US should not converge just for the sake of changing the system to comply with reporting requirements of the world. US businesses and capital markets dominate the world and if the world needs to deal with US, then they need to follow US GAAP and the US companies dealing with other countries needs to comply with the respective standards. There are several anti arguments against IFRS, so it is fair to say that US GAAP should remain and not converge with IFRS
-
We don’t need cross boarder British accountants to tell us what to do! It is the US regulatory regime. US GAAP did and will continue to serve US corporations and investors well in the decades to come.
-
-
The Brits should put their house in order first! IFRS isn’t better than even the Chinese GAAP.
-
-
- Posted by:
- G. Moore, US CPA, 28 Sep 2011 | 08:54
-
-
-
-
-
-
- IFRS isn't British
-
-
Reading your comments I am stunned! Have you ever read one of th IFRSs?? I don't even think you know that IFRS is principle based, while US GAAP is all rules. IFRS is about 900 pages excluding guidance and other material compared to 2000 pages plus rules.
-
-
IFRS has the potential to be an excellent tool to transform global markets. It's transparent and gives users of statements a lot of useful info.
-
-
IFRS is also continuously being transformed and updated as markets require change.
-
-
The US is one country while most of the world implement IFRS. You don't always have to be difficult for the sake of being difficult. Do the right thing for once!
-
- Posted by:
- MJ CA(SA), 01 Oct 2011 | 18:12
-
-
-
-
-
-
- What is US GAAP?
-
-
TO: MJ CA(SA)
-
-
What do you mean US GAAP is all rules?
-
-
Do you know what US GAAP means?
-
-
-
Do you know anything about hierarchy of GAAP?
-
-
IFRS is in fact part of US hierarchy of GAAP!
-
-
By the same token, why Brits won’t adopt EU Constitution and EUROs?
-
-
- Posted by:
- california cpa, 04 Oct 2011 | 10:02
-
-
-
-
-
-
- IFRS - Anti-Innovation
-
-
The demand for a big bang transition is nothing new. Advocates for mandating IFRS in the USA have wanted a big bang transition since the mid-1990's.
-
-
The IFRS advocates just have no tolerance for ingenuity, innovation, or capitalism in general.
-
-
Global accounting firms are the only beneficiary for a mandated IFRS - that much has not changed.
-
- Posted by:
- Joe Jefferis, 06 Oct 2011 | 13:30
-
-
-
-
-
-
- Calm Down and take a breath
-
-
The current convergence of IFRS toward most of US GAAP seems to be on track. I think US GAAP is already making IFRS better so that the differences upon eventual adoption will be minimal. That being said, I think IFRS needs more teeth and supporing guidance like US GAAP has achieved over the years. Thus IFRS has a way to go to replace US GAAP here in the US.
-
- Posted by:
- SJ, 06 Oct 2011 | 13:59
-
-
-
-
-
-
- Another soon declining US industry
-
-
I'm amazed at the narrow minded opinions here. If we don't adopt IFRS, the USA will slowly drift away as the world's primary capital market. We're already no longer #1 in IPOs. It's only a matter of time when we're no longer #1 in total market cap if we don't adopt the accounting standards used by what 90+% of the world? Do you really think we can ignore them? They're going to go elsewhere.
-
-
Used to be that all global companies wanted to be listed on US exchanges. Not anymore.
-
-
But IFRS should be voluntary. Any company should be allowed to file with the SEC under IFRS.
-
-
- By looking at the reasons supplier statements became unfashionable, and the reasons why it is different today, this paper delves into the many benefits that can be obtained by automating the process.
-
- Having a real and true view of your organisation’s current financial position, and having the right systems and processes in place, will ensure that you can make strong choices and are ready to capitalise on opportunities
-
AccountancyAgeInsight is a frequently updated resource centre for finance professionals, offering a free and easy-to-use digital library of briefings, white papers and other information resources.
World's hottest chilli contest leaves two in hospital
-
-
-A 'world's hottest chilli' competition at a curry restaurant left two people
- in hospital.
-
-
-
-
-
-
-
-
-
-
-
-
-
-
- Competitors taking part in the chilli eating competition at Kismot Restaurant on St Leonards Place, EdinburghPhoto: DEADLINE
-
-
-
-
-
-
-
-
-
-
-
-
-
9:39AM BST 05 Oct 2011
-
-
-
-
-
-
-Emergency services were called to Kismot Restaurant's curry-eating challenge,
- on St Leonards Place, Edinburgh, after competitors started writhing on the
- floor in agony, vomiting and fainting during the contest.
-
-
-One participant, Curie Kim was so ill after sampling the "Kismot Killer"
- that she had to be taken by ambulance to the Edinburgh Royal Infirmary twice
- in a matter of hours.
-
-
-Today, the Scottish Ambulance Service said it wanted the restaurant to review
- the way the event was managed.
-
-
-
-Paramedics attended the event on Saturday - the busiest day of the week for
- the ambulance service - costing the service several hundred pounds.
-
-
-Participants were required to sign a legal disclaimer prior to taking part in
- the competition, and two members of the British Red Cross were on hand, but
- they could not cope with the nature of the injuries sustained.
-
-Curry house owner Abdul Ali admitted that he would have to "tone down"
- the contest, but said the challenge had raised hundreds of pounds for
- charity CHAS.
-
-
-He added that half of the 20 people who took part in the challenge had dropped
- out after witnessing the first 10 diners vomiting, collapsing, sweating and
- panting.
-
-
-
-Previously the restaurant's Kismot Killer dish has caused diners to suffer
- nose bleeds and one elderly man had to go to hospital.
-
-
-Curie, 21, a Korean exchange student at Edinburgh University, came second in
- the competition, but she admitted the accolade "came with a price".
-
-She said: "I've always enjoyed spicy foods and thought this was for a
- good cause. But it came with a price, I had to be taken to the ERI twice.
-
-
-"I first went to hospital at around 4pm and the second time was at 9pm.
- It got really bad. I have never endured such pain in my life."
-
-
-Mr Ali said he felt the competition had gone well, but that he had
- overestimated how much heat the competitors could take.
-
-
-Beverly Jones, from Newington, was crowned curry queen after she managed to
- finish nine spoonfuls of the chilli-filled dish.
-
-
-
-Mike Lavin, from Polwarth, came fifth, but he, too, had to be taken to the
- ERI.
-
-
-Local councillor Gordon Mackenzie branded the event a "shambles" and
- said: "The owners owe a debt to the ambulance service, and I hope
- they'll find some way of making it up to them."
-
-
-A spokesman for the ambulance service said: "We would urge the organisers
- to review the way in which this event is managed in future in order to avoid
- another situation where emergency ambulances are required to treat their
- customers."
-
-http://seekingalpha.com/user/926530/instablog/full_index