Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[NH-011] - Improve consume feed process #11

Open
danielmasegosa opened this issue Jul 21, 2019 · 0 comments
Open

[NH-011] - Improve consume feed process #11

danielmasegosa opened this issue Jul 21, 2019 · 0 comments
Labels
bug Something isn't working collector

Comments

@danielmasegosa
Copy link

danielmasegosa commented Jul 21, 2019

We must improve the process of collect feeds from opml file.

Expected Behavior
Several RSS resources have been deprecated and others can't be parsed correctly by the Rome library. The list which contains all theses resources is:

  • AdRoll
  • Arkency
  • Artsy
  • Avenue Code
  • Azavea
  • Blogfoster
  • BloomReach
  • Boxever
  • Cerner
  • Coinbase
  • Convox
  • Data Artisans
  • DeferPanic
  • Deliveroo
  • DoorDash
  • Expedia
  • Flickr
  • Flipboard
  • Foursquare
  • Funding Circle
  • Future Processing
  • Geoblink
  • GitHub Old
  • Google Online Security
  • Grab
  • Grouper
  • Harry's
  • Heroku
  • Honeybadger
  • Hootsuite
  • IFTTT
  • IMVU
  • Intel
  • Intent HQ
  • Intercom
  • InVision
  • Just Eat
  • King
  • Laterooms
  • LiveChat
  • Made Tech
  • MailChimp
  • MemSQL
  • Microsoft Python Engineering
  • Mozilla Automation Team
  • Mozilla Release Engineering
  • Nvidia
  • Opensooq
  • Paypal
  • REA Group
  • Realm.io
  • Remind
  • RisingStack
  • Scrunch
  • Segment
  • Semantics3
  • Semaphore CI Engineering
  • Sensible
  • Sharethis
  • Shazam
  • Shopify
  • Snyk
  • Takipi Target
  • theScore
  • Tinder
  • TripAdvisor
  • TrueCar
  • Tumblr
  • Twitter
  • Venmo
  • Vine
  • VNGRS
  • Wattpad
  • We Are Wizards
  • Wingify
  • WyeWorks
  • Xmartlabs
  • Yahoo
  • Zenefits
  • Addy Osmani
  • Anders Aarvik
  • Andreas Schuster
  • Andrew Bancroft
  • Andrew Ray
  • Andrey Akinshin
  • Barry Warsaw
  • Ben McCormick
  • Bill the Lizard
  • Blundell's Android Tutorials
  • Brandon Rhodes
  • Chris Wellons
  • Code with style!
  • Dave Atchley
  • Discover Meteor
  • Evan Jones
  • Ievgen Kuzminov
  • Ilija Eftimov
  • Ilya Grigorik
  • Jake Wharton
  • James Hague
  • James Long
  • Jan Lelis
  • Jesus Castello
  • Jon Kensy
  • Jonathan Dekhtiar
  • Juan Treminio
  • Larry Land
  • Lerner Consulting Blog
  • Luciano Mammino
  • Manu Sporny
  • Matt Aimonetti
  • Matt Warren
  • Michaël Gallego
  • Michael Herman
  • Mike Ash
  • Peteris Krumins
  • Petr Mitrichev
  • Philipp Oppermann
  • Radek Pazdera
  • Regular Geek
  • Sam Saffron
  • Sergey Zhuk
  • Scott Johnson
  • Stack Abuse
  • Stefan Parker
  • The Coded Self
  • Thomas Young
  • Todd Motto
  • Yifan Lu
  • Android
  • Atom.io
  • React
  • RocksDB
  • Vertabelo

Current Behavior
Multiple errors are produced through the collecting process. The errors are caught in the RssFeedListener service are shown in a log trace.

Steps to reproduce
For reproducing the current behavior you need:

  • Up and running docker-compose stack
  • Run FeedCollectorApplication

Steps to fix
A good practice to fix theses errors could be:

  • In a unit test, similar to RssFeedListenerTest, you could reproduce the parser process of a feed through Rome library.
  • If the error could be solved, do and pushed it. Otherwise, the feed must be deleted from opml file in the collector artifact.
@danielmasegosa danielmasegosa changed the title Improve consume feed process [NH-011] - Improve consume feed process Jul 23, 2019
@ivangrod ivangrod added bug Something isn't working collector labels Jul 29, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working collector
Projects
None yet
Development

No branches or pull requests

2 participants