[Answered ]-Django Heroku APScheduler Scrapy

2👍

I have not used Scrapy at all, but I’m actually working with APScheduler and it’s very simple to use. So my first guess would be to use a BackgroundScheduler (inside your Django app) and add a job to it that would execute a callable “spider” periodically.

The thing here is how could you embed a Scrapy project inside your Django app so you can access one of its “spiders” and effectively use it as a callable in your scheduled job.

I’m maybe not helping much, but I’m just trying to give you some kickstart orientation. I’m pretty sure that if you carefully read the Scrapy’s documentation you’ll make your way.

Best.

Leave a comment