Thread:Talk:PDF rendering/Architecture/A few questions/reply


 * We agreed in this mornings standup that we should explicitly split spidering and rendering into two jobs. The spider will then inject a job into a 'pending render' queue with a URL to it's endpoint for the 'post_zip' command.


 * The idea of a lookaside image cache has merit; but let's not do that right now. Implement it later if we need it (which should be easier as we have a separate spider/render workflow)


 * Progress update messages; haven't looked into it too much. It'll have to be very similar to the old format which I haven't yet looked at closely.


 * I would argue against putting large things in Redis; it wasn't really designed for large binary objects. The current plan of hosting them on disk; or in varnish seems to be workable.