Write arch docs

[njoyard]

Notes on live updates (uwaaa! #100 :D)

<is_null> the process is: admin pastes a dossier url in memopol admin
<njoyard> I wonder if there's an easy way to tell what changed on parltrack since date X
<is_null> not needed imho
<is_null> the minutely cron picks up the one oldest dossier that has a url
<is_null> i'm talking about **toutatis** dossier url here
<njoyard> yeah I know
<is_null> the cron would fetch the proposals from toutatis for this dossier
<njoyard> need to figure out sync between memopol/toutatis first
<is_null> then the admin can make recommendations for each proposal
<njoyard> and I feel we DO need diff updates on toutatis, there is too much data
<njoyard> see you later, tunnel  :D
<is_null> kk
<is_null> another cron job (minutely) fetches votes for every proposal that has no votes
<is_null> so scores would almost be live here, at most one minute old
<is_null> then we can have another cron to sync older data, in case there's an errata or something
<is_null> so the architecture here is the most simple i could think of
<is_null> least chances of failures imho
<njoyard> I'll write some arch docs so we can discuss it is_null
<njoyard> But i think reading full parltrack dumps every night is dumb (currently on memopol, next on toutatis)
<njoyard> esp since basically nothing ever changes, copared to the amount of data availavle :)
<njoyard> (sorry, mobile)
<njoyard> so I'd like to see with stf if we can work out daily diffs 
<is_null> i think stf wants to rewrite parltrack on top of postgresql
<is_null> and invest the least possible time on the current parltrack
<is_null> stf will correct me if i'm wrong
<njoyard> in this case I'll diff the dumps at the object level