Three providers need a publish crawler — Mandi Price, Mosamgram and Pocra — and the work is the same shape for each. Agree the approach once so the three implementations share it rather than each solving it differently.
- Decide how a crawler is structured and where it runs
- Work out how on-demand and direct publish modes are both supported
- Decide how often each source is polled and how changes are detected
- Settle how source data maps onto the published resource, and what happens when a publish fails
- Write up the design the three crawler implementations will follow
Three providers need a publish crawler — Mandi Price, Mosamgram and Pocra — and the work is the same shape for each. Agree the approach once so the three implementations share it rather than each solving it differently.