Decision
Run a one-week Apify shadow test against AWS + Accountify. If Apify accuracy hits 95%+ by Aug 12, switch immediately. AWS + Accountify are replaceable at near-zero cost; the evaluation determines whether accuracy is good enough to proceed.
Context
AWS + Accountify are currently costing ~$2,000-2,500/month for functionality that Apify could replicate at near-zero cost. One week of shadowing was already underway at the time of this call. Ben is running the evaluation and will deliver an accuracy report by Aug 12.
Options Considered
- Keep AWS + Accountify: rejected if Apify hits the accuracy bar - cost savings are significant with no offsetting benefit.
- Switch to Apify immediately without testing: rejected - accuracy must be validated first.
- Hybrid approach: not discussed; binary go/no-go based on accuracy threshold.
Consequences
- Ben delivers accuracy report by Aug 12.
- If 95%+ accuracy: switch immediately, eliminate AWS + Accountify spend.
- If below threshold: revisit evaluation scope or continue current setup.
- Kick MCP is currently read-only; email sent requesting write access for Rena’s workflow (separate track).
Source meeting: Houck + Ben Ornstein 1:1 Weekly