The result
This project is a technical implementation which connects to google to track and determine the status of a backlink on Google.
Corporate clients can add, track and manage large lists of backlinks to improve the overall SEO score of their websites.
The project presented multiple challenges, the biggest of which is how to manage automated pipelines for large datasets flexibly. When a new client comes on they can add 100's of 1000's of domains which should be processed quickly.
To achieve this we used scheduled batch processing and scaled up servers as and when needed.