Data Pipelines & Synchronization

TBA is more than just a simple ecommerce store, it's a one-stop destination for all your home improvement needs.

Challenge

The client was facing a challenge in finding a solution to synchronize inventory and create new products from multiple vendors through various channels as there were no APIs available. The store was set up on Shopify, and it was imperative that all the data be in line with the platform's specifications.

Solution

Labvent implemented a solution that utilized multiple scrapers to collect data from over 6 partnered vendors. These scrapers were designed to collect relevant information such as product descriptions, pricing, and images, to ensure that the inventory on the Shopify store was up-to-date. The inventory syncing modules were designed to run on a schedule, but could also be initiated on demand. This allowed for real-time updates to the store's inventory, ensuring that customers always had access to the latest products and information. Additionally, automated email logs were generated to track changes and updates to the inventory. To ensure scalability and reliability, each scrapper was deployed on AWS Lambda and was scheduled to run at regular intervals. This implementation allowed for seamless and efficient synchronization of the inventory and creation of new products from multiple vendors, ensuring that the store's data was always in line with the vendor's specifications.