A leading e-commerce price-comparison platform needed deeper user analytics without compromising privacy, but its data took 24-48 hours to reach dashboards. Netlight built a cloud-native event collection system on AWS with real-time validation and efficient ETL, cutting latency to 15 minutes while enforcing data quality, privacy and cost transparency.
Event-to-dashboard delivery reduced from 24-48 hours to just 15 minutes.
Optimised file sizes improved query times by 10 to 100 times.
Challenge
The client needed to enhance its analytics capabilities for deeper user insights without compromising privacy. Without this, it risked lagging in market analysis, overlooking trends and making uninformed decisions that could harm user satisfaction and business growth. It enlisted Netlight to create a cloud event collection system and an analytics framework that balanced centralisation and decentralisation for efficient data handling across teams.
Solution
Netlight used its AWS expertise to build a cloud-native solution that handles high-traffic events like Black Friday. A central processing layer validates data against predefined schemas and stores it in team-specific data lake buckets, with a two-step collection-validation architecture and AWS Kinesis for accuracy and stability. AWS Glue and Kinesis Firehose transform raw data into actionable insights, and AWS Lambda optimises file sizes. CloudWatch provides monitoring and detailed alerting, and custom recovery tools minimise data loss.
Impact
The client offers a prominent e-commerce platform that empowers users to compare prices and products across various industries. With a reputation for comprehensive and unbiased information, it has become a go-to platform for informed shopping decisions.
Next up
We build it with the right people.
Contact us
Impact Story
Netlight helped a Swedish FinTech unicorn use generative AI to cut marketing spend by 11% and personalise campaigns for customers at scale, with team training.
Impact Story
Netlight enabled real-time emission tracking for a Nordic logistics provider, cutting manual reporting workload by 80% with serverless data pipelines.
Impact Story
Netlight scaled a global logistics provider's data team from 10 to 25+ and built data products that lifted revenue 5-20% across trade lanes.