Scalable Serverless AWS Architecture for Dash Cam Data Processing

JashDS designed and implemented a comprehensive serverless AWS solution that completely replaced the existing prototype FTP architecture. The team developed a private API Gateway to securely receive video and data streams from dash cam devices, ensuring secure and reliable data transmission.

The solution included a sophisticated video processing pipeline using AWS Lambda functions that transcoded video files as needed and stored them securely in Amazon S3 with relevant metadata and efficient organization for optimal retrieval and management. A separate processing pipeline was created for non-video device data including GPS coordinates, event flags, and other telemetry metadata.

The architecture implemented Amazon SQS queuing system to handle large volumes of incoming data and ensure reliable processing even during network connectivity interruptions. Lambda functions were developed to process queued data and store it in the appropriate Aurora Serverless.

The team configured and optimized S3 storage for video files with appropriate lifecycle policies based on retention requirements and established connectivity with the client's existing VPN connections to cellular providers including Verizon and AT&T. The entire architecture was designed with automatic scaling capabilities to handle the projected tenfold increase in data volume while accommodating dash cam local storage capabilities and network interruption scenarios.