ilustration image

Kickstart

Serverless

Beyond Boundaries: Seamless Scalability with Serverless

The New York-based company conducts sales through bi-weekly product drops, and faces challenges managing a significant influx of users arriving at their site within a narrow time frame. Their current setup encounters numerous bottlenecks, not only at the infrastructure layer, but also in the broader design of the application solution, requiring a comprehensive approach to address these performance and scalability issues.

The Client

This unconventional New York based company is known for their unique and often bizarre creations. They gained attention for limited-edition product drops that challenged traditional norms and expectations. The company aims to provoke conversations and critical thinking through their satirical approach.

Challenge

The client required assistance in designing a new infrastructure solution optimized for cost-effectiveness and capable of managing regular yet highly intensive spikes in traffic during product release events, often called drops, attended by hundreds of thousands of individuals. The primary challenge lays in scaling the infrastructure to accommodate thousands of users simultaneously within a mere minute or two. Additionally, support was required in shaping the application layer to be both performant and scalable, equipped to process large volumes of orders, users, and payment transactions.

Common traffic spikes during product release events [yes, millions of requests]

12 mil

requests per minute

Technology Stack

  • Serverless framework, SST
  • API Gateway, DynamoDB
  • RDS
  • Datadog

What We Did

Our design process for the client’s application architecture prioritized high scalability, utilizing an event-based architecture and serverless technologies and frameworks. After a successful proof of concept (PoC), we collaborated with the client to implement the final solution based on the Serverless framework. During the PoC phase, scaling of RDS and Lambda cold starts turned out to be the biggest bottleneck in our setup. Both of the key components needed to be scaled to a certain size before receiving the spike of user traffic at the beginning of each drop. 

 

To address the need of handling large spikes in user traffic we implemented a pre-scale mechanism which automatically adjusted the sizes of instances used in the RDS cluster and utilised the provisioned concurrency feature of AWS Lambda, setting different weights on different Lambda groups based on actual demand on the solution.

 

The solution underwent a verification process, which included load testing to ensure robustness under high traffic. After the client’s verification, we established a long-term maintenance plan, involving regular upgrades and a commitment to continuous enhancements and improvements for optimum performance.



Beyond Boundaries

How we started

The customer needed a robust and cost optimal solution for handling regular drops. The initial work on the solution was composed of assessment of the current state, design and PoC of the solution, and load testing of the proposed concept.

Final design

The final solution was derived from the initial PoC phase and contained further optimization of the Serverless architecture, scaling and monitoring of the solution.

Finish and Continuous optimization

The solution was battle tested during a large number of drops and we further continue our collaboration with the customer on enhancing the functions of the whole platform.

Outcomes

As a result of our collaboration, we successfully resolved the client’s pain points associated with handling large-scale drop events without any downtime. The new system can now manage high-traffic scenarios without any additional overhead, signifying a marked improvement in performance and scalability. Moreover, the implemented solution has proven to be cost-effective, further enhancing its value to the client and providing a robust framework for managing their unique business model.

Future Steps

As we look to the future, our partnership with the client will continue to prioritize long-term maintenance and systematic enhancements. Our planned future improvements include the incorporation of analytics workloads to further optimize their operations and provide deeper insights into their activities. These enhancements are designed to help the client better understand user behavior, refine their product drop strategies, and continuously improve their overall business performance.

Want to achieve
such results?

We are here for you
contact us

profile photo

Ivan Sakin

Growth & Partnership Manager

WHAT’S NEXT?