Welcome!

Microsoft Cloud Authors: Pat Romanski, Liz McMillan, John Basso, Glenn Rossman, Elizabeth White

Related Topics: Microservices Expo, Java IoT, Industrial IoT, Microsoft Cloud, IoT User Interface, Agile Computing, Apache

Microservices Expo: Article

Case Study: Preventing Site Outages During the Holiday Rush

Performance testing in advance of trigger points can save your customer relations

This time of year, many companies are now in the process of conducting web load testing in advance of the holidays. In this article, you'll learn details on how a large online retailer conducted web load testing in advance of the holiday spike in traffic - and they're moving into the holiday season more confidently than ever.

Why This ‘Retailer' Came to Compuware
As a leading retailer of personalized gifts, it needed to ensure that its website would be ready for the 2012 holidays. Despite load testing its site last year with a different vendor, The Retailer experienced several outages during peak traffic, costing them significant revenue. Great customer experiences and relationships are very important to this Retailer - both in-store and online. However, as a result of the site outages, customer relationships were impacted both online and in its brick and mortar locations.

In order to provide its customers with great experiences, and protect its reputation, the Retailer's online store has to not only provide a great shopping experience, but also withstand the traffic spikes caused by seasonal upswings, events and promotions. Since performance directly impacts the business, much is riding on the performance of its website during the critical holiday season.

Understandably, leery of promises about ensuring scalability after last years' experience, the Retailer contacted Compuware to engage services to deploy its Gomez 360o Web Load Testing solution which was selected based on three key factors:

  • Enough Load could be generated from enough locations to thoroughly stress its system;
  • Real browser technology for the agents would ensure the most realistic testing and problem identification; and
  • The diagnostic capabilities of dynaTrace's PurePath technology would show the root cause of any problem

The Retailer utilized Compuware Professional services in order to have an independent third-party that would help them design a test plan to re-create issues, not just prove that the system worked.

With Gomez 360o Web Load Testing, each transaction performed during load testing was traced. In addition, all of the diagnostic information correlated into load test reports so there was complete visibility into how applications behaved under load. Armed with this information, the Retailer identified any problems in both proprietary code as well as third-party code.

Retailer's Plan of Attack

  • Test from the end-user perspective using last mile, real browsers and less than ideal Internet speeds.
  • Test the production system during least use in the middle of the night giving a four hour test window with normal peaks lasting approximately 10 hours
  • Calculate load volume based on highest hourly historical activity - then multiply the test window by 2.5 to obtain a 10 hour peak.

Results
The Retailer's site could handle the peak load but not for the allotted four hours. The analysis revealed multiple root causes of instability including:

  • Load balancer issues
  • Gateway errors
  • SQL issues
  • JVM Issues

Reconfiguring the load balancer solved the site crashes while code changes optimized certain queries. JVM optimization was taken care of by forcing garbage collection more frequently.

The quality and speed of the Retailer's website is now on par to provide exceptional user experiences for their e-commerce customers, aligning it with the caliber of in-store service that is expected. The Retailer was also able to reduce testing iterations and cycle time with proactive problem resolution and prevention and validate that the website architecture is performing properly for maximum scalability under peak load.

Actionable data is easily provided to their outsourced development vendor. This not only gives the vendor a deep, code level view in order to quickly fix and optimize the application code, but relations between the vendor and the retailer are greatly improved since the data eliminates finger pointing.

The Retailer is confident it will not have a repeat of last year's outages and its site will perform optimally during peak traffic periods throughout the holiday season.

To learn how performance testing in advance of trigger points can save your customer relations, attend our live webcast with Forrester's Peter Wannemacher on Thursday, Nov. 15.

More Stories By Laura Strassman

Laura Strassman has more than 20 years of experience in product management and marketing in the technology space, and has focused extensively in the application performance area. At SmartBear, she is responsible for technical content strategy and programs for AlertSite UXM, the company’s industry-leading user experience and performance monitoring platform. Prior to SmartBear, Strassman held positions at companies in the application performance, digital video, speech recognition and software development tool markets.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@ThingsExpo Stories
For basic one-to-one voice or video calling solutions, WebRTC has proven to be a very powerful technology. Although WebRTC’s core functionality is to provide secure, real-time p2p media streaming, leveraging native platform features and server-side components brings up new communication capabilities for web and native mobile applications, allowing for advanced multi-user use cases such as video broadcasting, conferencing, and media recording.
SYS-CON Events announced today that Venafi, the Immune System for the Internet™ and the leading provider of Next Generation Trust Protection, will exhibit at @DevOpsSummit at 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Venafi is the Immune System for the Internet™ that protects the foundation of all cybersecurity – cryptographic keys and digital certificates – so they can’t be misused by bad guys in attacks...
The cloud market growth today is largely in public clouds. While there is a lot of spend in IT departments in virtualization, these aren’t yet translating into a true “cloud” experience within the enterprise. What is stopping the growth of the “private cloud” market? In his general session at 18th Cloud Expo, Nara Rajagopalan, CEO of Accelerite, explored the challenges in deploying, managing, and getting adoption for a private cloud within an enterprise. What are the key differences between wh...
There will be new vendors providing applications, middleware, and connected devices to support the thriving IoT ecosystem. This essentially means that electronic device manufacturers will also be in the software business. Many will be new to building embedded software or robust software. This creates an increased importance on software quality, particularly within the Industrial Internet of Things where business-critical applications are becoming dependent on products controlled by software. Qua...
In addition to all the benefits, IoT is also bringing new kind of customer experience challenges - cars that unlock themselves, thermostats turning houses into saunas and baby video monitors broadcasting over the internet. This list can only increase because while IoT services should be intuitive and simple to use, the delivery ecosystem is a myriad of potential problems as IoT explodes complexity. So finding a performance issue is like finding the proverbial needle in the haystack.
Machine Learning helps make complex systems more efficient. By applying advanced Machine Learning techniques such as Cognitive Fingerprinting, wind project operators can utilize these tools to learn from collected data, detect regular patterns, and optimize their own operations. In his session at 18th Cloud Expo, Stuart Gillen, Director of Business Development at SparkCognition, discussed how research has demonstrated the value of Machine Learning in delivering next generation analytics to imp...
The 19th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Digital Transformation, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportuni...
The Internet of Things will challenge the status quo of how IT and development organizations operate. Or will it? Certainly the fog layer of IoT requires special insights about data ontology, security and transactional integrity. But the developmental challenges are the same: People, Process and Platform. In his session at @ThingsExpo, Craig Sproule, CEO of Metavine, demonstrated how to move beyond today's coding paradigm and shared the must-have mindsets for removing complexity from the develo...
SYS-CON Events announced today that MangoApps will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. MangoApps provides modern company intranets and team collaboration software, allowing workers to stay connected and productive from anywhere in the world and from any device.
Large scale deployments present unique planning challenges, system commissioning hurdles between IT and OT and demand careful system hand-off orchestration. In his session at @ThingsExpo, Jeff Smith, Senior Director and a founding member of Incenergy, will discuss some of the key tactics to ensure delivery success based on his experience of the last two years deploying Industrial IoT systems across four continents.
Basho Technologies has announced the latest release of Basho Riak TS, version 1.3. Riak TS is an enterprise-grade NoSQL database optimized for Internet of Things (IoT). The open source version enables developers to download the software for free and use it in production as well as make contributions to the code and develop applications around Riak TS. Enhancements to Riak TS make it quick, easy and cost-effective to spin up an instance to test new ideas and build IoT applications. In addition to...
Identity is in everything and customers are looking to their providers to ensure the security of their identities, transactions and data. With the increased reliance on cloud-based services, service providers must build security and trust into their offerings, adding value to customers and improving the user experience. Making identity, security and privacy easy for customers provides a unique advantage over the competition.
"We've discovered that after shows 80% if leads that people get, 80% of the conversations end up on the show floor, meaning people forget about it, people forget who they talk to, people forget that there are actual business opportunities to be had here so we try to help out and keep the conversations going," explained Jeff Mesnik, Founder and President of ContentMX, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
"There's a growing demand from users for things to be faster. When you think about all the transactions or interactions users will have with your product and everything that is between those transactions and interactions - what drives us at Catchpoint Systems is the idea to measure that and to analyze it," explained Leo Vasiliou, Director of Web Performance Engineering at Catchpoint Systems, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York Ci...
Internet of @ThingsExpo, taking place November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with the 19th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world and ThingsExpo Silicon Valley Call for Papers is now open.
I wanted to gather all of my Internet of Things (IOT) blogs into a single blog (that I could later use with my University of San Francisco (USF) Big Data “MBA” course). However as I started to pull these blogs together, I realized that my IOT discussion lacked a vision; it lacked an end point towards which an organization could drive their IOT envisioning, proof of value, app dev, data engineering and data science efforts. And I think that the IOT end point is really quite simple…
"My role is working with customers, helping them go through this digital transformation. I spend a lot of time talking to banks, big industries, manufacturers working through how they are integrating and transforming their IT platforms and moving them forward," explained William Morrish, General Manager Product Sales at Interoute, in this SYS-CON.tv interview at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
You think you know what’s in your data. But do you? Most organizations are now aware of the business intelligence represented by their data. Data science stands to take this to a level you never thought of – literally. The techniques of data science, when used with the capabilities of Big Data technologies, can make connections you had not yet imagined, helping you discover new insights and ask new questions of your data. In his session at @ThingsExpo, Sarbjit Sarkaria, data science team lead ...
Extracting business value from Internet of Things (IoT) data doesn’t happen overnight. There are several requirements that must be satisfied, including IoT device enablement, data analysis, real-time detection of complex events and automated orchestration of actions. Unfortunately, too many companies fall short in achieving their business goals by implementing incomplete solutions or not focusing on tangible use cases. In his general session at @ThingsExpo, Dave McCarthy, Director of Products...
WebRTC is bringing significant change to the communications landscape that will bridge the worlds of web and telephony, making the Internet the new standard for communications. Cloud9 took the road less traveled and used WebRTC to create a downloadable enterprise-grade communications platform that is changing the communication dynamic in the financial sector. In his session at @ThingsExpo, Leo Papadopoulos, CTO of Cloud9, discussed the importance of WebRTC and how it enables companies to focus...