Microsoft Cloud Authors: Elizabeth White, Yeshim Deniz, Serafima Al, Janakiram MSV, John Katrick

Related Topics: Microservices Expo, Java IoT, Microsoft Cloud, Machine Learning , Agile Computing, @CloudExpo

Microservices Expo: Article

Learning to Expect the Unexpected: Load Test Before It’s Too Late

Unfortunately, many organizations tend to treat load testing as one of those activities that they can put off until a later day

At times, I can be a bit of a procrastinator. If there is no pressing need to clean out the garage this week, shop for holiday gifts, or do my taxes, I can easily be convinced to let it go until next week or next month. Inevitably, though, something happens that makes me wish I hadn't delayed quite as long as I did. The garage gets flooded, for example, and the boxes that I had been meaning to organize get soaked and destroyed... or my Valentine's Day gift doesn't get shipped in time and I'm left holding the bag. I'm sure many of you can think of your own examples.

Unfortunately, many organizations tend to treat load testing as one of those activities that they can put off until a later day. You can almost imagine what they're thinking: "Our website is up and handling the daily load with little difficulty. Yes, there's a major advertising campaign - or new product launch, or major news release, or something similar - coming, but that's a few months away, and we have plenty of time to prepare for it." Then, inevitably something happens, testing doesn't get completed and the website is flooded with traffic that it is unable to handle. If you're the one responsible for the fall-out from such an event, it's time to stop procrastinating and start load testing. By load testing, I'm not just talking about throwing a bunch of simultaneous users at your website. I'm talking about generating a realistic load so you get results your developers and infrastructure team will actually pay attention to. This involves modeling real-world factors in your user loads, including users accessing your website and applications from mobile devices and from lots of different geographies. With proper load testing you can be prepared when the unexpected deluge of users hits your site. You'll know what your site can handle, and how it will respond. More important, you can put mechanisms and procedures in place to help ensure your site will scale - or at least fail gracefully - and avoid the organizational embarrassment and opportunity cost of a major outage.

Perhaps you're still not convinced that some event could happen tomorrow that sends a tidal wave of users your way. That's what Florida Gulf Coast University (FGCU) thought in March of 2013, when the school's basketball team scored an unprecedented and unexpected series of victories in the 2013 NCAA Men's Division I Basketball Tournament. Suddenly, what was a relatively unknown school outside of Florida was thrust into the national limelight, and millions of people wanted to learn more about it. What happened? The university's website crashed. At exactly the time when FCGU could present a positive image of itself to a wide, interested audience, the website failed under load. To be clear, I have no inside information about what tests FGCU may have performed if any, but I can infer that the tests were either inadequate or that the results were not taken seriously. As a result, what could have been a public relations slam dunk turned into a missed opportunity.

Sure, you say, but that's a once-in-a-generation occurrence, and you're a business not a university. Consider this. While watching the Super Bowl, I saw a rather cryptic commercial for a company I hadn't heard of before. Like many people around the country, I wanted to know more so I visited the company's website. What did I find? It had crashed.

And they weren't alone. Coke, Acura, and other big names experienced similar outages. It's true that running a Super Bowl add does not really qualify as an "unexpected event." Surely, many individuals in each of those companies knew the ads would run, yet still the web team was left looking unprepared. Perhaps they had not tested with a realistic, geographically distributed user load? It is not inconceivable that in some cases the web teams were not aware that the ad would run. Can you say with 100% confidence that you know exactly when your company's next big campaign will launch? What if a mistake is made - one outside the control of anyone in your organization? Is your website ready today to handle the traffic generated by such an event? If not, how will it fail?

So far, the examples I've cited have resulted in maybe a little embarrassment, a bit (or more) of revenue loss, and some brand tarnishing. But, it's easier to imagine a more dire scenario. People depend on the web today like never before. Websites that serve the public interest and public safety are expected to perform and deliver up-to-date information that the public needs at all times.

During the terrorist hunt after the tragic marathon bombing in Boston earlier this year, the FBI had held a press conference alerting the public of the identification of the suspects. Among the discussion was the release of a URL that contained photos of the suspects. Living just a few miles from where the bombing took place, I, like most of the people watching the press conference, tried to bring up the website only to find a "website not available" message. While the outage seemed to be resolved promptly, I can only imagine the ramifications if the site had remained down.


While the latter example might be extreme, all of these situations had one thing in common: the organizations did not expect the causes of the failures to ever occur in the first place. If they had, obviously they would have done more to protect against it. Instead of wracking your brain to think about all the possible causes of traffic spikes such as a water main breaking, a major storm approaching or a competitor's site going down, just test it so you know if and how you can handle the spike. This will ensure you have the answers to those questions you will be sure to get should an unforeseeable event impact your site. The fact is unlikely events occur all the time. Our job as load testers is to understand how our software will perform when they do. Since learning to expect the unexpected, I realize it's all about preparation, not procrastination.

This weekend, I'm cleaning out the garage... maybe I'll even get a jump on my holiday shopping.

More Stories By Steve Weisfeldt

Steve Weisfeldt is a Senior Performance Engineer at Neotys, a provider of load testing software for Web applications. Previously, he has worked as the President of Engine 1 Consulting, a services firm specializing in all facets of test automation. Prior to his involvement at Engine 1 Consulting, he was a Senior Systems Engineer at Aternity. Prior to that, Steve spent seven years at automated testing vendor Segue Software (acquired by Borland). While spending most of his time at Segue delivering professional services and training, he was also involved in pre-sales and product marketing efforts.

Being in the load and performance testing space since 1999, Steve has been involved in load and performance testing projects of all sizes, in industries that span the retail, financial services, insurance and manufacturing sectors. His expertise lies in enabling organizations to optimize their ability to develop, test and launch high-quality applications efficiently, on-time and on-budget. Steve graduated from the University of Massachusetts-Lowell with a BS in Electrical Engineering and an MS in Computer Engineering.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

@ThingsExpo Stories
Dion Hinchcliffe is an internationally recognized digital expert, bestselling book author, frequent keynote speaker, analyst, futurist, and transformation expert based in Washington, DC. He is currently Chief Strategy Officer at the industry-leading digital strategy and online community solutions firm, 7Summits.
Digital Transformation and Disruption, Amazon Style - What You Can Learn. Chris Kocher is a co-founder of Grey Heron, a management and strategic marketing consulting firm. He has 25+ years in both strategic and hands-on operating experience helping executives and investors build revenues and shareholder value. He has consulted with over 130 companies on innovating with new business models, product strategies and monetization. Chris has held management positions at HP and Symantec in addition to ...
Cloud-enabled transformation has evolved from cost saving measure to business innovation strategy -- one that combines the cloud with cognitive capabilities to drive market disruption. Learn how you can achieve the insight and agility you need to gain a competitive advantage. Industry-acclaimed CTO and cloud expert, Shankar Kalyana presents. Only the most exceptional IBMers are appointed with the rare distinction of IBM Fellow, the highest technical honor in the company. Shankar has also receive...
Enterprises have taken advantage of IoT to achieve important revenue and cost advantages. What is less apparent is how incumbent enterprises operating at scale have, following success with IoT, built analytic, operations management and software development capabilities - ranging from autonomous vehicles to manageable robotics installations. They have embraced these capabilities as if they were Silicon Valley startups.
Internet-of-Things discussions can end up either going down the consumer gadget rabbit hole or focused on the sort of data logging that industrial manufacturers have been doing forever. However, in fact, companies today are already using IoT data both to optimize their operational technology and to improve the experience of customer interactions in novel ways. In his session at @ThingsExpo, Gordon Haff, Red Hat Technology Evangelist, shared examples from a wide range of industries – including en...
The standardization of container runtimes and images has sparked the creation of an almost overwhelming number of new open source projects that build on and otherwise work with these specifications. Of course, there's Kubernetes, which orchestrates and manages collections of containers. It was one of the first and best-known examples of projects that make containers truly useful for production use. However, more recently, the container ecosystem has truly exploded. A service mesh like Istio addr...
Rodrigo Coutinho is part of OutSystems' founders' team and currently the Head of Product Design. He provides a cross-functional role where he supports Product Management in defining the positioning and direction of the Agile Platform, while at the same time promoting model-based development and new techniques to deliver applications in the cloud.
Predicting the future has never been more challenging - not because of the lack of data but because of the flood of ungoverned and risk laden information. Microsoft states that 2.5 exabytes of data are created every day. Expectations and reliance on data are being pushed to the limits, as demands around hybrid options continue to grow.
Business professionals no longer wonder if they'll migrate to the cloud; it's now a matter of when. The cloud environment has proved to be a major force in transitioning to an agile business model that enables quick decisions and fast implementation that solidify customer relationships. And when the cloud is combined with the power of cognitive computing, it drives innovation and transformation that achieves astounding competitive advantage.
Poor data quality and analytics drive down business value. In fact, Gartner estimated that the average financial impact of poor data quality on organizations is $9.7 million per year. But bad data is much more than a cost center. By eroding trust in information, analytics and the business decisions based on these, it is a serious impediment to digital transformation.
Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settlement products to hedge funds and investment banks. After, he co-founded a revenue cycle management company where he learned about Bitcoin and eventually Ethereal. Andrew's role at ConsenSys Enterprise is a mul...
As IoT continues to increase momentum, so does the associated risk. Secure Device Lifecycle Management (DLM) is ranked as one of the most important technology areas of IoT. Driving this trend is the realization that secure support for IoT devices provides companies the ability to deliver high-quality, reliable, secure offerings faster, create new revenue streams, and reduce support costs, all while building a competitive advantage in their markets. In this session, we will use customer use cases...
Digital Transformation: Preparing Cloud & IoT Security for the Age of Artificial Intelligence. As automation and artificial intelligence (AI) power solution development and delivery, many businesses need to build backend cloud capabilities. Well-poised organizations, marketing smart devices with AI and BlockChain capabilities prepare to refine compliance and regulatory capabilities in 2018. Volumes of health, financial, technical and privacy data, along with tightening compliance requirements by...
delaPlex is a global technology and software development solutions and consulting provider, deeply committed to helping companies drive growth, revenue and marketplace value. Since 2008, delaPlex's objective has been to be a trusted advisor to its clients. By redefining the outsourcing industry's business model, the innovative delaPlex Agile Business Framework brings an unmatched alliance of industry experts, across industries and functional skillsets, to clients anywhere around the world.
Headquartered in Plainsboro, NJ, Synametrics Technologies has provided IT professionals and computer systems developers since 1997. Based on the success of their initial product offerings (WinSQL and DeltaCopy), the company continues to create and hone innovative products that help its customers get more from their computer applications, databases and infrastructure. To date, over one million users around the world have chosen Synametrics solutions to help power their accelerated business or per...
DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to one location.
DXWorldEXPO | CloudEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
The best way to leverage your Cloud Expo presence as a sponsor and exhibitor is to plan your news announcements around our events. The press covering Cloud Expo and @ThingsExpo will have access to these releases and will amplify your news announcements. More than two dozen Cloud companies either set deals at our shows or have announced their mergers and acquisitions at Cloud Expo. Product announcements during our show provide your company with the most reach through our targeted audiences.
DXWorldEXPO LLC announced today that "Miami Blockchain Event by FinTechEXPO" has announced that its Call for Papers is now open. The two-day event will present 20 top Blockchain experts. All speaking inquiries which covers the following information can be submitted by email to [email protected] Financial enterprises in New York City, London, Singapore, and other world financial capitals are embracing a new generation of smart, automated FinTech that eliminates many cumbersome, slow, and expe...
DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City. Digital Transformation (DX) is a major focus with the introduction of DXWorldEXPO within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of bus...