Welcome!

Microsoft Cloud Authors: Andreas Grabner, Nick Basinger, Kevin Benedict, Pat Romanski, Liz McMillan

Blog Feed Post

Unraveling the Mystery: How to Anticipate Application Performance Problems

Complexity vs application performance monitoring

Monitoring application performance is simple…as long as the application and the deployment architecture are also simple.  The mystery appears as the complexity of the application architecture grows and begins to span from an isolated Java or .NET silo into a full-blooded composite application spanning web, middleware and mainframe tiers.  Unraveling this mystery can be daunting as the builders of the application often view their role as within a silo, e.g. web, application server, or database.  However, as transactions traverse across tiers the consequences of what has been coded is not always clear to the developer.  They may have done a perfect job in Java, but their objects might have created something in the database that unknowingly persists after the Java part of the application has exited and its objects are destroyed.  And that is where problems start to creep in…unknowable consequences whose frequency grows with complexity.

Complexity itself is a word that can be used to describe composite applications. According to Wikipedia: “A complex system is a system composed of interconnected parts that as a whole exhibit one or more properties (behavior among the possible properties) not obvious from the properties of the individual parts.”  One may conclude (sometimes, erroneously) from this definition that misbehavior in one or more components of a complex system may not necessarily compromise the system as a whole. The challenge is in how to know that our “complex system” is misbehaving or acting outside of “normal” and what is the impact of this?

Today’s monitoring tools are pretty good at identifying known faults such as server availability, network errors, resource utilization, etc – piece parts. A typical data center receives many thousands of alerts (sometimes millions) daily about all kinds of faults. Many alerts have nothing to do with system-wide outages, but are in fact part of the normal operation of complex systems.  But, from this never ending stream of event big data, how do we separate the signal from the noise and detect abnormal behavior?

For example, a “server down” alert is clearly an indication of a failed system. However, if the server is clustered and the failover succeeded without service interruption, the “server down” is part of normal operation of a complex system and should not raise a red flag. The same applies to the performance attributes of complex systems such as response time, volume and latency. Knowing normal ranges, deviations (dispersion) is key to understanding how complex systems behave.  The other crucial dimension of composite applications is transaction flow, which is the context and the flow of information from one part of the application to another – their behavior.

Real-time application performance monitoring of composite applications requires low-latency analysis using something like a Complex Event Processing engine in order to effectively understand the performance behavior of composite applications as it unfolds.   It must be able to rapidly determine whether current behavior is normal or abnormal or trending towards abnormal and then take action. For more on this topic see the white paper here.

Read the original blog entry...

More Stories By Charles Rich

Charles Rich is Vice President of Product Management at Nastel Technologies, a provider of middleware-centric application performance monitoring for mission-critical applications from the datacenter to the cloud. He is a software product management professional who brings over 27 years of technical hands-on experience working with large-scale customers to meet their application and systems management requirements.

IoT & Smart Cities Stories
When Enterprises started adopting Hadoop-based Big Data environments over the last ten years, they were mainly on-premise deployments. Organizations would spin up and manage large Hadoop clusters, where they would funnel exabytes or petabytes of unstructured data.However, over the last few years the economics of maintaining this enormous infrastructure compared with the elastic scalability of viable cloud options has changed this equation. The growth of cloud storage, cloud-managed big data e...
The platform combines the strengths of Singtel's extensive, intelligent network capabilities with Microsoft's cloud expertise to create a unique solution that sets new standards for IoT applications," said Mr Diomedes Kastanis, Head of IoT at Singtel. "Our solution provides speed, transparency and flexibility, paving the way for a more pervasive use of IoT to accelerate enterprises' digitalisation efforts. AI-powered intelligent connectivity over Microsoft Azure will be the fastest connected pat...
After years of investments and acquisitions, CloudBlue was created with the goal of building the world's only hyperscale digital platform with an increasingly infinite ecosystem and proven go-to-market services. The result? An unmatched platform that helps customers streamline cloud operations, save time and money, and revolutionize their businesses overnight. Today, the platform operates in more than 45 countries and powers more than 200 of the world's largest cloud marketplaces, managing mo...
Your applications have evolved, your computing needs are changing, and your servers have become more and more dense. But your data center hasn't changed so you can't get the benefits of cheaper, better, smaller, faster... until now. Colovore is Silicon Valley's premier provider of high-density colocation solutions that are a perfect fit for companies operating modern, high-performance hardware. No other Bay Area colo provider can match our density, operating efficiency, and ease of scalability.
CloudEXPO has been the M&A capital for Cloud companies for more than a decade with memorable acquisition news stories which came out of CloudEXPO expo floor. DevOpsSUMMIT New York faculty member Greg Bledsoe shared his views on IBM's Red Hat acquisition live from NASDAQ floor. Acquisition news was announced during CloudEXPO New York which took place November 12-13, 2019 in New York City.
At CloudEXPO Silicon Valley, June 24-26, 2019, Digital Transformation (DX) is a major focus with expanded DevOpsSUMMIT and FinTechEXPO programs within the DXWorldEXPO agenda. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of business. Only 12% still survive. Similar percentages are found throug...
Atmosera delivers modern cloud services that maximize the advantages of cloud-based infrastructures. Offering private, hybrid, and public cloud solutions, Atmosera works closely with customers to engineer, deploy, and operate cloud architectures with advanced services that deliver strategic business outcomes. Atmosera's expertise simplifies the process of cloud transformation and our 20+ years of experience managing complex IT environments provides our customers with the confidence and trust tha...
The graph represents a network of 1,329 Twitter users whose recent tweets contained "#DevOps", or who were replied to or mentioned in those tweets, taken from a data set limited to a maximum of 18,000 tweets. The network was obtained from Twitter on Thursday, 10 January 2019 at 23:50 UTC. The tweets in the network were tweeted over the 7-hour, 6-minute period from Thursday, 10 January 2019 at 16:29 UTC to Thursday, 10 January 2019 at 23:36 UTC. Additional tweets that were mentioned in this...
Today's workforce is trading their cubicles and corporate desktops in favor of an any-location, any-device work style. And as digital natives make up more and more of the modern workforce, the appetite for user-friendly, cloud-based services grows. The center of work is shifting to the user and to the cloud. But managing a proliferation of SaaS, web, and mobile apps running on any number of clouds and devices is unwieldy and increases security risks. Steve Wilson, Citrix Vice President of Cloud,...
Artificial intelligence, machine learning, neural networks. We're in the midst of a wave of excitement around AI such as hasn't been seen for a few decades. But those previous periods of inflated expectations led to troughs of disappointment. This time is (mostly) different. Applications of AI such as predictive analytics are already decreasing costs and improving reliability of industrial machinery. Pattern recognition can equal or exceed the ability of human experts in some domains. It's devel...