Welcome!

Microsoft Cloud Authors: Nick Basinger, Kevin Benedict, Pat Romanski, Liz McMillan, Lori MacVittie

Related Topics: Microservices Expo, Java IoT, Industrial IoT, Microsoft Cloud, Machine Learning , Agile Computing

Microservices Expo: Article

Predictive Analytics Product Strategy Echoed by Monitoring Expert

Schlossnagle examines interesting concepts on high metric volume performance monitoring, visualization, and anomaly detection

As Netuitive's director of product management, I was fortunate to attend the O'Reilly Velocity Conference this year in San Francisco where one presentation in particular  stood out.

The presentation, "Monitoring & Observability - Getting Off the Starting Blocks" was by technology visionary Theo Schlossnagle.  It examined several interesting concepts on high metric volume performance monitoring, visualization, anomaly detection, and alerting.  In his summary (see slides 69 to 73) he mentions several interesting monitoring tenets (my editorial comments in parentheses):

  • While monitoring all things seems like a good approach, alerting on things that do not have specific remediation requirements is horribly damaging (i.e. don't cry "wolf").
  • Use the same datasets for alerting and visualization (i.e., your visiualization has to enhance your understanding of your alarms, not contradict it.)
  • Never alert against a set of metrics without documentation that...

o Explains the failure in plain English

o Provides concise and repeatable remediation advice and escalation path

o Presents the business impact of the failure condition

o ( i.e. Level 1-3 operations staff want actionable alerts and executives want to know how the problem is affecting business)

This is not only good advice, it is a survival strategy for dealing with the monitoring data deluge faced by infrastructure and application support staff. Netuitive Product Management took a deep introspective look over the past 18 months about "what's working / not working" with regards to anomaly detecting and alarming for our customers. The result of the analysis mirrors much of what Mr. Schlossnagle says, and some of these concepts have been "baked in" to Netuitive's product strategy since the release of Netuitive 6.0 in June of 2012. Specifically:

  • Netuitive has made it much easier to leverage a Knowledge Base to help operations staff understand impact and recommended remediation steps when an "anomaly" is detected.
  • By default, Netuitive only presents Level 1 operations staff with an alert if a set of anomalies can be matched to a Knowledge Base entry with remediation advice.
  • Netuitive's Integration Studio tools make it easy to incorporate virtually any business KPI into the statistical performance models for an application - so that users and executives can quickly assess the business impact of any potential failure condition.

All this came from a deep-rooted desire to make it easier for Netuitive's Global 2000 customers to operationalize the use of our analytics software.  The last thing we want our customers' executives to feel is that they've bought more expensive shelfware.

By the way, we weren't the only people that noticed the nuggets of wisdom in this presentation.  Gartner's Jonah Kowall, also blogged about it.  Great minds...

More Stories By Marcus Jackson

Marcus is Director of Product Management at Netuitive. He is responsible for the direction of Netuitive's flagship product, including analytics and data visualization. He has over 20 years of experience in software engineering and performance management. Previously, he headed development for Netuitive and the IEEE Computer Society. Marcus holds a bachelor's degree in Computer Science from Harvard University.

IoT & Smart Cities Stories
Every organization is facing their own Digital Transformation as they attempt to stay ahead of the competition, or worse, just keep up. Each new opportunity, whether embracing machine learning, IoT, or a cloud migration, seems to bring new development, deployment, and management models. The results are more diverse and federated computing models than any time in our history.
At CloudEXPO Silicon Valley, June 24-26, 2019, Digital Transformation (DX) is a major focus with expanded DevOpsSUMMIT and FinTechEXPO programs within the DXWorldEXPO agenda. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of business. Only 12% still survive. Similar percentages are found throug...
At CloudEXPO Silicon Valley, June 24-26, 2019, Digital Transformation (DX) is a major focus with expanded DevOpsSUMMIT and FinTechEXPO programs within the DXWorldEXPO agenda. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of business. Only 12% still survive. Similar percentages are found throug...
Where many organizations get into trouble, however, is that they try to have a broad and deep knowledge in each of these areas. This is a huge blow to an organization's productivity. By automating or outsourcing some of these pieces, such as databases, infrastructure, and networks, your team can instead focus on development, testing, and deployment. Further, organizations that focus their attention on these areas can eventually move to a test-driven development structure that condenses several l...
The term "digital transformation" (DX) is being used by everyone for just about any company initiative that involves technology, the web, ecommerce, software, or even customer experience. While the term has certainly turned into a buzzword with a lot of hype, the transition to a more connected, digital world is real and comes with real challenges. In his opening keynote, Four Essentials To Become DX Hero Status Now, Jonathan Hoppe, Co-Founder and CTO of Total Uptime Technologies, shared that ...
The graph represents a network of 1,329 Twitter users whose recent tweets contained "#DevOps", or who were replied to or mentioned in those tweets, taken from a data set limited to a maximum of 18,000 tweets. The network was obtained from Twitter on Thursday, 10 January 2019 at 23:50 UTC. The tweets in the network were tweeted over the 7-hour, 6-minute period from Thursday, 10 January 2019 at 16:29 UTC to Thursday, 10 January 2019 at 23:36 UTC. Additional tweets that were mentioned in this...
Over the course of two days, in addition to insightful conversations and presentations delving into the industry's current pressing challenges, there was considerable buzz about digital transformation and how it is enabling global enterprises to accelerate business growth. Blockchain has been a term that people hear but don't quite understand. The most common myths about blockchain include the assumption that it is private, or that there is only one blockchain, and the idea that blockchain is...
Never mind that we might not know what the future holds for cryptocurrencies and how much values will fluctuate or even how the process of mining a coin could cost as much as the value of the coin itself - cryptocurrency mining is a hot industry and shows no signs of slowing down. However, energy consumption to mine cryptocurrency is one of the biggest issues facing this industry. Burning huge amounts of electricity isn't incidental to cryptocurrency, it's basically embedded in the core of "mini...
Japan DX Pavilion at @CloudEXPO Silicon Valley
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...