Welcome!

Microsoft Cloud Authors: Kevin Benedict, Pat Romanski, Liz McMillan, Lori MacVittie, Elizabeth White

Related Topics: @ThingsExpo, @CloudExpo, @DXWorldExpo

@ThingsExpo: Blog Feed Post

Understanding Chaos Theory | @ThingsExpo #DX #BI #IoT #M2M #Analytics

Chaos Theory is the branch of mathematics that deals with complex systems whose behavior is highly sensitive to slight changes

Why Understanding Chaos Theory Is Important to Your Business

“Chaos: When the present determines the future, but the approximate present does not approximately determine the future.”

– Edward Lorenz

We all probably remember the movie (“Jurassic Park”), even if we don’t remember this exact scene: Dr. Malcolm, played by Jeff Goldblum is explaining Chaos Theory to Dr. Ellie Sattler, played by Laura Dern.

Dr. Malcolm is explaining how random, seemingly negligible events can disrupt even the most carefully laid out plans.

Dr. Ian Malcolm: [after the T-Rex failed to appear for the tour group]. “You see a Tyrannosaur doesn’t follow a set pattern or park schedules, the essence of chaos.”

And then later in the movie…

Dr. Ian Malcolm: “Oh, yeah. Oooh, ahhh, that’s how it always starts. Then later there’s running and um, screaming.”

Yes, running and screaming. That’s what happens when even the most carefully developed plans eventually succumb to the compounding of all these “random, seemingly negligible” events. And understanding the ramifications of Chaos Theory is becoming even more relevant as we look to machines to take over increasingly complex tasks.

What Is Chaos Theory?
Chaos Theory
is the branch of mathematics that deals with complex systems whose behavior is highly sensitive to slight changes in conditions, so that small alterations can give rise to unintended consequences. Chaos Theory is the science of surprises, and not always pleasant surprises. While traditional science deals with predictable phenomena like gravity, electricity, or chemical reactions, Chaos Theory deals with nonlinear things that are mostly impossible to predict, calculate, or control, like turbulence, a bar brawl, the stock market futures, debris flying out of the bed of a truck, or a child darting onto the street[1].

There are several underlying principles of Chaos Theory, including:

  • Butterfly Effect: This is probably the most common principle; that a butterfly flapping its wings in one part of the world can eventually cause a hurricane in another part of the world. Here is a more realistic way to describe the Butterfly Effect: small changes in the initial conditions can lead to drastic changes in the results. Our lives are an ongoing demonstration of this principle.
  • Unpredictability: Because we can never know all the initial conditions of a complex system in sufficient detail, we cannot hope to predict the ultimate fate of a complex system. Even slight errors in measuring the initial state of a system could be amplified dramatically, rendering any prediction useless or even wrong.
  • Mixing: Turbulence describes how two adjacent points in a complex system could eventually end up in very different positions after time has elapsed. Examples: Two neighboring water molecules may end up in different parts of the ocean or even in different oceans. Or a group of helium balloons that launch together eventually landing in drastically different locations.
  • Feedback: Systems often become chaotic when there is feedback. A good example is the behavior of the stock market. As the value of a stock rises or falls, people are inclined to buy or sell that stock. This in turn further affects the price of the stock, causing chaotic, unpredictable stock price movements.

Chaos Theory Meets the Autonomous Car
Complex systems
(sometimes called complexity theory) are systems whose behavior is intrinsically difficult to model due to the dependencies, relationships, or interactions between their parts and its environment. Complex systems are impacted by factors such as non-linearity, emergence, spontaneous order, adaptation, and feedback loops. And while an autonomous car may not be the most complex system in the world, it is certainly more complex than playing checkers, chess or Grand Theft Auto.

So what happens when Complex Systems run into the world of Chaos Theory?

Complex or dynamical systems – that is, systems whose state evolves over time –display dynamics that are highly sensitive to initial conditions (butterfly effect). These sensitivities manifest themselves as an exponential growth of perturbations in the initial conditions over time. As a result, the behavior of these complex systems grows more and more random (unpredictable). This happens even though these systems are deterministic, meaning that their future dynamics are fully defined by their initial conditions[2].

Summary
So while we can’t avoid the impact of Chaos Theory, especially as we employ Machine Learning and Artificial Intelligence to a growing body of complex systems and environments, here’s what we can do to mitigate the impact of Chaos Theory:

  • Build a plan for the continuous testing and refinement of the analytics. The performance of analytic models decay over time; they have a half-life because the world changes such as public sentiments driven by widening wealth gaps, corporate acts of malfeasance, government scandals, rising burden of student debt, growing ranks of the under-employed, wage stagnation, mounting populace divide on social media, legalization of marijuana, rising media sensationalism, climate change, terrorism, Cubs win the World Series, etc.

Figure 1: Half-life Calculation

Even apparently stable analytic models constantly need to be evaluated and fine-tuned.  Think of it as the “Data Scientist Life-time Employment Act!”  See the blog “2016 Presidential Election: Did Big Data Just Get Lazy” for more details on the analytics half-life effect.

  • Create a dashboard to monitor the performance of your analytic models. A dashboard is the perfect monitoring device to ensure that business managers and the data science team are proactively monitoring the performance and state of the analytic models.  Heck, maybe even integrate some data science into the dashboard to predict when a model is starting to fail (i.e., predictive maintenance).  See the blog “Big Data Dashboards” for some ideas about how to transform your “monitoring” dashboard into a “predictive” dashboard.
  • Understand the costs and liabilities associated with Type I and Type II errors and use those costs and liabilities to prioritize your investments in data acquisition, data quality, metadata enhancements and model tuning. See the blog “Understanding Type I and Type II Errors” for an approach for quantifying the costs and liabilities associated with Type I and Type II errors.

To borrow again from the movie “Jurassic Park”, don’t get caught with your pants down with respect to the potential ramifications of Chaos Theory on your complex analytic projects.

  1. http://fractalfoundation.org/resources/what-is-chaos-theory/
  2. https://en.wikipedia.org/wiki/Dynamical_systems_theory#Chaos_theory

The post Why Understanding Chaos Theory Is Important To Your Business appeared first on InFocus Blog | Dell EMC Services.

Read the original blog entry...

More Stories By William Schmarzo

Bill Schmarzo, author of “Big Data: Understanding How Data Powers Big Business” and “Big Data MBA: Driving Business Strategies with Data Science”, is responsible for setting strategy and defining the Big Data service offerings for Hitachi Vantara as CTO, IoT and Analytics.

Previously, as a CTO within Dell EMC’s 2,000+ person consulting organization, he works with organizations to identify where and how to start their big data journeys. He’s written white papers, is an avid blogger and is a frequent speaker on the use of Big Data and data science to power an organization’s key business initiatives. He is a University of San Francisco School of Management (SOM) Executive Fellow where he teaches the “Big Data MBA” course. Bill also just completed a research paper on “Determining The Economic Value of Data”. Onalytica recently ranked Bill as #4 Big Data Influencer worldwide.

Bill has over three decades of experience in data warehousing, BI and analytics. Bill authored the Vision Workshop methodology that links an organization’s strategic business initiatives with their supporting data and analytic requirements. Bill serves on the City of San Jose’s Technology Innovation Board, and on the faculties of The Data Warehouse Institute and Strata.

Previously, Bill was vice president of Analytics at Yahoo where he was responsible for the development of Yahoo’s Advertiser and Website analytics products, including the delivery of “actionable insights” through a holistic user experience. Before that, Bill oversaw the Analytic Applications business unit at Business Objects, including the development, marketing and sales of their industry-defining analytic applications.

Bill holds a Masters Business Administration from University of Iowa and a Bachelor of Science degree in Mathematics, Computer Science and Business Administration from Coe College.

IoT & Smart Cities Stories
DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to one location.
Discussions of cloud computing have evolved in recent years from a focus on specific types of cloud, to a world of hybrid cloud, and to a world dominated by the APIs that make today's multi-cloud environments and hybrid clouds possible. In this Power Panel at 17th Cloud Expo, moderated by Conference Chair Roger Strukhoff, panelists addressed the importance of customers being able to use the specific technologies they need, through environments and ecosystems that expose their APIs to make true ...
"Space Monkey by Vivent Smart Home is a product that is a distributed cloud-based edge storage network. Vivent Smart Home, our parent company, is a smart home provider that places a lot of hard drives across homes in North America," explained JT Olds, Director of Engineering, and Brandon Crowfeather, Product Manager, at Vivint Smart Home, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
We are seeing a major migration of enterprises applications to the cloud. As cloud and business use of real time applications accelerate, legacy networks are no longer able to architecturally support cloud adoption and deliver the performance and security required by highly distributed enterprises. These outdated solutions have become more costly and complicated to implement, install, manage, and maintain.SD-WAN offers unlimited capabilities for accessing the benefits of the cloud and Internet. ...
In an era of historic innovation fueled by unprecedented access to data and technology, the low cost and risk of entering new markets has leveled the playing field for business. Today, any ambitious innovator can easily introduce a new application or product that can reinvent business models and transform the client experience. In their Day 2 Keynote at 19th Cloud Expo, Mercer Rowe, IBM Vice President of Strategic Alliances, and Raejeanne Skillern, Intel Vice President of Data Center Group and G...
Business professionals no longer wonder if they'll migrate to the cloud; it's now a matter of when. The cloud environment has proved to be a major force in transitioning to an agile business model that enables quick decisions and fast implementation that solidify customer relationships. And when the cloud is combined with the power of cognitive computing, it drives innovation and transformation that achieves astounding competitive advantage.
DXWorldEXPO LLC announced today that "IoT Now" was named media sponsor of CloudEXPO | DXWorldEXPO 2018 New York, which will take place on November 11-13, 2018 in New York City, NY. IoT Now explores the evolving opportunities and challenges facing CSPs, and it passes on some lessons learned from those who have taken the first steps in next-gen IoT services.
The current age of digital transformation means that IT organizations must adapt their toolset to cover all digital experiences, beyond just the end users’. Today’s businesses can no longer focus solely on the digital interactions they manage with employees or customers; they must now contend with non-traditional factors. Whether it's the power of brand to make or break a company, the need to monitor across all locations 24/7, or the ability to proactively resolve issues, companies must adapt to...
"IBM is really all in on blockchain. We take a look at sort of the history of blockchain ledger technologies. It started out with bitcoin, Ethereum, and IBM evaluated these particular blockchain technologies and found they were anonymous and permissionless and that many companies were looking for permissioned blockchain," stated René Bostic, Technical VP of the IBM Cloud Unit in North America, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventi...
Founded in 2000, Chetu Inc. is a global provider of customized software development solutions and IT staff augmentation services for software technology providers. By providing clients with unparalleled niche technology expertise and industry experience, Chetu has become the premiere long-term, back-end software development partner for start-ups, SMBs, and Fortune 500 companies. Chetu is headquartered in Plantation, Florida, with thirteen offices throughout the U.S. and abroad.