Click here to close now.


Microsoft Cloud Authors: Jayaram Krishnaswamy, Elizabeth White, Andreas Grabner, Jim Kaskade, Pat Romanski

Related Topics: @BigDataExpo, Microservices Expo, Open Source Cloud, Containers Expo Blog, Server Monitoring, @CloudExpo

@BigDataExpo: Blog Post

Evolution and Innovation in Middleware

Undoubtedly, the future holds a number of surprises for the enterprise IT industry

2013 middleware predictions by Red Hat's Craig Muzilla. This post originally appeared on Dec. 18, 2012.

Last year, I offered my thoughts on trends and developments that the market would see in 2012. At that time, I felt that we were looking at a continued emphasis on cloud, while mobile and backend integration technologies would rise in prominence within enterprise IT. I think the industry made progress in all three areas: analysts indicate huge adoption of mobile technologies as a substitute for what would have typically been a laptop or desktop computer; at Red Hat we saw an uptick in interest around some of our backend integration tools like rules-based processing and business process management (BPM); and the industry as a whole saw a solidification around cloud visions and roadmaps from vendors.

One area that turned out to be much bigger than I had anticipated was the explosion and interest in big data. Moving forward, I think applications will be much more data-driven, using information generated by the millions of mobile devices I mentioned earlier.

To-date, the primary use of big data has been related to the analysis of large volumes of information that could not be analyzed using traditional data warehouses. I think this will continue; however, I anticipate a rise in applications wanting to participate in either big data or NoSQL solutions. I expect technologies such as Hive, which allows users to do traditional SQL queries in a big data setting, are going to become very important and popular in the coming year.

Transactional or production-related applications will need to interface with these big data solutions beyond simple analysis to take on some action or activity. Where I predict the market will likely see the most activity is around technologies like middleware that have been on the sidelines but may now begin to develop interfaces for things like MapReduce queries, Hive, or even traditional SQL queries. In this way I expect to see the more traditional application servers and tools like ESBs participate in the big data movement.

Another significant development that I anticipate for next year is the explosion of private cloud. There has been a lot of discussion lately about cloud in general, but public cloud has largely been the focus. Infrastructure-as-a-Service (IaaS) and Platform-as-a-Service (PaaS) technologies have both made a lot of progress from a public cloud standpoint, where they have primarily been used for development, testing and experimentation. I predict that PaaS will come out of this paradigm for production purposes. While very few applications are in production right now in public clouds, I think we'll see a lot of companies begin to take applications into production via private clouds.

A word of caution, though. Organizations need to shift their ways of thinking about governance models. Developers have much more responsibility and power than they did in the on-premises world. There was always a development process, and then an application went into operations, and operations took it into production. Today, we have the idea of DevOps, which is designed to empower the developer to not only work in the development phase, but then take the finished application into production and even manage it there. This model redefines governance because companies will need to think about what kind of responsibility and authority they give to staff members that may have not had those roles before. Ultimately, I think there will be a lot more flexibility, productivity and freedom, but companies will need to rethink their governance model to avoid running into problems.

In the near term, I predict the primary themes will remain the top priorities moving forward: cloud computing and PaaS, especially on-premises, will be important; OpenStack will play a big role in terms of basic cloud infrastructure for IaaS; and the industry will see continued movement in the mobile area. Today, most enterprise mobile activity has been around the client application with little backend service considerations, but I think we'll see a huge movement in iPhone or Android development, even natively, but requiring backend services such as security, transactions, enterprise integration, and persistence. As a result, I expect to see a lot of technology being developed that allows these mobile applications to fully participate in backend services and applications, and that will be a breakthrough for the industry.

In terms of big data, I hope to see a surge of technologies that seek to allow a broad set of applications, both analytical applications and transactional applications, become more involved. Whether this is using data in-memory, such as NoSQL solutions, or data management solutions like Hadoop with virtualized storage, I predict that it will ultimately lead to more data-driven applications. The foundation for this is already in place with MapReduce and Hadoop, and NoSQL solutions like Mongo and our own Red Hat JBoss Data Grid, but I think the interfaces required for participation from a broad set of applications still need to be built out over the next few years. Companies will look to NoSQL and big data solutions as a replacement for traditional relational databases or to reduce the dependency on them, and they will use them for a variety of transaction and analytical apps. I expect middleware to evolve to support this.

Long term, I think the nature of an enterprise application will change, especially as it relates to creating higher levels of abstraction, allowing non-technologists and business users to participate in the creation of those applications and mobile applications. Over the next two to five years, business users, consumers and partners will use tools like BPM and rules management that offer this level of abstraction to develop and adjust applications based on needs. There is some discussion regarding intelligent BPM (iBPM) now, but it still seems to be largely under the radar. The industry will likely hear much more discussion about these sophisticated and end user-friendly technologies, both in the cloud and in traditional uses, in the years to come.

Undoubtedly, the future holds a number of surprises for the enterprise IT industry. While my thoughts and observations here are based on some existing trends, all of these things are driving innovation. What's more, cloud, mobile and big data are all driving the need for innovation. Small pieces of innovation are happening every day in communities at the developer level. It's exciting to see and be a part of these innovations as they emerge, take hold in the enterprise and make their mark on the world.

More Stories By Daniel Thompson

I curate the content on this page, but the credit goes to my talented colleagues for the posts that you see here. Much of what you read on this page is the work of friends at How to JBoss, and I encourage you to drop by the site at for some of the best JBoss technical and non-technical content for developers, architects and technology executives on the Web.

@ThingsExpo Stories
SYS-CON Events announced today that Luxoft Holding, Inc., a leading provider of software development services and innovative IT solutions, has been named “Bronze Sponsor” of SYS-CON's @ThingsExpo, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. Luxoft’s software development services consist of core and mission-critical custom software development and support, product engineering and testing, and technology consulting.
“In the past year we've seen a lot of stabilization of WebRTC. You can now use it in production with a far greater degree of certainty. A lot of the real developments in the past year have been in things like the data channel, which will enable a whole new type of application," explained Peter Dunkley, Technical Director at Acision, in this interview at @ThingsExpo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
NHK, Japan Broadcasting, will feature the upcoming @ThingsExpo Silicon Valley in a special 'Internet of Things' and smart technology documentary that will be filmed on the expo floor between November 3 to 5, 2015, in Santa Clara. NHK is the sole public TV network in Japan equivalent to the BBC in the UK and the largest in Asia with many award-winning science and technology programs. Japanese TV is producing a documentary about IoT and Smart technology and will be covering @ThingsExpo Silicon Valley. The program, to be aired during the peak viewership season of the year, will have a major impac...
"Matrix is an ambitious open standard and implementation that's set up to break down the fragmentation problems that exist in IP messaging and VoIP communication," explained John Woolf, Technical Evangelist at Matrix, in this interview at @ThingsExpo, held Nov 4–6, 2014, at the Santa Clara Convention Center in Santa Clara, CA.
Developing software for the Internet of Things (IoT) comes with its own set of challenges. Security, privacy, and unified standards are a few key issues. In addition, each IoT product is comprised of at least three separate application components: the software embedded in the device, the backend big-data service, and the mobile application for the end user's controls. Each component is developed by a different team, using different technologies and practices, and deployed to a different stack/target - this makes the integration of these separate pipelines and the coordination of software upd...
You have your devices and your data, but what about the rest of your Internet of Things story? Two popular classes of technologies that nicely handle the Big Data analytics for Internet of Things are Apache Hadoop and NoSQL. Hadoop is designed for parallelizing analytical work across many servers and is ideal for the massive data volumes you create with IoT devices. NoSQL databases such as Apache HBase are ideal for storing and retrieving IoT data as “time series data.”
There are so many tools and techniques for data analytics that even for a data scientist the choices, possible systems, and even the types of data can be daunting. In his session at @ThingsExpo, Chris Harrold, Global CTO for Big Data Solutions for EMC Corporation, will show how to perform a simple, but meaningful analysis of social sentiment data using freely available tools that take only minutes to download and install. Participants will get the download information, scripts, and complete end-to-end walkthrough of the analysis from start to finish. Participants will also be given the pract...
Clearly the way forward is to move to cloud be it bare metal, VMs or containers. One aspect of the current public clouds that is slowing this cloud migration is cloud lock-in. Every cloud vendor is trying to make it very difficult to move out once a customer has chosen their cloud. In his session at 17th Cloud Expo, Naveen Nimmu, CEO of Clouber, Inc., will advocate that making the inter-cloud migration as simple as changing airlines would help the entire industry to quickly adopt the cloud without worrying about any lock-in fears. In fact by having standard APIs for IaaS would help PaaS expl...
SYS-CON Events announced today that ProfitBricks, the provider of painless cloud infrastructure, will exhibit at SYS-CON's 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. ProfitBricks is the IaaS provider that offers a painless cloud experience for all IT users, with no learning curve. ProfitBricks boasts flexible cloud servers and networking, an integrated Data Center Designer tool for visual control over the cloud and the best price/performance value available. ProfitBricks was named one of the coolest Clo...
Organizations already struggle with the simple collection of data resulting from the proliferation of IoT, lacking the right infrastructure to manage it. They can't only rely on the cloud to collect and utilize this data because many applications still require dedicated infrastructure for security, redundancy, performance, etc. In his session at 17th Cloud Expo, Emil Sayegh, CEO of Codero Hosting, will discuss how in order to resolve the inherent issues, companies need to combine dedicated and cloud solutions through hybrid hosting – a sustainable solution for the data required to manage I...
WebRTC is about the data channel as much as about video and audio conferencing. However, basically all commercial WebRTC applications have been built with a focus on audio and video. The handling of “data” has been limited to text chat and file download – all other data sharing seems to end with screensharing. What is holding back a more intensive use of peer-to-peer data? In her session at @ThingsExpo, Dr Silvia Pfeiffer, WebRTC Applications Team Lead at National ICT Australia, will look at different existing uses of peer-to-peer data sharing and how it can become useful in a live session to...
Mobile messaging has been a popular communication channel for more than 20 years. Finnish engineer Matti Makkonen invented the idea for SMS (Short Message Service) in 1984, making his vision a reality on December 3, 1992 by sending the first message ("Happy Christmas") from a PC to a cell phone. Since then, the technology has evolved immensely, from both a technology standpoint, and in our everyday uses for it. Originally used for person-to-person (P2P) communication, i.e., Sally sends a text message to Betty – mobile messaging now offers tremendous value to businesses for customer and empl...
SYS-CON Events announced today that IBM Cloud Data Services has been named “Bronze Sponsor” of SYS-CON's 17th Cloud Expo, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. IBM Cloud Data Services offers a portfolio of integrated, best-of-breed cloud data services for developers focused on mobile computing and analytics use cases.
Scott Guthrie's keynote presentation "Journey to the intelligent cloud" is a must view video. This is from AzureCon 2015, September 29, 2015 I have reproduced some screen shots in case you are unable to view this long video for one reason or another. One of the highlights is 3 datacenters coming on line in India.
Nowadays, a large number of sensors and devices are connected to the network. Leading-edge IoT technologies integrate various types of sensor data to create a new value for several business decision scenarios. The transparent cloud is a model of a new IoT emergence service platform. Many service providers store and access various types of sensor data in order to create and find out new business values by integrating such data.
Apps and devices shouldn't stop working when there's limited or no network connectivity. Learn how to bring data stored in a cloud database to the edge of the network (and back again) whenever an Internet connection is available. In his session at 17th Cloud Expo, Bradley Holt, Developer Advocate at IBM Cloud Data Services, will demonstrate techniques for replicating cloud databases with devices in order to build offline-first mobile or Internet of Things (IoT) apps that can provide a better, faster user experience, both offline and online. The focus of this talk will be on IBM Cloudant, Apa...
The enterprise is being consumerized, and the consumer is being enterprised. Moore's Law does not matter anymore, the future belongs to business virtualization powered by invisible service architecture, powered by hyperscale and hyperconvergence, and facilitated by vertical streaming and horizontal scaling and consolidation. Both buyers and sellers want instant results, and from paperwork to paperless to mindless is the ultimate goal for any seamless transaction. The sweetest sweet spot in innovation is automation. The most painful pain point for any business is the mismatch between supplies a...
As a company adopts a DevOps approach to software development, what are key things that both the Dev and Ops side of the business must keep in mind to ensure effective continuous delivery? In his session at DevOps Summit, Mark Hydar, Head of DevOps, Ericsson TV Platforms, will share best practices and provide helpful tips for Ops teams to adopt an open line of communication with the development side of the house to ensure success between the two sides.
As more and more data is generated from a variety of connected devices, the need to get insights from this data and predict future behavior and trends is increasingly essential for businesses. Real-time stream processing is needed in a variety of different industries such as Manufacturing, Oil and Gas, Automobile, Finance, Online Retail, Smart Grids, and Healthcare. Azure Stream Analytics is a fully managed distributed stream computation service that provides low latency, scalable processing of streaming data in the cloud with an enterprise grade SLA. It features built-in integration with Azur...
WebRTC: together these advances have created a perfect storm of technologies that are disrupting and transforming classic communications models and ecosystems. In his session at WebRTC Summit, Cary Bran, VP of Innovation and New Ventures at Plantronics and PLT Labs, will provide an overview of this technological shift, including associated business and consumer communications impacts, and opportunities it may enable, complement or entirely transform.