The Future of Data Virtualization
July 23, 2013 2 Comments
Rick van der Lans is the most prolific analyst covering the data virtualization scene these days.
Rick’s recent BeyeNetwork article, Data Virtualization: Where Do We Stand Today? provides an excellent overview of Rick’s latest data virtualization thinking. I found his thoughts on the future of data virtualization products to be prescient.
Performance, Full Life Cycle and NoSQL
According to Rick, “It is important that the data virtualization products continue to develop in the following three areas:
- The vendors have to continue their research into improving performance for all kinds of queries and on all kinds of data sources, including NoSQL systems. Also, their caching mechanisms have to be strengthened. Here, support for in-memory database servers could be beneficial. Furthermore, now that more and more data is moving to the cloud, data virtualization products have to improve the efficiency of moving data in, to and within the cloud.
- The products have to be extended to support the full system development cycle. The design modules of current data virtualization servers should allow designers and analysts to enter other more business-related specifications, such as business glossaries, data models and taxonomies. Data virtualization servers should support more and more features currently supported by tools such as data modeling, master data management and business glossary tools. Data virtualization servers should be able to support the whole process of information management, including information modeling, data governance, and logical database design, and not just the implementation phase. For more information see my book, Data Virtualization for Business Intelligence Systems.
- NoSQL systems are very powerful with respect to storage and processing of massive amounts of data. However, in BI environments most of the tools in use don’t know how to handle data not stored in a relational way. This means that all that valuable (big) data stored in NoSQL systems is not available to everyone in the organization. To open up all that data, SQL interfaces are extremely important and useful. A SQL interface to a NoSQL system makes the data available to a larger user community and thus increases the potential business value of it. Lately, more and more SQL interfaces are becoming available for NoSQL. Unfortunately, these interfaces are still very young and most of them offer access to one NoSQL system only—they don’t federate data from multiple systems. This is a potential area in which data virtualization products can play an important role. They have mature SQL optimizers capable of handling large amounts of data, they have been designed to federate data and they know how to handle non-relational data sources. They should be able to win a considerable portion of this market. Thus, the increasing NoSQL market may create a new market for data virtualization products.”
More from Rick van der Lans
If you want to learn more about Rick’s thoughts on data virtualization, check out this and other videos on The Data Virtualization Channel.
See the Future of Data Virtualization at Data Virtualization Day
To see the future of data virtualization yourself, check out Data Virtualization Day 2013 on Wednesday, October 9, 2013 at The New York Palace, a historic New York City landmark situated in Midtown Manhattan in New York City.