You are currently browsing the category archive for the ‘Big Data’ category.
At its annual MicroStrategy World conference, this provider of analytics and business intelligence systems for business and IT introduced a new version of its flagship product, MicroStrategy 9s. Among many advances it adds enterprise grade security with MicroStrategy Usher as part of the maintenance update to its 9.4.1 release. Security is increasingly critical for analytics and BI. Technologies that work intensively with data, including reporting, business intelligence, analytics and data preparation, have access to a range of applications and databases and could leave gaps in access controls and security of essential business data. Already in 2015 the data breach at Anthem put more than 80 million medical records at risk. Our benchmark research in big data analytics finds that integration into security and user access frameworks is a very important capability to 37 percent of organizations.
MicroStrategy has spent years and significant investment of resources on MicroStrategy Usher. On the company’s mobile platform Usher provides multifactor authentication that includes fingerprinting for biometrics, unique identification through smartphone verification and a mobile device pass code to ensure secure access. Further identification security is offered through geo-fencing, which requires a user to be within range of a specified access point such as a building or a computer, by permitting access only during a specific time window or using QR code scanning to rapidly match the individual with authorized access. At the conference MicroStrategy demonstrated these security techniques along with AES-128 GCM encryption of data on devices and in transit.
Ventana Research recognized MicroStrategy Usher with a Technology Innovation Award in 2014 for using mobile technology to provide secure access to applications, information and even physical locations; in the last case it has partnered with building companies such as Honeywell. Organizations should realize the risk of having only single sign-on through insecure passwords, which can expose access to all their systems. Usher is available as part of MicroStrategy 9s or as a stand-alone product.
On another advanced technology front, MicroStrategy has advanced its cloud computing offering to embrace Amazon Web Services (AWS). This partnership can provide flexibility for its customers while reducing the effort it must put into building out its own data centers to support its products. Here also the company is addressing security of information and systems. MicroStrategy Secure Cloud includes enterprise security capabilities to ensure authenticated access. This is an important feature: Our big data integration benchmark research finds that security concerns are the most common barrier (in 54% of organizations) to using big data through cloud computing. Many buyers want to reduce the amount of software they have to license and install, but they must have confidence that their data is safe in on-demand cloud systems. Keeping it simple but secure for cloud computing is critical, and our research finds room for improvement here across the technology industry.
Regarding big data MicroStrategy has advanced its computing power through PRIME, its in-memory and parallel processing technology. Our research in big data analytics finds that in-memory systems are the most sought-after innovation in half of organizations seeking to enhance analysis. That research also shows that the number and dispersal of data sources is a major issue. More than one-third (36%) of organizations have six to 15 sources and one-fourth (26%) have 16 or more information sources that need to be integrated for optimum access. And blending data from so many sources raises security concerns; in our research in big data integration security is the fourth-most important data activity, cited by 61 percent of organizations. MicroStrategy continues its efforts to help organizations get access to any data sources. For example, it now supports the Oracle Database 12c with in-memory and databases releases and has embedded its BI software in Oracle appliances that become big data machines. In addition MicroStrategy has embraced Apache Spark to maximize compute potential across Hadoop, NoSQL and RDBMSs and expands its database support every quarter. Earlier in 2014 MicroStrategy announced support for MarkLogic 7 NoSQL technology, which is becoming more relevant in the analytics and BI market. MicroStrategy also has been continuing its efforts to support data preparation tasks performed by analysts rather than administrators as some other vendors do. Our big data analytics research finds that in creating and deploying information and using analytics, almost half (47%) of organizations spend the largest portion of time in data preparation; this is true across customer service, finance, HR and other operational areas.
Like many others MicroStrategy discovered painfully in 2014 that overall the IT market for purchasing software to deploy on-premises has slowed down and specifically that the BI market has reached a saturation point in organizations that have more than US$10 billion in revenue. Even so the company exceeded $579 million in total revenue for 2014. Its investments in cloud computing over the last several years have helped it through this transition. To adjust to the market changes it has brought in new executives including CTO Tim Lang, who has decades of experience dating back to Holistic Systems and Crystal Software, and CMO Mark Gambill who has over 18 years’ experience leading marketing teams; these two are streamlining their respective areas to make them more efficient. MicroStrategy continues to get brand-name customers on board with its mobile and analytic offerings, and its focus on security in 2015 should help in these efforts. In the past several years demand has been strong for visualization-related discovery and analytics tools among the lines of business and analysts, and now MicroStrategy has caught up and matched these capabilities. Visualization and presentation of analytics and data remain very important, according to our research: Half (49%) of organizations said it helps those who have the right skills perform analytics faster. Our research also finds that the majority of businesses want analytics to be simpler and easier to understand and available quickly on their mobile devices.
In our 2014 Value Index on Mobile BI, MicroStrategy earned the Hot Vendor rating for its mobile business intelligence technology across device platforms, primarily for Apple and Android support. But MicroStrategy will have to ante up its support for Microsoft who is making inroads with smartphones and even more so with its Surface 3 tablets and also with new generations of notebooks using Windows Touch, which enables the use of gestures in Windows; Microsoft is finding opportunities in businesses that are phasing out older desktop and laptop computers with new ones running Windows Touch technology. MicroStrategy in 2014 simplified packaging and pricing of MicroStrategy Mobile and its Web products that operate on its MicroStrategy Server platform. MicroStrategy is building on a solid year of technology advancement as I pointed out in 2014 and is poised for innovation. It provided a sneak peek at MicroStrategy World of MicroStrategy 10 (now in beta and early release), which will up the ante with the next generation of in-memory analytics and simpler administration. Developments include further support of Apple Mac OS and iOS and advancing visualization and sophistication of analytics, which may be available fairly early in 2015.
I believe that MicroStrategy should do more with search and collaborative capabilities, which our research finds to be a priority for business professionals (less so for IT). All BI vendors must be careful to listen to all audiences and stop paying attention only to IT. They will need to make sure that those in the lines of business understand how they can use analytics within the context of solving problems and opportunities, and make it as easy as possible for them do so on their own. Vendors also must understand their purchasers’ own business priorities. For instance, our next-generation customer analytics benchmark research shows that improving the customer experience and customer service strategy are the top drivers in this analytics segment. The release of MicroStrategy 9s and the upcoming MicroStrategy 10 continue this company’s prominence as an enterprise-class provider. We advise organizations to assess its evolving portfolio to identify missing elements in their existing BI and analytics deployments, with an eye on mobile platforms and security of data.
CEO and Chief Research Officer
Big data has become a big deal as the technology industry has invested tens of billions of dollars to create the next generation of databases and data processing. After the accompanying flood of new categories and marketing terminology from vendors, most in the IT community are now beginning to understand the potential of big data. Ventana Research thoroughly covered the evolving state of the big data and information optimization sector in 2014 and will continue this research in 2015 and beyond. As it progresses the importance of making big data systems interoperate with existing enterprise and information architecture along with digital transformation strategiesbecomes critical. Done properly companies can take advantage of big data innovations to optimize their established business processes and execute new business strategies. But just deploying big data and applying analytics to understand it is just the beginning. Innovative organizations must go beyond the usual exploratory and root-cause analyses through applied analytic discovery and other techniques. This of course requires them to develop competencies in information management for big data.
Among big data technologies, the open source Hadoop has been commercialized by now established providers including Cloudera, Hortonworks and MapR and made available in the cloud through platforms such as Qubole, which received a Ventana Research Technology Innovation Award in 2014. Other big data technologies are growing as well; for example, use of in-memory and specialized databases also is growing like Hadoop in more than 40 percent of organizations, according to our big data integration benchmark research. These technologies have been integrated into databases or what I call hybrid big data appliances like those from IBM, Oracle, SAP and Teradata that bring the power of Hadoop to the RDBMS and exploit in-memory processing to perform ever faster computing. When placed into hosted and cloud environments these appliances can virtualize big data processing. Another new provider, Splice Machine, brings the power of SQL processing in a scalable approach that uses Hadoop in a cloud-based approach; it received a Ventana Research Technology Leadership Award last year. Likewise advances in NoSQL approaches help organizations process and utilize semistructured information along with other information and blend them with analytics as Datawatch does. These examples show that disruptive technologies still have the potential to revolutionize our approaches to managing information.
Our firm also explores what we call information optimization, which assesses techniques for gaining full value from business information. Big data is one of these when used effectively in an enterprise information architecture. In this context the “data lake” analogy is not helpful in representing the full scope of big data, suggesting simply a container like a data marts or data warehouse. With big data, taking an architectural approach is critical. This viewpoint is evident in our 2014 Ventana Research Technology Innovation Award in Information Management to Teradata for its Unified Data Architecture. Another award winner, Software AG, blends big data and information optimization using its real-time and in-memory processing technologies.
Businesses need to process data in rapid cycles, many in real time and what we call operational intelligence, which utilizes events and streams and provides the ability to sense and respond immediately to issues and opportunities in organizations that adapt to a data-driven culture. Our operational intelligence research finds that monitoring, alerting and notification are the top use cases for deployment, in more than half of organizations. Also machine data can help businesses optimize not just IT processes but business processes that help govern and control the security of data in the enterprise. This imperative is evident in the dramatic growth of suppliers such as Splunk, Sumo Logic and Savi Technology, all of which won Ventana Research Technology Innovation awards for how they process machine and business data in large volumes at rapid velocity.
Another increasing trend in big data is presenting it in ways that ordinary users can understand quickly. Discovery and advanced visualization is not enough for business users who are not trained to interpret these presentations. Some vendors can present locationand geospatial data on maps that are easier to understand. At the other end of the user spectrum data scientists and analysts need more robust analytic and discovery tools, including predictive analytics, which is a priority for many organizations, according toour big data analytics research. In 2015 we will examine the next generation of predictive analytics in new benchmark research. But there is more work to do to present insights from information that are easy to understand. Some analytics vendors are telling stories by linking pages of content, but these narratives don’t as yet help individuals assess and act. Most analytics tools can’t match the simple functionality of Microsoft PowerPoint, placing descriptive titles, bullets and recommendations on a page with a graphic that represents something important to these business professional who reads it. Deeper insights may come from advances in machine learning and cognitive computing that have arrived on the market and bring more science to analytics.
So we strong potential for the outputs of big data, but they don’t arrive just by loading data into these new computing environments. Pragmatic and experienced professionals realize that information management processes do not disappear. A key one in this area is data preparation, which helps ready data sets for processing into big data environments. Preparing data is the second-most important task for 46 percent of organizations in our big data integration research. A second is data integration, which some new tools can automate. This can enable lines of business and IT to work together on big data integration, as 41 percent of organizations in our research are planning to do. To address this need a new generation of technologies came into their own in 2014 including those that received Ventana Research Technology Innovation Awards like Paxata and Tamr but also Trifacta.
Yet another area to watch is the convergence of big data and cloud computing. The proliferation of data sources in the cloud forces organizations to managed and integrate data from a variety of cloud and Internet sources, hence the rise of information as a service for business needs. Ventana Research Technology Innovation Award winner DataSift provides information as a service to blend social media data with other big data and analytics. Such techniques require more flexible environments for integration that can operate anywhere at any time. Dell Boomi, MuleSoft, SnapLogic and others now challenge established data integration providers such as Informatica and others including IBM, Oracle and SAP. Advances in master data management, data governance, data quality and integration backbones, and Informatica and Information Builders help provide better consistency of any type of big data for any business purpose. In addition our research finds that data security is critical for big data in 61 percent of organizations; only 14 percent said that is very adequate in their organization.
There is no doubt that big data is now widespread; almost 80 percent of organizations in our information optimization research, for example, will be using it some form by the end of 2015. This is partly due to increased use across the lines of business; our research on next-generation customer analytics in 2014 shows that it is important to improving understanding customers in 60 percent of organizations, is being used in one-fifth of organizations and will be in 46 percent by the end of this year. Similarly our next-generation finance analytics research in 2014 finds big data important to 37 percent of organizations, with 13 percent using it today and 42 percent planning to by the end of 2015. And we have already measured how it will impact human capital management and HR and where organizations are leveraging it in this area of importance.
I invite you to download and peruse our big data agenda for 2015. We will examine how organizations can instrument information optimization processes that use big data and pass this guidance along. We will explore big data’s role in sales and product areas and produce new research on data and analytics in the cloud. Our research will uncover best practices that innovative organizations use not only to prepare and integrate big data but also more tightly unify it with analytics and operations across enterprise and cloud computing environments. For many organizations taking on this challenge and seeking its benefits will require new information platforms and methods to access and provide information as part of their big data deployments. (Getting consistent information across the enterprise is the top benefit of big data integration according to 39 percent of organizations.) We expect 2015 to be a big year for big data and information optimization. I look forward to providing more insights and information about big data and helping everyone get the most from their time and investments in it.
CEO and Chief Research Officer