Mark Smith's Analyst Perspectives

Big data has become a big deal as the technology industry has invested tens of billions of dollars to create the next generation of databases and data processing. After the accompanying flood of new categories and marketing terminology from vendors, most in the IT community are now beginning to understand the potential of big data. Ventana Research thoroughly covered the evolving state of the big data and information optimization sector in 2014 and will continue this research in 2015 and...

I had the pleasure of attending Cloudera’s recent analyst summit. Presenters reviewed the work the company has done since its founding six years ago and outlined its plans to use Hadoop to further empower big data technology to support what I call information optimization. Cloudera’s executive team has the co-founders of Hadoop who worked at Facebook, Oracle and Yahoo when they developed and used Hadoop. Last year they brought in CEO Tom Reilly, who led successful organizations at ArcSight, HP...

In the realm of technology that matters for business and IT, our firm as part of our responsibility continually assesses the latest technology and how it can impact organizations’ efficiency and effectiveness. Our benchmark research in technology innovation found that 87% of participants indicated the importance of increasing the organization’s value through technology innovation. Every year we take our knowledge from research and technology briefings to focus on our Technology Innovation Awards

The big-data landscape just got a little more interesting with the release of EMC’s Pivotal HD distribution of Hadoop. Pivotal HD takes Apache Hadoop and extends it with a data loader and command center capabilities to configure, deploy, monitor and manage Hadoop. Pivotal HD, from EMC’s Pivotal Labs division, integrates with Greenplum Database, a massively parallel processing (MPP) database from EMC’s Greenplum division, and uses HDFS as the storage technology. The combination should help sites...

Business is starting to realize that taking advantage of big data is not just technically feasible but affordable by organizations of all sizes. However, as outlined in our agenda on big data and information optimization, the technology must be engineered to the information needs of business. Hortonworks has been steadily advancing its big data technology called Hadoop and contributing its developments back to the Apache Software Foundation for a range of projects. The company performs...

LucidWorks addresses the growing volume of information now being stored in the enterprise and in big data with two products aimed at the enterprise with search technology. Though you may not be familiar with LucidWorks (previously known as Lucid Imagination), the company has for many years contributed to Apache Lucene, an open source search project, and commercialized and supported for it for business.

At the recent Teradata’s annual Partners user conference, the company outlined its expanding role as a provider distributed information architecture technology. My colleague Tony Cosentino assessed Teradata’s business analytics and big data strategy, but there is more under the covers in regards to the company’s expanding role for big data and enterprise architectures. Over the last several decades Teradata has been known for providing enterprise data warehouse appliances, such as its unveiling...

Kognitio has been serving the analytics and data needs of organizations for more than 20 years with an in-memory analytics platform that meets many of the big-data needs of today’s organizations. Kognitio Analytical Platform provides a unique massively parallel processing (MPP) in-memory database that can rapidly load data and calculate analytics; it is available both in an analytical software appliance and via cloud computing.

Hadoop, the big-data technology, has transformed businesses’ ability to cost-effectively store and process large volumes of data for analysis. Numerous companies have invested in supporting Hadoop, and some produce commercial versions of the open source technology. At last year’s Hadoop Summit Hortonworks had just started to establish itself as one of these providers. Now, at the 2012 Hadoop Summit, with a new CEO, Rob Bearden, a new head of marketing, John Kreisa, and other hires, it is moving...

Using Hadoop just got easier, thanks to Teradata’s introduction of SQL-H, a new query interface to analyze data from Hadoop.  Most Hadoop access methods require preprocessing and staging of data from the Hadoop Distributed File System (HDFS) using technologies such as MapReduce. These approaches require new skills and technologies, introducing more time and costs for users, which offset the benefits of Hadoop, which according to our big data benchmark research include increasing the speed of...