You are currently browsing the category archive for the ‘Operational Performance Management (OPM)’ category.
Teradata recently gave me a technology update and a peek into the future of its portfolio for big data, information management and business analytics at its annual technology influencer summit. The company continues to innovate and build upon its Teradata 14 releases and its new processing technology. Since my last analysis 
of Teradata’s big data strategy, it has embraced technologies like Hadoop with its Teradata Aster Appliance, which won our 2012 Technology Innovation Award in Big Data. Teradata is steadily extending beyond providing just big data technology to offer a range of analytic options and appliances through advances in Teradata Aster and its overall data and analytic architectures. One example is its data warehouse appliance business, which according to our benchmark research is one of the key technological approaches to big data; as well Teradata has advanced support with its own technology offering for in-memory databases, specialized databases and Hadoop in one integrated architecture. It is taking an enterprise management approach to these technologies through Teradata Viewpoint, which helps monitor and manage systems and support a more distributed computing architecture.
By expanding its platform to include workload-based appliances that can support terabytes to petabytes of data, its Unified Data Architecture (UDA) can meet a broad class of enterprise needs. That can help support a range of big data analytic needs, as my colleague Tony Cosentino has pointed out, by providing a common approach to getting data from Hadoop into Teradata Aster and then into Teradata’s analytics. This UDA can begin to address challenges in data activities and tasks in the analytic process, which our research finds are issues for 42 percent of organizations. Teradata Aster Big Analytics Appliance is for organizations that are serious about retaining and analyzing more data, which 29 percent of organizations in our research cited as the top benefit of big data technology. This appliance can handle up to 5 petabytes and is tightly integrated with Aster and Hadoop technology from Hortonworks, a company that is rapidly expanding its footprint, as I have already assessed.
The packaged approach of an appliance can help organization address what our technology innovation research identified as the largest challenges in big data: not enough skilled resources (for 56% of organizations) and being hard to build and maintain (52%). These can be overcome if an organization designs a big data strategy that can apply a common set of skills, and the Teradata technology portfolio can help with that.
At the influencer summit, I was surprised that Teradata did not go into the role of data integration processes and the steps to profile, cleanse, master, synchronize and even migrate data (which its closest partner, Informatica, emphasizes) but focused more on access to and movement of data through its own connectors, Unity Data Mover, Smart Loader for Hadoop and support of SQL-H. For most of its deployments there is a range of complementary data integration technology from its partners as much as it is a Teradata only approach. For SQL-H Teradata takes advantage of the metadata HCatalog to improve access to data in HDFS. I like how Teradata Studio 14 helps simplify the view and use of data in Hadoop, Teradata Aster and even spreadsheets and flat files for building sandbox and test environments for big data. (To learn more, look into the Teradata Developer Exchange.) Teradata has made it easy to add connecters to get access to Hadoop on its Exchange which is a great way to get the latest advances in its utilities and add-ons to its offerings.
Teradata provided an early peak on the just announced Teradata Intelligent Memory, a significant step in adapting big data architectures to the next generation of memory management. This new advancement can cache and pool data that is in high demand (hot) across any number of Teradata workload-specific platforms by processing data to determine the importance of data (described as hot, warm or cold) for fast and efficient access and applying analytics. This technological feat can then utilize both solid-state and conventional disk storage to ensure the fastest access and computation of the data for a range of needs. This is a unique and powerful way to support an extended memory space for big data and to intelligently adapt to the data patterns of user organizations; its algorithms can interoperate across Teradata’s family of appliances.
Teradata has also invested further into its data and computing architecture through what it calls fabric-based computing. That can help connect nodes across systems through access on the company’s Fabric Switch using its BYNET, Infiniband and other methods. (Teradata participates in the OpenFabrics Alliance, which works to optimize access and interconnection of systems data across storage-area networks.) Fabric Switch provides an access point through which other aspects of Teradata’s UDA can access and use data for various purposes, including backup and restore or data movement. These advances will significantly increase the throughput and combined reliability of systems and enhance performance and scalability at both the user and data levels.
Tony Cosentino pointed out the various types of analytics that Teradata can support; one of them is analytics for discovery through its recently launched Teradata Aster Discovery Platform. This directly addresses two of the four types of discovery I have just outlined : data and visual discovery. Teradata Aster has a powerful library of analytics such as path, text, statistical, cluster and other areas as core elements of its platform. Its nPath analytic expression has significant potential in enabling Aster to process distributed sets of 
data from Teradata and Hadoop in one platform. Analytic architectures should apply the same computational analytics across systems, from core database technology to Teradata Aster to the analytics tools that an analyst is actually using. Aster’s approach to visual and data discovery is challenging in that it requires a high level of expertise in SQL to make customizations; the majority of analysts that could use this technology don’t have that level of knowledge. But here Teradata can turn to partners such as MicroStrategy and Tableau, which have built more integrated support for Teradata Aster and offer easier to use that are interactive and visual designed for analysts who do not want to muck with SQL. Teradata has internal challenges in improving support for analysts and the analytic processes they are responsible for; its IT-focused, data-centric approach will not help here. Our big data research finds that staffing and training are the top two barriers for using this technology, according to more than 77 percent of organizations; vendors should note this and reduce the custom and manual work that requires specific SQL and data skills in their products.
Regarding analytics specifically, Teradata has continued to deepen its analytics efforts with partner SAS. A new release of Teradata Appliance supports SAS High-Performance Analytics 
for up to 52 terabytes of data and also supports SAS Visual Analytics, which I have tried and assessed and tried myself.
Through its Teradata Aprimo applications Teradata continues its efforts to attract marketing executives in business-to-consumer companies that require big data technology to utilize a broad range of information. Teradata has outlined a larger role for the CMO with big data and analytics capabilities that go well beyond its marketing automation software. The company announced expansion to support predictive analytics and has outlined its direction for supporting customer engagement. It needs to take steps such as these to ensure it tunes into business needs beyond what CIOs and IT are doing with Teradata as a big data environment for the enterprise.
Along these lines I have also pointed out that we should be cautious about accepting research that predicts the CMO will outspend the 
CIO in the future. What I have seen in these assertions is flawed in many facets and often come from those who have no experience in market research and the role marketing and dealing with technology expenditure in that context. As we have done research into both the business and IT sides, we have discovered the complexities of making practical technology investments; for example, our research into customer relationship maturity found that inbound interactions from customers occur across many departments; they occur in marketing (in 46% of organizations), but more often through contact centers (77%), where Teradata should strengthen its efforts. On the plus side Teradata continues to demonstrate success in assisting customers in marketing, winning our 2013 Leadership Award for Marketing Excellence with its deployment at International Speedway Corp. and in 2012 at Nationwide Insurance with Teradata Aprimo. Our current research into next-generation customer engagement already identifies a need to support multichannel and multidepartment interactions. Teradata could further expand its efforts in these areas with existing customers; KPN won our 2013 Leadership Award in Customer Excellence after connecting Teradata with its Oracle-based applications and supporting BI systems.
Overall Teradata is doing a great job of focusing on its strengths in big data and areas where it can maximize the impact of its analytics, especially marketing and customer relations. While IBM, Oracle, SAP and other large technology providers in the database and analytic markets tend to minimize what Teradata has created, it is has a loyal customer base that is attracted to the expanded architectures of its appliances and its broader UDA and intelligent memory systems. I think with more focus on the processes of real business analysts and further simplifying usability, Teradata’s opportunity could grow significantly. In helping its customers process more of the vast volumes of data and information from the Internet, such as weather, demographic and social media, it could make clear the broader value of big data in optimizing information from the variety of data in content and documents. It could expand its new generation of tools and applications to exploit the use of this information as it is beginning to do with marketing applications from Teradata Aprimo. If Teradata customers find it easier to access information and share it across lines of business through social collaboration and mobile technology, that will further demand for its technology to operate on larger scales in both the number of users and the places where it can be accessed even via cloud computing. Exploiting in-memory computing along with providing more discovery potential from analytics will help its customers utilize the power of big data and trust in Teradata to supply it.
Regards,
Mark Smith
CEO & Chief Research Officer
Information technology for business is changing rapidly as organizations demand innovation to help them discover insights and facts. Our research into business technology innovation found analytics to be the
top priority in 39 percent of organizations. Businesses feel pressure to be better, faster and smarter in operating processes, and understanding their various types of information is a key to success. Businesses are looking to capture value from all types of information both within the enterprise and on the Internet. In this context technology providers are now using the term “discovery” to capture potential buyers’ attention; it became an area for technology spending in 2012 and likely will be for years to come. In fact my colleague Tony Cosentino has identified discovery as one of the four pillars of big data analytics.
Discovery is one of many business analytics methods that can be used realize value from current and future investments into big data. Discovery, of course is the act of finding something, whether it’s truly new or just overlooked. Wikipedia adds, “With reference to science and academic disciplines, discovery is the observation of new phenomena, new actions or new events and providing new reasoning to explain the knowledge gathered through such observations with previously acquired knowledge from abstract thought and everyday experiences. Visual discoveries are often called sightings.”
In business the knowledge gathered by individuals engaged in discovery is critical to provide context; typically those people are analysts responsible for the organization’s analytics or increasingly are business professionals competent to delve into the discovery process; for either, analytic technology should provide meaningful information in dynamic fashion. Done right, discovery produces intelligence, and analytic tools have improved the usability that enables more people to discover insights using this class of technology. I have already pointed out why conventional business intelligence is failing business; improving on these failings should also be a guide to what we need from discovery technology. With the wide adoption of big data technologies in varying approaches, organizations need to find the right tools to take advantage of it, but adequate data and visual discovery are not currently available in almost one-fifth (19%) of organizations participating in our technology innovation research.
There are four main types of discovery for business analytics: in no particular order, they are event, data, information and visual. Let’s consider each of them and the potential they hold for realizing full value from business analytics and big data investments.
Event Discovery: Enterprise networks now must handle extreme velocity in the streams of events that pass into and through them. If they are processed effectively, discovery through analytics could reveal current bottlenecks and opportunities for improvement or if trended and projected could indicate patterns developing in a negative direction. Processing events in a real-time or right-time manner has evolved from complex event processing into a category of its own, operational intelligence. Our research in this area found that nearly half (45%) organizations consider it very important to analyze business and IT events, and another 44% indicated it is somewhat important. The process of discovery applied to events can take many directions; for example, discovery analytics can immediately notify someone to take action, or the results can be displayed visually to make it easier to identify outliers or trends that should be further analyzed for review. As well, discovering relationships between events is very important to 53 percent of organizations. But the right tools are necessary for success. Our research shows that the large majority (91%) of organizations that use specialized tools for this are satisfied with them, compared to 76 percent that use general-purpose BI tools. The role of event discovery, now being called big data in motion, is changing rapidly as Tony Cosentino has pointed out.
Data Discovery: Enterprise databases contain ever larger volumes of structured data that describe transactions and interactions with their customers, their products and employees, the locations where their business operates and relations with their partners and suppliers. This kind of data is significant and can be sourced from in-house business applications and data warehouses and from software rented in the cloud computing environments, as well as through new investments in big data. From whatever source, having more interactive and data-centric discovery is critical to empower analysts and even data scientists. Data discovery is not new, but it has evolved greatly. Intuitive and flexible a new tools have advanced from the foundation of OLAP to perform data discovery on large volumes of source data and place it into a business model or analyze it while still in its almost original formats. The ability to combine and relate data from Internet sources expands the realm of what is possible to know and act on while expending less time and resources. Many business intelligence suppliers are just beginning to see what is required to meet the needs of today’s analysts compared to the past needs of IT or BI professionals needs to publish reports and dashboards. Our research finds that exploring data underlying analytics in a discovery manner is a critical business analytics need in 37 percent of organizations. Some new big data-oriented analytic tools can do more comprehensive data discovery, and IT departments will have accommodate them to provide what analysts need to do their jobs.
Information Discovery: Organizations now must handle a broader variety of information than ever before, including documents and semi-structured content whose data is not contained in a database. This wealth of information provides an opportunity to increase business understanding, but users need to access and integrate it for a range of tasks such as fraud, risk and compliance; process improvement; and reporting and analytics. This information can also be combined with data from databases to provide a comprehensive foundation for applying discovery processes. Our research shows that content is the second-most important type of data in 59 percent of organizations, right after customer data (71%). We believe that information optimization is a key benefit of big data and information management investments, but as I have pointed out it requires flexible technology to utilize all this information. Information discovery was once left to very expensive technology and specialized resources, and hence was beyond the reach of many organizations. Now many vendors offer tools that can perform content analytics to discover key information in proprietary formats and harvest it for business operations. The new generation of tools also provides the ability to define templates and placement for information to be integrated without the work of developers; it can analyze the layouts of documents and process their contents on an automated basis.
Visual Discovery: This is the latest technology craze as analysts clamor to add it to their analytic tool sets. Our research finds that presenting data visually is the second-most demanded critical business analytics capability for 48 percent of organizations. This type of discovery helps visualize large volumes of data to add new focus to finding areas of opportunity and challenges. Visualization may seem deceptively easy, but it is actually quite difficult to design technology that a range of nontechnical roles find easy to understand and present. I have seen vendors just attempt to lay more sophisticated visualization on top of their existing products, but doing this does not produce the usability and interactivity users insist on; lacking these qualities has severely hindered adoption. Being able to use visualization as a selection method for further discovery dramatically reduces the time it takes users to analyze data and find new insights. At some point in the visual discovery process, users want to share a visualization or a chart for further collaboration, to identify potential places for root-cause analysis or to make recommendations for resolution. At this point in development, however, most of the technology in visual discovery is not able to easily associate comments or bullets to a specific view and then enable sharing or collaboration on it electronically.
Not all discovery technology is created equal, as my discussion of the four big types of discovery shows. Some tool providers excel at one type, but few do all of them well. Thus your organization will have to create a discovery strategy as part of your business analytics efforts and choose and budget appropriately as you identify your most critical needs. You certainly will need to do something: Our business analytics research finds that analysts in 42 percent of organizations spend the majority of their time on data-related activities instead of actual analysis, so it is vital to reduce these chores and that ensure discovery methods do not increase that time; have IT staff automate these tasks through data integration and virtualization. For the CIO, it is important to ensure you are not just investing into evolution of your business intelligence tools as Tony points out; remember that the priority now is meeting the needs of the business and especially the analysts who are held responsible for analytics. Just serving reports and dashboards faster and in prettier form in many cases is not going to provide the critical insights. As I have already pointed out, putting more charts in dashboards or embedding key performance indicators are not smart strategies for guiding business improvement.
There is work to do here in convincing skeptics of the need for investment.
According to our business technology innovation research building the business case (43%) is the second-greatest t barrier to adopting innovative technology like discovery, following lack of resources (51%). It is not easy to use a traditional business case that projects value and benefits from a specific investment in the case of discovery, where the technology is about finding the unknown and providing benefits depends on the competency and skill of your analysts and business professionals as well as the effectiveness of the technology. Because usability is critical (the evaluation category criteria most often classified as important by 64% of organizations in our research) you must look beyond just the capabilities in the technology to how easily a variety of roles can use it and collaborate on the insights found from it. Most tools are only suitable for certain roles and maybe not for every analyst, let alone directors or vice presidents. These innovations by many technology vendors are just coming to market. Many organizations decide the potential value of an investment on the time to utilization of the tool and the projected time to value on potential insights from it; for analytics through discovery that is not always easy today.
To evaluate the benefits of the new generation of business analytics that utilize the discovery methods discussed here, start with a conversation internally to identify your needs and look at some online demos to see what is possible. Our next-generation business intelligence research finds discovery to be a critical consideration for 69 percent of organizations, which indicates the strong interest in discovery technology that will work for business and IT. From another perspective, our spreadsheets in the enterprise research finds that 74 percent of organizations are still using personal spreadsheets with BI to meet many of their data and visual discovery needs, at the same time as 56 percent find it time-consuming to combine spreadsheets through copying and pasting and more than one-third (35%) find data errors from their use of spreadsheets. As my colleague Robert Kugel puts it, it is time to end denial about the use of spreadsheets and focus on buying tools designed for complex tasks like discovery. For IT organizations, it is essential to address data and integration needs for analytics and analysts so business is not spending so much time on data-related tasks; they also should understand that while there will be more tools and vendors in use, the architecture and support of them should be simplified. For business, it is critical to understand what the types of discovery are all about and where technology innovation in 2013 can help make your organization’s processes run better and faster. It will be well worth your time to investigate why more organizations – and maybe your competitors among them – are getting benefits from making their business to smarter by using discovery.
Regards,
Mark Smith
CEO & Chief Research Officer
Business Exchange
Google+
Klout
Kred
LinkedIn
Plaxo
Twitter
Facebook Fan Page
Ventana Research Website
