You are currently browsing the tag archive for the ‘Data Integration’ tag.
At the Informatica World 2014 conference, the company known for its data integration software unveiled the Intelligent Data Platform. In the last three years Informatica has expanded beyond data integration and now has a broad software portfolio that facilitates information management within the enterprise and through cloud computing. The Intelligent Data Platform forms a framework for its portfolio. This expression of broad potential is important for Informatica, which has been slow to position its products as capable of more than data integration. A large part of the value it provides lies in what its products can do to help organizations strengthen their enterprise architectures for managing applications and data. We see Informatica’s sweet spot in facilitating efficient use of data for business and IT purposes; we call this information optimization.
Informatica’s Intelligent Data Platform is built in three layers. The bottom layer is Informatica Vibe, the virtual data machine that I covered at its launch last year. Informatica Vibe won our Ventana Research 2013 Technology Innovation Award for information optimization. It virtualizes information management technology to operate on any platform whether on-premises or in any form of cloud computing.
Above Informatica Vibe in the platform is a data infrastructure layer, which contains all the technologies that act upon data, from integration through archiving, masking, mastering, quality assurance, security, streaming and other tasks. At the core of this second layer is Informatica PowerCenter, which provides data integration and other capabilities central to processing of data into information. PowerCenter provides parsing, profiling, joining and filtering but also is integral for data services through Informatica’s Data Integration Hub that operates in a publish-and-subscribe model. The latest PowerCenter release, version 9.6, focuses on providing agility in development and provides a series of packaged editions that provide certain levels of functionality; users choose among them to fit their requirements. This developer support includes advances in test data management and data masking for enterprise-class needs. There are editions for Informatica Data Quality, too. The latest release of Informatica MDM, 9.7, improves the user experience for data stewards along with enhanced performance and governance. Not much was mentioned at the conference about Informatica’s Product Information Management (PIM) offering that our most recent Value Index vendor and product assessment rated Hot.
The third layer is data intelligence. Here Informatica has added capabilities to organize, infer and recommend action from data and to provision and map data to business needs. In addition Informatica’s Business Glossary and Metadata Manager help establish consistent definitions and use of data for operational or analytical tasks. Informatica RulePoint, a product that also was not mentioned much at the conference, processes events through workflow in a continuous rule based manner; depending on how processing occurs, its function is to support complex event processing or event streaming.
On top of the Intelligent Data Platform, Informatica has added a couple of new innovations. Project Springbok, which is not yet released, is a tool for preparation of data for analytics and operations through its Innovation division. This new product will use Informatica’s expertise in providing access to and integration of data sources, which according to our information optimization benchmark research is the top analyst requirement in 39 percent of organizations. Despite data warehouse efforts, analysts and business users still have to access many data sources. Simplifying information is critical for nearly all organizations that have more than 16 data sources. Demonstrations showed that Springbok can dynamically create and automate the transformations that run in PowerCenter. It also offers access to a master reference to ensure that data is processed in a consistent manner. IT professionals gain visibility into what business units are doing to show how they can help in provisioning data. Even in beta release Springbok has significant potential to address the range of data issues analysts face and reduce the time they spend on data-related tasks. Our research has shown for several years that this data challenge presses organizations to diversify the tools they use, and software vendors in this market have responded. Informatica will have to compete with more than a dozen others and demonstrate its superiority for integration. Our research finds that the lines of business and IT now share responsibility for information availability in 42 percent of organizations. Informatica will have to demonstrate its value to line of business analysts who are evaluating a new generation of tools for data and analytics.
A second innovation is a new data security product called Secure@Source, also being developed in the Innovation unit, is designed to protect data assets where they are stored and processed. This product moves Informatica into the information security market segment. Secure@Source helps users discover, detect, assess and protect data assets in their persistent locations and during consumption by applications or Internet services. The question is whether Informatica can convince current customers to examine it or will have to approach information security professionals who are not users of Informatica. Security of data is among the top five required data activities according to our research and a key part of the manageability requirements that organizations find important in considering products. Informatica has an opportunity to insert itself into the dialogue in this area if it properly presents the new product to IT and business people alike.
In big data Informatica has made steady progress, but to reach its potential in this segment will require more investments in the mixed big data environments, not just Hadoop. As our research has shown for three years, customers want big data to distribute processing and integration of data across sources. Our recent research on big data analytics finds that three out of four (76%) define big data analytics as being about accessing and analyzing all sources of data. This poses a challenge for data integration, and our new research on big data integration finds that most have a long way to go in accessibility and mastering of data. Informatica begins to address this and has an opportunity in helping develop a new generation of data architecture.
In cloud computing, the company has consolidated its efforts to ensure that the cloud is part of its core technology. It released new versions for its cloud-based integration, quality, master and real-time data management products; these begin to address the challenge of process and application integration, which are important considerations for businesses in determining whether integrate or replace point cloud solutions to improve efficiency of tasks and business processes. Informatica has continued to focus on integrating mostly with the large cloud computing providers and has yet to invest in streamlining processes in particular lines of business. This has left openings for other cloud integration providers to compete, making it harder than expected for Informatica to dominate in this segment. The next step here is up to Informatica.
I believe that one of the highest potential opportunities for Informatica is in the application architectures of organizations whose business processes have been distributed through a collection of cloud-based applications that lack interconnectivity and integration. For example, finance departments often have software from different providers for budgeting and planning, consolidation and reporting, accounting and payroll management. When these applications are spread across the cloud, connecting them is a real challenge, let alone trying to get information from sales force automation and customer service applications. The implications of this are shown in our finance analytics research : Data-related tasks consume the most time and impede the efficiency of financial processes as they do in all other line of business areas that we have researched. Similar situations exist in customer-related areas (marketing, sales and customer service) and employee management processes (recruiting, onboarding, performance, compensation and learning). Informatica has made progress with Informatica Cloud Extend for interconnecting tasks across applications, which can help streamline processes. While perhaps not obvious to data integration specialists, this level of process automation and integration is essential to the future of cloud computing. Informatica also announced it will offer master data management in the cloud; this should help it not just to place a data hub in the cloud but to help companies interoperate separate cloud applications more efficiently.
Overall the Informatica Intelligent Data Platform is a good reference model for tasks related to turning data into information assets. But it could be much distinct in how its automation accelerates the processing of data faster and helps specific roles work faster and smarter. This platform does not provide a context for enterprise architectures that are stretched between on-premises and various cloud deployments. Organizations will have to determine whether Informatica’s approach fits their future data and architectural needs. As Informatica pushes its platform approach, it has to ensure it is seen as a leader in big data integration, helping business analysts with data, supporting a larger number of application sources and connecting cloud computing through unifying business applications. This won’t be easy to accomplish as Informatica has not been as progressive in the broader approach to big data and use across operations and analytics.
Informatica has been growing substantially and is getting close to US$1 billion in annual software revenue. We have recognized its success through rating it a Hot vendor in our Data Integration Value Index and naming one of its customers, the CIO of UMass Memorial Health Care, the Chief Information Officer in our 2013 Leadership Awards. Informatica has been continuing substantial investment in R&D. Its acquisitions of data-related software companies have helped it grow, and Informatica has invested to integrate the products with PowerCenter. With almost half (49%) of organizations planning to change their information availability processes, the opportunity for Informatica is significant; its challenge is to gain the confidence and recognition by business customers, who now play a larger role in the selection and purchasing of software. This will require Informatica to speak their language of business and not just technology but the business processes that they are held accountable. Informatica is a major player in information management; now it must become as significant a choice for streamlining business processes and use of applications and data across the enterprise and cloud computing to enable information optimization.
CEO & Chief Research Officer
Information management is important to every line of business that seeks to improve its business processes and decision-making. In response to pressure from those departments, CIOs and IT organizations must examine whether they have focused enough on the I for information and not just the T for technology, and if they have not, commit to taking this responsibility more seriously than in the past. Informatica is one vendor that realizes the potential of its information beyond just data integration, and this is reflected in its expanded product portfolio and position in the market over the last several years. Our firm has taken note of companies gaining value from using Informatica; we awarded our 2013 CIO Leadership Award to George Brenckle of UMass Memorial Health Care for his work to maximize the value of information assets through managing data innovatively. Informatica itself has enhanced its position by introducing its new brand and a new CMO and demonstrating commitment to change from its executive leadership team at the company’s recent 2013 user conference. The focus of the brand now is on helping business and IT find the full value of their information.
The Informatica name is well-known in the corridors of IT, associated with addressing the need to make data accessible and integrated anywhere. The vendor has been advancing steadily for some time. We rated it Hot in our 2012 Value Index for Data Integration, and I recently assessed its efforts at our 2013 analyst summit. Established in data integration, Informatica is now focusing on the efficient management of information assets. This is not easy for most organizations, which have data spread across applications and systems; for two-thirds of organizations, according to our research as shown in the chart, this is a barrier to managing information.
The first step for the newly positioned company was to incorporate its technology into a virtual data machine (VDM) called Vibe that will make it easier to operate on any platform at any time. This approach unifies Informatica’s transformation library, optimizer, executor and connectors, which will help Informatica deploy any type of data and integration techniques on just about any platform a customer uses. Virtualizing the operations of its technology to isolate them from the platform on which it runs is a design Informatica has used before, but now the techniques and the execution of virtualization are fully realized. Opting to build integrations and deploy to any platform without the need to know the particulars of a system or technology is a wise decision for Informatica. When using Vibe it becomes simpler for organizations to run Informatica’s tools on-premises or in the cloud as they have to change nothing to run in either environment.
In addition the company has introduced a slimmer version of PowerCenter called PowerCenter Express, an entry-level product targeted for customers with smaller projects and providing a path to manage more sophisticated ones with the enterprise version. The PowerCenter Express Personal and Professional versions are available today for individual or departmental use, respectively. The Personal edition limits the number of rows used per day, which will prevent it from serious individual use in midsize and larger organizations, but it could be useful in small or lower-end midsize businesses. Informatica will need to invest to make sure prospects know it can help with smaller projects or companies with limited resources; the company is generally perceived as selling enterprise-class technology, and has limited its selection for data integration projects below the enterprise level. PowerCenter Express can support more than SQL-based sources and integrate with social media and other data integration technologies like those from Kapow Software that I have separately assessed. The Express edition will be available in July; Informatica has stated they are offering the single-user Personal Edition free of charge, and the Professional Edition for five users will be priced at $8,000 per user per year.
Informatica also announced availability of its Data Integration Hub, which I think can be as important as virtualization of the technology for many enterprises. Many want to centralize integration tasks to and from applications in a publish and subscribe method; that may be easier for managing the current and changing needs of applications and projects for some that see a centralized point-to-point movement as cumbersome. This approach, once referred to as enterprise application integration (EAI), was validated a decade ago and can remove latency in not just data transfer but in IT’s processes to get access to what is needed. Since its beginning Informatica and its products have been involved in an industry debate on the best way to pipe data across the enterprise and the company had been a staunch supporter of its approach over the hub-based approach. Now Informatica gives the customer the choice instead of championing one architectural approach over another. This is a step toward maturity in realizing that it has to adapt further to be a leader of information technology for CIOs moving forward. Data Integration Hub has been in early release and is expected to be generally available in the third quarter of 2013.
In the realm of master data management for IT organizations, Informatica has released MDM 9.6 to help organizations that want to use this critical mastering technique in both on-premises and on-demand cloud environments and where it must be accessed within applications. The new release has advanced data masking to support more sophisticated security and compliance, easier administration and a simpler application interface for business users and analysts. The focus on data security is significant, especially in cloud computing: In our research 63 percent of organizations said that is their largest concern about moving to the cloud, as the chart shows, and in our governance, risk and compliance research 38 percent of organizations said cloud computing is risky enough that they do not use it or limit it significantly. Informatica thus has an opportunity to help them with managing and securing data assets. Coupled with connectivity to the new Informatica Data Integration Hub, master data can be deployed more simply and consistently and operated across cloud computing environments where the interchange of data across many applications is not as easy as it may sound. In a related area Informatica enhances data governance with its MDM Data Director, which monitors the stewardship of data and facilitates action upon it; as well the company made it accessible from Apple smartphones and tablet interfaces earlier this year.
Continuing a longstanding effort, Informatica has assembled industry-specific solutions such as for healthcare and insurance. Advances in the Cloud MDM release help consolidate multiple instances of salesforce.com into one in which management of accounts is simpler; this should appeal to organizations looking to enforce consistency of data across marketing, sales and customer service. For those looking to enrich their information with external data, Informatica helps bring the data types together in a common account and customer record. A realistic approach to MDM that interoperates in both the cloud and on-premises is essential for organizations as the technology architectures of information and applications diversify and are not always confined to the data center of IT.
Informatica also pays attention to the importance of business-centric product information management through its nearly completed acquisition of Heiler Software, which I assessed when it was announced. After satisfying the legal requirements of acquiring a German software company, Informatica has accelerated its efforts to use the recent Heiler Enterprise PIM 7 release across the enterprise and to suppliers. This release improves data integration for self-service access to product information and methods to apply data quality and mapping to data across the enterprise. It also helps provides better data mastering from searches and classifications and improves how it manages digital assets related to the product information. It is critical for product information management to support multiple channels, from print and commerce to procurement and data exchange. Integrated with Informatica Data Quality, PIM 7 can provide efficient processing and support of natural-language processing, which can help organizations improve data quality; 45 percent of organizations said that is a reason for changing PIM, according to our research. Heiler has had global success with its products, and we recently awarded the 2013 Ventana Research Leadership Award in Information Management to Sportscheck, which uses Heiler for PIM across its retail channels. We also rated Heiler a Hot vendor in the 2012 Ventana Research Product Information Management Value Index. The battle for gaining value through PIM is something I pontificated about: Some observers see this as an MDM and IT agenda, but it is not. Informatica is gaining important capabilities through its acquisition of Heiler Software.
Informatica has been slower to improve its support for big data technologies. It has been advancing in integration of Hadoop, but in other systems including appliances and in-memory computing Informatica will need to step up its efforts to be a market leader. At the Informatica World conference the company demonstrated simple methods for integration and profiling and reintegration of data across Hadoop clusters, which is part of the larger big data integration challenges that I have written about. At the conference it also announced expansion of support for MongoDB through 10gen; that will help in integration of NoSQL databases to support documents and other information that is typically not placed into rows and columns. This partnership is important for Informatica’s efforts to be an information platform provider that brings together all types of content to support business. Also in the big data realm, Informatica has worked to apply its data matching technology to support the variety and volume of data, including international data sets like those from India and China. It has done a nice job to abstract the complexities of the underlying big data technology through its common user interface, which will help organizations streamline their data needs without requiring more staffing; our research found insufficient staffing to be an obstacle to effective information management for two-thirds of organizations, as the chart illustrates.
As Informatica turns the corner from some marketing and sales challenges in 2012, it has come into 2013 with a strong focus on new products to address gaps in its product portfolio, namely virtualization, a data hub, the cloud, big data and efficiency of product information management. Each of these is a substantial achievement, but pushing all of this news to the public at once can impede getting recognition for them individually. It is a marketing challenge to pace and streamline the release of technology announcements in order to maximize credit for its contributions to helping business and IT. Informatica is not the first to virtualize its technology or to support information management in the cloud or to integrate with product information management, but it is a sizable technology company and has to understand timing and readiness of the market, and when customers are ready to make investments.
We describe Informatica’s approach as information optimization, which goes beyond just the management of information to extract full value from these investments. I articulated an example of this with big data, and information optimization is a formal research priority in our agenda for 2013. We see a new generation of information applications for businesses and then consumers and suppliers that will be realized over the coming years and can be facilitated with Information. They have made a strong move to reposition itself as capable of unleashing the information potential of organizations. Now it must demonstrate its ability to accelerate growth and become a top software provider for technology that maximizes the value of information assets.
CEO & Chief Research Officer