Thursday, October 30, 2014

Informatica’s Hadoop Connectivity Reaches for the Clouds

This blog post was originally posted on the Informatica website on October 16th, 2014 here:
http://blogs.informatica.com/perspectives/2014/10/16/informaticas-hadoop-connectivity-reaches-for-the-clouds/#fbid=GN4ScbY72Yd

Informatica’s Hadoop Connectivity Reaches for the Clouds

Posted on October 16, 2014 by Scott Hedrick

The Informatica Cloud team has been busy updating connectivity to Hadoop using the Cloud Connector SDK. Updated connectors are available now for Cloudera and Hortonworks and new connectivity has been added for MapR, Pivotal HD and Amazon EMR (Elastic Map Reduce).

Informatica Cloud’s Hadoop connectivity brings a new level of ease of use to Hadoop data loading and integration. Informatica Cloud provides a quick way to load data from popular on premise data sources and apps such as SAP and Oracle E-Business, as well as SaaS apps, such as Salesforce.com, NetSuite, and Workday, into Hadoop clusters for pilots and POCs. Less technical users are empowered to contribute to enterprise data lakes through the easy-to-use Informatica Cloud web user interface.

Informatica Cloud’s rich connectivity to a multitude of SaaS apps can now be leveraged with Hadoop. Data from SaaS apps for CRM, ERP and other lines of business are becoming increasingly important to enterprises. Bringing this data into Hadoop for analytics is now easier than ever.

Users of Amazon Web Services (AWS) can leverage Informatica Cloud to load data from SaaS apps and on premise sources into EMR directly. Combined with connectivity to Amazon Redshift, Informatica Cloud can be used to move data into EMR for processing and then onto Redshift for analytics.

Self service data loading and basic integration can be done by less technical users through Informatica Cloud’s drag and drop web-based user interface. This enables more of the team to contribute to and collaborate on data lakes without having to learn Hadoop.

Bringing the cloud and Big Data together to put the potential of data to work – that’s the power of Informatica in action.

Free trials of the Informatica Cloud Connector for Hadoop are available here:http://www.informaticacloud.com/connectivity/hadoop-connector.html

Informatica Brings Enterprise-Wide Governance And Management To Hadoop With Cloudera Integrations

This blog post was originally posted on the Informatica website on October 15th, 2014 here:
http://blogs.informatica.com/perspectives/2014/10/15/informatica-brings-enterprise-wide-governance-and-management-to-hadoop-with-cloudera-integrations/#fbid=GN4ScbY72Yd

Informatica Brings Enterprise-Wide Governance And Management To Hadoop With Cloudera Integrations

Posted on October 15, 2014 by Scott Hedrick

Governance and management of Hadoop clusters in enterprise environments has been a challenge for organizations that want to put data pipelines into production use. Without proper tools, organizations are forced to rely on their teams to thoroughly document data pipelines and hope that no one will show up to audit their Hadoop data infrastructure. Without end-to-end management, apps running on the Hadoop cluster need to be installed and updated manually.

Informatica’s recent integration with Cloudera Navigator and Manager are major steps forward in enabling enterprises to confidently and efficiently deploy Hadoop and data management tools into production with their existing enterprise data infrastructure.

Over the past decade, Informatica has been developing the most sophisticated and flexible metadata management in the industry. Thousands of enterprise customers rely on Informatica to help them govern their data and comply with industry regulations. By integrating with Cloudera Navigator, Informatica has extended it’s proven metadata management tools with the ability to view end-to-end data lineage of data flows across entire data pipelines that flow from source systems into and processed on Cloudera Hadoop clusters and into target applications.

Informatica’s metadata management capabilities combined with Cloudera Navigator is the most advanced solution today for tracking metadata within Hadoop and across other enterprise systems. With the ability to pull data in from Navigator, Informatica can visually trace full data lineage starting from the source systems outside of Hadoop, through the data integration, parsing and cleansing that is executed in the Hadoop cluster and on to target analytical systems outside of Hadoop. When the processing on Hadoop is done with Informatica Big Data Edition, all the details of each transformation, data mappings and associated metadata is brought together to provide governance of the entire data pipeline. Each step can be drilled into for greater detail on the transformations in the data wrangling process and the resulting data relationships in the curated end results.

For organizations that have been looking for the same level of governance and management from their Hadoop enterprise data hub that they have come to expect from their tradition infrastructure, this is the solution. Data scientists and analysts can be more certain of the content and veracity of their data by getting a detailed view into where their data has come from and how it has been combined, parsed, cleansed and prepped for analytics projects. IT organizations needing to comply with industry regulations regarding data can be confident that everything is in place to trace the complete data history for audit purposes. The new levels of data visibility and governance this integration provides with the combination of Informatica and Cloudera dramatically boosts the confidence organizations can have about putting Hadoop into production.

In order to make it easier for customers to manage deployments of Informatica Big Data Edition on Cloudera Hadoop, Informatica has integrated with Cloudera Manager. Using Cloudera Manager, Informatica Big Data Edition software components can be installed on each node of the Cloudera Hadoop cluster for distributed processing leveraging the full power of the cluster. Big Data Edition patch levels can be monitored and the software updated on the Cloudera cluster via the Cloudera Manager interface. This makes it easier to manage Informatica Big Data Edition as an integral part of a Cloudera Enterprise Data Hub.

Come and see full Hadoop data pipeline lineage in action! Informatica will be showing demos of the new integrations with Cloudera Navigator and Manager in the Informatica booth #352 at Strata + Hadoop World in New York City. Contact Informatica if you would like to schedule a time to get more information about how complete data lineage and manageability can add value to your organization.

For more information, here is a link to Informatica’s press release announcing these new capabilities.

Learn how to use Informatica Big Data Edition with Cloudera - See more at: http://vision.cloudera.com/learn-how-to-use-informatica-big-data-edition-with-cloudera/#sthash.FH75nEAg.dpuf

This blog post was originally posted on the Informatica website on September 12th, 2014 here:
http://vision.cloudera.com/learn-how-to-use-informatica-big-data-edition-with-cloudera/

Learn how to use Informatica Big Data Edition with Cloudera

By Scott Hedrick, Big Data @ Informatica

Large enterprises are looking for ways to accelerate their time to production with mission-critical use cases on Hadoop. They want to optimize their data warehouses, run new analytics applications and develop a better understanding of their customers by leveraging Hadoop. Often they find it challenging to build it all themselves without the enterprise tools they are used to from traditional systems.

As the Hadoop market matures, so do the tools and applications for extracting value from the data in Hadoop clusters. Informatica has been working on product integrations with Cloudera for more than three years, to help large organizations leverage Hadoop as part of their data management architecture. Leading financial institutions, insurance companies, energy companies, gaming networks, health management and government organizations are using Informatica with Cloudera to put their data to work on Hadoop.

Organizations that want to explore how to leverage Informatica tools on an enterprise data hub (EDH) can now easily evaluate our visual development tools for Cloudera though a new trial. The Informatica Big Data Edition Trial Sandbox VM for Cloudera provides developers with a visual development solution to connect a Cloudera EDH with enterprise systems and leverage the power of the entire Hadoop cluster for data transformation. Companies already using Informatica can easily migrate mappings to Cloudera and integrate Hadoop into their existing data pipelines with minimal effort using the skills their teams or systems integration partners already have.

Developers can leverage hundreds of out-of-the-box pre-built transforms and connectors for structured and unstructured data processing on Cloudera. This eases the challenges of loading data from relational and NoSQL databases, on premise and SaaS enterprise applications, log files, mainframes and machines into a Cloudera enterprise data hub.

In order to increase understanding of how the two technologies can be used together, we published a whitepaper on our joint reference architecture for data warehouse optimization. At Informatica World in May, we launched a joint Big Data single-day training for data warehouse optimization to help developers get started on their projects.

Working closely with Cloudera, the Informatica Big Data team has preinstalled a trial version of the Big Data Edition into Cloudera’s Quickstart 1-node Hadoop VM and made it available as a free trial downloadable from the Informatica Marketplace. This trial includes sample data and mappings as well as getting started documentation and videos. Try it and let us know what you think.

Get the Informatica Big Data Edition Trial Sandbox VM for Cloudera from the Informatica Marketplace at http://marketplace.informatica.com/bdecloudera

- See more at: http://vision.cloudera.com/learn-how-to-use-informatica-big-data-edition-with-cloudera/#sthash.FH75nEAg.dpuf

Download the Informatica Big Data Edition Trial and Unleash the Power of Hadoop

This blog post was originally posted on the Informatica website on September 11th, 2014 here:
http://blogs.informatica.com/perspectives/2014/09/11/download-the-informatica-big-data-edition-trial-and-unleash-the-power-of-hadoop/#fbid=GN4ScbY72Yd

Download the Informatica Big Data Edition Trial and Unleash the Power of Hadoop

Posted on September 11, 2014 by Scott Hedrick

Big Data Edition Trial Sandbox for Cloudera

Come and get it. For developers hungry to get their hands on Informatica on Hadoop, a downloadable free trial of Informatica Big Data Edition was launched today on the Informatica Marketplace. See for yourself the power of the killer app on Hadoop from the leader in data integration and quality.

Thanks to the generous help of our partners, the Informatica Big Data team has preinstalled the Big Data Edition inside the sandbox VMs of the two leading Hadoop distributions. This empowers Hadoop and Informatica developers to easily try the codeless, GUI driven Big Data Edition to build and execute ETL and data integration pipelines natively on Hadoop for Big Data analytics.

The Informatica Big Data Edition Trial Sandbox VMs will have a 60 day trial version of the Big Data Edition preinstalled inside a 1-node Hadoop cluster. The trials include sample data and mappings as well as getting started documentation and videos. It is possible to try your own data with the trials, but processing is limited to the 1-node Hadoop cluster and the machine you have it running on. Any mappings you develop in the trial can be easily moved on to a production Hadoop cluster running the Big Data Edition. The Informatica Big Data Edition also supports MapR and Pivotal Hadoop distributions, however, the trial is currently only available for Cloudera and Hortonworks.

Big Data Edition Trial Sandbox for Hortonworks

Accelerate your ability to bring Hadoop from the sandbox into production by leveraging Informatica’s Big Data Edition. Informatica’s visual development approach means that more than one hundred thousand existing Informatica developers are now Hadoop developers without having to learn Hadoop or new hand coding techniques and languages. Informatica can help organizations easily integrate Hadoop into their enterprise data infrastructure and bring the PowerCenter data pipeline mappings running on traditional servers onto Hadoop clusters with minimal modification. Informatica Big Data Edition reduces the risk of Hadoop projects and increases agility by enabling more of your organization to interact with the data in your Hadoop cluster.

To get the Informatica Big Data Edition Trial Sandbox VMs and more information please visit Informatica Marketplace

YARN Ready Informatica Big Data Edition Trial Sandbox for Hortonworks Available Today

This blog post was originally posted on the Hortonworks website on September 10th, 2014 here:
http://hortonworks.com/blog/yarn-ready-informatica-big-data-edition-trial-sandbox-hortonworks-available-today/

YARN Ready Informatica Big Data Edition Trial Sandbox for Hortonworks Available Today

Hortonworks and Informatica have teamed up to provide the data systems and tools making up the foundation of the modern data architecture. Today, Scott Hedrick, Director of Big Data Partnerships at Informatica, tells us more about the brand new Informatica Big Data Edition Trial Sandbox for Hortonworks

With the help of our friends at Hortonworks, the Informatica Big Data team has preinstalled a 60-day trial version of the Informatica Big Data Edition into the Hortonworks Sandbox. This free trial enables you to download and test out the Big Data Edition on your notebook or spare computer and experience your own personal Modern Data Architecture (MDA). Since 80% of the effort in Big Data projects is moving and preparing the data, Informatica Big Data Edition plays a key role in enabling a MDA, while the Hortonworks Sandbox is the fastest way to get familiar with Hadoop.

Accelerate Time To Value

Informatica Big Data Edition’s codeless, visual development environment accelerates the ability of enterprises to put their Hortonworks Data Platform clusters into production. As an alternative to implementing complex hand coded data movement and transformation, the Big Data Edition enables high-performance data integration and quality pipelines that leverage the full power of each node of your Hadoop cluster with team based visual tools that can be used by any ETL developer.

Not only can the Big Data Edition reduce the risk and time of your getting Hadoop into production, Informatica abstracts away the complexity and ever evolving Hadoop ecosystem of languages and processing frameworks. Informatica Big Data Edition is certified YARN Ready by Hortonworks to play nicely with the other applications in the data lake. Hortonworks develops, distributes and supports a 100% open source distribution of Apache Hadoop for the enterprise, as well as training, support & services. It gives companies the foundation needed to build their Modern Data Architecture and fully unlock the value of their big data with Enterprise Apache Hadoop.

Hortonworks-INFA Joint Reference Architecture 090814

Leverage Existing Skills

Since the data mappings created in the visual development environment of Big Data Edition abstract away changes in Hadoop, mappings don’t need to be modified as Hive, Map Reduce, Stinger, Tez and other Hadoop projects evolve. The one hundred thousand plus Informatica developers available around the world are now Hadoop developers. Companies currently using Informatica can adapt their existing Informatica mappings running on traditional systems to run on Hortonworks with minimal effort.

For Telco and Internet of Things systems, Informatica’s visual data parsing and prebuilt parsers make it much easier to get unstructured and specially formatted data into Hadoop, combined with traditional data and cleansed for analytics and operational systems. Financial institutions, healthcare corporations, and other highly regulated organizations will appreciate the greater governance they get with their Hadoop data using Informatica.

Informatica Big Data Edition is the most complete and powerful suite for Hadoop data pipelines and can increase productivity up to 5 times. Developers can leverage hundreds of out-of-the-box Informatica pre-built transforms and connectors for structured and unstructured data processing on Hadoop. With the Informatica Vibe Virtual Data Machine running directly on each node of the Hadoop cluster, the Big Data Edition can profile, parse, transform and cleanse data at any scale to prepare data for data science, business intelligence and operational analytics.
The Informatica Big Data Edition Trial Sandbox for Hortonworks is a 60 day trial version of the Big Data Edition preinstalled inside a 1-node Hortonworks Data Platform (HDP) Hadoop cluster. The trial features sample data and mappings as well as getting started documentation and videos. You can try your own data with the trials, but processing is limited to the 1-node Hadoop cluster and system you are running it on. Any mappings you develop in the trial can be easily moved on to a production Hadoop cluster running the Big Data Edition.

Discover and Learn More

Get the Informatica Big Data Edition Trial Sandbox VM for Hortonworks from the Informatica Marketplace
Learn more about how Hortonworks and Informatica have teamed up to provide the data systems and tools making up the foundation of the modern data architecture that helps deliver on the promise of big data