Introducing Salesforce Data Pipelines

Salesforce Data Pipelines is a new Salesforce product that allows you to enrich and transform your CRM data, natively in Salesforce. With Salesforce Data Pipelines, you can consolidate data scattered across multiple systems into a coherent view inside the CRM, or clean up and transform your Salesforce data without it ever leaving the Salesforce trust boundary.

Data Pipelines can read your CRM data, combine it with data coming from a number of external sources, clean it and aggregate it using a fast and scalable engine that supports machine learning-powered data transformations, and quickly write it back to the CRM or other systems.

What does Salesforce Data Pipelines do?

Data Pipelines includes a new and powerful Data Manager, that allows you to schedule and monitor all of your data jobs, directly from your Salesforce org.

Any admin can visually build data transformation jobs, called Recipes, using a point and click editor that shows previews of the data at each and every step.

Recipes enable you to shape your data to fit your unique needs with features such as joins and aggregations, and ML-powered data transformations such as sentiment detection, clustering, and predicting missing values.

The data you use can be already living in your CRM or external data, thanks to over 50 connectors available out of the box. Often, it is the combination of CRM data and data coming from other systems that helps you see the full picture and deliver the business outcome you need!

Data Manager also includes a Limits page where the Admin can always be up to speed with the usage of the product.

Consolidate External Data Direct in Your CRM: A Sample Use Case

So what are the real-world applications of this new amazing product? Soon we will publish a new blog with an exploration of the variety of use cases covered by Salesforce Data Pipelines, but in the meantime, we want to give you a quick example of what an Admin can accomplish with it.

In this scenario, Anna, our admin, wants to make sure that all the Account Executives working for her organization have a combined view of how much the order total is for each customer over time, and how positively or negatively each customer feels about the company based on their latest online review.

But Anna knows that order and review data don’t live inside the CRM – they are in external systems. After some research, Anna discovers that she can use Salesforce Data Pipelines to connect to Redshift and Snowflake, where the data she needs is located.

It’s pretty easy for Anna to then create a new Recipe where she loads Opportunity data from Salesforce, combines it with order data from these external sources, and aggregates it at the account level:

Anna immediately gets a preview of the calculated data, so that she can verify each transformation step by step.

As you can see from the image above, a Recipe can have multiple branches. This means that in the same recipe, Anna can also load the Survey responses from the website, and run the Sentiment Detection algorithm so that Account Executives can quickly see if the customer has a positive or negative impression of their organization.

Finally, Anna can easily map each field of the Recipe to fields on the Account object that she has created, and then schedule the Recipe so that the data is updated multiple times a day! No more slow APEX code or external ETL tools.

Every time they log into Salesforce, Account Executives can now see on the Account page updated information on Lifetime Spend and Customer Sentiment.

Learn More

Ready to learn more? Join the webinar on April 29th introducing Salesforce Data Pipelines, and read through our Release Notes and Product Documentation.

Written by