Configuring Pipeline Credentials and Secrets
Configure Salesforce connection credentials and secret definitions in Matillion so pipelines can authenticate and load data from a Salesforce or ServiceMax Core org.
Pre-built pipelines downloaded from PTC Orbit require Salesforce credentials before they can connect and load data. Matillion stores non-sensitive identifiers, such as usernames, as pipeline variables, and sensitive values, such as passwords and security tokens, as secrets. You reference both in the Salesforce Load component, then validate the connection before running the pipeline.
|
Prerequisites
|
|---|
|
• Pre-built pipelines must be imported into the customer Matillion project. See Importing Pre-Built Pipelines.
|
1. Log in to Matillion and open the customer project. In the Files panel, open the SFDC DataSync OOTB Pipelines folder and click the pipeline to configure — for example, 7 - Salesforce Work Order Incre Sync Pipeline. The pipeline canvas opens, showing the component flow: Start > Get Last Modified Date > Salesforce Load > Run Transformation > SQL Script.
2. Click Add a variable. In the Add Variable dialog, set the following:
◦ Scope: select Project to share the variable across pipelines.
◦ Type: select Text.
◦ Name: enter SF_USERNAME.
◦ Behavior: select Shared.
◦ Default Value: enter the Salesforce integration username.
Click Create.
3. Open the Salesforce Load component on the canvas.
4. In the component configuration panel, set the following connection fields:
◦ Authentication Type: Username & Password.
◦ Use Sandbox: No (or Yes if connecting to a sandbox org).
◦ Username: select the SF_USERNAME variable.
5. Click Add secret. In the Add Secret dialog, set the following:
◦ Name: enter SF-DemoOrgP.
◦ Description: enter Salesforce org Password.
◦ Default Value: enter the org password.
Click Create. In the Password field of the Salesforce Load component, select the SF-DemoOrgP secret.
6. Click Add secret again. In the Add Secret dialog, set the following:
◦ Name: enter SF-SecToken.
◦ Description: enter Security Token of the Salesforce or ServiceMax Org.
◦ Default Value: enter the security token.
Click Create. In the Security Token field of the Salesforce Load component, select the SF-SecToken secret.
7. Click Validate on the Salesforce Load component. Confirm the Validation successful message appears on the component.
8. Click Run to execute the full pipeline. Monitor progress in the Task History panel and the Tasks tab. Each component — Start, Get Last Modified Date, Salesforce Load, Run Transformation, and SQL Script — reports a success status when the run completes.
What to Do Next
The pipeline is authenticated and ready for scheduled or manual runs. Repeat this process for each pipeline in the SFDC DataSync OOTB Pipelines folder that connects to the same Salesforce org.
 |
Store all passwords and security tokens as Matillion secrets rather than in plain-text pipeline variables. Secrets are encrypted at rest and are not included in exported pipeline packages.
|