InfoSphere DataStage to Salesforce, Eloqua, Marketo and other SaaS via ODBC

Infosphere DataStage is one of the top data integration platforms from a data connectivity perspective since most sources and targets are fueled by DataDirect ODBC connectivity. This includes our streaming bulk load (without landing flat files) functionality for faster loads into popular RDBMS such as SQL Server from Unix/Linux.

I have been working with an increasing number of DataStage shops looking for expanded connectivity to SaaS applications using flexible ODBC access direct to Salesforce, Veeva CRM, Eloqua, Oracle RightNow and Marketo. DataDirect delivers SaaS data connectivity that is built from the same framework as relational ODBC drivers already bundled with DataStage today.



Why add DataDirect SaaS connectivity to your stage?

• We’re putting a SQL-92 ODBC compliant interface on SaaS applications so ETL developers can hit the ground running. You don’t even have to know how to spell “eloqua”.
• We have Informatica shops running ODBC drivers to access Salesforce SaaS data in production today with complete read-write access, including streaming bulk load support.
• Disruptive SaaS data sources are coming soon to a DataStage near you. I’ve seen a couple projects where organizations are forced to use a kludgy architecture to consume SaaS data against your own best practices/data governance for consuming SaaS data.
• IT can take control of the SaaS landscape before business sponsors even know what to ask. It’s really important to me that you use the best platform for the job without spinning up one-off satellite data integration systems.
• The same connectivity works with any standards based IBM application including IBM Cognos (Data Manager, BI, Transformer), IBM Cognos TM1, IBM SPSS, DB2 Federation Server, Websphere Application Server … as well as any standards based applications from Oracle, SAP, or Microsoft.

Getting Started unleashing the power of DataStage on SaaS


Below are steps to integrate additional DataDirect ODBC drivers with DataStage:

1. If you only care about Salesforce, install the DataDirect Connect XE for ODBC Salesforce driver. If you’re planning to add support for other SaaS sources in addition to Salesforce, install the DataDirect Cloud client. Both provide real-time direct connections to Salesforce suitable for use with enterprise ETL platforms.
2. Verify test-connection works independently from DataStage by following the corresponding quick start guide with the download.
3. Integrate the ODBC shared library path (e.g. LIBPATH on AIX, SHLIB_PATH on HP-UX pa-risc, and LD_LIBRARY_PATH on Solaris, Linux and HP-UX Itanium) in <InformationServer>/DSEngine/dsenv file. (Note: If running on Websphere, the shared library path will need to be configured from Websphere)
4. Specify the ODBC data source name in the uvodbc.config
5. Merge the odbc.ini data source into the existing file used by DataStage typically found in $DSHOME. Below is a sample Salesforce DSN:
   [Salesforce]
   Driver=/opt/Progress/DataDirect/Connect64_for_ODBC_71/lib/ddsfrc27.so
   Description=DataDirect 7.1 Salesforce
   HostName=login.salesforce.com
   SecurityToken=<your security token>
   StmtCallLimit=0
   TransactionMode=1
   Database=/tmp/sfdc
6. Optional: The Connect XE Salesforce.com driver requires a JRE, and if DataStage is running with an older JRE version, the driver can be configured to use a standalone JRE independent from DataStage by following these steps:
   - Configure shared library path with desired JRE. For example on AIX: - LIBPATH=/usr/java6_64/jre/lib/ppc64:/usr/java6_64/jre/lib/ppc64/classic:$LIBPATH
   - Add following property to Salesforce ODBC DSN in odbc.ini file: SQLEngineMode=1
   - Check whether the standalone java service is running, ps -ef | grep “sforce”
   - If not running, please start it from the following directory: /opt/Progress/DataDirect/Connect64_for_ODBC_71/java/lib
   - java -cp sforce.jar com.ddtek.cloud.sql.Server &
7. Restart the node agents and begin importing SaaS metadata via ODBC

Information Server Designer Client ODBC connection to SaaS




Learn more about the expanded Data Connectivity Options available from DataDirect


1. Download free 15 day trial of the DataDirect Connect64 XE for ODBC Salesforce drivers or try the DataDirect Cloud Connectivity Service to integrate an unlimited number of applications with SaaS data sources.

2. Or call 1-800-876-3101 to speak with a systems engineer to learn how other organizations are making progress with DataDirect Connect Salesforce integration.

Continue reading...