The Premier Data Integration Summit – Last chance to register
Metamorphosis, now in its third year, will be hosted at the Hyatt Harborside Hotel. With separate SI and ISV tracks, you'll be sure to find the information most relevant to your needs. Confirmed speakers include:
- Industry Analyst Carl Olofson, Research VP, IDC
- Ted Bardasz, VP of Research and Development, Softrax Corporation
- Steve Woods, CTO, Eloqua Corporation
Topic: Event-based Integration for OnDemand Software - Swamy Narayana, Director, CGI-AMS
Topic: Repeatable Datamart Implementations - Tom Bertrand, Data Conversion Manager, ACS
Topic: Anatomy of Data Conversion Projects for Large-Scale Court and Financial Systems - Javier Betancourt, Progress Software
Topic: Completing the SOA picture – bridging the last mile - Anne Marie Berger, Forefront
Topic: Extending Legacy Payroll Systems with Complex Payroll Analysis Processes for Retail Chains - Frank Johnson, PHCS
Topic: Reducing Claims Processing Costs through Multi-functional Data Integration Tools
Preview our Agenda or see some of the presentations from past Metamorphosis events.
If you qualify, the Summit is complimentary. Register now
OR Call 1-888-296-5964.
Radio Integration: The ABC's of compliance
Shawn Brown, a CPA with Pervasive, talks about some of the challenges for companies concerning compliance regulations – and some solutions. Have a listen…
Click on the player button below to listen to Integration Radio. This audio requires the Flash plug-in, which you can download for free here.
You can also download the audio in MP3 format here. An archive of all of our audios can be found here.
Multiple Beta programs on the horizon
May 15, 2006: The "Project Dataflow" Beta program starts with the release of a Technology Preview for a limited set of 5-10 large enterprises, followed by a full-featured widely available Beta Release during the summer of 2006. You may recall that "dataflow" provides a 100% Java development framework for data-intensive and compute-intensive processing/integration tasks. I spoke about it in previous issues, but we never had a locked release date until now. We expect the Beta Release to include features such as:
- Eclipse IDE with dataflow graph visualization and component development "Cheat Sheets"
- Many data readers/writers (i.e., "data adapters" or "connectors") including relational databases, "flat file" and XML
- Computational components for sorting, joining, and various data transforms
- A highly parallel runtime engine that includes a full debugging UI so each step in the dataflow graph can be debugged independently
Late summer 2006: Pervasive Business Integrator/Data Integrator 8.12 Beta program starts with the release of a Technology Preview, followed by a full-featured Beta release shortly thereafter. We are planning for the General Availability (GA) of 8.12 to come during the fall of 2006 once we get to a stable, high-performing Release Candidate. Release 8.12 GA will include the following new features:
- An optional, simpler, easier to learn mapping interface in Map Designer
- MS SQL Server 2005 adapter verification
- Oracle Financials adapter
- MS Dynamics CRM 3.0 adapter
- NetSuite adapter
- AcuCOBOL adapter
- Improved Java/COM SDK for dynamic modification of maps and connectors
- Eclipse-based Java creation wizard for use in building Message Component Framework (MCF) components
- New Integration Engine Embedding Guide for ISVs and Systems Integrators
If you wish to participate in either Beta program, please do not hesitate to contact me.
Emilio P. Bernabei
Director Product Management
P.S. – We invite you to visit our Integration Online Demo Center, where you can select from different online demos providing you with an extensive overview of our Integration products and solutions.
Download new components for 8.10 release
8.10 customers can find Web Services Invoker (MCF) and a new version of the XML Mapper Invoker (MCF) by going to our Product Updates page.
Select "Maintenance: Software and Component Update." A table is then shown, with full binaries and component downloads to the right. Version 8.10: Web Service Invoker and XML Mapper will be in the far right column. Install instructions are also found at the bottom of the screen.
Watch future editions of Integration Insights for other new components and features!
Best practices for mapping repeating segments
When dealing with segments in an EDI source that can occur multiple times, the data must be placed in a rowset or in some other type of variable storage AfterEveryRecord. Otherwise, only the final occurrence of that segment will be mapped to the target.
For example, in the 271, 2100D loop, the REF has a max use of 9, and the data is likely to look something like this:
REF*SY*403585824*SUBSCRIBER SOCIAL SEC~
REF*6P*PRINCIPAL MUTUALRF*PREMIER GROUP NUMBER~
REF*18*HD01*PAYER PLAN ID~You can see that there are three different pieces of data that need to be mapped to three different locations in the target all in a repetition of the same segment. Because the source schema recognizes each segment as exactly the same segment, it allots only one source buffer, and when the second and third occurrences of the segment come in, they overwrite the previous occurrences.
The mapping for the three target fields would logically be like this:
Dependent_SSN =
if Records("[L.2000D!L.2100D]REF").Fields("REF_01_128") == "SY" then
Records("[L.2000D!L.2100D]REF").Fields("REF_02_127")
end if
Dependent_Group =
if Records("[L.2000D!L.2100D]REF").Fields("REF_01_128") == "6P" then
Records("[L.2000D!L.2100D]REF").Fields("REF_02_127")
end if
Dependent_Plan =
if Records("[L.2000D!L.2100D]REF").Fields("REF_01_128") == "18" then
Records("[L.2000D!L.2100D]REF").Fields("REF_02_127")
end if
However, if the put or insert action is later on in the transformation, this mapping will result in Dependent_SSN, and Dependent_Group coming out blank. Only Dependent_Plan will have data, even though the Map actions are at the AfterEveryRecord event for that REF segment.
Instead, in the AfterEveryRecord of the REF segment just before the Map action, the data needs to be placed in a separate variable or row in a rowset as it comes in, and before another record is read in. In this case, since there are only three fields in the target, global variables were chosen, and the field mapping was changed to this:
Dependent_SSN = DepSSN
Dependent_Group = DepGroup
Dependent_Plan = DepPlan
This was placed in the Execute action in the AfterEveryRecord of that REF:
if Records("[L.2000D!L.2100D]REF").Fields("REF_01_128") == "SY" then
DEP_SSN = Records("[L.2000D!L.2100D]REF").Fields("REF_02_127")
End if
if Records("[L.2000D!L.2100D]REF").Fields("REF_01_128") == "6P" then
DEP_GRP = Records("[L.2000D!L.2100D]REF").Fields("REF_02_127")
End if
if Records("[L.2000D!L.2100D]REF").Fields("REF_01_128") == "18" then
DEP_PLAN = Records("[L.2000D!L.2100D]REF").Fields("REF_02_127")
End if
This Best Practice results in correct data output.
In instances where you do not have the experience, time, or manpower to create your own EDI/HIPAA maps/processes, check out Pervasive Software's Professional Services Group (PSG) to ensure the most efficient, compliant results.
Next month, watch for tips on how to write map steps.
Hit the ground running with 'Integration Jumpstart'
Pervasive's Professional Services Group brings years of valuable experience to your integration project — we can even implement your integration software. When you work with us, you're leveraging the combined expertise of hundreds of developers and tens of thousands of hours building and implementing integration solutions.
As a part of Pervasive's Professional Services Group, our Training Services team will share their rich integration skill sets and experiences to empower your staff to better develop and manage their own integration projects. Together, we will ensure you optimize your efforts, while helping you sidestep potential pitfalls. Pervasive has all the resources to train your staff to better create and manage their own integration projects.
Challenges: Product Knowledge, Turnover, and Adaptability
Success Factor: Training Services
Our Training Services team has extensive experience working with new and existing users to provide a maximum amount of product knowledge in a short amount of time. We invite you to visit our Web site to learn more about our Training Services.
Challenges: Available Resources and Deadlines
Success Factor: Implementation Services
Our Implementation Services team has a history of success filling resource gaps to meet tight deadlines and implementing solutions rapidly. Please visit our Web site to learn more about our Implementation Services.
Challenges: All of the Above
Success Factor: Fast-Track Training and Implementation Packages
Our Professional Services Group will allocate the best resource for your needs and deliver knowledge transfer in a classroom environment, followed by actual product implementation and consulting. Stop by our Web site to see the list of our Packaged Offerings.
Three questions for you!
In order to learn more about your reporting and your data warehousing/data mart needs, we invite you to take our Readers' Poll. Three randomly picked participants will receive a Pervasive shirt. Results of the poll will be published in next month's edition of Insights Integration Edition.
To Add Pervasive Software to Your Safe Senders List
Due to spam filters differing, and that at times they filter legitimate email, it is highly recommended that you add Pervasive Software domain to your Safe Senders list in your email client. This will ensure that our email correspondence will get to you successfully.
For Outlook 2000 and higher
In your email from Pervasive Software:
1. Open the email from Pervasive Software
2. Click on the Actions menu on the top of your email window.
3. Choose Junk Email.
4. Select Add Senders Domain .... to Safe Senders List to add Pervasive Software to your safe sender list.
Click here for free subscriptions to all Pervasive news and event alerts!
Pervasive Online Demo Center. Solutions matched to your needs. We offer an ever expanding list of online demos. Simply select from a product family to view the selection of online demos.
