“I’ve worked on several data integration projects in the past.  I am not aware of any widely accepted methodologies specific for data integration.  In general I adapted systems development lifecycle methodology and worked through each phase of the data integration lifecycle.  The data integration projects I worked before were either focused on data conversion or data consolidation.  The first step was always analyzing the requirements and making a work plan.  Data mapping was one of the most important tasks.  In most of the projects I wrote my own customized scripts for data migration.  I used Informatica’s data conversion ETL tools in a few projects.  Database design tools like Oracle Designer and ERWin were very handy for me to manage repository and meta data for the data integration projects.”

“In past jobs I had opportunities to evaluate software tools and make decisions best for the project.  Before I started to evaluate a software or technology, it’s important for me to analyze the project requirements and understand what is really needed.  In general, it is not necessary to get the latest and hottest technologies, I’d rather select a technology that is stable, well accepted in the industry, and has long-term future.  I would also consider the functions and usability of the software and initial cost.  Another important factor is the cost of ownership.  Of course I would evaluate existing resources to implementing the tools and technology and potential training costs.  In my previous job I was involved in evaluating and selecting a software suite for our development platform.  Based on all of the analysis we decided to use Java/J2EE technology and I recommended Eclipse open source platform for our development environment, and potentially we could implement Java-based SOA for system integration. I also selected Struts as the web-based application framework.”

Interoperability enables communication, data exchange, or program execution among various systems in a way that requires the user to have little or no awareness of the underlying operations of those systems.

Today’s interoperability is realized by XML web services. The most interoperability cases are between J2EE environment and .NET platform.

Interoperability between Java and .NET is hot. In 2005′s JavaOne Conference, Microsoft and Sun presented at two breakout sessions to showcase technology that Sun and Microsoft are delivering to help customers easily interoperate between their Java and Microsoft® .NET-based systems. Both Sun and Microsoft look forward to a sustained relationship in building interoperable systems on standards-based XML web services technology.

Microsoft provided the following resources for Java/.NET interoperability:

Microsoft .NET Resources for Java Developers

http://msdn.microsoft.com/vstudio/java/

This is your one-stop shop for Java and .NET interoperability, community, and general information about the .NET Framework for Java developers. On this developer center you can learn how to interoperate between Java and the .NET Framework using techniques such as Web services and 3rd party bridging solutions.

Microsoft .NET and Java/J2EE Interoperability

http://msdn.microsoft.com/vstudio/java/interop/default.aspx

.NET Framework Training for Java Developers

http://msdn.microsoft.com/vstudio/java/migrate/workshop/default.aspx

Learn how to build Microsoft .NET-based applications with the .NET Framework Training for Java Developers by using your existing Java knowledge as a frame of reference. For instance, you’re probably aware of how to use RMI, but how does this compare with .NET Remoting? How does JSP compare with building Web-based applications using ASP.NET? This workshop provides hours of recorded Web casts and even hands-on labs which can be completed for free, from your desk, and at your own pace.

Java to .NET Framework Migration Workshop

http://msdn.microsoft.com/vstudio/java/migrate/workshop/default.aspx

Additional Interop Resources
- Microsoft and Interoperability

http://www.microsoft.com/windowsserversystem/interop/default.mspx

- Microsoft Interoperability Webcasts

http://www.microsoft.com/events/series/interopseries.mspx

- Microsoft Connected Systems Business Kit

http://www.microsoft.com/windowsserversystem/overview/benefits/cstrial.mspx

If you do not see what you’re looking for, you may email to Java-MS@microsoft.com for additional information.

Data Integration is the process of accumulating and combining data set from disparate sources at various locations. This data can then be used for business intelligence, CRM, data mining, or other applications that involve the analysis of data in order to make key decisions.

Data integration incorporates a series of processes – the sequence of applications that extract data from various sources, bring them to a data staging area, and then programmatically prepare the data for migration into to data warehouse and the actual loading of the data into the data warehouse and data marts.

Data integration usually involves operations such as data conversion, cleansing, formatting and aggregation. After the data is extracted a number of transformations may be applied in preparation for data consolidation and subsequently loaded into data warehouses, data marts or dimensional data structures used for decision support systems or business intelligence systems.

Key benefits of data integration:

- Availability of data
- Enhanced data quality
- Better manageability
- Improved decision making
- Higher return on investment (ROI)