Data Integration Service

Why Trust Techopedia

What Does Data Integration Service Mean?

A data integration service is programming that can connect to a source system, extract data, transform it and incorporate it in a target system along with data from other source systems. The target system can then be used as a golden record (single source of truth) for other applications and computing systems.

Advertisements

Data integration service strategies include:

  • Extract, Transform and Load — extracted data is transformed by a middleware ETL server before it’s transferred to the target system.
  • Data Replication — changes to the source system are replicated on the target system in real-time.
  • Publish-Subscribe – downstream systems subscribe to a data integration service that will periodically update the target system.
  • API & Web Services – used to build a loosely coupled architecture that can accommodate multiple request/response-based data services simultaneously.

Techopedia Explains Data Integration Service

Building a single data pipeline can be difficult today because it requires someone to manage business rules, rules for transforming data and rules for managing configuration drift, job scheduling and data transfers in multiple settings. Cloud-based data integration services can expedite data integration significantly by automating workflows that directly impact data availability.

How Data Integration Services Work

In the past, data integration services were so complicated that building them often required help from data engineers who knew how to code. Today, cloud-based data integration services are designed to be managed through a low-code/no-code (LCNC) dashboard and use application programming interfaces (APIs) to extract and transfer data.

The graphical user interface (GUI) dashboard, which hides back-end complexities, allows users to drag and drop icons that represent different types of dataflows, pipelines or workflow designs. Once a service has been assembled, it can be tested in a sandbox environment before executing it in the production environment.

To keep data integration services as simple as possible, experts recommend avoiding:

  • Designs that involve creating and managing too many moving parts.
  • Code-heavy approaches that fail to take advantage of automation.
  • Legacy programs that were never designed to support native or hybrid cloud architectures.
  • Integration service engines that are designed to accommodate a specific, narrow use case (e.g., application integration).
Advertisements

Related Terms

Margaret Rouse
Technology Specialist
Margaret Rouse
Technology Specialist

Margaret is an award-winning writer and educator known for her ability to explain complex technical topics to a non-technical business audience. Over the past twenty years, her IT definitions have been published by Que in an encyclopedia of technology terms and cited in articles in the New York Times, Time Magazine, USA Today, ZDNet, PC Magazine, and Discovery Magazine. She joined Techopedia in 2011. Margaret’s idea of ​​a fun day is to help IT and business professionals to learn to speak each other’s highly specialized languages.