Data staging into SAP Business Technology Platform (BTP) using Smart Data Integration (SDI).

In modern data management, efficiently staging data is vital for organizations aiming to leverage the power of analytics and drive informed decision-making. SAP Business Technology Platform (BTP) offers a robust data integration and management ecosystem, with Smart Data Integration (SDI) as a critical tool for managing data flows.

Before discussing the intricacies of data staging using SDI, it’s essential to understand the foundation laid by our previous blog on BTP introduction. Now, let’s explore the detailed process of staging data in SAP BTP using SDI as the ETL (Extract, Transform, Load) tool.

Extraction Process Setup:

• Remote source configuration in HANA CLOUD (BTP)
• Create a user with required access privileges to the database
• User-provided service instance

Remote Source Configuration in HANA Cloud (BTP):

• Setting up a remote source configuration involves providing details of the source system (ECC or S/4 HANA) within HANA Cloud (BTP).
• The configuration encompasses establishing credentials and selecting the appropriate adapter (ABAP or HANA) for data extraction.

Note:

ABAP or HANA adapters are configured at the DPAGENT level at the source system.

Creation of User with Required Access Privileges:

A dedicated user, such as “UPS_USER_ABAP2,” is created with the necessary access privileges at the database schema level.

This user is granted permission to create virtual tables, functions, and procedures utilizing a remote source.

User-Provided Service Instance:

A user-provided service instance, named ‘UPS_ABAP,’ is created based on the previously established user ‘UPS_USER_ABAP2.’

This service instance facilitates the creation of virtual tables, views, and stored procedures at the schema level, essential for full-stack and native HANA developments.

Data Transformation Setup:

We embark on data transformation endeavors using the ‘SAP HANA Native Application Dev Space’ in SAP Business Application Studio.

By selecting the SAP HANA Database Project template, we create a project to initiate development activities.

We have created a project as shown below:

We have set up the database connections for the HDI container (SALES_HDI) and User-provided service instance (UPS_ABAP)

Data Staging Setup:

Virtual Table Creation:

• Leveraging the ‘.hdbvirtualtable’ file, we define details for virtual tables, which are converted into database objects by the virtual-table plug-in.
• An example includes creating a virtual table ‘VT_VBAK,’ pointing to the ‘VBAK’ table of the source schema.

Replication Task Configuration:

• Replication tasks facilitate real-time or batch data replication from source to target.
• Configuration involves creating and configuring the ‘.hdbreptask’ file, such as creating a replication task named RT_MARA.

Synonym Creation:

• Synonyms are established for tables to enhance accessibility and usability.
• For instance, a synonym ‘ hdsynonym’ is created for the ‘VBAK’ table in the Business Application Studio.

This VBAK table will be used later in our further development.

Similarly, for the VBAP table, we built a virtual table and a synonym.

Calculation Views:

Calculation views are pivotal in visualization and analytics within SAP Analytics Cloud. By integrating tables such as ‘VBAK’ and ‘VBAP,’ we construct and deploy calculation views like ‘CV_SALES’ to facilitate insightful analytics as illustrated below:

The row data from the calculation view can be seen here.

In subsequent blogs, we will discuss how calculation views in SAP Analytics Cloud (SAC) are consumed for visualization and analytics purposes, further extracting the potential of data insights.
Seamlessly integrating data into SAP BTP using SDI empowers organizations to drive data-driven strategies, streamline operations, and gain a competitive edge in today’s dynamic business landscape. Watch this space for more insights into harnessing the power of SAP BTP for transformative data management initiatives.

• SAP
• SAP BTP
• Smart Data Integration