Posts

Showing posts from September, 2022

What is Core Data Service View in SAP

Image
SAP CDS (SAP Core Data Service) is a data modeling structure that defines and consumes data models that are not on the application server but on the database server. Certain key needs are met by the powerful in-memory database of SAP HANA. These include fast real-time performance for optimized activities at the database level, quick retrieval of data, and reduced application execution time. Developers use the SAP CDS to create underlying data models and application services for exposure to UI clients as  CDSView SAP. CDS View SAP   is a virtual data model of SAP. It allows direct access to the underlying tables of the HANA database.  CDS View SAP   was introduced by SAP with a new programming model that focused on pushing logic from the application server to the client-side and database and is known as  ‘Code -to-date or ‘Code Pushdown’. CDS View SAP   gets the logic from the ABAP application and executes it on the database server instead of the application...

Migrating Databases from Oracle to Cloud-based Snowflake

Image
Oracle is a relational database management system of the Oracle Corporation and has been mainly designed for grid computing and data warehousing. For decades now, it has offered affordable solutions for applications and data management activities. However, the recent advancements in cloud technologies have made most businesses want to migrate databases from Oracle to Snowflake, a cloud-based data warehousing solution. What does a cloud platform bring to the table that makes Oracle users want to migrate to snowflake? Here are some of the main reasons for doing so. · Snowflake provides excellent data management solutions as users can work with both structured and unstructured data, an attribute that is not available in the Oracle database. · Since Snowflake is a SaaS product, it provides unlimited storage facilities, enabling businesses to meet a sudden spike in demand for storage resources without investing in additional infrastructure. · Similarly, Snowflake offer...

Building Data Lake on Amazon S3

Image
Amazon S3 (Simple Storage Service) is a cloud-based data storage service that facilitates data storage in native form – unstructured, semi-structured, or structured. Data is stored in a secure environment with data durability as high as 99.999999999 (11 9s). Data in S3 is stored in buckets with files consisting of metadata and objects. An object has to be uploaded to Amazon S3 for storing a file or metadata in a bucket. Once done, permissions can be set on the object or the related metadata stored in the buckets for holding the objects. Access to the buckets is restricted to those who have the required permissions to access logs and objects for deciding where they will be stored on Amazon S3. The Concept of Amazon S3 Data Lake Several competencies are used when building an S3 data lake such as Machine Learning (ML), Artificial Intelligence (AI), big data analytics, media data processing applications, and high-performance computing (HPC). All these together help to get critical busines...

Moving Databases with the Migration Service of AWS

Image
The Database Migration Service (DMS) of Amazon Web Service (AWS) is a cloud-based platform that facilitates the migration of databases from on-premises systems to the cloud or from one cloud provider to another. For   AWS DMS   to function optimally, one of the sources or the target, or both should be functioning in a cloud environment. The Database Migration Service is very user-friendly. First, it is compatible with the most commonly used databases. Next, DMS allows continuous data replication, and several databases can be easily consolidated into a petabyte-sized data warehouse through data streaming to Amazon Simple Storage Service (S3) or Amazon Redshift. A very important advantage of working with AWS DMSis that the source database remains fully functional during the migration process. This is a great benefit for large data-driven organizations for whom downtime even for brief periods can upset operating schedules. Some of the other cutting-edge benefits of AWS DMS are as...

What is a Snowflake Data Lake and its Cutting-Edge Features

Image
Data lakes are storage repositories of data where massive volumes can be stored in one place for later processing and analytics. In the past, data storage capabilities consisted of several components like data warehouses, data marts, and more which are now not required due to technological advancements and databases being operated in the cloud. One of the most highly optimized cloud-based data warehousing solutions providing unlimited storage and computing facilities is the Snowflake data lake . Users can scale up or down in data usage for computing or storing, paying for the resources used only. This is critical for businesses as they do not have to invest in additional hardware or software when faced with a sudden surge in demand.      Data Structure of the Snowflake Data Lake Snowflake Data Lake has an extendable architecture that ensures seamless loading of databases within the same cloud environment, thereby doing away with the need to choose a specific data warehous...

Migrating Databases From Oracle to S3

Image
This post will go into migrating databases from Oracle to S3 and analyze the benefits of moving to the Amazon Web Service (AWS) S3 (Simple Storage Service). Oracle, a proprietary relational database management system (RDMS) is mainly used for data warehousing and Online Transaction Processing (OLTP). It provides support to GNU/LINUX and Windows Server and most applications merge seamlessly into the database. Being ACID-compliant, Oracle assures data integrity and reliability. On the other hand, Amazon S3 is a data warehousing solution based in the cloud and is ideal for Online Analytical Processing (OLAP). For launching applications, an S3 cluster is initiated through API calls and then connected with the help of the AWS Management Console to an S3 instance. The benefits of S3 range from high data availability, scalability, and performance, to unlimited storage. It is because of these advantages that organizations prefer to move databases fro m Oracle to S3. Further, S3 can backup, re...

How to Migrate Databases to Snowflake From SQL Server

Image
Before going into the details of migrating databases from Microsoft SQL Server to Snowflake – the tools and the processes – it is necessary to understand the benefits of Snowflake. Why do organizations today prefer SQL Server to Snowflake migration of databases? First, Snowflake, an optimized cloud-based data warehousing solution enables the migration of data in its native format regardless of whether it is unstructured, semi-structured, or structured. This feature is not available in other leading database platforms like Oracle and SQL Server. Snowflake also has high computing abilities and multiple users can simultaneously execute several intricate queries without any lag or drop in performance. Further, Snowflake offers unlimited storage space and users can download it in minutes whenever required by paying for the quantum of resources used. This leads to huge savings when compared with traditional database systems that charged flat fees for storage space regardless of the volumes ...

The Technology and Functioning of SQL Server Change Data Capture

Image
One of the major goals of data-driven organizations of today is to ensure data security and durability, both of which can be had through the Change Data Capture (CDC) technology. While making sure that that change data is stored in a way that does not affect its history, CDC also insulates data from possible breaches and hacking. Several solutions like complex queries, timestamps, and triggers had been tested in the past, but none had met with the success of the CDC. Introduction of SQL Server Change Data Capture In 2005, Microsoft launched the SQL Server Change Data Capture product. Its advanced features had “after update”, “after insert”, and “after deleting” capabilities. But this technology had no takers due to its complex nature and hence in 2008, a revised version of SQL Server Change Data Capture DC was launched that was a major improvement. It could capture and document historical data without any other activities or work. The Technology Behind SQL Server Change Data Capture T...

What is Core Data Service View in SAP

Image
Core Data Service (CDS) has been created by SAP and is a semantically rich data definition language. With CDS View SAP , you can define and consume models on the database without the use of the application server. CDS views is a specialized and optimized platform for designing data models that can be moved outside applications with the help of OData services. This post will go into the details and the many intricacies of the CDS View SAP beginning with what is SAP CDS. What is SAP CDS SAP CDS is a short form of SAP Core Data Service. It is a framework for data modeling that ensures data models are defined and consumed not on the more common application server but on the database server and leverages the robust in-memory database of SAP HANA to meet the requirements of real-time performance. This can be done by users through maximized operations at the database level, leading to a reduction in application execution time and quick retrieval of databases. SAP CDS is used to create data ...