Migrating Oracle Database to Amazon Simple Storage Service (S3)

Amazon Simple Storage Service (S3) is a cloud-based service that is cost-effective and provides unlimited storage capabilities. For Oracle databases, the most common source for data lakes in the Amazon Relational Database Service (RDS).

To migrate the database from Oracle to S3, there should be an AWS account. Further, also required is an Amazon RDS for the Oracle database and an S3 bucket located in the same region where the AWS DMS (Database Migration Service) replication instance is created for migration. 


Databases can be migrated from Oracle to S3in any one of two ways.

The first is by importing data, Oracle Data Pump, and Database Link where the Data Pump and the Oracle DBMS_FILE_TRANSFER package are used to link to a source Oracle instance. This can be initiated either through an Amazon EC2 instance or an Amazon RDS for the Oracle database instance. After the Oracle data is exported to a dump file with the DBMS_DATAPUMP package, the file thus created is copied to the Amazon RDS Oracle DB instance through a linked database. Finally, the data is imported to S3 through the DBMS_DATAPUMP package.

The second method is importing Data, Oracle Data Pump, and Amazon S3 Bucket where the Oracle source data is exported through the Oracle DBMS_DATAPUMP package, and the file is kept in an Amazon S3 bucket. This file is downloaded to the DATA_PUMP_DIR directory in the RDS Oracle DB instance. Finally, the data in the dump file is imported and copied to the Amazon RDS Oracle DB instance using the DBMS_DATAPUMP package.

Organizations can choose one of the two for Oracle to S3database migration as per their convenience. 

Comments

Post a Comment

Popular posts from this blog

The Unique Architecture of the SAP HANA Data Lake

Image
In April 2020, SAP launched the HANA Data Lake that added more power to the existing cloud-based business ecosystem. Users benefitted from a cost-effective storage system from the package that consisted of a native storage extension and a relational SAP data lake. From the start, this data lake was considered to be as feature-rich as the existing players like Microsoft Azure and Amazon S3.  What makes SAP data lake stand out among its competitors is its unique architecture. Organizations have the option of storing data that is frequently used and regularly accessed in one layer while moving other not-so-critical data in low-cost storage layers of SAP HANA. Visualize the SAP data lake as a pyramid that has three layers. The top of the pyramid houses the most important data of an organization that is used in the regular course of business. Hence the cost of storing this data is the highest as it is frequently accessed for analytics or reporting. In the second layer of the ...
Read more

The Unique Architecture of the SAP Data Lake

Image
SAP launched HANA Data Lake in April 2020, intending to provide users with an advanced as well as a very cost-effective data storage repository. The complete package consists of a native storage extension and an  SAP Data Lake   that is standard across all models and versions. The architecture of the SAP Data Lake is unique and stands out from other forms of data lakes. Businesses have the option to store data that is frequently used and accessed (hot data) segregated from data that is not used much (warm data) in the Native Storage Extension (NSE) of SAP HANA. The SAP Data Lake may be visualized as a pyramid with three distinct layers. On the top part of the pyramid is space offered to businesses to store the data which is critical for daily operations and has to be accessed daily. Since this data has very high demand, the storing cost too is the highest among all the three segments. The middle layer of the pyramid is for organizations to store data that is no...
Read more

Everything you need to know about Extract, Transform and Load (ETL) tools

Image
As a central repository that holds all the bid data from various different sources, a data lake is the vast, richest pool of raw data, the purpose of which is undefined. Data from this lake is then put to use for analytics and machine learning by organizations. A data lake is used for storing both relational and non-relational data from devices, apps, and users. Different types of analytics, such as machine learning, big data analytics, textual search, SQL queries, and real-time analytics can be derived from a data lake. It has both curated and non-curated data. An SAP data lake is easy to set up and can ingest data from on-premise or from a cloud warehouse. According to a survey, 90% of businesses believe that big data initiatives help them determine future success. A data lake allows data engineers, data scientists, and business analysts to access information using the tools and applications of their choice. There’s a lot of value in a data lake for businesses, the ability to harnes...
Read more