Oracle | DBMS

Oracle DBMS_HADOOP Version 21c

General Information

Library Note

Morgan's Library Page Header

ACE Director Alum Daniel Morgan, founder of Morgan's Library, is scheduling complimentary technical Workshops on Database Security for the first 30 Oracle Database customers located anywhere in North America, EMEA, LATAM, or APAC that send an email to asra_us@oracle.com. Request a Workshop for your organization today.

Purpose Provides a PL/SQL procedure called CREATE_EXTDDL_FOR_HIVE(), that creates an Oracle external table for a given hive table. Big Data SQL needs to be correctly set up for DBMS_HADOOP to work.

AUTHID CURRENT_USER

Dependencies

ALL_HIVE_COLUMNS	DBMS_HADOOP_INTERNAL	ROLE_TAB_PRIVS
ALL_HIVE_DATABASES	DBMS_METADATA	USER_HIVE_COLUMNS
ALL_HIVE_PART_KEY_COLUMNS	DBMS_OUTPUT	USER_HIVE_DATABASES
ALL_HIVE_TABLES	DBMS_PRIV_CAPTURE	USER_HIVE_PART_KEY_COLUMNS
ALL_HIVE_TAB_PARTITIONS	DBMS_SESSION	USER_HIVE_TABLES
ALL_XT_HIVE_TABLES_VALIDATION	DBMS_SQL	USER_HIVE_TAB_PARTITIONS
DBMS_ASSERT	DBMS_STANDARD	USER_XT_HIVE_TABLES_VALIDATION

Documented Yes: Packages and Types Reference

First Available 12.2

Security Model Owned by SYS with EXECUTE granted to PUBLIC

Source {ORACLE_HOME}/rdbms/admin/dbmshadp1.sql

This file is only run during installation on the Linux O/S.

Subprograms

CREATE_EXTDDL_FOR_HIVE	SYNC_PARTITIONS_FOR_HIVE	USER_PRIVILEGED
CREATE_HYBRID_PARTNED_TABLE

CREATE_EXTDDL_FOR_HIVE

Given a hive table name, creates a text of DDL that can be executed to create an external table corresponding to the hive table dbms_hadoop.create_extddl_for_hive( cluster_id IN VARCHAR2, db_name IN VARCHAR2, hive_table_name IN VARCHAR2, hive_partition IN BOOLEAN, table_name IN VARCHAR2, perform_ddl IN BOOLEAN, text_of_ddl OUT CLOB);

TBD

CREATE_HYBRID_PARTNED_TABLE

Given a LIST partitioned local Oracle table and a (list) partitioned Hive table, merge the Hive partitions into the Oracle table. The Oracle table now becomes a hybrid partitioned table. dbms_hadoop.create_hybrid_partned_table( cluster_id IN VARCHAR2, db_name IN VARCHAR2, hive_table_name IN VARCHAR2, table_name IN VARCHAR2, perform_ddl IN BOOLEAN := FALSE, text_of_ddl OUT CLOB);

TBD

SYNC_PARTITIONS_FOR_HIVE

Synchronizes the existing partitioning definition of a hive table in Oracle catalog dbms_hadoop.sync_partitions_for_hive( xt_tab_name IN VARCHAR2, xt_tab_owner IN VARCHAR2);

TBD

USER_PRIVILEGED

Verifies whether a user has a given role dbms_hadoop.user_privileged( user_role IN VARCHAR2, cluster_id IN VARCHAR2) RETURN NUMBER;

TBD