From the course: Azure Data Lake for Developers

Unlock the full course today

Join today to access over 24,900 courses taught by industry experts.

What are the benefits of hierarchical namespaces?

What are the benefits of hierarchical namespaces? - Azure Tutorial

From the course: Azure Data Lake for Developers

What are the benefits of hierarchical namespaces?

- [Instructor] As we have seen, hierarchical namespace allows us to support file system type operations over our organized data. This functionality allows us to: support directory managed operations, which enables better support for analytics engines, such as Spark, improve query performance via data partitioning, it allows us to more easily manage files and data and it also gives us the opportunity to silo data by security boundaries. Directory-managed operations include things such as moving, renaming or deleting directories. The crucial operation here when we talk about supporting large scale analytics engines, such as Apache Spark, is renaming. These large scale analytics frameworks are used in a lot of big data processing and are an important use case for Azure Data Lake. Because Azure Data Lakes supports real directory-like file management, it enables us to atomically rename files. In Azure Blob Storage, when…

Contents