From the course: Azure Data Lake for Developers
Unlock the full course today
Join today to access over 24,900 courses taught by industry experts.
What are the benefits of hierarchical namespaces? - Azure Tutorial
From the course: Azure Data Lake for Developers
What are the benefits of hierarchical namespaces?
- [Instructor] As we have seen, hierarchical namespace allows us to support file system type operations over our organized data. This functionality allows us to: support directory managed operations, which enables better support for analytics engines, such as Spark, improve query performance via data partitioning, it allows us to more easily manage files and data and it also gives us the opportunity to silo data by security boundaries. Directory-managed operations include things such as moving, renaming or deleting directories. The crucial operation here when we talk about supporting large scale analytics engines, such as Apache Spark, is renaming. These large scale analytics frameworks are used in a lot of big data processing and are an important use case for Azure Data Lake. Because Azure Data Lakes supports real directory-like file management, it enables us to atomically rename files. In Azure Blob Storage, when…