Wednesday, January 30, 2019

HDFS Offline Analysis of FsImage Metadata

Overview

HDFS, which is a part of Hadoop, has a command to download a current namenode snapshot. We can load image via Spark or perform data ingestion on it to get it into Hive to analyze the data and verify how it uses HDFS.

The HDFS file system metadata is stored in a file called 'FsImage.' Contained in this snapshot we have:



from DZone.com Feed http://bit.ly/2ShpnQU

No comments:

Post a Comment