Hi I have a process which generates parquet files daily at a specific path in a hive partition format. I don't want to change this setup. I just want to start monitoring the base of my hive database ...

Let's add the option to partition vertically: e.g. file1 and file2 col names are different file1 and file2 have same number of rowgroups rowgroups with matching index, match num rows (whatever ...