2

I am using Hive and Impala on the same cluster. I find that when I create new tables, the Impala StateStore does not refresh automatically even after a few hours.

I know that I can accomplish this by running "refresh" in impala-shell (in a cron job if need be), but I would like to know: how often does impalad refresh metadata and can I set this interval to be shorter? If so, how?

John Chilton
  • 21
  • 3

1 Answers1

1

It is my understanding that impala does not automatically refresh the metadata. If you create new tables etc through impala (1.2 and higher) it will update the other impala nodes, however if you create new tables etc in hive you will have to manually refresh the impala metadata.

You can manually refresh the metadata on either a table basis with 'REFRESH table_name' or you can do this for all tables with 'INVALIDATE METADATA'. Also, note that if you update the files on HDFS you will have to refresh the table to pickup the new data as well.

zarthross
  • 111
  • 1