Problem
DDL fails to load metadata. Planner log shows an error similar to
AnalysisException: Failed to load metadata for table: DB.TB\nCAUSED BY: TableLoadingException: Failed to load metadata for table: DB.TB\nCAUSED BY: AnalysisException: Comment of column 'COLUMN' exceeds maximum length of 256 characters
Answer
Prior to version Okera 2.1.x had a 256 character limit for columns set in HMS. But not this limit can be toggled with a setting that can disable to soft limit.
- Check the cerebro-planner deployment, YAML configuration details and confirm the following setting is not set to "false". If so, you can either remove the entry or explicitly set to "true" and allow the clustered update and pod restarts so HMS can not process the 256 character column limit.
HMS_REMOVE_LENGTH_RESTRICTION=false
- Specifically this removes the 256 character limitation.
Comments
0 comments
Please sign in to leave a comment.