kudu安装部署异常记录

kudu安装部署异常记录

init kudu failed the cpu on this system does not support sse4.2

判断主机/虚拟机是否支持 sse4_2 指令集：

1

grep -q sse4_2 /proc/cpuinfo && echo "SSE 4.2 supported" || echo "SSE 4.2 not supported“"

由于物理主机的CPU是支持该指令集的，所以只需要修改虚拟机的主机模式

Unable to init master catalog manager

1
2
3

E0120 17:24:11.348664 17140 master.cc:283] Unable to init master catalog manager: Not found: Unable to initialize catalog manager: Failed to initial000000000000000: Unable to load consensus metadata for tablet 00000000000000000000000000000000: /.../base-kudu/data/master/wal/con
E0120 17:24:11.361861 17058 master_main.cc:40] Not found: RunMasterServer() failed: Unable to initialize catalog manager: Failed to initialize sys t000000: Unable to load consensus metadata for tablet 00000000000000000000000000000000: /.../base-kudu/data/master/wal/consensus-me
Dumping heap profile to /.../base-kudu/data/master/heap.0001.heap (Exiting, 402 kB in use)

第一次启动因为其他异常启动失败，因为是初始安装，所以直接删除 /…/base-kudu/data/master/ 下所有的文件

1
2
3
4

rm -rf /var/lib/kudu/master/wal/* 
rm -rf /var/lib/kudu/master/data/* 
rm -rf /var/lib/kudu/tserver/wal/* 
rm -rf /var/lib/kudu/tserver/data/*

unable to find SASL plugin: PLAIN

E0120 17:30:40.908908 21053 master.cc:283] Unable to init master catalog manager: Timed out: Unable to initialize catalog manager: Failed to initiale UUID for peer member_type: VOTER last_known_addr { host: “ilop-tingyun-kudu-01” port: 7051 }: Getting permanent uuid from ilop-tingyun-kudu-01:705 client connection to 100.90.21.29:7051: unable to find SASL plugin: PLAIN
E0120 17:30:40.923074 20970 master_main.cc:40] Timed out: RunMasterServer() failed: Unable to initialize catalog manager: Failed to initialize sys tr peer member_type: VOTER last_known_addr { host: “ilop-tingyun-kudu-01” port: 7051 }: Getting permanent uuid from ilop-tingyun-kudu-01:7051 timed oonnection to 100.90.21.29:7051: unable to find SASL plugin: PLAIN
Dumping heap profile to /…/base-kudu/data/master/heap.0001.heap (Exiting, 660 kB in use)

1
2
3
4
5

rpm -qa gcc

yum install gcc python-devel
 
yum install cyrus-sasl*

Cannot initialize clock

1

tablet_server_main.cc:38 Check failed: _s.ok() Bad status: Service unavailable: Cannot initialize clock: Cannot initialize HybridClock. Clock synchronized but error was too high (11711000 us).

Kudu server 之前要求NTP同步时钟的最大时钟误差（不要与估计的错误相混淆）不低于阈值 max_clock_sync_error_usec（10s）；

number of columns 301 is greater than the permitted maxinum 300(Kudu 列数过多)

解决方案：

1. 增大列数限制参数，需要修改以下配置:

   --max_num_columns=600
   --unlock_unsafe_flags=true #不安全参数选项

2. 或者在应用层面想其他办法，比如扩展多表，然后join合并