MySQL保存Spark实时写入Phoenix的异常数据

写失败的数据存在数据库中,用作错误分析和数据恢复

  1. 建mysql表

    create table error_log(
    id int NOT NULL AUTO_INCREMENT comment '主键',
    user varchar(32) comment '用户',
    data varchar(128) comment '数据内容',
    cause varchar(256) comment '报错原因',
    recover int comment '是否恢复',
    date varchar(32) comment '时间',
    PRIMARY KEY ( `id` )
    )
  2. 查看结果

    统计异常数据

Author: Tunan
Link: http://yerias.github.io/2020/12/09/spark/40/
Copyright Notice: All articles in this blog are licensed under CC BY-NC-SA 4.0 unless stating additionally.