「 Article 」
January 23, 2024
Words count
6k
Reading time
5 mins.
与虚拟机完全通过xshell/moba等工具交互 Linux mint jdk8 hdfs3.3.4 spark3.1.3 thrift 0.20 不需要任何header 环境变量可选写入/etc/profile或者~/.profile hadoop伪分布配置https://hadoop.apache.org/docs/r3.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html etc/hado...
Read article
「 Article 」
January 23, 2024
Words count
37k
Reading time
33 mins.
install123export version="2.3.3"wget "https://archive.apache.org/dist/incubator/seatunnel/${version}/apache-seatunnel-incubating-${version}-bin.tar.gz"tar -xzvf "apache-seatunnel-incubating-${version&...
Read article
「 Article 」
January 23, 2024
Words count
4.5k
Reading time
4 mins.
InitEnv安装12wsl --list --onlinewsl --install Ubuntu-22.04 通过迁移 更改WSL存储目录12345678wsl -l --all -vwsl --shutdownwsl --export Ubuntu E:\runtime\wsl-ubuntu.tarwsl --unregister Ubuntuwsl --import Ubuntu E:\runtime\wsl-ubuntu\ E:\runtime\wsl-ubuntu.tar --ver...
Read article
「 Article 」
January 23, 2024
Words count
687
Reading time
1 mins.
Ozone/HDDShttps://ozone.apache.org/docs/1.2.1/index.html 分布式存储 兼容S3对象存储API兼容HDFS使用RAFT协议 概念：Ozone consists of volumes, buckets, and keys.namespace: Volumes are similar to user accounts. used to store buckets. Only administrators can create or de...
Read article
「 Article 」
January 23, 2024
Words count
77
Reading time
1 mins.
语言：Python特色：Workflows as code 上述两点结合，可以有动态流程 UI比较复杂
Read article
「 Article 」
January 23, 2024
Words count
233
Reading time
1 mins.
参数$[yyyyMMdd-1] 日期不允许参数将年月日拆分并t-1时只对天-1，必须对年月日都进行-1操作 会出现跨月时出错。20230401执行20230431
Read article
「 Article 」
January 23, 2024
Words count
5.3k
Reading time
5 mins.
各表各字段https://dolphinscheduler.apache.org/zh-cn/docs/latest/user_doc/metadata-1.3.html 数据库 dolphinscheduler 表名 表信息t_ds_access_token 访问ds后端的tokent_ds_alert 告警信息t_ds_alertgroup 告警组t_ds_command 执行命令t_ds_datasource 数据源t_ds_error_command 错误命令t_ds_process_d...
Read article
「 Article 」
January 23, 2024
Words count
1k
Reading time
1 mins.
启动new SpringApplicationBuilder(AlertServer.class).run(args); Spring 是用于创建企业应用的流行 Java 应用框架。Spring Boot 是 Spring 框架的演进，可帮助您轻松创建独立的，生产级的基于 Spring 的应用。SpringApplication是一个类，用于从 Java main 方法引导 Spring 应用。 AlertSenderServiceNettyRemotingServerFactory.build...
Read article
「 Article 」
January 23, 2024
Words count
2.4k
Reading time
2 mins.
Prometheus collects and stores its metrics as time series data Components Prometheus server: scrapes and stores time series data 单文件 alertmanager exporter https://www.prometheus.wang/exporter/what-is-prometheus-exporter.html node_exporter Grafana, fo...
Read article
