Article January 23, 2024

env_hyperv

Words count 6k Reading time 5 mins.

与虚拟机完全通过xshell/moba等工具交互 Linux mint jdk8 hdfs3.3.4 spark3.1.3 thrift 0.20 不需要任何header 环境变量可选写入... Read article

Article January 23, 2024

env_hyperv

Words count 6k Reading time 5 mins.

与虚拟机完全通过xshell/moba等工具交互 Linux mint jdk8 hdfs3.3.4 spark3.1.3 thrift 0.20 不需要任何header 环境变量可选写入/etc/profile或者~/.profile hadoop伪分布配置https://hadoop.apache.org/docs/r3.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html etc/hado... Read article

Article January 23, 2024

work

Words count 36 Reading time 1 mins.

业务挤压时间,忙于应付各种突如其来的需要,无暇优化、做细 Read article

Article January 23, 2024

seatunnel

Words count 37k Reading time 33 mins.

install123export version="2.3.3"wget "https://archive.apache.org/dist/incubator/seatunnel/${version}/apache-seatunnel-incubating-${version}-bin.tar.gz"tar -xzvf "apache-seatunnel-incubating-${version&... Read article

Article January 23, 2024

wsl

Words count 4.5k Reading time 4 mins.

InitEnv安装12wsl --list --onlinewsl --install Ubuntu-22.04 通过迁移 更改WSL存储目录12345678wsl -l --all -vwsl --shutdownwsl --export Ubuntu E:\runtime\wsl-ubuntu.tarwsl --unregister Ubuntuwsl --import Ubuntu E:\runtime\wsl-ubuntu\ E:\runtime\wsl-ubuntu.tar --ver... Read article

Article January 23, 2024

ozone

Words count 687 Reading time 1 mins.

Ozone/HDDShttps://ozone.apache.org/docs/1.2.1/index.html 分布式存储 兼容S3对象存储API兼容HDFS使用RAFT协议 概念:Ozone consists of volumes, buckets, and keys.namespace: Volumes are similar to user accounts. used to store buckets. Only administrators can create or de... Read article

Article January 23, 2024

airflow

Words count 77 Reading time 1 mins.

语言:Python特色:Workflows as code 上述两点结合,可以有动态流程 UI比较复杂 Read article

Article January 23, 2024

readme

Words count 233 Reading time 1 mins.

参数$[yyyyMMdd-1] 日期不允许参数将年月日拆分并t-1时只对天-1,必须对年月日都进行-1操作 会出现跨月时出错。20230401执行20230431 Read article

Article January 23, 2024

metaTables

Words count 5.3k Reading time 5 mins.

各表各字段https://dolphinscheduler.apache.org/zh-cn/docs/latest/user_doc/metadata-1.3.html 数据库 dolphinscheduler 表名 表信息t_ds_access_token 访问ds后端的tokent_ds_alert 告警信息t_ds_alertgroup 告警组t_ds_command 执行命令t_ds_datasource 数据源t_ds_error_command 错误命令t_ds_process_d... Read article

Article January 23, 2024

AlertServer

Words count 1k Reading time 1 mins.

启动new SpringApplicationBuilder(AlertServer.class).run(args); Spring 是用于创建企业应用的流行 Java 应用框架。Spring Boot 是 Spring 框架的演进,可帮助您轻松创建独立的,生产级的基于 Spring 的应用。SpringApplication是一个类,用于从 Java main 方法引导 Spring 应用。 AlertSenderServiceNettyRemotingServerFactory.build... Read article

Article January 23, 2024

prometheus

Words count 2.4k Reading time 2 mins.

Prometheus collects and stores its metrics as time series data Components Prometheus server: scrapes and stores time series data 单文件 alertmanager exporter https://www.prometheus.wang/exporter/what-is-prometheus-exporter.html node_exporter Grafana, fo... Read article
Load more
0%