XXL-JOB研究

一、背景说明

XXL-JOB 是一个分布式任务调度平台，作为IT运维我不懂JAVA，不会开发，只想把XXL-JOB当成一个crontab 网络版，应该怎么做呢
本文记录了，从IT运维角度，部属XXL-JOB的一些折腾记录

二、部署

生产环境不建议使用docker部属，配置文件不好修改，特别是客户端秘钥，
环境变量方式修改不了！
环境变量方式修改不了！！
环境变量方式修改不了！！！

2.1 docker部署

version: '3.8'
services:
  admin:
    image: xuxueli/xxl-job-admin:2.4.1
    restart: always
    hostname: admin
    container_name: xxl_job
    ports:
      - "8008:8080"
    volumes:
      - "./tmp:/data/applogs"
    environment:
      SPRING_DATASOURCE_URL: "jdbc:mysql://数据库IP:30974/xxl_job?useUnicode=true&characterEncoding=UTF-8&autoReconnect=true&serverTimezone=Asia/Shanghai"
      SPRING_DATASOURCE_USERNAME: "root"
      SPRING_DATASOURCE_PASSWORD: "密码"

2.2 修改数据库

执行sql文件即可

2.3 登陆前台

http://IP地址:8008/xxl-job-admin ，后缀一定要加

默认账户admin，密码123456

三、部署执行器

3.1 在linux中安装执行器

安装java环境

sudo yum install java-11-openjdk-devel -y
yum install maven -y

加速 maven

  <mirrors>

    <!-- mirror
     | Specifies a repository mirror site to use instead of a given repository. The repository that
     | this mirror serves has an ID that matches the mirrorOf element of this mirror. IDs are used
     | for inheritance and direct lookup purposes, and must be unique across the set of mirrors.
     |
    <mirror>
      <id>mirrorId</id>
      <mirrorOf>repositoryId</mirrorOf>
      <name>Human Readable Name for this Mirror.</name>
      <url>http://my.repository.com/repo/path</url>
    </mirror>
     -->
    <mirror>
      <id>nexus-aliyun</id>
      <mirrorOf>central</mirrorOf>
      <name>Nexus aliyun</name>
      <url>http://maven.aliyun.com/nexus/content/groups/public</url>
    </mirror>
  </mirrors>
    
    
    

3.2 克隆github项目

git clone https://github.com/xuxueli/xxl-job.git
进入执行器目录

3.3 修改执行器(客户端)配置文件

vi src/main/resources/application.properties

# web port
server.port=8081
# no web
#spring.main.web-environment=false

# log config
logging.config=classpath:logback.xml

### xxl-job admin address list, such as "http://address" or "http://address01,http://address02"
xxl.job.admin.addresses=http://服务端IP:8008/xxl-job-admin

### xxl-job, access token-docker部署的话一定要写这个,环境变量方式修改不了
xxl.job.accessToken=default_token

### xxl-job executor appname
xxl.job.executor.appname=xxl-job-executor-sample
### xxl-job executor registry-address: default use address to registry , otherwise use ip:port if address is null
xxl.job.executor.address=
### xxl-job executor server-info
xxl.job.executor.ip=
xxl.job.executor.port=9999
### xxl-job executor log-path
xxl.job.executor.logpath=
### xxl-job executor log-retention-days
xxl.job.executor.logretentiondays=30

3.4 打包为jar包

#进入到执行器目录执行，速度慢的话设置镜像
mvn clean package

3.5 运行jar包

3.5.1 linux 客户端 运行

java -jar target/xxl-job-executor-sample-springboot-2.4.1.jar

正常运行的日志

13:35:46.915 logback [Thread-4] INFO  com.xxl.job.core.server.EmbedServer - >>>>>>>>>>> xxl-job remoting server start success, nettype = class com.xxl.job.core.server.EmbedServer, port = 9999

3.5.2 windows 客户端运行

直接把jar包拷贝到windows运行,windows需要安装java环境，我这里直接拷了个JRE的绿色包也能运行

3.5.3 控制台比对

token不对的日志，docker部署就会遇到这个问题，环境变量改不了token

12:28:15.222 logback [xxl-job, executor ExecutorRegistryThread] INFO  c.x.j.c.t.ExecutorRegistryThread - >>>>>>>>>>> xxl-job registry fail, registryParam:RegistryParam{registryGroup='EXECUTOR', registryKey='xxl-job-executor-sample', registryValue='http://IP地址:9999/'}, registryResult:ReturnT [code=500, msg=The access token is wrong., content=null]

四、创建任务

4.1 创建任务

4.2 编辑脚本

#!/bin/bash

# 获取本机 IP 地址
IP_ADDRESS=$(hostname -I)

echo "xxl-job: hello shell"
echo "IP 地址：$IP_ADDRESS"

echo "脚本位置：$0"
echo "任务参数：$1"
echo "分片序号 = $2"
echo "分片总数 = $3"

echo "Good bye!"
ifconfig > 123.txt
exit 0

4.3 客户端确认

验证txt的路径可得
客户端的当前目录是jar包，所在的目录

/docker/xxl-job/xxl-job-executor-samples/xxl-job-executor-sample-springboot/123.txt

客户端的日志位于

cd /data/applogs/xxl-job/jobhandler

客户端脚本位于

[root@ks9p-yum-source01 jobhandler]# ls /data/applogs/xxl-job/jobhandler/gluesource/
2_1718085164000.sh

五、将执行器注册为服务

5.1 编写服务文件

sudo nano /etc/systemd/system/xxl-job-executor.service

填入内容

[Unit]
Description=XXL-JOB Executor
After=syslog.target network.target

[Service]
Type=simple
WorkingDirectory=/docker/xxl-job/xxl-job-executor-samples/xxl-job-executor-sample-springboot
ExecStart=/usr/bin/java -jar target/xxl-job-executor-sample-springboot-2.4.1.jar
Restart=always
StandardOutput=syslog
StandardError=syslog

[Install]
WantedBy=multi-user.target

5.2 启动服务

sudo systemctl daemon-reload
sudo systemctl start xxl-job-executor
sudo systemctl enable xxl-job-executor
sudo systemctl status xxl-job-executor

5.3 windows 注册为服务参考

将exe程序注册为windows服务方法总结_exe注册成服务

https://www.xiaoweigod.com/pc/1638.html