当前位置: 首页 > news >正文

dolphinscheduler创建文件夹显示存储未启用的问题--已解决

只要修改api-server/comf/common.properties和standalone-server/conf/common.properties里面的内容就可以了,应为你要靠standalone-server这个服务启动dolphinscheduler-web,其他就算怎么改你重启dolphinscheduler的时候系统也不会识别新的common.properties导致修改之后没反应

因为dolphinscheduler的储存在 /dolphinscheduler ,所以创建一个文件夹,指定权限和权限组
创建一个文件夹
指定权限指定用户组

mkdir /dolphinscheduler
chmod 777 /dolphinscheduler
chown dolphinscheduler:dolphinscheduler /dolphinscheduler

api-server/comf/common.properties和standalone-server/conf/common.properties文件的修改内容如下:
修改配置文件

vim standalone-server/conf/common.properties
vim api-server/comf/common.properties

修改的内容

data.basedir.path=/tmp/dolphinscheduler
resource.storage.type=HDFS
resource.storage.upload.base.path=/dolphinscheduler
resource.hdfs.fs.defaultFS=file:///

原文件内容

#
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements.  See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License.  You may obtain a copy of the License at
#
#     http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#

# user data local directory path, please make sure the directory exists and have read write permissions
data.basedir.path=/tmp/dolphinscheduler

# resource view suffixs
#resource.view.suffixs=txt,log,sh,bat,conf,cfg,py,java,sql,xml,hql,properties,json,yml,yaml,ini,js

# resource storage type: HDFS, S3, OSS, NONE
resource.storage.type=HDFS
# resource store on HDFS/S3 path, resource file will store to this base path, self configuration, please make sure the directory exists on hdfs and have read write permissions. "/dolphinscheduler" is recommended
resource.storage.upload.base.path=/dolphinscheduler

# The AWS access key. if resource.storage.type=S3 or use EMR-Task, This configuration is required
resource.aws.access.key.id=minioadmin
# The AWS secret access key. if resource.storage.type=S3 or use EMR-Task, This configuration is required
resource.aws.secret.access.key=minioadmin
# The AWS Region to use. if resource.storage.type=S3 or use EMR-Task, This configuration is required
resource.aws.region=cn-north-1
# The name of the bucket. You need to create them by yourself. Otherwise, the system cannot start. All buckets in Amazon S3 share a single namespace; ensure the bucket is given a unique name.
resource.aws.s3.bucket.name=dolphinscheduler
# You need to set this parameter when private cloud s3. If S3 uses public cloud, you only need to set resource.aws.region or set to the endpoint of a public cloud such as S3.cn-north-1.amazonaws.com.cn
resource.aws.s3.endpoint=http://localhost:9000

# alibaba cloud access key id, required if you set resource.storage.type=OSS
resource.alibaba.cloud.access.key.id=<your-access-key-id>
# alibaba cloud access key secret, required if you set resource.storage.type=OSS
resource.alibaba.cloud.access.key.secret=<your-access-key-secret>
# alibaba cloud region, required if you set resource.storage.type=OSS
resource.alibaba.cloud.region=cn-hangzhou
# oss bucket name, required if you set resource.storage.type=OSS
resource.alibaba.cloud.oss.bucket.name=dolphinscheduler
# oss bucket endpoint, required if you set resource.storage.type=OSS
resource.alibaba.cloud.oss.endpoint=https://oss-cn-hangzhou.aliyuncs.com

# if resource.storage.type=HDFS, the user must have the permission to create directories under the HDFS root path
resource.hdfs.root.user=hdfs
# if resource.storage.type=S3, the value like: s3a://dolphinscheduler; if resource.storage.type=HDFS and namenode HA is enabled, you need to copy core-site.xml and hdfs-site.xml to conf dir
resource.hdfs.fs.defaultFS=file:///

# whether to startup kerberos
hadoop.security.authentication.startup.state=false

# java.security.krb5.conf path
java.security.krb5.conf.path=/opt/krb5.conf

# login user from keytab username
login.user.keytab.username=hdfs-mycluster@ESZ.COM

# login user from keytab path
login.user.keytab.path=/opt/hdfs.headless.keytab

# kerberos expire time, the unit is hour
kerberos.expire.time=2


# resourcemanager port, the default value is 8088 if not specified
resource.manager.httpaddress.port=8088
# if resourcemanager HA is enabled, please set the HA IPs; if resourcemanager is single, keep this value empty
yarn.resourcemanager.ha.rm.ids=192.168.xx.xx,192.168.xx.xx
# if resourcemanager HA is enabled or not use resourcemanager, please keep the default value; If resourcemanager is single, you only need to replace ds1 to actual resourcemanager hostname
yarn.application.status.address=http://ds1:%s/ws/v1/cluster/apps/%s
# job history status url when application number threshold is reached(default 10000, maybe it was set to 1000)
yarn.job.history.status.address=http://ds1:19888/ws/v1/history/mapreduce/jobs/%s

# datasource encryption enable
datasource.encryption.enable=false

# datasource encryption salt
datasource.encryption.salt=!@#$%^&*

# data quality option
data-quality.jar.name=dolphinscheduler-data-quality-dev-SNAPSHOT.jar

#data-quality.error.output.path=/tmp/data-quality-error-data

# Network IP gets priority, default inner outer

# Whether hive SQL is executed in the same session
support.hive.oneSession=false

# use sudo or not, if set true, executing user is tenant user and deploy user needs sudo permissions; if set false, executing user is the deploy user and doesn't need sudo permissions
sudo.enable=true
setTaskDirToTenant.enable=false

# network interface preferred like eth0, default: empty
#dolphin.scheduler.network.interface.preferred=

# network IP gets priority, default: inner outer
#dolphin.scheduler.network.priority.strategy=default

# system env path
#dolphinscheduler.env.path=dolphinscheduler_env.sh

# development state
development.state=false

# rpc port
alert.rpc.port=50052

# set path of conda.sh
conda.path=/opt/anaconda3/etc/profile.d/conda.sh

# Task resource limit state
task.resource.limit.state=false

# mlflow task plugin preset repository
ml.mlflow.preset_repository=https://github.com/apache/dolphinscheduler-mlflow
# mlflow task plugin preset repository version
ml.mlflow.preset_repository_version="main"


文章转载自:

http://ztW4tDOA.tgyzk.cn
http://CtEe6LeO.tgyzk.cn
http://asc4CL0e.tgyzk.cn
http://aCcnQnMo.tgyzk.cn
http://jaM1oNX1.tgyzk.cn
http://cVKux43x.tgyzk.cn
http://fmhvx91M.tgyzk.cn
http://El61ecvo.tgyzk.cn
http://TBrX0S1c.tgyzk.cn
http://Jy1Tea5D.tgyzk.cn
http://pRWLSQAv.tgyzk.cn
http://yxqtlm82.tgyzk.cn
http://T3h20YP3.tgyzk.cn
http://Y5j1V4kC.tgyzk.cn
http://q4NdAmca.tgyzk.cn
http://7PjI46HY.tgyzk.cn
http://XSUJMNQv.tgyzk.cn
http://pYqdciWt.tgyzk.cn
http://mJIuoqet.tgyzk.cn
http://fOq34qTy.tgyzk.cn
http://BV5z6Oq9.tgyzk.cn
http://Y69yZND6.tgyzk.cn
http://ETuRmjQQ.tgyzk.cn
http://dH8Gv47x.tgyzk.cn
http://QRjj1ylz.tgyzk.cn
http://WekMIjbK.tgyzk.cn
http://CMr3EXdo.tgyzk.cn
http://PxQ5Ccpq.tgyzk.cn
http://1WpBY0H9.tgyzk.cn
http://XyXwW51k.tgyzk.cn
http://www.dtcms.com/a/128370.html

相关文章:

  • Windows for Redis 后台服务运行
  • 驱动学习专栏--写在前面
  • MyBatis-plus 快速入门
  • Mouse without Borders – 用一套鼠标 / 键盘控制四台电脑
  • trae 中设置 python flake8
  • Java中的Map vs Python字典:核心对比与使用指南
  • 【力扣hot100题】(091)最小路径和
  • Python正则表达式实战技巧:如何高效处理文本匹配?
  • [redis进阶一]redis的持久化(1)RDB篇章
  • Python | 第十七章 | pyecharts开发图表 | 折线图 | 地图 | 轮播图
  • ESP32S3 TCP直接通信实战指南
  • Linux网络编程——详解网络层IP协议、网段划分、路由
  • 事务隔离级别和MVCC
  • Python生成exe
  • 记录一次因ASM磁盘组空间不足,导致MAP进程无法启动
  • 通过课程学习大幅提高LLM强化学习效率
  • 《实战AI智能体》——AI自动化如何赋能Outbound Email
  • 关于读完《毛泽东选集》的一些思考迭代
  • Linux基础7
  • 第十二章:FreeRTOS多任务创建与删除
  • SEO长尾词深度优化策略
  • 体验智能体构建过程:从零开始构建Agent
  • 实信号的傅里叶变换为何属于埃尔米特函数?从数学原理到 MATLAB 动态演示
  • 1 程序的本质,计算机语言简史,TIOBE 指数,C 语言的独特魅力、发展历程、发行版本和应用场景
  • 第二篇:Python函数与模块化编程深度教程
  • bitsandbytes 报错心得
  • 解析 WebSocket 协议的基本原理
  • PostgreSQL全平台安装指南:从入门到生产环境部署
  • Redis常用数据结构和应用场景
  • spring 服务调用中 RestTemplate vs OpenFeign 对比详解