当前位置: 首页 > news >正文

kubernetes部署3节点高可用elasticsearch v8.14.3

1 概述

一个yaml部署3节点的elasticsearch v8.14.3,修改storageclass名称后就能直接用。

2 环境准备

2.1 在华为云准备一个kubernetes集群

在这里插入图片描述

2.2 在华为云准备一个NAS作为PV底层存储

在这里插入图片描述
必须是NAS存储,不能是块存储,因为后续多个跨不同节点的pod会同时挂载到同一个PV。

2.3 创建kubernetes存储类

k8s storageclass的yaml如下,提交到k8s中即可,这个sc的名称叫做nfs,这个sc的名称叫做nfs,这个sc的名称叫做nfs,重要的事情重复三遍,这个名称会被后续的elasticsearch yaml引用。

apiVersion: storage.k8s.io/v1
allowVolumeExpansion: true
kind: StorageClass
metadata:name: nfs
mountOptions:
- lock
parameters:csi.storage.k8s.io/csi-driver-name: sfsturbo.csi.everest.iocsi.storage.k8s.io/fstype: nfseverest.io/archive-on-delete: "true"everest.io/share-access-to: fc1f5584-4423-4************   # VPC IDeverest.io/share-expand-type: bandwidtheverest.io/share-export-location: b134a******.sfsturbo.internal:/mydir   # sfs turbo实例的共享路径:自定义子目录everest.io/share-source: sfs-turboeverest.io/share-volume-type: STANDARDeverest.io/volume-as: subpatheverest.io/volume-id: b134a******   # sfs turbo实例的ID
provisioner: everest-csi-provisioner
reclaimPolicy: Retain
volumeBindingMode: Immediate

3 部署ES

elasticsearch的yaml如下,提交到k8s中即可:

apiVersion: apps/v1
kind: StatefulSet
metadata:name: elasticsearch
spec:serviceName: elasticsearchpodManagementPolicy: Parallelreplicas: 3selector:matchLabels:app: elasticsearchtemplate:metadata:labels:app: elasticsearchspec:initContainers:- name: configure-sysctlimage: swr.cn-south-1.myhuaweicloud.com/migrator/busybox:1.36command: ["sysctl", "-w", "vm.max_map_count=262144"]securityContext:privileged: truecontainers:- name: elasticsearchimage: swr.cn-south-1.myhuaweicloud.com/migrator/elasticsearch:8.14.3resources:limits:cpu: "4"memory: "8Gi"requests:cpu: "0.5"memory: "1Gi"ports:- containerPort: 9200name: http- containerPort: 9300name: transportenv:- name: ES_JAVA_OPTSvalue: "-Xms2g -Xmx2g"volumeMounts:- name: elasticsearch-datamountPath: /usr/share/elasticsearch/data- name: configmountPath: /usr/share/elasticsearch/config/elasticsearch.ymlsubPath: elasticsearch.yml- name: elasticsearch-logsmountPath: /usr/share/elasticsearch/logslivenessProbe:httpGet:path: /_cluster/health?local=trueport: 9200scheme: HTTPhttpHeaders:- name: Authorizationvalue: "Basic ZWxhc3RpYzpkaWZ5YWkxMjM0NTY="initialDelaySeconds: 30timeoutSeconds: 5periodSeconds: 30successThreshold: 1failureThreshold: 3readinessProbe:httpGet:path: /_cluster/health?local=trueport: 9200scheme: HTTPhttpHeaders:- name: Authorizationvalue: "Basic ZWxhc3RpYzpkaWZ5YWkxMjM0NTY="initialDelaySeconds: 30timeoutSeconds: 5periodSeconds: 30successThreshold: 1failureThreshold: 3volumes:- name: configconfigMap:name: elasticsearch-configvolumeClaimTemplates:- metadata:name: elasticsearch-datalabels:app: elasticsearchspec:accessModes: [ "ReadWriteOnce" ]storageClassName: nfsresources:requests:storage: 50Gi- metadata:name: elasticsearch-logslabels:app: elasticsearchspec:accessModes: [ "ReadWriteOnce" ]storageClassName: nfsresources:requests:storage: 4Gi---
apiVersion: v1
kind: Service
metadata:name: elasticsearchlabels:app: elasticsearch
spec:ports:- port: 9200name: http- port: 9300name: transportclusterIP: None selector:app: elasticsearch
---apiVersion: v1
kind: ConfigMap
metadata:name: elasticsearch-config
data:elasticsearch.yml: |cluster.name: es-clusternode.name: ${HOSTNAME}network.host: 0.0.0.0discovery.seed_hosts: ["elasticsearch-0.elasticsearch", "elasticsearch-1.elasticsearch", "elasticsearch-2.elasticsearch"]cluster.initial_master_nodes: ["elasticsearch-0", "elasticsearch-1", "elasticsearch-2"]xpack.security.enrollment.enabled: truexpack.security.http.ssl.enabled: falsebootstrap.memory_lock: falseindices.memory.index_buffer_size: 10%indices.queries.cache.size: 5%action.destructive_requires_name: truexpack.security.transport.ssl.enabled: falsexpack.security.enabled: falsenode.roles: ["master", "data", "ingest"]

部署结果如下:
在这里插入图片描述

相关文章:

  • 【数学基础】复杂度理论
  • Python异步编程深度解析
  • 基于Spring Boot的网上购物平台设计与实现
  • AD22以上的基础操作
  • C++算法学习专题:双指针
  • 编译安装交叉工具链 riscv-gnu-toolchain
  • RGB+EVS视觉融合相机:事件相机的革命性突破​
  • 微机系统 第九章 人机接口 (包含了第四章的题)
  • MCPA2APPT:基于 A2A+MCP+ADK 的多智能体流式并发高质量 PPT 智能生成系统
  • 《自动控制原理 》- 第 1 章 自动控制的基本原理与方式
  • 分布式电源采集控制装置:江苏光伏电站的“智能调度中枢
  • java nio 所有影响 plc 的方法一览表
  • TCP 和 UDP 是什么?
  • 计算机操作系统(十七)内存管理
  • 暑假复习篇之运算与逻辑
  • 【软考--软件设计师】11 关系型数据库
  • lambda、function基础/响应式编程基础
  • 路由器对不同数据帧的处理
  • 一分钟了解思路链提示词(Chain-of-thought Prompting)
  • 【软考高项论文】论信息系统项目的成本管理