Easysearch VS Opensearch 数据写入与存储性能对比

本文记录 Easysearch 和 Opensearch 数据写入和数据存储方面的性能对比。

准备

1. 压测工具：INFINI Loadgen

2. 对比版本：

• Easysearch 1.11.1（lucene 8.11.4）
• Opensearch 2.19.1（lucene 9.12.1）

3. 节点 JVM 配置：1G

数据写入

压测命令：

./loadgen-linux-amd64 -c 20 -d 300

Opensearch

PUT infinilabs
{
  "settings": {
    "number_of_shards": "1",
    "number_of_replicas": 0,
    "index.refresh_interval": "120s",
    "translog": {
      "durability": "async",
      "sync_interval": "120s"
    }
  }
}

Easysearch

PUT infinilabs
{
  "settings": {
    "number_of_shards": "1",
    "number_of_replicas": 0,
    "index.refresh_interval": "120s",
    "translog": {
      "durability": "async",
      "sync_interval": "120s"
    }
  }
}

数据存储

压测命令：

./loadgen-linux-amd64 -c 20 -d 600 -l 10000

Opensearch: zstd 压缩

PUT infinilabs
{
  "settings": {
    "number_of_shards": "1",
    "number_of_replicas": 0,
    "index.refresh_interval": "120s",
    "translog": {
      "durability": "async",
      "sync_interval": "120s"
    },
    "index.codec": "zstd"
  }
}

Easysearch: zstd + source_reuse 压缩

PUT infinilabs
{
  "settings": {
    "number_of_shards": "1",
    "number_of_replicas": 0,
    "index.refresh_interval": "120s",
    "translog": {
      "durability": "async",
      "sync_interval": "120s"
    },
    "index.codec": "ZSTD",
    "index.source_reuse": "true"
  }
}

结论

1. 数据写入方面，Easysearch（lucene 8.x） 和 Opensearch（lucene 9.x）基本持平；
2. 数据存储方面，相同数据量经过 Easysearch 和 Opensearch 的压缩后，Easysearch 占用的空间明显少于 Opensearch，并且数据量越大越明显。