存储性能委员会(SPC)
Benchmarks | Storage Performance Council
一、SPC
核心测试标准体系
测试标准 | 核心目标 | 适用场景 | 关键性能指标 |
---|---|---|---|
SPC-1 | 随机I/O负载性能 | OLTP、数据库、邮件服务器(高并发随机读写) | IOPS、响应时间、ORT |
SPC-2 | 大块顺序I/O吞吐性能 | 科学计算、视频点播(VOD)、大数据分析(连续数据流) | 吞吐量(MB/s)、响应时间 |
SPC-3 | 混合负载与备份恢复性能 | 文件系统备份、云存储、软件定义存储(SDS) | 带宽、恢复时间 |
SPC-1C/2C | 组件级性能(如SSD、HBA) | 单设备或小型子系统评估(如SPC-1C针对SSD可持续性能) | IOPS、延迟、成本效能比 |
SPC SPECIFICATIONS
SPC BENCHMARK 1 (SPC-1) SPECIFICATION
The SPC-1 version 3, retains the core capabilities and requirements of SPC-1 version 1, but includes support for data deduplication, and data compression, in addition to refining some of the workload attributes to bring the benchmark more in-line with modern storage system workloads. To assure a smooth transition to the new implementation of the SPC-1 workload, Test Sponsors are allowed to publish against either the version 1 or version 3 specification for the time being, though version 1 results are not comparable to version 3 results.
The current and previous versions of the SPC-1 specification, which includes the SPC-1/E Energy Extension, are listed below. The "Effective Date" designates the date on which a given specifcaiton revision replaces its predecessor. Benchmark results may be released to be compliant with a version of the specification that has an "Effective Date" in the future.
Questions and comments concerning the specification may be sent to the SPC Administrator.
Version (effective date) | Description/Comments | Format |
---|---|---|
v3.10(01 January 2021) | A minor revision to clarify Physical Free Space. | PDF (1.84 MB) |
v3.9(27 May 2020) |
| PDF (1.82 MB) |
v3.8(28 October 2018) | Official release. Recent changes:
| PDF (1.55 MB) |
v3.8(27 August 2018) | Identical to the official 3.8 release, but with change bars relative to v3.7. | PDF (1.58 MB) |
v3.7(22 July 2018) | See "Document History" for a list of revisions. | PDF (1.55 MB) |
v3.6(15 February 2018) | See "Document History" for a list of revisions | PDF (1.55 MB) |
v1.14(31 January 2017) | Version 1.0 of the SPC-1 benchmark has been retired, but the results are still visible on the SPC web site. The final revision of the version benchmark specification is retained to provide proper context for the review of those results. | PDF (1.18 MB) |
SPC BENCHMARK 2 (SPC-2) SPC BENCHMARK 2/ENERGY EXTENSION (SPC-2/E) SPECIFICATION
The current and previous versions of the SPC-2 specification, which includes the SPC-2/E Energy Extension, are listed below. The "Effective Date" designates the date on which the current version replaces the previous version. Benchmark results may be released to be compliant with a version of the specification that has an "Effective Date" in the future.
Questions and comments concerning the specification may be sent to the SPC Administrator.
Version (effective date) | Description/Comments | Format |
---|---|---|
v1.8(01 January 2021) | This revision includes a general overhaul of the specification to bring it more in line with the approaches taken with SPC-1. Most of the changes are organizational only, with a few exceptions:
| PDF (1.26 MB) |
v1.7(15 August 2017) | See "Document History" (page 2) for a list of revisions | PDF (2.17 MB) |
v1.6(15 January 2017) | See "Document History" (page 2) for a list of revisions | PDF (2.21 MB) PDF (2.25 MB) |
SPC BENCHMARK 1C (SPC-1C) SPC BENCHMARK 1C/ENERGY EXTENSION (SPC-1C/E) SPECIFICATION
The current and previous versions of the SPC-1C specification, which includes the SPC-1C/E Energy Extension, are listed below. The "Effective Date" designates the date on which the current version replaces the previous version. Benchmark results may be released to be compliant with a version of the specification that has an "Effective Date" in the future.
Questions and comments concerning the specification may be sent to the SPC Administrator.
Version (effective date) | Description/Comments | Format |
---|---|---|
v1.5(12 May 2013) | See "Document History" (page 3) for a list of revisions | PDF (1.01 MB) |
v1.4(18 November 2012) | See "Document History" (page vi) for a list of revisions | PDF (782.59 KB) |
SPC BENCHMARK 2C (SPC-2C) SPC BENCHMARK 2C/ENERGY EXTENSION (SPC-2C/E) SPECIFICATION
The current and previous versions of the SPC-2C specification, which includes the SPC-2C/E Energy Extension, are listed below. The "Effective Date" designates the date on which the current version replaces the previous version. Benchmark results may be released to be compliant with a version of the specification that has an "Effective Date" in the future.
Questions and comments concerning the specification may be sent to the SPC Administrator.
Version (effective date) | Description/Comments | Format |
---|---|---|
v1.4(12 May 2013) | See "Document History" (page 2) for a list of revisions | PDF (1.10 MB) |
v1.3(18 November 2013) | See "Document History" (page 2) for a list of revisions | PDF (908.50 KB) |
SPC POLICIES AND PROCEDURES
The SPC Policies and Procedures define the day-to-day operations for the Storage Performance Council. This is the definitive source of information about meetings, benchmark development, results publication, technical subcommittees, and all other operational aspects of the council. If you have any questions about this or any other administrative documents, please contact the executive director.
Version (effective date) | Description/Comments | Format |
---|---|---|
v5.1(01 November 2022) | Extend lifecycle for benchmark extensions Introduce more flexible dues payment schedule | PDF (458.99 KB) |
v5.0(01 November 2020) | Rework Policies to align with Bylaws version 3.0 | PDF (461.03 KB) |
v4.12(01 November 2019) | Changes approved at the October 2019 Face-to-Face meeting:
| PDF (590.51 KB) |
v4.11(01 October 2019) | Changes in this revision:
| PDF (585.02 KB) PDF (669.22 KB) |
v4.10(01 January 2019) | Change Summary:
| PDF (397.78 KB) PDF (429.64 KB) |
v4.9(01 February 2018) | Version 4.9 defines Benchmark Extensions, and related policies. | PDF (229.07 KB) |
v4.9(01 February 2018) | Identical to the official release of version 4.9, but with change bars relative to version 4.8 | PDF (231.95 KB) |
v4.8(15 July 2017) | Changes in this revision:
| PDF (220.15 KB) |
SPC BYLAWS
Version (effective date) | Description/Comments | Format |
---|---|---|
v3.0(10 November 2020) | Reorganize Board and Steering Committee | PDF (225.59 KB) |
v2.2(18 July 2017) |
| PDF (114.99 KB) |
ANTITRUST POLICY
The Storage Performance Council was formed to provide benefit for the storage industry and its customers. As set forth in Article I of the Bylaws, it is the policy of the SPC to comply fully with the antitrust laws of the United States and similar foreign competition laws applicable to the SPC’s activities. It is expected that all company member
representatives involved in SPC activities, all SPC contractors, all SPC auditors, and any guests invited to participate in any SPC activity will take all measures necessary to comply with antitrust and competition laws.
Version (effective date) | Description/Comments | Format |
---|---|---|
v1.0(01 December 2016) | Initial release | PDF (43.47 KB) |
SPC PRICING GUIDE
This specification provides a uniform approach to the composition and pricing of storage configurations that may be applied to all SPC benchmarks. It is intended to:
- Clarify the basis for pricing-related calculations and disclosures;
- Define the terms and constraints related to pricing within SPC benchmark disclosures;
- Provide a uniform framework that can be applied to all SPC benchmarks without constraining the development of novel benchmark methodologies;
- Simplify the process of benchmark and benchmark extension development.
Version (effective date) | Description/Comments | Format |
---|---|---|
v1.0(08 June 2020) | Initial release (modeled on SPC-1 v3.8 content) | PDF (410.33 KB) |
PO BOX 3504,
REDWOOD CITY, CA 94064-5304
TEL: (650) 556-9384
FAX: (650) 206-5354
Footer Menu
- HOME
- BENCHMARKS
- ABOUT SPC
- SPECIFICATIONS
- MEMBERSHIP
- NEWS
- LINKS
- CONTACT US
- SUPPORT
Copyright © 2017 Storage Performance Council. All rights reserved. Privacy Policy
二、测试系统理论基础
-
负载模型设计
- ASU(应用存储单元):划分三类逻辑存储区域,模拟真实业务数据分布:
- ASU1(数据存储,45%空间):59.6%负载,含4类I/O流(随机读写+顺序读)
- ASU2(用户存储,45%空间):12.3%负载,含3类I/O流(读少写多)
- ASU3(日志存储,10%空间):28.1%负载,纯顺序写
- BSU(事务扩展单元):动态调整I/O请求规模,模拟业务压力变化。
- ASU(应用存储单元):划分三类逻辑存储区域,模拟真实业务数据分布:
-
I/O流参数规范
每类I/O流定义五维属性:| 参数 | 选项示例 | |---------------|-----------------------------------| | 传输块大小 | 4K/8K/16K/32K/64K(混合SMIX流) | | 读写比例 | 1:1(ASU1)、3:7(ASU2)、0:100(ASU3) | | 访问模式 | 随机(Uniform)、顺序(Incremental) | | 访问区域 | 全地址空间或局部热点(如0.15-0.2) | | 访问强度 | 负载权重系数(如ASU1-Stream2占28.1%)|
三、测试规则与执行序列
-
SPC-1测试流程(分阶段强制验证):
- Metrics测试
- 持续性测试(≥8小时):满负载稳定性验证(波动需<5%)
- IOPS测试(10分钟):记录峰值性能(平均延迟≤30ms)
- 响应时间坡度测试:负载从100%阶梯降至10%(95%/90%/80%/50%/10%)
- Repeat测试(×2次):重复Metrics阶段,结果偏差需<5%
- Persistence测试:断电重启验证数据一致性
- Metrics测试
-
SPC-2测试流程(顺序负载):
- LFP(大文件处理):顺序读/写/混合(1MB/256KB块)
- LDQ(大型数据库查询):全表扫描(1MB/64KB块)
- VOD(视频点播):多流并发读取
四、核心测试算法
-
性能指标算法
- 总体响应时间(ORT):基于负载阶梯的延时方差计算
ORT = \sqrt{\frac{\sum_{i=1}^{n}(RT_i - \overline{RT})^2}{n-1}}
- 可持续IOPS:长稳测试中剔除首尾10%数据后的均值
- 总体响应时间(ORT):基于负载阶梯的延时方差计算
-
负载生成算法
- 随机地址生成:均匀分布(Uniform)、局部热点(R1/W1)
- 动态强度调整:按BSU单位线性缩放请求并发量
五、测试模型代码设计
SPC未公开完整源码,但规范中明确关键逻辑(以伪代码示例):
# ASU1 Stream 3 (SMIX混合负载) 实现
def generate_smix_io():block_sizes = [4, 8, 16, 32, 64] # KBweights = [0.35, 0.30, 0.20, 0.10, 0.05] # 出现概率size = np.random.choice(block_sizes, p=weights) * 1024 # 按权重选块大小address = calc_address(mode="incremental", zone=(0.2, 0.7)) # 在20%-70%地址段顺序访问return IO_Request(size, address, op="READ") # 100%读操作
六、测试系统设计哲学
-
真实性与可重复性
- 禁用缓存优化(长稳测试规避缓存命中)
- 强制公开完整环境配置(硬件型号、固件版本、网络拓扑)
-
扩展性演进
- SPC-1 Gold Star:新增五项能力验证(数据缩减/快照/加密/复制/无损升级)
- 6G融合场景:通感算一体架构支持实时边缘分析(如无人机避障)
通过分层负载模型(ASU/BSU)、多阶段验证(长稳/重复/断电)和开放审计,SPC为存储系统提供了业界公认的“性能标尺”。开发者可通过SPC官网获取测试工具包与规范文档,实现私有化部署验证。