如何利用wrap测试oss性能？

如何利用wrap测试oss性能？

前言

我们利用mino与ceph rgw搭建好的oss经过多层网络转发，传输速度必定有所折损，这个时候我们使用wrap来测试oss对象存储的真实性能。

利用wrap测试oss性能

wrap是minio项目下的一个开源测试工具，wrap会上传一定随机数据到oss对象存储服务器上，统计过程消耗时间得出整个oss性能分析。

使用docker 执行测试

docker pull minio/warp:v0.5.5docker run --net host minio/warp:v0.5.5 mixed --host=172.16.1.54:7480 \--access-key=123456 \--secret-key=123456 \--autoterm

上述命令使用warpv0.5.5对地址为172.16.1.54:7480的oss服务器进行测试。

相关命令

FLAGS:--no-color disable color theme--debug enable debug output--insecure disable TLS certificate verification--autocompletion install auto-completion for your shell--host value host. Multiple hosts can be specified as a comma separated list. (default: "127.0.0.1:9000") [$WARP_HOST]--access-key value Specify access key [$WARP_ACCESS_KEY]--secret-key value Specify secret key [$WARP_SECRET_KEY]--tls Use TLS (HTTPS) for transport [$WARP_TLS]--region value Specify a custom region [$WARP_REGION]--encrypt encrypt/decrypt objects (using server-side encryption with random keys)--bucket value Bucket to use for benchmark data. ALL DATA WILL BE DELETED IN BUCKET! (default: "warp-benchmark-bucket")--host-select value Host selection algorithm. Can be "weighed" or "roundrobin" (default: "weighed")--concurrent value Run this many concurrent operations (default: 20)--noprefix Do not use separate prefix for each thread--prefix value Use a custom prefix for each thread--disable-multipart disable multipart uploads--md5 Add MD5 sum to uploads--storage-class value Specify custom storage class, for instance 'STANDARD' or 'REDUCED_REDUNDANCY'.--objects value Number of objects to upload. (default: 2500)--obj.size value Size of each generated object. Can be a number or 10KiB/MiB/GiB. All sizes are base 2 binary. (default: "10MiB")--get-distrib value The amount of GET operations. (default: 45)--stat-distrib value The amount of STAT operations. (default: 30)--put-distrib value The amount of PUT operations. (default: 15)--delete-distrib value The amount of DELETE operations. Must be at least the same as PUT. (default: 10)--obj.generator value Use specific data generator (default: "random")--obj.randsize Randomize size of objects so they will be up to the specified size--benchdata value Output benchmark+profile data to this file. By default unique filename is generated.--serverprof value Run MinIO server profiling during benchmark; possible values are 'cpu', 'mem', 'block', 'mutex' and 'trace'.--duration value Duration to run the benchmark. Use 's' and 'm' to specify seconds and minutes. (default: 5m0s)--autoterm Auto terminate when benchmark is considered stable.--autoterm.dur value Minimum duration where output must have been stable to allow automatic termination. (default: 10s)--autoterm.pct value The percentage the last 6/25 time blocks must be within current speed to auto terminate. (default: 7.5)--noclear Do not clear bucket before or after running benchmarks. Use when running multiple clients.--syncstart value Specify a benchmark start time. Time format is 'hh:mm' where hours are specified in 24h format, server TZ.--warp-client value Connect to warp clients and run benchmarks there.--analyze.dur value Split analysis into durations of this length. Can be '1s', '5s', '1m', etc.--analyze.out value Output aggregated data as to file--analyze.op value Only output for this op. Can be GET/PUT/DELETE, etc.--analyze.host value Only output for this host.--analyze.skip value Additional duration to skip when analyzing data. (default: 0s)--analyze.v Display additional analysis data.--serve value When running benchmarks open a webserver to fetch results remotely, eg: localhost:7762--help, -h show help

结果

Uploading 2500 objects of Random data; 4194304 bytes totalwarp: Starting benchmark in 3s...warp: Benchmark starting...Throughput 101.0 objects/s within 7.500000% for 10.262s. Assuming stability. Terminating benchmark.warp: Saving benchmark data...warp: Benchmark data written to "warp-mixed-2022-04-18[030853]-nm3V.csv.zst"Mixed operations.Operation: DELETE, 10%, Concurrency: 20, Ran 36s.* Throughput: 33.90 obj/sOperation: GET, 45%, Concurrency: 20, Ran 36s.* Throughput: 610.60 MiB/s, 152.65 obj/sOperation: PUT, 15%, Concurrency: 20, Ran 36s.* Throughput: 203.71 MiB/s, 50.93 obj/sOperation: STAT, 30%, Concurrency: 20, Ran 36s.* Throughput: 101.58 obj/sCluster Total: 813.56 MiB/s, 338.78 obj/s over 37s.

结语

以上就是使用wrap测试oss的其中一种办法，你学会了吗？希望读者朋友看完这篇文章后有所启发。

版权声明：本文内容由网络用户投稿，版权归原作者所有，本站不拥有其著作权，亦不承担相应法律责任。如果您发现本站中有涉嫌抄袭或描述失实的内容，请联系我们jiasou666@gmail.com 处理，核实后本网站将在24小时内删除侵权内容。