Skip to content

[In-Progress] Extending ingestion benchmarks. Included a 10M docs single field benchmark #1180

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
filipecosta90 wants to merge 10 commits into
base: master
Choose a base branch
from
Open

[In-Progress] Extending ingestion benchmarks. Included a 10M docs single field benchmark #1180

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
1bf33c1
Extending ingestion benchmarks. Included a 10M docs single field benc…
filipecosta90 Feb 6, 2024
ed1dc66
Extending ingestion benchmarks. Included a 80M docs single field benc…
filipecosta90 Feb 6, 2024
f5f8df9
Running benchmarks faster by spliting from 3 to 5 envs
filipecosta90 Feb 6, 2024
b301a45
Added a 10M docs array single field benchmark
filipecosta90 Feb 19, 2024
6293871
Merge remote-tracking branch 'origin/master' into extend.ingestion.be…
filipecosta90 Apr 10, 2024
2f46922
Added bool, numeric float, and int single field benchmarks
filipecosta90 Apr 10, 2024
996b04a
Included 5 new array ingestion benchmarks
filipecosta90 Apr 23, 2024
83a460a
Merge branch 'master' into extend.ingestion.benchmarks
filipecosta90 Apr 24, 2024
59e3c0e
Extended the exported metrics in the benchmarks
filipecosta90 Apr 30, 2024
ee55fbc
Fixed json_set_10M_docs_array_single_numeric_int benchmark definition
filipecosta90 Apr 30, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .github/workflows/benchmark-runner.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ jobs:
benchmark-json-oss-standalone:
strategy:
matrix:
member_id: [1, 2, 3]
member_id: [1, 2, 3, 4, 5]
uses: ./.github/workflows/benchmark-flow.yml
secrets: inherit
with:
Expand All @@ -27,7 +27,7 @@ jobs:
benchmark-json-oss-standalone-profiler:
strategy:
matrix:
member_id: [1, 2, 3]
member_id: [1, 2, 3, 4, 5]
uses: ./.github/workflows/benchmark-flow.yml
secrets: inherit
with:
Expand Down
4 changes: 4 additions & 0 deletions tests/benchmarks/.gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,3 +4,7 @@
datasets/*.rdb
*.rdb
binaries
*.rdb
*.log
*.zip

4 changes: 4 additions & 0 deletions tests/benchmarks/defaults.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,10 @@ exporter:
- "$.Tests.Overall.min_latency_ms"
- '$."ALL STATS".*."Ops/sec"'
- '$."ALL STATS".*."Latency"'
- "$.OverallRates.overallOpsRate"
- "$.OverallQuantiles.allCommands.q50"
- "$.OverallQuantiles.allCommands.q95"
- "$.OverallQuantiles.allCommands.q99"
comparison:
metrics:
- "Ops/sec"
Expand Down
11 changes: 11 additions & 0 deletions tests/benchmarks/json_set_10M_docs_array_nested_array_text.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
version: 0.2
name: "json_set_10M_docs_array_nested_array_text"
description: "JSON.SET of 10M docs with a single nested array with a text field within it"


clientconfig:
- tool: ftsb_redisearch
- parameters:
- workers: 64
- reporting-period: 1s
- input: "https://s3.amazonaws.com/benchmarks.redislabs/redisearch/datasets/10M-json-array-nested-array-text/10M-json-array-nested-array-text.redisjson.commands.SETUP.csv"
11 changes: 11 additions & 0 deletions tests/benchmarks/json_set_10M_docs_array_nested_dict_with_array_with_text.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
version: 0.2
name: "json_set_10M_docs_array_nested_dict_with_array_with_text"
description: "JSON.SET of 10M docs with a single nested array with a dict with an array with a text field within it"


clientconfig:
- tool: ftsb_redisearch
- parameters:
- workers: 64
- reporting-period: 1s
- input: "https://s3.amazonaws.com/benchmarks.redislabs/redisearch/datasets/10M-json-array-nested-dict-with-array-with-text/10M-json-array-nested-dict-with-array-with-text.redisjson.commands.SETUP.csv"
11 changes: 11 additions & 0 deletions tests/benchmarks/json_set_10M_docs_array_nested_dict_with_numeric_int.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
version: 0.2
name: "json_set_10M_docs_array_nested_dict_with_numeric_int"
description: "JSON.SET of 10M docs with a single nested array with a dict with an array with a numeric int field within it"


clientconfig:
- tool: ftsb_redisearch
- parameters:
- workers: 64
- reporting-period: 1s
- input: "https://s3.amazonaws.com/benchmarks.redislabs/redisearch/datasets/10M-json-array-nested-dict-with-numeric-int/10M-json-array-nested-dict-with-numeric-int.redisjson.commands.SETUP.csv"
11 changes: 11 additions & 0 deletions tests/benchmarks/json_set_10M_docs_array_nested_dict_with_text.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
version: 0.2
name: "json_set_10M_docs_array_nested_dict_with_text"
description: "JSON.SET of 10M docs with a single nested array with a dict with text field within it"


clientconfig:
- tool: ftsb_redisearch
- parameters:
- workers: 64
- reporting-period: 1s
- input: "https://s3.amazonaws.com/benchmarks.redislabs/redisearch/datasets/10M-json-array-nested-dict-with-text/10M-json-array-nested-dict-with-text.redisjson.commands.SETUP.csv"
11 changes: 11 additions & 0 deletions tests/benchmarks/json_set_10M_docs_array_single_numeric_int.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
version: 0.2
name: "json_set_10M_docs_array_single_numeric_int"
description: "JSON.SET of 10M docs with a single numeric int field whitin an array"


clientconfig:
- tool: ftsb_redisearch
- parameters:
- workers: 64
- reporting-period: 1s
- input: "https://s3.amazonaws.com/benchmarks.redislabs/redisearch/datasets/10M-json-array-singlevalue-numeric-int/10M-json-array-singlevalue-numeric-int.redisjson.commands.SETUP.csv"
11 changes: 11 additions & 0 deletions tests/benchmarks/json_set_10M_docs_array_single_text.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
version: 0.2
name: "json_set_10M_docs_array_single_text"
description: "JSON.SET of 10M docs with a single text field whitin an array"


clientconfig:
- tool: ftsb_redisearch
- parameters:
- workers: 64
- reporting-period: 1s
- input: "https://s3.amazonaws.com/benchmarks.redislabs/redisearch/datasets/10M-singlevalue-text-json-array/10M-singlevalue-text-json-array.redisjson.commands.SETUP.csv"
11 changes: 11 additions & 0 deletions tests/benchmarks/json_set_10M_docs_single_bool.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
version: 0.2
name: "json_set_10M_docs_single_bool"
description: "JSON.SET of 10M docs with a single bool field"


clientconfig:
- tool: ftsb_redisearch
- parameters:
- workers: 64
- reporting-period: 1s
- input: "//s3.amazonaws.com/benchmarks.redislabs/redisearch/datasets/10M-singlevalue-bool-json/10M-singlevalue-bool-json.redisjson.commands.SETUP.csv"
11 changes: 11 additions & 0 deletions tests/benchmarks/json_set_10M_docs_single_numeric_float.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
version: 0.2
name: "json_set_10M_docs_single_numeric_float"
description: "JSON.SET of 10M docs with a single numeric field with float values"


clientconfig:
- tool: ftsb_redisearch
- parameters:
- workers: 64
- reporting-period: 1s
- input: "https://s3.amazonaws.com/benchmarks.redislabs/redisearch/datasets/10M-singlevalue-numeric-float-json/10M-singlevalue-numeric-float-json.redisjson.commands.SETUP.csv"
11 changes: 11 additions & 0 deletions tests/benchmarks/json_set_10M_docs_single_numeric_int.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
version: 0.2
name: "json_set_10M_docs_single_numeric_int"
description: "JSON.SET of 10M docs with a single numeric field with int values"


clientconfig:
- tool: ftsb_redisearch
- parameters:
- workers: 64
- reporting-period: 1s
- input: "https://s3.amazonaws.com/benchmarks.redislabs/redisearch/datasets/10M-singlevalue-numeric-int-json/10M-singlevalue-numeric-int-json.redisjson.commands.SETUP.csv"
11 changes: 11 additions & 0 deletions tests/benchmarks/json_set_10M_docs_single_text.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
version: 0.2
name: "json_set_10M_docs_single_text"
description: "JSON.SET of 10M docs with a single text field"


clientconfig:
- tool: ftsb_redisearch
- parameters:
- workers: 64
- reporting-period: 1s
- input: "https://s3.amazonaws.com/benchmarks.redislabs/redisearch/datasets/10M-singlevalue-text-json/10M-singlevalue-text-json.redisjson.commands.SETUP.csv"