Modified comprehensive_8dev_experiments.yaml from 20 num runs to 100#123
Closed
danielwu7115 wants to merge 90 commits into
Closed
Modified comprehensive_8dev_experiments.yaml from 20 num runs to 100#123danielwu7115 wants to merge 90 commits into
danielwu7115 wants to merge 90 commits into
Conversation
Support run_benchmark.py to use argument `gcs-bucket-csv-dir` to configure the directory for writing csv/tsv result.
* Fix the issue where `kubectl wait` could only wait for one condition. Use poll loop to check for status. * Store the failed jobs and retry with maximum 3 times TEST=Use dummy `must-fail` and `must-succeed` job which exit 1/0 directly. Make sure the script will retry on the failed one for 3 times, and eventually print out the command to retry.
…#111) We add a tuned table instead of. run the sweeping at each microbenchmark. For the config not tuned yet, we just use default block sizes and output with flag has_optimized=false.
…-Hypercomputer#112) Use segment id to filter out the padding KV if needed. Since the segment id would affect the latency, we should add them to reflect the padding situation.
* Adding CCC based autoscaler files Signed-off-by: pulasthi <pulasthi@google.com> * adding Readme file --------- Signed-off-by: pulasthi <pulasthi@google.com>
Test out larger matrix Test out larger matrix
…ns from 20 to 100.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
9 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What this PR does:
This PR updates the microbenchmark workload configuration for 8-device Host to Device and Device to Host (
h2dd2h). Specifically, it:Why these changes are needed:
num_runsto 100 provides a larger, more statistically robust dataset, ensuring more reliable and repeatable performance insights.How these changes were implemented:
num_runswas updated from 20 to 100 inIronwood/configs/host_device/comprehensive_8dev_experiments.yaml.How this was tested: