Repository navigation
Tags: aws/sagemaker-python-sdk
Tags
feat(mlops): Add CleanupStep pipeline step (#6468) * feat(mlops): Add CleanupStep pipeline step Add a CleanupStep that deletes the Amazon S3 outputs of upstream steps. Each S3CleanupSource names a source step and, for Processing and Transform steps, the exact object URIs to delete. Other rules (supported source types, URI limits, VpcConfig) are left to the service, which validates them at CreatePipeline. depends_on defaults to the source steps since only outputs of completed steps can be deleted. Integ test passed against a production region. --- X-AI-Prompt: Add a PySDK CleanupStep with unit and integration tests and raise a PR X-AI-Tool: kiro-cli * fix(mlops): Always add CleanupStep sources to depends_on The service does not require a Cleanup step's DependsOn to include its sources, so an explicit depends_on could let Cleanup run before its source steps finished. --- X-AI-Prompt: Address jkasiraj's PR comment to merge sources into depends_on X-AI-Tool: kiro-cli * fix(mlops): Resolve every depends_on form in CleanupStep A StepOutput entry raised AttributeError and a StepCollection was matched by its own name instead of its last step, so the source could be appended twice. --- X-AI-Prompt: Address jkasiraj's PR comment to handle all depends_on types X-AI-Tool: kiro-cli * fix(mlops): Honor StepDependency entries in CleanupStep depends_on A source listed with a run condition was not recognized, so a second plain Completed edge was appended and compilation failed on conflicting triggers. --- X-AI-Prompt: Fix CleanupStep for the merged run conditions PR X-AI-Tool: kiro-cli --------- Co-authored-by: nayan3107 <nayancho@amazon.com>
Add me-west-1 (RUH) JumpStart bucket info to region_config.json (#6455) Add the me-west-1 content and gated content buckets to the PySDK region_config.json, following the me-central-1 / eu-central-2 pattern. Neo bucket omitted (sagemaker+neo NOT_PLANNED in RUH). X-AI-Tool: sm-rb-cr-creator X-AI-Prompt: Add me-west-1 (RUH) JumpStart bucket info to region_config.json sm-rb: sagemaker+model-hub/me-west-1/step-2 Co-authored-by: Eli Davidson <elleedee@amazon.com>
chore(release): Release 3.22.0 (#6274) * chore(release): Release 3.22.0 Bump package versions and inter-package dependency floors for the 3.22.0 release. Raise the sagemaker-core boto3 floor for InstancePreferences compatibility and update the package changelogs. --- X-AI-Prompt: Complete all SageMaker Python SDK 3.22.0 changelog entries X-AI-Tool: Kiro
fix(serve): pre-deploy JumpStart benchmark data + public HuggingFace … …download helper (#6175) Fixes ModelBuilder benchmark APIs for pre-deploy JumpStart models and adds a public HuggingFace-Hub download helper: - benchmark_metrics: display_benchmark_metrics() read self.benchmark_metrics, a property that existed in v2 but was dropped in the v3 port, so it raised AttributeError. Restore the property (a pandas DataFrame built from the model's published deployment-config benchmark data). - list_deployment_configs(): with no instance_type it called _get_deployment_configs() before the JumpStart metadata configs were loaded, so a pre-deploy builder (_metadata_configs=None) got []. _get_deployment_configs now calls _ensure_metadata_configs() itself, so every caller lazily loads them. - ragged benchmark data: get_metrics_from_deployment_configs built columns independently, appending the instance-rate (pricing) column only for instances that had it. That produced unequal-length columns (crashing pd.DataFrame with "All arrays must be of the same length") AND misaligned the present rate values onto the wrong rows. Assemble one record per row and pivot to columns at the end, padding unset cells with None, so columns stay equal length and every value stays on its own row. Column layout is unchanged (the rate column still comes last). - download_huggingface_model(): new public helper in serve.utils.hf_utils, exported from sagemaker.serve. Downloads a Hub snapshot and optionally uploads it to S3, so notebooks no longer hand-roll snapshot_download + S3Uploader. Supports revision / allow_patterns / ignore_patterns passthroughs; when staging to S3 without a caller-supplied local_dir it uses a temporary directory that is removed after the upload. migration.md documents both new surfaces. Unit: 11 new tests (benchmark/config, ragged-metrics alignment/order, HF helper incl. temp-dir cleanup and passthroughs).
PreviousNext