I cannot find any reference in the documentation, but I suspect the way you are updating Tensorflow is not totally supported by Sagemaker. Sagemaker usually uses prebuilt containers, that already contains tensorflow, but also CUDA. If you just update Tensorflow there is no guarantee that will be still compatible with the installed CUDA.

Answer from rok on Stack Overflow
🌐
Vantage
instances.vantage.sh › aws › ec2 › g4dn.xlarge
g4dn.xlarge pricing and specs - Vantage
The g4dn.xlarge instance is in the GPU instance family with 4 vCPUs, 16 GiB of memory and up to 25 Gibps of bandwidth starting at $0.526 per hour.
🌐
AWS
aws.amazon.com › amazon ec2 › instance types › g4 instances
Amazon EC2 G4 Instances — Amazon Web Services (AWS)
6 days ago - They provide up to 8 NVIDIA T4 GPUs, 96 vCPUs, 100 Gbps networking, and 1.8 TB local NVMe-based SSD storage and are also available as bare metal instances. G4dn instances are equipped with NVIDIA T4 GPUs which deliver up to 40X better low-latency throughput than CPUs, so more requests can be ...
🌐
Vantage
instances.vantage.sh › aws › ec2 › g4dn.4xlarge
g4dn.4xlarge pricing and specs - Vantage
The g4dn.4xlarge instance is in the GPU instance family with 16 vCPUs, 64 GiB of memory and up to 25 Gibps of bandwidth starting at $1.204 per hour.
🌐
EC2 Pricing Calculator
costcalc.cloudoptimo.com › aws-pricing-calculator › ec2 › g4dn.xlarge
g4dn.xlarge Pricing and Specs: AWS EC2
The g4dn.xlarge instance is part of the g4dn series, featuring 4 vCPUs and Up to 25 Gigabit of RAM, with Gpu Instances.
🌐
Vantage
instances.vantage.sh › aws › ec2 › g4dn.16xlarge
g4dn.16xlarge pricing and specs - Vantage
The g4dn.16xlarge instance is in the GPU instance family with 64 vCPUs, 256 GiB of memory and 50 Gibps of bandwidth starting at $4.352 per hour.
Find elsewhere
🌐
Cloudzero
advisor.cloudzero.com › aws › sagemaker › ml.g4dn.12xlarge
ml.g4dn.12xlarge SageMaker ML Instance Specs And Pricing
CloudZero's intelligent platform helps you optimize cloud costs and improve infrastructure efficiency.
🌐
NVIDIA Developer
developer.nvidia.com › blog › getting-the-most-out-of-nvidia-t4-on-aws-g4-instances
Getting the Most Out of NVIDIA T4 on AWS G4 Instances | NVIDIA Technical Blog
August 21, 2022 - Select the Deep Learning AMI (Ubuntu 18.04) version 43.0 to run on a g4dn.xlarge instance with at least 150G of storage space. Log into your instance. Clone TensorRT repository into your local environment: git clone -b master https://github.com/nvidia/TensorRT TensorRT ... docker run --gpus all -it --rm -v $HOME/TensorRT:/workspace/TensorRT nvcr.io/nvidia/tensorflow:21.04-tf1-py3
🌐
Cloudzero
advisor.cloudzero.com › aws › sagemaker › ml.g4dn.xlarge
ml.g4dn.xlarge SageMaker ML Instance Specs And Pricing
CloudZero's intelligent platform helps you optimize cloud costs and improve infrastructure efficiency.
🌐
Umbrella
anodot.com › home › learning center › aws cost management › amazon ec2 g4 instances
Using AWS EC2 G4dn and G4ad | Amazon EC2 G4 | Umbrella
April 10, 2025 - In December 2020, AWS released the Amazon EC2 G4ad instance subfamily — powered by AMD Radeon Pro V520 GPUs and second-generation AMD EPYC processors with up to 2.4 TB of local NVMe storage — that delivers up to 40% better price performance over comparable GPU-based instances for graphics intensive applications such as virtual workstations and game streaming. In July 2021, AWS expanded the G4ad subfamily with the g4ad.xlarge and g4ad.2xlarge sizes, which are designed to be cost-effective for workloads that don’t need the high vCPU and system memory that current larger G4ad instance sizes offer — rounding out their AMD offering and providing the lowest cost GPU instance in the AWS Cloud.
🌐
Vantage
instances.vantage.sh › aws › ec2 › g4dn.8xlarge
g4dn.8xlarge pricing and specs - Vantage
The g4dn.8xlarge instance is in the GPU instance family with 32 vCPUs, 128 GiB of memory and 50 Gibps of bandwidth starting at $2.176 per hour.
🌐
CloudPrice
cloudprice.net › amazon web services › ec2 › g4dn.xlarge
g4dn.xlarge specs and pricing | AWS | CloudPrice
Amazon EC2 instance g4dn.xlarge with 4 vCPUs, 16 GiB RAM and 1 x NVIDIA T4 16 GiB. Available in 23 regions starting from $383.98 per month.
🌐
Vantage
instances.vantage.sh › aws › ec2 › g4dn.12xlarge
g4dn.12xlarge pricing and specs - Vantage
The g4dn.12xlarge instance is in the GPU instance family with 48 vCPUs, 192 GiB of memory and 50 Gibps of bandwidth starting at $3.912 per hour.
🌐
Cloudzero
advisor.cloudzero.com › aws › sagemaker › ml.g4dn.8xlarge
ml.g4dn.8xlarge SageMaker ML Instance Specs And Pricing
CloudZero's intelligent platform helps you optimize cloud costs and improve infrastructure efficiency.
🌐
Vantage
instances.vantage.sh › aws › ec2 › g4dn.2xlarge
g4dn.2xlarge pricing and specs - Vantage
The g4dn.2xlarge instance is in the GPU instance family with 8 vCPUs, 32 GiB of memory and up to 25 Gibps of bandwidth starting at $0.752 per hour.