TensorFlow

TensorFlow is an open source framework for machine learning. With CUDO Compute you can deploy TensorFlow docker containers to the latest NVIDIA Ampere Architecture GPUs. Prebuilt images with NVIDIA drivers and docker and ready to deploy in the marketplace.

Common uses for TensorFlow:

• Deep Neural Networks (DNN)
• Convolutional Neural Networks (CNN)
• Conversational AI
• Recurrent Neural Networks (RNN)
• Reinforcement Learning
• Natural Language Processing (NLP)

Quick start guide

1. Prerequisites
2. TensorFlow with Docker
3. TensorFlow Serving with Docker

Prerequisites

• Create a project and add an SSH key
• Optionally download CLI tool
• Choose a VM with an NVIDIA GPU and Configure
• Use the Ubuntu 22.04 + NVIDIA drivers + Docker image (in CLI tool type -image ubuntu-nvidia-docker)

Running TensorFlow on CUDO Compute with Docker

SSH into your VM and run the following commands

    
    docker run --gpus all -it --rm tensorflow/tensorflow:latest-gpu

    Copy to clipboardCopy
  

Or for the NVIDIA optimised TensorFlow container

    
    docker run --gpus all -it --rm nvcr.io/nvidia/tensorflow:22.08-tf2-py3

    Copy to clipboardCopy
  

NGC tags can be found here

At the prompt

    
    $ python
>>> import tensorflow as tf
>>> tf.config.list_physical_devices("GPU")

    Copy to clipboardCopy
  

TensorFlow serving on CUDO Compute

    
    docker pull tensorflow/serving:latest-gpu

    Copy to clipboardCopy
  

Try an example model:

    
    mkdir -p /tmp/tfserving
cd /tmp/tfserving
git clone https://github.com/tensorflow/serving

    Copy to clipboardCopy
  

    
    docker run --gpus all -p 8501:8501 \
--mount type=bind,\
source=/tmp/tfserving/serving/tensorflow_serving/servables/tensorflow/testdata/saved_model_half_plus_two_gpu,\
target=/models/half_plus_two \
  -e MODEL_NAME=half_plus_two -t tensorflow/serving:latest-gpu &

    Copy to clipboardCopy
  

    
    curl -d '{"instances": [1.0, 2.0, 5.0]}' \
  -X POST http://PUBLIC_IP_ADDRESS:8501/v1/models/half_plus_two:predict

    Copy to clipboardCopy
  

Get more information in the official docs