How To Deploy Cartesia Edge to Runpod

1

Create a runpod pod with specific start command to install cartesia-pytorch

runpodctl create pods --gpuType "NVIDIA A40" \
--imageName "runpod/pytorch:2.1.0-py3.10-cuda11.8.0-devel-ubuntu22.04" \
--containerDiskSize 20 \
--volumeSize 100 \
--args "bash -c 'pip install --no-binary :all: cartesia-pytorch && /start.sh'" \
--secureCloud \
--ports '22/tcp' \
--name "<pod-name>"
2

Get all pods in the current namespace with detailed information.

runpodctl get pod -a
3

List available ssh keys for runpod instances

runpodctl ssh list-keys
4

Copy a local file to a RunPod instance using SCP.

scp -i ~/.runpod/ssh/<key-name> -P 22149 ./cartesia.py root@69.30.85.152:~/
5

Run a Python script on a RunPod instance via SSH.

ssh root@69.30.85.152 -p 22149 -i ~/.runpod/ssh/<key-name> -C 'python cartesia.py'