Dashboard

vastai

NVIDIA GeForce RTX 4090

$0.07

/hr

Inference Speed

42.7 tokens/sec

Training Speed

2.4 sec/epoch

vastai

NVIDIA GeForce RTX 3090

$0.08

/hr

Inference Speed

0.0 tokens/sec

Training Speed

1.5 sec/epoch

vastai

NVIDIA GeForce RTX 3090

$0.11

/hr

Inference Speed

31.6 tokens/sec

Training Speed

4.2 sec/epoch

vastai

NVIDIA GeForce RTX 4090

$0.15

/hr

Inference Speed

60.3 tokens/sec

Training Speed

1.8 sec/epoch

vastai

NVIDIA GeForce RTX 3090

$0.15

/hr

Inference Speed

45.0 tokens/sec

Training Speed

2.7 sec/epoch

vastai

NVIDIA H100 PCIe

$0.26

/hr

Inference Speed

47.9 tokens/sec

Training Speed

1.7 sec/epoch

vastai

NVIDIA GeForce RTX 4090

$0.33

/hr

Inference Speed

46.1 tokens/sec

Training Speed

2.9 sec/epoch

vastai

NVIDIA GeForce RTX 4090

$0.33

/hr

Inference Speed

44.5 tokens/sec

Training Speed

2.9 sec/epoch

tensordock

NVIDIA GeForce RTX 3090

$0.43

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.6 sec/epoch

vastai

NVIDIA GeForce RTX 4090

$0.50

/hr

Inference Speed

38.4 tokens/sec

Training Speed

2.9 sec/epoch

tensordock

NVIDIA RTX A6000

$0.52

/hr

Inference Speed

47.7 tokens/sec

Training Speed

3.6 sec/epoch

runpod

NVIDIA GeForce RTX 4090

$0.54

/hr

Inference Speed

39.6 tokens/sec

Training Speed

3.6 sec/epoch

tensordock

NVIDIA GeForce RTX 4090

$0.59

/hr

Inference Speed

58.9 tokens/sec

Training Speed

2.1 sec/epoch

tensordock

NVIDIA GeForce RTX 3090

$0.77

/hr

Inference Speed

0.0 tokens/sec

Training Speed

1.9 sec/epoch

tensordock

NVIDIA RTX A6000

$0.81

/hr

Inference Speed

42.4 tokens/sec

Training Speed

3.7 sec/epoch

tensordock

NVIDIA RTX A6000

$0.89

/hr

Inference Speed

40.0 tokens/sec

Training Speed

3.7 sec/epoch

tensordock

NVIDIA GeForce RTX 4090

$0.98

/hr

Inference Speed

25.1 tokens/sec

Training Speed

5.1 sec/epoch

datacrunch

NVIDIA RTX A6000

$1.01

/hr

Inference Speed

44.7 tokens/sec

Training Speed

2.8 sec/epoch

valdi

NVIDIA RTX A5000 2 GPUs

$1.04

/hr

Inference Speed

40.0 tokens/sec

Training Speed

1.8 sec/epoch

tensordock

NVIDIA GeForce RTX 4090

$1.07

/hr

Inference Speed

51.9 tokens/sec

Training Speed

3.2 sec/epoch

massedcompute

NVIDIA L40S

$1.10

/hr

Inference Speed

49.6 tokens/sec

Training Speed

1.6 sec/epoch

crusoe

NVIDIA A40

$1.10

/hr

Inference Speed

40.0 tokens/sec

Training Speed

2.1 sec/epoch

tensordock

NVIDIA GeForce RTX 4090

$1.10

/hr

Inference Speed

48.2 tokens/sec

Training Speed

4.3 sec/epoch

massedcompute

NVIDIA RTX A6000 2 GPUs

$1.14

/hr

Inference Speed

23.9 tokens/sec

Training Speed

3.2 sec/epoch

massedcompute

NVIDIA RTX A6000 2 GPUs

$1.14

/hr

Inference Speed

23.8 tokens/sec

Training Speed

3.6 sec/epoch

massedcompute

NVIDIA RTX A6000 2 GPUs

$1.14

/hr

Inference Speed

41.4 tokens/sec

Training Speed

2.0 sec/epoch

massedcompute

NVIDIA RTX A6000 2 GPUs

$1.14

/hr

Inference Speed

20.9 tokens/sec

Training Speed

3.6 sec/epoch

massedcompute

NVIDIA RTX A6000 2 GPUs

$1.16

/hr

Inference Speed

33.9 tokens/sec

Training Speed

1.9 sec/epoch

datacrunch

NVIDIA RTX 6000 Ada Generation

$1.19

/hr

Inference Speed

51.0 tokens/sec

Training Speed

2.4 sec/epoch

datacrunch

NVIDIA RTX 6000 Ada Generation

$1.19

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.4 sec/epoch

denvr

NVIDIA A100-SXM4-40GB

$1.25

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.2 sec/epoch

fluidstack

NVIDIA L40

$1.25

/hr

Inference Speed

46.1 tokens/sec

Training Speed

2.4 sec/epoch

datacrunch

NVIDIA A100-SXM4-40GB

$1.29

/hr

Inference Speed

41.9 tokens/sec

Training Speed

3.4 sec/epoch

lambdalabs

NVIDIA A100-SXM4-40GB

$1.29

/hr

Inference Speed

40.1 tokens/sec

Training Speed

1.9 sec/epoch

lambdalabs

NVIDIA A100-SXM4-40GB

$1.29

/hr

Inference Speed

39.4 tokens/sec

Training Speed

2.0 sec/epoch

lambdalabs

NVIDIA A100-SXM4-40GB

$1.29

/hr

Inference Speed

40.4 tokens/sec

Training Speed

1.9 sec/epoch

lambdalabs

NVIDIA A100-SXM4-40GB

$1.29

/hr

Inference Speed

39.4 tokens/sec

Training Speed

2.0 sec/epoch

lambdalabs

NVIDIA A100-SXM4-40GB

$1.29

/hr

Inference Speed

40.0 tokens/sec

Training Speed

2.0 sec/epoch

lambdalabs

NVIDIA A100-SXM4-40GB

$1.29

/hr

Inference Speed

39.9 tokens/sec

Training Speed

2.0 sec/epoch

tensordock

NVIDIA GeForce RTX 4090

$1.34

/hr

Inference Speed

54.5 tokens/sec

Training Speed

5.3 sec/epoch

hyperstack

NVIDIA A100 80GB PCIe

$1.35

/hr

Inference Speed

45.3 tokens/sec

Training Speed

2.3 sec/epoch

hyperstack

NVIDIA A100 80GB PCIe

$1.35

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.9 sec/epoch

valdi

NVIDIA RTX A6000 2 GPUs

$1.36

/hr

Inference Speed

46.9 tokens/sec

Training Speed

1.8 sec/epoch

valdi

NVIDIA A40 2 GPUs

$1.36

/hr

Inference Speed

39.5 tokens/sec

Training Speed

1.9 sec/epoch

datacrunch

NVIDIA L40S

$1.36

/hr

Inference Speed

39.6 tokens/sec

Training Speed

3.6 sec/epoch

crusoe

NVIDIA L40S

$1.45

/hr

Inference Speed

49.8 tokens/sec

Training Speed

2.2 sec/epoch

crusoe

NVIDIA L40S

$1.45

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.2 sec/epoch

crusoe

NVIDIA A100-PCIE-40GB

$1.45

/hr

Inference Speed

48.9 tokens/sec

Training Speed

2.8 sec/epoch

oblivus

NVIDIA A100 80GB PCIe

$1.48

/hr

Inference Speed

43.9 tokens/sec

Training Speed

2.1 sec/epoch

lambdalabs

NVIDIA GH200 480GB

$1.49

/hr

Inference Speed

0.0 tokens/sec

Training Speed

1.8 sec/epoch

datacrunch

Tesla V100-SXM2-16GB 4 GPUs

$1.56

/hr

Inference Speed

38.3 tokens/sec

Training Speed

6.4 sec/epoch

nebius

[Unknown Error]

$1.58

/hr

Inference Speed

0.0 tokens/sec

Training Speed

1.9 sec/epoch

runpod

NVIDIA A100 80GB PCIe

$1.59

/hr

Inference Speed

42.4 tokens/sec

Training Speed

2.8 sec/epoch

lambdalabs

NVIDIA RTX A6000 2 GPUs

$1.60

/hr

Inference Speed

40.2 tokens/sec

Training Speed

3.9 sec/epoch

datacrunch

NVIDIA A100-SXM4-80GB

$1.65

/hr

Inference Speed

28.4 tokens/sec

Training Speed

3.4 sec/epoch

datacrunch

NVIDIA A100-SXM4-80GB

$1.65

/hr

Inference Speed

40.4 tokens/sec

Training Speed

2.9 sec/epoch

crusoe

NVIDIA A100 80GB PCIe

$1.65

/hr

Inference Speed

49.5 tokens/sec

Training Speed

2.6 sec/epoch

runpod

NVIDIA A100-SXM4-80GB

$1.69

/hr

Inference Speed

46.2 tokens/sec

Training Speed

3.1 sec/epoch

massedcompute

NVIDIA A100 80GB PCIe

$1.72

/hr

Inference Speed

51.2 tokens/sec

Training Speed

1.7 sec/epoch

cudo

NVIDIA L40S

$1.75

/hr

Inference Speed

49.4 tokens/sec

Training Speed

5.4 sec/epoch

fluidstack

NVIDIA A100 80GB PCIe

$1.80

/hr

Inference Speed

45.6 tokens/sec

Training Speed

2.3 sec/epoch

cudo

NVIDIA A100 80GB PCIe

$1.83

/hr

Inference Speed

57.2 tokens/sec

Training Speed

2.9 sec/epoch

tensordock

NVIDIA RTX A6000

$1.83

/hr

Inference Speed

47.4 tokens/sec

Training Speed

4.9 sec/epoch

hyperstack

NVIDIA H100 PCIe

$1.90

/hr

Inference Speed

59.4 tokens/sec

Training Speed

1.6 sec/epoch

paperspace

NVIDIA RTX A6000

$1.93

/hr

Inference Speed

46.4 tokens/sec

Training Speed

2.2 sec/epoch

tensordock

NVIDIA GeForce RTX 3090

$1.95

/hr

Inference Speed

48.9 tokens/sec

Training Speed

2.8 sec/epoch

imwt

NVIDIA RTX A6000 4 GPUs

$1.96

/hr

Inference Speed

22.3 tokens/sec

Training Speed

3.8 sec/epoch

oblivus

NVIDIA H100 PCIe

$1.98

/hr

Inference Speed

60.7 tokens/sec

Training Speed

1.7 sec/epoch

massedcompute

NVIDIA L40 2 GPUs

$1.98

/hr

Inference Speed

45.5 tokens/sec

Training Speed

2.3 sec/epoch

hyperstack

NVIDIA RTX A6000 4 GPUs

$2.00

/hr

Inference Speed

44.6 tokens/sec

Training Speed

2.1 sec/epoch

hyperstack

NVIDIA L40 2 GPUs

$2.00

/hr

Inference Speed

45.5 tokens/sec

Training Speed

2.3 sec/epoch

datacrunch

NVIDIA RTX A6000 2 GPUs

$2.02

/hr

Inference Speed

43.2 tokens/sec

Training Speed

2.8 sec/epoch

valdi

NVIDIA RTX A5000 4 GPUs

$2.08

/hr

Inference Speed

40.7 tokens/sec

Training Speed

1.8 sec/epoch

vastai

NVIDIA H100 80GB HBM3

$2.10

/hr

Inference Speed

77.2 tokens/sec

Training Speed

1.5 sec/epoch

vastai

NVIDIA GeForce RTX 4090 8 GPUs

$2.13

/hr

Inference Speed

56.0 tokens/sec

Training Speed

8.7 sec/epoch

oblivus

NVIDIA RTX A6000 4 GPUs

$2.20

/hr

Inference Speed

45.8 tokens/sec

Training Speed

2.1 sec/epoch

crusoe

NVIDIA A40 2 GPUs

$2.20

/hr

Inference Speed

40.0 tokens/sec

Training Speed

2.5 sec/epoch

massedcompute

NVIDIA RTX A6000 4 GPUs

$2.28

/hr

Inference Speed

23.1 tokens/sec

Training Speed

3.7 sec/epoch

massedcompute

NVIDIA RTX A6000 4 GPUs

$2.28

/hr

Inference Speed

21.8 tokens/sec

Training Speed

3.6 sec/epoch

massedcompute

NVIDIA RTX A6000 4 GPUs

$2.28

/hr

Inference Speed

22.9 tokens/sec

Training Speed

3.7 sec/epoch

massedcompute

NVIDIA RTX A6000 4 GPUs

$2.28

/hr

Inference Speed

42.8 tokens/sec

Training Speed

2.1 sec/epoch

massedcompute

NVIDIA RTX A6000 4 GPUs

$2.32

/hr

Inference Speed

19.5 tokens/sec

Training Speed

3.6 sec/epoch

datacrunch

NVIDIA RTX 6000 Ada Generation 2 GPUs

$2.38

/hr

Inference Speed

49.2 tokens/sec

Training Speed

2.4 sec/epoch

denvr

NVIDIA H100 80GB HBM3

$2.44

/hr

Inference Speed

0.0 tokens/sec

Training Speed

6.1 sec/epoch

vastai

NVIDIA GeForce RTX 4090 8 GPUs

$2.48

/hr

Inference Speed

47.3 tokens/sec

Training Speed

2.2 sec/epoch

imwt

NVIDIA H100 PCIe

$2.48

/hr

Inference Speed

38.7 tokens/sec

Training Speed

1.8 sec/epoch

lambdalabs

NVIDIA H100 PCIe

$2.49

/hr

Inference Speed

72.1 tokens/sec

Training Speed

12.1 sec/epoch

denvr

NVIDIA A100-PCIE-40GB 2 GPUs

$2.50

/hr

Inference Speed

49.2 tokens/sec

Training Speed

3.4 sec/epoch

denvr

NVIDIA A100-SXM4-40GB 2 GPUs

$2.50

/hr

Inference Speed

0.0 tokens/sec

Training Speed

4.6 sec/epoch

fluidstack

NVIDIA L40 2 GPUs

$2.50

/hr

Inference Speed

48.0 tokens/sec

Training Speed

2.5 sec/epoch

massedcompute

NVIDIA L40S 2 GPUs

$2.60

/hr

Inference Speed

49.1 tokens/sec

Training Speed

1.6 sec/epoch

datacrunch

NVIDIA H100 80GB HBM3

$2.65

/hr

Inference Speed

88.8 tokens/sec

Training Speed

1.2 sec/epoch

hyperstack

NVIDIA A100 80GB PCIe 2 GPUs

$2.70

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.2 sec/epoch

hyperstack

NVIDIA A100 80GB PCIe 2 GPUs

$2.70

/hr

Inference Speed

46.2 tokens/sec

Training Speed

2.3 sec/epoch

valdi

NVIDIA RTX A6000 4 GPUs

$2.72

/hr

Inference Speed

47.4 tokens/sec

Training Speed

1.8 sec/epoch

valdi

NVIDIA A40 4 GPUs

$2.72

/hr

Inference Speed

39.7 tokens/sec

Training Speed

1.9 sec/epoch

vastai

NVIDIA GeForce RTX 4090 8 GPUs

$2.80

/hr

Inference Speed

56.1 tokens/sec

Training Speed

2.7 sec/epoch

fluidstack

NVIDIA H100 PCIe

$2.89

/hr

Inference Speed

58.8 tokens/sec

Training Speed

1.7 sec/epoch

crusoe

NVIDIA L40S 2 GPUs

$2.90

/hr

Inference Speed

50.0 tokens/sec

Training Speed

2.9 sec/epoch

crusoe

NVIDIA L40S 2 GPUs

$2.90

/hr

Inference Speed

49.9 tokens/sec

Training Speed

2.4 sec/epoch

crusoe

NVIDIA A100-PCIE-40GB 2 GPUs

$2.90

/hr

Inference Speed

49.0 tokens/sec

Training Speed

2.8 sec/epoch

oblivus

NVIDIA A100 80GB PCIe 2 GPUs

$2.95

/hr

Inference Speed

44.5 tokens/sec

Training Speed

2.3 sec/epoch

massedcompute

NVIDIA H100 PCIe

$2.98

/hr

Inference Speed

41.0 tokens/sec

Training Speed

1.9 sec/epoch

fluidstack

NVIDIA H100 80GB HBM3

$2.99

/hr

Inference Speed

88.7 tokens/sec

Training Speed

1.3 sec/epoch

vastai

NVIDIA GeForce RTX 4090 12 GPUs

$3.00

/hr

Inference Speed

45.4 tokens/sec

Training Speed

2.9 sec/epoch

nebius

NVIDIA H100 80GB HBM3

$3.06

/hr

Inference Speed

71.9 tokens/sec

Training Speed

1.5 sec/epoch

datacrunch

Tesla V100-SXM2-16GB 8 GPUs

$3.12

/hr

Inference Speed

38.3 tokens/sec

Training Speed

6.9 sec/epoch

cudo

NVIDIA H100 80GB HBM3

$3.18

/hr

Inference Speed

63.7 tokens/sec

Training Speed

1.8 sec/epoch

lambdalabs

NVIDIA RTX A6000 4 GPUs

$3.20

/hr

Inference Speed

42.7 tokens/sec

Training Speed

4.4 sec/epoch

paperspace

NVIDIA A100-SXM4-80GB

$3.28

/hr

Inference Speed

22.3 tokens/sec

Training Speed

2.4 sec/epoch

lambdalabs

NVIDIA H100 80GB HBM3

$3.29

/hr

Inference Speed

83.7 tokens/sec

Training Speed

1.3 sec/epoch

lambdalabs

NVIDIA H100 80GB HBM3

$3.29

/hr

Inference Speed

65.3 tokens/sec

Training Speed

1.5 sec/epoch

nebius

NVIDIA H100 80GB HBM3

$3.30

/hr

Inference Speed

77.9 tokens/sec

Training Speed

1.8 sec/epoch

crusoe

NVIDIA A100 80GB PCIe 2 GPUs

$3.30

/hr

Inference Speed

49.1 tokens/sec

Training Speed

2.4 sec/epoch

datacrunch

NVIDIA A100-SXM4-80GB 2 GPUs

$3.30

/hr

Inference Speed

29.6 tokens/sec

Training Speed

3.5 sec/epoch

runpod

NVIDIA H100 PCIe

$3.39

/hr

Inference Speed

42.0 tokens/sec

Training Speed

3.7 sec/epoch

digitalocean

NVIDIA H100 80GB HBM3

$3.39

/hr

Inference Speed

68.2 tokens/sec

Training Speed

1.7 sec/epoch

digitalocean

NVIDIA H100 80GB HBM3

$3.39

/hr

Inference Speed

65.1 tokens/sec

Training Speed

1.7 sec/epoch

nebius

NVIDIA H100 80GB HBM3

$3.55

/hr

Inference Speed

68.0 tokens/sec

Training Speed

1.5 sec/epoch

fluidstack

NVIDIA A100 80GB PCIe 2 GPUs

$3.60

/hr

Inference Speed

40.5 tokens/sec

Training Speed

2.4 sec/epoch

nebius

NVIDIA H200

$3.65

/hr

Inference Speed

83.3 tokens/sec

Training Speed

1.5 sec/epoch

cudo

NVIDIA A100 80GB PCIe 2 GPUs

$3.66

/hr

Inference Speed

64.3 tokens/sec

Training Speed

5.3 sec/epoch

hyperstack

NVIDIA H100 PCIe 2 GPUs

$3.80

/hr

Inference Speed

58.9 tokens/sec

Training Speed

1.7 sec/epoch

runpod

NVIDIA H100 80GB HBM3

$3.89

/hr

Inference Speed

81.5 tokens/sec

Training Speed

7.7 sec/epoch

imwt

NVIDIA RTX A6000 8 GPUs

$3.92

/hr

Inference Speed

21.6 tokens/sec

Training Speed

4.1 sec/epoch

oblivus

NVIDIA H100 PCIe 2 GPUs

$3.96

/hr

Inference Speed

59.6 tokens/sec

Training Speed

1.7 sec/epoch

hyperstack

NVIDIA RTX A6000 8 GPUs

$4.00

/hr

Inference Speed

44.8 tokens/sec

Training Speed

2.3 sec/epoch

hyperstack

NVIDIA L40 4 GPUs

$4.00

/hr

Inference Speed

47.1 tokens/sec

Training Speed

2.3 sec/epoch

tensordock

NVIDIA RTX A6000

$4.02

/hr

Inference Speed

47.7 tokens/sec

Training Speed

3.4 sec/epoch

datacrunch

NVIDIA RTX A6000 4 GPUs

$4.04

/hr

Inference Speed

43.9 tokens/sec

Training Speed

3.1 sec/epoch

valdi

NVIDIA H100 80GB HBM3

$4.14

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.8 sec/epoch

valdi

NVIDIA H100 80GB HBM3

$4.14

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.2 sec/epoch

vastai

NVIDIA GeForce RTX 4090 12 GPUs

$4.16

/hr

Inference Speed

55.5 tokens/sec

Training Speed

1.7 sec/epoch

valdi

NVIDIA RTX A5000 8 GPUs

$4.16

/hr

Inference Speed

40.9 tokens/sec

Training Speed

1.7 sec/epoch

datacrunch

NVIDIA H200

$4.35

/hr

Inference Speed

69.5 tokens/sec

Training Speed

2.4 sec/epoch

oblivus

NVIDIA RTX A6000 8 GPUs

$4.40

/hr

Inference Speed

46.1 tokens/sec

Training Speed

2.3 sec/epoch

lambdalabs

Tesla V100-SXM2-16GB 8 GPUs

$4.40

/hr

Inference Speed

40.6 tokens/sec

Training Speed

6.7 sec/epoch

crusoe

NVIDIA A40 4 GPUs

$4.40

/hr

Inference Speed

44.9 tokens/sec

Training Speed

2.5 sec/epoch

massedcompute

NVIDIA RTX A6000 8 GPUs

$4.56

/hr

Inference Speed

21.2 tokens/sec

Training Speed

4.1 sec/epoch

massedcompute

NVIDIA RTX A6000 8 GPUs

$4.56

/hr

Inference Speed

22.5 tokens/sec

Training Speed

3.8 sec/epoch

datacrunch

NVIDIA RTX 6000 Ada Generation 4 GPUs

$4.76

/hr

Inference Speed

47.7 tokens/sec

Training Speed

2.1 sec/epoch

imwt

NVIDIA H100 PCIe 2 GPUs

$4.96

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.1 sec/epoch

imwt

NVIDIA H100 PCIe 2 GPUs

$4.96

/hr

Inference Speed

0.0 tokens/sec

Training Speed

1.9 sec/epoch

denvr

NVIDIA A100-SXM4-40GB 4 GPUs

$5.00

/hr

Inference Speed

0.0 tokens/sec

Training Speed

4.0 sec/epoch

fluidstack

NVIDIA L40 4 GPUs

$5.00

/hr

Inference Speed

47.0 tokens/sec

Training Speed

2.2 sec/epoch

hyperstack

NVIDIA A100 80GB PCIe 4 GPUs

$5.40

/hr

Inference Speed

44.7 tokens/sec

Training Speed

2.3 sec/epoch

fluidstack

NVIDIA H100 PCIe 2 GPUs

$5.78

/hr

Inference Speed

58.0 tokens/sec

Training Speed

1.6 sec/epoch

crusoe

NVIDIA L40S 4 GPUs

$5.80

/hr

Inference Speed

50.0 tokens/sec

Training Speed

1.9 sec/epoch

crusoe

NVIDIA A100-PCIE-40GB 4 GPUs

$5.80

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.1 sec/epoch

crusoe

NVIDIA L40S 4 GPUs

$5.80

/hr

Inference Speed

49.8 tokens/sec

Training Speed

2.4 sec/epoch

oblivus

NVIDIA A100 80GB PCIe 4 GPUs

$5.89

/hr

Inference Speed

45.1 tokens/sec

Training Speed

2.5 sec/epoch

massedcompute

NVIDIA H100 PCIe 2 GPUs

$5.96

/hr

Inference Speed

41.7 tokens/sec

Training Speed

2.1 sec/epoch

paperspace

NVIDIA H100 80GB HBM3

$5.99

/hr

Inference Speed

67.9 tokens/sec

Training Speed

1.9 sec/epoch

denvr

NVIDIA A100-SXM4-80GB 4 GPUs

$6.00

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.3 sec/epoch

massedcompute

NVIDIA H100 NVL 2 GPUs

$6.32

/hr

Inference Speed

54.7 tokens/sec

Training Speed

1.8 sec/epoch

lambdalabs

NVIDIA H100 80GB HBM3 2 GPUs

$6.38

/hr

Inference Speed

78.7 tokens/sec

Training Speed

1.4 sec/epoch

crusoe

NVIDIA A100 80GB PCIe 4 GPUs

$6.60

/hr

Inference Speed

48.0 tokens/sec

Training Speed

2.8 sec/epoch

datacrunch

NVIDIA A100-SXM4-80GB 4 GPUs

$6.60

/hr

Inference Speed

40.5 tokens/sec

Training Speed

3.6 sec/epoch

nebius

NVIDIA H100 80GB HBM3 2 GPUs

$7.10

/hr

Inference Speed

68.3 tokens/sec

Training Speed

1.5 sec/epoch

fluidstack

NVIDIA A100 80GB PCIe 4 GPUs

$7.20

/hr

Inference Speed

43.3 tokens/sec

Training Speed

2.5 sec/epoch

hyperstack

NVIDIA H100 PCIe 4 GPUs

$7.60

/hr

Inference Speed

56.3 tokens/sec

Training Speed

1.6 sec/epoch

oblivus

NVIDIA H100 PCIe 4 GPUs

$7.92

/hr

Inference Speed

60.9 tokens/sec

Training Speed

1.7 sec/epoch

hyperstack

NVIDIA L40 8 GPUs

$8.00

/hr

Inference Speed

47.9 tokens/sec

Training Speed

2.4 sec/epoch

valdi

NVIDIA H100 80GB HBM3 2 GPUs

$8.28

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.9 sec/epoch

tensordock

NVIDIA A100-SXM4-80GB

$8.42

/hr

Inference Speed

51.8 tokens/sec

Training Speed

5.3 sec/epoch

datacrunch

NVIDIA H200 2 GPUs

$8.70

/hr

Inference Speed

69.2 tokens/sec

Training Speed

2.4 sec/epoch

crusoe

NVIDIA A40 8 GPUs

$8.80

/hr

Inference Speed

44.8 tokens/sec

Training Speed

2.1 sec/epoch

tensordock

NVIDIA A100-SXM4-80GB

$9.86

/hr

Inference Speed

48.2 tokens/sec

Training Speed

2.6 sec/epoch

imwt

NVIDIA H100 PCIe 4 GPUs

$9.92

/hr

Inference Speed

39.6 tokens/sec

Training Speed

1.9 sec/epoch

tensordock

NVIDIA A100-SXM4-80GB

$9.95

/hr

Inference Speed

44.9 tokens/sec

Training Speed

5.0 sec/epoch

denvr

NVIDIA A100-SXM4-40GB 8 GPUs

$10.00

/hr

Inference Speed

42.4 tokens/sec

Training Speed

2.4 sec/epoch

lambdalabs

NVIDIA A100-SXM4-40GB 8 GPUs

$10.32

/hr

Inference Speed

0.0 tokens/sec

Training Speed

1.9 sec/epoch

lambdalabs

NVIDIA A100-SXM4-40GB 8 GPUs

$10.32

/hr

Inference Speed

40.6 tokens/sec

Training Speed

2.1 sec/epoch

lambdalabs

NVIDIA A100-SXM4-40GB 8 GPUs

$10.32

/hr

Inference Speed

42.7 tokens/sec

Training Speed

2.6 sec/epoch

hyperstack

NVIDIA A100 80GB PCIe 8 GPUs

$10.80

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.8 sec/epoch

datacrunch

NVIDIA L40S 8 GPUs

$10.88

/hr

Inference Speed

40.1 tokens/sec

Training Speed

3.8 sec/epoch

hyperstack

NVIDIA A100 80GB PCIe 8 GPUs

$11.20

/hr

Inference Speed

64.6 tokens/sec

Training Speed

1.7 sec/epoch

crusoe

NVIDIA L40S 8 GPUs

$11.60

/hr

Inference Speed

49.8 tokens/sec

Training Speed

2.0 sec/epoch

crusoe

NVIDIA A100-PCIE-40GB 8 GPUs

$11.60

/hr

Inference Speed

48.6 tokens/sec

Training Speed

2.7 sec/epoch

crusoe

NVIDIA L40S 8 GPUs

$11.60

/hr

Inference Speed

49.8 tokens/sec

Training Speed

2.2 sec/epoch

oblivus

NVIDIA A100 80GB PCIe 8 GPUs

$11.77

/hr

Inference Speed

65.6 tokens/sec

Training Speed

1.5 sec/epoch

massedcompute

NVIDIA H100 PCIe 4 GPUs

$11.92

/hr

Inference Speed

40.4 tokens/sec

Training Speed

1.8 sec/epoch

lambdalabs

NVIDIA H100 80GB HBM3 4 GPUs

$12.36

/hr

Inference Speed

81.2 tokens/sec

Training Speed

1.3 sec/epoch

oblivus

NVIDIA A100 80GB PCIe 8 GPUs

$12.57

/hr

Inference Speed

65.6 tokens/sec

Training Speed

1.7 sec/epoch

datacrunch

NVIDIA A100-SXM4-80GB 8 GPUs

$13.20

/hr

Inference Speed

40.2 tokens/sec

Training Speed

3.3 sec/epoch

crusoe

NVIDIA A100 80GB PCIe 8 GPUs

$13.20

/hr

Inference Speed

47.7 tokens/sec

Training Speed

2.3 sec/epoch

nebius

NVIDIA H100 80GB HBM3 4 GPUs

$14.20

/hr

Inference Speed

73.5 tokens/sec

Training Speed

1.5 sec/epoch

lambdalabs

NVIDIA A100-SXM4-80GB 8 GPUs

$14.32

/hr

Inference Speed

39.3 tokens/sec

Training Speed

2.5 sec/epoch

crusoe

NVIDIA L40S 10 GPUs

$14.50

/hr

Inference Speed

49.7 tokens/sec

Training Speed

1.4 sec/epoch

crusoe

NVIDIA L40S 10 GPUs

$14.50

/hr

Inference Speed

49.8 tokens/sec

Training Speed

2.9 sec/epoch

hyperstack

NVIDIA RTX A4000

$15.00

/hr

Inference Speed

25.3 tokens/sec

Training Speed

3.6 sec/epoch

hyperstack

NVIDIA RTX A4000

$15.00

/hr

Inference Speed

3.5 tokens/sec

Training Speed

24.1 sec/epoch

hyperstack

NVIDIA H100 PCIe 8 GPUs

$15.20

/hr

Inference Speed

57.2 tokens/sec

Training Speed

1.7 sec/epoch

hyperstack

NVIDIA H100 PCIe 8 GPUs

$15.60

/hr

Inference Speed

55.5 tokens/sec

Training Speed

1.8 sec/epoch

tensordock

NVIDIA H100 80GB HBM3

$15.87

/hr

Inference Speed

70.8 tokens/sec

Training Speed

2.2 sec/epoch

valdi

NVIDIA H100 80GB HBM3 4 GPUs

$16.56

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.7 sec/epoch

valdi

NVIDIA H100 80GB HBM3 4 GPUs

$16.56

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.2 sec/epoch

datacrunch

NVIDIA H200 4 GPUs

$17.40

/hr

Inference Speed

65.0 tokens/sec

Training Speed

3.2 sec/epoch

vastai

NVIDIA H100 NVL 8 GPUs

$18.13

/hr

Inference Speed

70.3 tokens/sec

Training Speed

1.7 sec/epoch

tensordock

NVIDIA A100-SXM4-80GB

$19.27

/hr

Inference Speed

46.7 tokens/sec

Training Speed

5.0 sec/epoch

vastai

NVIDIA H100 NVL 8 GPUs

$19.73

/hr

Inference Speed

58.9 tokens/sec

Training Speed

1.8 sec/epoch

oblivus

NVIDIA RTX A4000

$20.00

/hr

Inference Speed

25.1 tokens/sec

Training Speed

3.1 sec/epoch

tensordock

NVIDIA A100-SXM4-80GB

$20.10

/hr

Inference Speed

47.1 tokens/sec

Training Speed

5.1 sec/epoch

lambdalabs

NVIDIA H100 80GB HBM3 8 GPUs

$23.92

/hr

Inference Speed

64.0 tokens/sec

Training Speed

1.5 sec/epoch

digitalocean

NVIDIA H100 80GB HBM3 8 GPUs

$23.92

/hr

Inference Speed

64.7 tokens/sec

Training Speed

1.9 sec/epoch

nebius

NVIDIA H100 80GB HBM3 8 GPUs

$23.99

/hr

Inference Speed

79.0 tokens/sec

Training Speed

1.5 sec/epoch

paperspace

NVIDIA A100-SXM4-80GB 8 GPUs

$25.76

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.5 sec/epoch

nebius

NVIDIA H100 80GB HBM3 8 GPUs

$28.39

/hr

Inference Speed

65.6 tokens/sec

Training Speed

1.5 sec/epoch

hyperstack

NVIDIA RTX A4000 2 GPUs

$30.00

/hr

Inference Speed

25.1 tokens/sec

Training Speed

3.1 sec/epoch

massedcompute

NVIDIA A30

$33.00

/hr

Inference Speed

32.7 tokens/sec

Training Speed

2.3 sec/epoch

datacrunch

NVIDIA H200 8 GPUs

$34.80

/hr

Inference Speed

64.6 tokens/sec

Training Speed

3.3 sec/epoch

datacrunch

Tesla V100-SXM2-16GB

$39.00

/hr

Inference Speed

36.4 tokens/sec

Training Speed

4.2 sec/epoch

oblivus

NVIDIA RTX A4000 2 GPUs

$40.00

/hr

Inference Speed

25.1 tokens/sec

Training Speed

4.2 sec/epoch

massedcompute

NVIDIA RTX A5000

$41.00

/hr

Inference Speed

0.0 tokens/sec

Training Speed

3.6 sec/epoch

cudo

NVIDIA RTX A4000

$47.00

/hr

Inference Speed

24.2 tokens/sec

Training Speed

3.5 sec/epoch

imwt

NVIDIA RTX A6000

$49.00

/hr

Inference Speed

23.0 tokens/sec

Training Speed

3.6 sec/epoch

imwt

NVIDIA RTX A6000

$49.00

/hr

Inference Speed

20.5 tokens/sec

Training Speed

3.5 sec/epoch

cudo

NVIDIA RTX A5000

$49.00

/hr

Inference Speed

35.8 tokens/sec

Training Speed

6.5 sec/epoch

hyperstack

NVIDIA RTX A6000

$50.00

/hr

Inference Speed

44.4 tokens/sec

Training Speed

2.3 sec/epoch

oblivus

NVIDIA RTX A6000

$55.00

/hr

Inference Speed

47.6 tokens/sec

Training Speed

3.5 sec/epoch

oblivus

NVIDIA RTX A6000

$55.00

/hr

Inference Speed

43.4 tokens/sec

Training Speed

2.3 sec/epoch

valdi

NVIDIA RTX A5000

$57.00

/hr

Inference Speed

39.9 tokens/sec

Training Speed

2.5 sec/epoch

massedcompute

NVIDIA RTX A6000

$57.00

/hr

Inference Speed

44.3 tokens/sec

Training Speed

2.0 sec/epoch

massedcompute

NVIDIA RTX A6000

$57.00

/hr

Inference Speed

26.7 tokens/sec

Training Speed

3.4 sec/epoch

massedcompute

NVIDIA RTX A6000

$57.00

/hr

Inference Speed

20.3 tokens/sec

Training Speed

3.6 sec/epoch

massedcompute

NVIDIA RTX A6000

$57.00

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.2 sec/epoch

massedcompute

NVIDIA RTX A6000

$57.00

/hr

Inference Speed

20.9 tokens/sec

Training Speed

3.3 sec/epoch

excesssupply

NVIDIA GeForce RTX 4090

$60.00

/hr

Inference Speed

50.5 tokens/sec

Training Speed

3.4 sec/epoch

valdi

NVIDIA A40

$68.00

/hr

Inference Speed

38.8 tokens/sec

Training Speed

1.9 sec/epoch

valdi

NVIDIA RTX A6000

$68.00

/hr

Inference Speed

43.8 tokens/sec

Training Speed

2.1 sec/epoch

valdi

NVIDIA RTX A6000

$74.00

/hr

Inference Speed

43.7 tokens/sec

Training Speed

3.2 sec/epoch

lambdalabs

NVIDIA A10

$75.00

/hr

Inference Speed

30.7 tokens/sec

Training Speed

1.5 sec/epoch

datacrunch

Tesla V100-SXM2-16GB 2 GPUs

$78.00

/hr

Inference Speed

37.0 tokens/sec

Training Speed

5.1 sec/epoch

oblivus

NVIDIA RTX A4000 4 GPUs

$80.00

/hr

Inference Speed

25.2 tokens/sec

Training Speed

4.1 sec/epoch

lambdalabs

NVIDIA RTX A6000

$80.00

/hr

Inference Speed

0.0 tokens/sec

Training Speed

4.8 sec/epoch

massedcompute

NVIDIA RTX A5000 2 GPUs

$82.00

/hr

Inference Speed

19.8 tokens/sec

Training Speed

3.4 sec/epoch

cudo

NVIDIA RTX A4000 2 GPUs

$94.00

/hr

Inference Speed

25.3 tokens/sec

Training Speed

3.1 sec/epoch

cudo

NVIDIA RTX A5000

$97.00

/hr

Inference Speed

38.7 tokens/sec

Training Speed

1.9 sec/epoch

imwt

NVIDIA RTX A6000 2 GPUs

$98.00

/hr

Inference Speed

22.4 tokens/sec

Training Speed

3.9 sec/epoch

imwt

NVIDIA RTX A6000 2 GPUs

$98.00

/hr

Inference Speed

22.1 tokens/sec

Training Speed

3.5 sec/epoch

massedcompute

NVIDIA L40

$99.00

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.7 sec/epoch

hyperstack

NVIDIA RTX A6000 2 GPUs

$100.00

/hr

Inference Speed

45.4 tokens/sec

Training Speed

2.3 sec/epoch

hyperstack

NVIDIA L40

$100.00

/hr

Inference Speed

42.8 tokens/sec

Training Speed

2.5 sec/epoch