Dashboard

vastai

NVIDIA GeForce RTX 4090 12 GPUs

$0.03

/hr

Inference Speed

45.4 tokens/sec

Training Speed

2.9 sec/epoch

vastai

NVIDIA GeForce RTX 4090

$0.07

/hr

Inference Speed

42.7 tokens/sec

Training Speed

2.4 sec/epoch

vastai

NVIDIA GeForce RTX 3090

$0.08

/hr

Inference Speed

0.0 tokens/sec

Training Speed

1.5 sec/epoch

vastai

NVIDIA GeForce RTX 3090

$0.11

/hr

Inference Speed

31.6 tokens/sec

Training Speed

4.2 sec/epoch

vastai

NVIDIA GeForce RTX 4090

$0.15

/hr

Inference Speed

60.3 tokens/sec

Training Speed

1.8 sec/epoch

vastai

NVIDIA GeForce RTX 3090

$0.15

/hr

Inference Speed

45.0 tokens/sec

Training Speed

2.7 sec/epoch

hyperstack

NVIDIA RTX A4000

$0.15

/hr

Inference Speed

25.3 tokens/sec

Training Speed

3.6 sec/epoch

hyperstack

NVIDIA RTX A4000

$0.15

/hr

Inference Speed

3.5 tokens/sec

Training Speed

24.1 sec/epoch

oblivus

NVIDIA RTX A4000

$0.20

/hr

Inference Speed

25.1 tokens/sec

Training Speed

3.1 sec/epoch

vastai

NVIDIA H100 PCIe

$0.26

/hr

Inference Speed

47.9 tokens/sec

Training Speed

1.7 sec/epoch

hyperstack

NVIDIA RTX A4000 2 GPUs

$0.30

/hr

Inference Speed

25.1 tokens/sec

Training Speed

3.1 sec/epoch

vastai

NVIDIA GeForce RTX 4090

$0.33

/hr

Inference Speed

46.1 tokens/sec

Training Speed

2.9 sec/epoch

vastai

NVIDIA GeForce RTX 4090

$0.33

/hr

Inference Speed

44.5 tokens/sec

Training Speed

2.9 sec/epoch

massedcompute

NVIDIA A30

$0.33

/hr

Inference Speed

32.7 tokens/sec

Training Speed

2.3 sec/epoch

oblivus

NVIDIA RTX A4000 2 GPUs

$0.40

/hr

Inference Speed

25.1 tokens/sec

Training Speed

4.2 sec/epoch

massedcompute

NVIDIA RTX A5000

$0.41

/hr

Inference Speed

0.0 tokens/sec

Training Speed

3.6 sec/epoch

tensordock

NVIDIA GeForce RTX 3090

$0.43

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.6 sec/epoch

cudo

NVIDIA RTX A4000

$0.47

/hr

Inference Speed

24.2 tokens/sec

Training Speed

3.5 sec/epoch

imwt

NVIDIA RTX A6000

$0.49

/hr

Inference Speed

23.0 tokens/sec

Training Speed

3.6 sec/epoch

imwt

NVIDIA RTX A6000

$0.49

/hr

Inference Speed

20.5 tokens/sec

Training Speed

3.5 sec/epoch

hyperstack

NVIDIA RTX A6000

$0.50

/hr

Inference Speed

44.4 tokens/sec

Training Speed

2.3 sec/epoch

vastai

NVIDIA GeForce RTX 4090

$0.50

/hr

Inference Speed

38.4 tokens/sec

Training Speed

2.9 sec/epoch

tensordock

NVIDIA RTX A6000

$0.52

/hr

Inference Speed

47.7 tokens/sec

Training Speed

3.6 sec/epoch

runpod

NVIDIA GeForce RTX 4090

$0.54

/hr

Inference Speed

39.6 tokens/sec

Training Speed

3.6 sec/epoch

oblivus

NVIDIA RTX A6000

$0.55

/hr

Inference Speed

47.6 tokens/sec

Training Speed

3.5 sec/epoch

oblivus

NVIDIA RTX A6000

$0.55

/hr

Inference Speed

43.4 tokens/sec

Training Speed

2.3 sec/epoch

valdi

NVIDIA RTX A5000

$0.57

/hr

Inference Speed

39.9 tokens/sec

Training Speed

2.5 sec/epoch

massedcompute

NVIDIA RTX A6000

$0.57

/hr

Inference Speed

44.3 tokens/sec

Training Speed

2.0 sec/epoch

massedcompute

NVIDIA RTX A6000

$0.57

/hr

Inference Speed

26.7 tokens/sec

Training Speed

3.4 sec/epoch

massedcompute

NVIDIA RTX A6000

$0.57

/hr

Inference Speed

20.3 tokens/sec

Training Speed

3.6 sec/epoch

massedcompute

NVIDIA RTX A6000

$0.57

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.2 sec/epoch

massedcompute

NVIDIA RTX A6000

$0.57

/hr

Inference Speed

20.9 tokens/sec

Training Speed

3.3 sec/epoch

tensordock

NVIDIA GeForce RTX 4090

$0.59

/hr

Inference Speed

58.9 tokens/sec

Training Speed

2.1 sec/epoch

valdi

NVIDIA A40

$0.68

/hr

Inference Speed

38.8 tokens/sec

Training Speed

1.9 sec/epoch

valdi

NVIDIA RTX A6000

$0.68

/hr

Inference Speed

43.8 tokens/sec

Training Speed

2.1 sec/epoch

valdi

NVIDIA RTX A6000

$0.74

/hr

Inference Speed

43.7 tokens/sec

Training Speed

3.2 sec/epoch

tensordock

NVIDIA GeForce RTX 3090

$0.77

/hr

Inference Speed

0.0 tokens/sec

Training Speed

1.9 sec/epoch

oblivus

NVIDIA RTX A4000 4 GPUs

$0.80

/hr

Inference Speed

25.2 tokens/sec

Training Speed

4.1 sec/epoch

lambdalabs

NVIDIA RTX A6000

$0.80

/hr

Inference Speed

0.0 tokens/sec

Training Speed

4.8 sec/epoch

tensordock

NVIDIA RTX A6000

$0.81

/hr

Inference Speed

42.4 tokens/sec

Training Speed

3.7 sec/epoch

massedcompute

NVIDIA RTX A5000 2 GPUs

$0.82

/hr

Inference Speed

19.8 tokens/sec

Training Speed

3.4 sec/epoch

tensordock

NVIDIA RTX A6000

$0.89

/hr

Inference Speed

40.0 tokens/sec

Training Speed

3.7 sec/epoch

cudo

NVIDIA RTX A4000 2 GPUs

$0.94

/hr

Inference Speed

25.3 tokens/sec

Training Speed

3.1 sec/epoch

tensordock

NVIDIA GeForce RTX 4090

$0.98

/hr

Inference Speed

25.1 tokens/sec

Training Speed

5.1 sec/epoch

imwt

NVIDIA RTX A6000 2 GPUs

$0.98

/hr

Inference Speed

22.4 tokens/sec

Training Speed

3.9 sec/epoch

imwt

NVIDIA RTX A6000 2 GPUs

$0.98

/hr

Inference Speed

22.1 tokens/sec

Training Speed

3.5 sec/epoch

hyperstack

NVIDIA RTX A6000 2 GPUs

$1.00

/hr

Inference Speed

45.4 tokens/sec

Training Speed

2.3 sec/epoch

datacrunch

NVIDIA RTX A6000

$1.01

/hr

Inference Speed

44.7 tokens/sec

Training Speed

2.8 sec/epoch

valdi

NVIDIA RTX A5000 2 GPUs

$1.04

/hr

Inference Speed

40.0 tokens/sec

Training Speed

1.8 sec/epoch

tensordock

NVIDIA GeForce RTX 4090

$1.07

/hr

Inference Speed

51.9 tokens/sec

Training Speed

3.2 sec/epoch

massedcompute

NVIDIA L40S

$1.10

/hr

Inference Speed

49.6 tokens/sec

Training Speed

1.6 sec/epoch

tensordock

NVIDIA GeForce RTX 4090

$1.10

/hr

Inference Speed

48.2 tokens/sec

Training Speed

4.3 sec/epoch

massedcompute

NVIDIA RTX A6000 2 GPUs

$1.14

/hr

Inference Speed

23.9 tokens/sec

Training Speed

3.2 sec/epoch

massedcompute

NVIDIA RTX A6000 2 GPUs

$1.14

/hr

Inference Speed

23.8 tokens/sec

Training Speed

3.6 sec/epoch

massedcompute

NVIDIA RTX A6000 2 GPUs

$1.14

/hr

Inference Speed

41.4 tokens/sec

Training Speed

2.0 sec/epoch

massedcompute

NVIDIA RTX A6000 2 GPUs

$1.14

/hr

Inference Speed

20.9 tokens/sec

Training Speed

3.6 sec/epoch

massedcompute

NVIDIA RTX A6000 2 GPUs

$1.14

/hr

Inference Speed

0.0 tokens/sec

Training Speed

3.4 sec/epoch

massedcompute

NVIDIA RTX A6000 2 GPUs

$1.16

/hr

Inference Speed

33.9 tokens/sec

Training Speed

1.9 sec/epoch

datacrunch

NVIDIA RTX 6000 Ada Generation

$1.19

/hr

Inference Speed

51.0 tokens/sec

Training Speed

2.4 sec/epoch

denvr

NVIDIA A100-SXM4-40GB

$1.25

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.2 sec/epoch

fluidstack

NVIDIA L40

$1.25

/hr

Inference Speed

46.1 tokens/sec

Training Speed

2.4 sec/epoch

datacrunch

NVIDIA A100-SXM4-40GB

$1.29

/hr

Inference Speed

41.9 tokens/sec

Training Speed

3.4 sec/epoch

lambdalabs

NVIDIA A100-SXM4-40GB

$1.29

/hr

Inference Speed

40.1 tokens/sec

Training Speed

1.9 sec/epoch

lambdalabs

NVIDIA A100-SXM4-40GB

$1.29

/hr

Inference Speed

39.4 tokens/sec

Training Speed

2.0 sec/epoch

lambdalabs

NVIDIA A100-SXM4-40GB

$1.29

/hr

Inference Speed

40.4 tokens/sec

Training Speed

1.9 sec/epoch

lambdalabs

NVIDIA A100-SXM4-40GB

$1.29

/hr

Inference Speed

39.4 tokens/sec

Training Speed

2.0 sec/epoch

lambdalabs

NVIDIA A100-SXM4-40GB

$1.29

/hr

Inference Speed

40.0 tokens/sec

Training Speed

2.0 sec/epoch

lambdalabs

NVIDIA A100-SXM4-40GB

$1.29

/hr

Inference Speed

39.9 tokens/sec

Training Speed

2.0 sec/epoch

tensordock

NVIDIA GeForce RTX 4090

$1.34

/hr

Inference Speed

54.5 tokens/sec

Training Speed

5.3 sec/epoch

hyperstack

NVIDIA A100 80GB PCIe

$1.35

/hr

Inference Speed

45.3 tokens/sec

Training Speed

2.3 sec/epoch

valdi

NVIDIA RTX A6000 2 GPUs

$1.36

/hr

Inference Speed

46.9 tokens/sec

Training Speed

1.8 sec/epoch

valdi

NVIDIA A40 2 GPUs

$1.36

/hr

Inference Speed

39.5 tokens/sec

Training Speed

1.9 sec/epoch

datacrunch

NVIDIA L40S

$1.36

/hr

Inference Speed

39.6 tokens/sec

Training Speed

3.6 sec/epoch

crusoe

NVIDIA A100-PCIE-40GB

$1.45

/hr

Inference Speed

48.9 tokens/sec

Training Speed

2.8 sec/epoch

oblivus

NVIDIA A100 80GB PCIe

$1.48

/hr

Inference Speed

43.9 tokens/sec

Training Speed

2.1 sec/epoch

nebius

[Unknown Error]

$1.58

/hr

Inference Speed

0.0 tokens/sec

Training Speed

1.9 sec/epoch

runpod

NVIDIA A100 80GB PCIe

$1.59

/hr

Inference Speed

42.4 tokens/sec

Training Speed

2.8 sec/epoch

lambdalabs

NVIDIA RTX A6000 2 GPUs

$1.60

/hr

Inference Speed

40.2 tokens/sec

Training Speed

3.9 sec/epoch

datacrunch

NVIDIA A100-SXM4-80GB

$1.65

/hr

Inference Speed

28.4 tokens/sec

Training Speed

3.4 sec/epoch

datacrunch

NVIDIA A100-SXM4-80GB

$1.65

/hr

Inference Speed

40.4 tokens/sec

Training Speed

2.9 sec/epoch

runpod

NVIDIA A100-SXM4-80GB

$1.69

/hr

Inference Speed

46.2 tokens/sec

Training Speed

3.1 sec/epoch

massedcompute

NVIDIA A100 80GB PCIe

$1.72

/hr

Inference Speed

51.2 tokens/sec

Training Speed

1.7 sec/epoch

fluidstack

NVIDIA A100 80GB PCIe

$1.80

/hr

Inference Speed

45.6 tokens/sec

Training Speed

2.3 sec/epoch

tensordock

NVIDIA RTX A6000

$1.83

/hr

Inference Speed

47.4 tokens/sec

Training Speed

4.9 sec/epoch

paperspace

NVIDIA RTX A6000

$1.93

/hr

Inference Speed

46.4 tokens/sec

Training Speed

2.2 sec/epoch

tensordock

NVIDIA GeForce RTX 3090

$1.95

/hr

Inference Speed

48.9 tokens/sec

Training Speed

2.8 sec/epoch

imwt

NVIDIA RTX A6000 4 GPUs

$1.96

/hr

Inference Speed

22.3 tokens/sec

Training Speed

3.8 sec/epoch

oblivus

NVIDIA H100 PCIe

$1.98

/hr

Inference Speed

60.7 tokens/sec

Training Speed

1.7 sec/epoch

massedcompute

NVIDIA L40 2 GPUs

$1.98

/hr

Inference Speed

45.5 tokens/sec

Training Speed

2.3 sec/epoch

hyperstack

NVIDIA RTX A6000 4 GPUs

$2.00

/hr

Inference Speed

44.6 tokens/sec

Training Speed

2.1 sec/epoch

valdi

NVIDIA RTX A5000 4 GPUs

$2.08

/hr

Inference Speed

40.7 tokens/sec

Training Speed

1.8 sec/epoch

vastai

NVIDIA H100 80GB HBM3

$2.10

/hr

Inference Speed

77.2 tokens/sec

Training Speed

1.5 sec/epoch

vastai

NVIDIA GeForce RTX 4090 8 GPUs

$2.13

/hr

Inference Speed

56.0 tokens/sec

Training Speed

8.7 sec/epoch

oblivus

NVIDIA RTX A6000 4 GPUs

$2.20

/hr

Inference Speed

45.8 tokens/sec

Training Speed

2.1 sec/epoch

massedcompute

NVIDIA RTX A6000 4 GPUs

$2.28

/hr

Inference Speed

23.1 tokens/sec

Training Speed

3.7 sec/epoch

massedcompute

NVIDIA RTX A6000 4 GPUs

$2.28

/hr

Inference Speed

21.8 tokens/sec

Training Speed

3.6 sec/epoch

massedcompute

NVIDIA RTX A6000 4 GPUs

$2.28

/hr

Inference Speed

22.9 tokens/sec

Training Speed

3.7 sec/epoch

massedcompute

NVIDIA RTX A6000 4 GPUs

$2.28

/hr

Inference Speed

42.8 tokens/sec

Training Speed

2.1 sec/epoch

massedcompute

NVIDIA RTX A6000 4 GPUs

$2.32

/hr

Inference Speed

19.5 tokens/sec

Training Speed

3.6 sec/epoch

datacrunch

NVIDIA RTX 6000 Ada Generation 2 GPUs

$2.38

/hr

Inference Speed

49.2 tokens/sec

Training Speed

2.4 sec/epoch

denvr

NVIDIA H100 80GB HBM3

$2.44

/hr

Inference Speed

0.0 tokens/sec

Training Speed

6.1 sec/epoch

vastai

NVIDIA GeForce RTX 4090 8 GPUs

$2.48

/hr

Inference Speed

47.3 tokens/sec

Training Speed

2.2 sec/epoch

imwt

NVIDIA H100 PCIe

$2.48

/hr

Inference Speed

38.7 tokens/sec

Training Speed

1.8 sec/epoch

denvr

NVIDIA A100-PCIE-40GB 2 GPUs

$2.50

/hr

Inference Speed

49.2 tokens/sec

Training Speed

3.4 sec/epoch

denvr

NVIDIA A100-SXM4-40GB 2 GPUs

$2.50

/hr

Inference Speed

0.0 tokens/sec

Training Speed

4.6 sec/epoch

fluidstack

NVIDIA L40 2 GPUs

$2.50

/hr

Inference Speed

48.0 tokens/sec

Training Speed

2.5 sec/epoch

massedcompute

NVIDIA L40S 2 GPUs

$2.60

/hr

Inference Speed

49.1 tokens/sec

Training Speed

1.6 sec/epoch

hyperstack

NVIDIA A100 80GB PCIe 2 GPUs

$2.70

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.2 sec/epoch

valdi

NVIDIA RTX A6000 4 GPUs

$2.72

/hr

Inference Speed

47.4 tokens/sec

Training Speed

1.8 sec/epoch

valdi

NVIDIA A40 4 GPUs

$2.72

/hr

Inference Speed

39.7 tokens/sec

Training Speed

1.9 sec/epoch

vastai

NVIDIA GeForce RTX 4090 8 GPUs

$2.80

/hr

Inference Speed

56.1 tokens/sec

Training Speed

2.7 sec/epoch

fluidstack

NVIDIA H100 PCIe

$2.89

/hr

Inference Speed

58.8 tokens/sec

Training Speed

1.7 sec/epoch

crusoe

NVIDIA A100-PCIE-40GB 2 GPUs

$2.90

/hr

Inference Speed

49.0 tokens/sec

Training Speed

2.8 sec/epoch

oblivus

NVIDIA A100 80GB PCIe 2 GPUs

$2.95

/hr

Inference Speed

44.5 tokens/sec

Training Speed

2.3 sec/epoch

massedcompute

NVIDIA H100 PCIe

$2.98

/hr

Inference Speed

41.0 tokens/sec

Training Speed

1.9 sec/epoch

datacrunch

Tesla V100-SXM2-16GB 8 GPUs

$3.12

/hr

Inference Speed

38.3 tokens/sec

Training Speed

6.9 sec/epoch

cudo

NVIDIA H100 80GB HBM3

$3.18

/hr

Inference Speed

63.7 tokens/sec

Training Speed

1.8 sec/epoch

lambdalabs

NVIDIA RTX A6000 4 GPUs

$3.20

/hr

Inference Speed

42.7 tokens/sec

Training Speed

4.4 sec/epoch

paperspace

NVIDIA A100-SXM4-80GB

$3.28

/hr

Inference Speed

22.3 tokens/sec

Training Speed

2.4 sec/epoch

lambdalabs

NVIDIA H100 80GB HBM3

$3.29

/hr

Inference Speed

83.7 tokens/sec

Training Speed

1.3 sec/epoch

nebius

NVIDIA H100 80GB HBM3

$3.30

/hr

Inference Speed

77.9 tokens/sec

Training Speed

1.8 sec/epoch

runpod

NVIDIA H100 PCIe

$3.39

/hr

Inference Speed

42.0 tokens/sec

Training Speed

3.7 sec/epoch

nebius

NVIDIA H100 80GB HBM3

$3.55

/hr

Inference Speed

68.0 tokens/sec

Training Speed

1.5 sec/epoch

fluidstack

NVIDIA A100 80GB PCIe 2 GPUs

$3.60

/hr

Inference Speed

40.5 tokens/sec

Training Speed

2.4 sec/epoch

nebius

NVIDIA H200

$3.65

/hr

Inference Speed

83.3 tokens/sec

Training Speed

1.5 sec/epoch

hyperstack

NVIDIA H100 PCIe 2 GPUs

$3.80

/hr

Inference Speed

58.9 tokens/sec

Training Speed

1.7 sec/epoch

runpod

NVIDIA H100 80GB HBM3

$3.89

/hr

Inference Speed

81.5 tokens/sec

Training Speed

7.7 sec/epoch

imwt

NVIDIA RTX A6000 8 GPUs

$3.92

/hr

Inference Speed

21.6 tokens/sec

Training Speed

4.1 sec/epoch

oblivus

NVIDIA H100 PCIe 2 GPUs

$3.96

/hr

Inference Speed

59.6 tokens/sec

Training Speed

1.7 sec/epoch

hyperstack

NVIDIA RTX A6000 8 GPUs

$4.00

/hr

Inference Speed

44.8 tokens/sec

Training Speed

2.3 sec/epoch

tensordock

NVIDIA RTX A6000

$4.02

/hr

Inference Speed

47.7 tokens/sec

Training Speed

3.4 sec/epoch

datacrunch

NVIDIA RTX A6000 4 GPUs

$4.04

/hr

Inference Speed

43.9 tokens/sec

Training Speed

3.1 sec/epoch

valdi

NVIDIA H100 80GB HBM3

$4.14

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.8 sec/epoch

valdi

NVIDIA H100 80GB HBM3

$4.14

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.2 sec/epoch

vastai

NVIDIA GeForce RTX 4090 12 GPUs

$4.16

/hr

Inference Speed

55.5 tokens/sec

Training Speed

1.7 sec/epoch

valdi

NVIDIA RTX A5000 8 GPUs

$4.16

/hr

Inference Speed

40.9 tokens/sec

Training Speed

1.7 sec/epoch

datacrunch

NVIDIA H200

$4.35

/hr

Inference Speed

69.5 tokens/sec

Training Speed

2.4 sec/epoch

oblivus

NVIDIA RTX A6000 8 GPUs

$4.40

/hr

Inference Speed

46.1 tokens/sec

Training Speed

2.3 sec/epoch

lambdalabs

Tesla V100-SXM2-16GB 8 GPUs

$4.40

/hr

Inference Speed

40.6 tokens/sec

Training Speed

6.7 sec/epoch

massedcompute

NVIDIA RTX A6000 8 GPUs

$4.56

/hr

Inference Speed

21.2 tokens/sec

Training Speed

4.1 sec/epoch

massedcompute

NVIDIA RTX A6000 8 GPUs

$4.56

/hr

Inference Speed

22.5 tokens/sec

Training Speed

3.8 sec/epoch

imwt

NVIDIA H100 PCIe 2 GPUs

$4.96

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.1 sec/epoch

imwt

NVIDIA H100 PCIe 2 GPUs

$4.96

/hr

Inference Speed

0.0 tokens/sec

Training Speed

1.9 sec/epoch

denvr

NVIDIA A100-SXM4-40GB 4 GPUs

$5.00

/hr

Inference Speed

0.0 tokens/sec

Training Speed

4.0 sec/epoch

fluidstack

NVIDIA L40 4 GPUs

$5.00

/hr

Inference Speed

47.0 tokens/sec

Training Speed

2.2 sec/epoch

hyperstack

NVIDIA A100 80GB PCIe 4 GPUs

$5.40

/hr

Inference Speed

44.7 tokens/sec

Training Speed

2.3 sec/epoch

fluidstack

NVIDIA H100 PCIe 2 GPUs

$5.78

/hr

Inference Speed

58.0 tokens/sec

Training Speed

1.6 sec/epoch

crusoe

NVIDIA A100-PCIE-40GB 4 GPUs

$5.80

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.1 sec/epoch

oblivus

NVIDIA A100 80GB PCIe 4 GPUs

$5.89

/hr

Inference Speed

45.1 tokens/sec

Training Speed

2.5 sec/epoch

massedcompute

NVIDIA H100 PCIe 2 GPUs

$5.96

/hr

Inference Speed

41.7 tokens/sec

Training Speed

2.1 sec/epoch

paperspace

NVIDIA H100 80GB HBM3

$5.99

/hr

Inference Speed

67.9 tokens/sec

Training Speed

1.9 sec/epoch

denvr

NVIDIA A100-SXM4-80GB 4 GPUs

$6.00

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.3 sec/epoch

massedcompute

NVIDIA H100 NVL 2 GPUs

$6.32

/hr

Inference Speed

54.7 tokens/sec

Training Speed

1.8 sec/epoch

lambdalabs

NVIDIA H100 80GB HBM3 2 GPUs

$6.38

/hr

Inference Speed

78.7 tokens/sec

Training Speed

1.4 sec/epoch

lambdalabs

NVIDIA H100 80GB HBM3 2 GPUs

$6.38

/hr

Inference Speed

66.2 tokens/sec

Training Speed

1.6 sec/epoch

datacrunch

NVIDIA A100-SXM4-80GB 4 GPUs

$6.60

/hr

Inference Speed

40.5 tokens/sec

Training Speed

3.6 sec/epoch

nebius

NVIDIA H100 80GB HBM3 2 GPUs

$7.10

/hr

Inference Speed

68.3 tokens/sec

Training Speed

1.5 sec/epoch

fluidstack

NVIDIA A100 80GB PCIe 4 GPUs

$7.20

/hr

Inference Speed

43.3 tokens/sec

Training Speed

2.5 sec/epoch

hyperstack

NVIDIA H100 PCIe 4 GPUs

$7.60

/hr

Inference Speed

56.3 tokens/sec

Training Speed

1.6 sec/epoch

oblivus

NVIDIA H100 PCIe 4 GPUs

$7.92

/hr

Inference Speed

60.9 tokens/sec

Training Speed

1.7 sec/epoch

hyperstack

NVIDIA L40 8 GPUs

$8.00

/hr

Inference Speed

47.9 tokens/sec

Training Speed

2.4 sec/epoch

valdi

NVIDIA H100 80GB HBM3 2 GPUs

$8.28

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.9 sec/epoch

tensordock

NVIDIA A100-SXM4-80GB

$8.42

/hr

Inference Speed

51.8 tokens/sec

Training Speed

5.3 sec/epoch

tensordock

NVIDIA A100-SXM4-80GB

$9.86

/hr

Inference Speed

48.2 tokens/sec

Training Speed

2.6 sec/epoch

imwt

NVIDIA H100 PCIe 4 GPUs

$9.92

/hr

Inference Speed

39.6 tokens/sec

Training Speed

1.9 sec/epoch

tensordock

NVIDIA A100-SXM4-80GB

$9.95

/hr

Inference Speed

44.9 tokens/sec

Training Speed

5.0 sec/epoch

denvr

NVIDIA A100-SXM4-40GB 8 GPUs

$10.00

/hr

Inference Speed

42.4 tokens/sec

Training Speed

2.4 sec/epoch

lambdalabs

NVIDIA A100-SXM4-40GB 8 GPUs

$10.32

/hr

Inference Speed

0.0 tokens/sec

Training Speed

1.9 sec/epoch

lambdalabs

NVIDIA A100-SXM4-40GB 8 GPUs

$10.32

/hr

Inference Speed

40.6 tokens/sec

Training Speed

2.1 sec/epoch

lambdalabs

NVIDIA A100-SXM4-40GB 8 GPUs

$10.32

/hr

Inference Speed

42.7 tokens/sec

Training Speed

2.6 sec/epoch

hyperstack

NVIDIA A100 80GB PCIe 8 GPUs

$10.80

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.8 sec/epoch

datacrunch

NVIDIA L40S 8 GPUs

$10.88

/hr

Inference Speed

40.1 tokens/sec

Training Speed

3.8 sec/epoch

hyperstack

NVIDIA A100 80GB PCIe 8 GPUs

$11.20

/hr

Inference Speed

64.6 tokens/sec

Training Speed

1.7 sec/epoch

crusoe

NVIDIA L40S 8 GPUs

$11.60

/hr

Inference Speed

49.8 tokens/sec

Training Speed

2.0 sec/epoch

crusoe

NVIDIA A100-PCIE-40GB 8 GPUs

$11.60

/hr

Inference Speed

48.6 tokens/sec

Training Speed

2.7 sec/epoch

oblivus

NVIDIA A100 80GB PCIe 8 GPUs

$11.77

/hr

Inference Speed

65.6 tokens/sec

Training Speed

1.5 sec/epoch

massedcompute

NVIDIA H100 PCIe 4 GPUs

$11.92

/hr

Inference Speed

40.4 tokens/sec

Training Speed

1.8 sec/epoch

lambdalabs

NVIDIA H100 80GB HBM3 4 GPUs

$12.36

/hr

Inference Speed

81.2 tokens/sec

Training Speed

1.3 sec/epoch

oblivus

NVIDIA A100 80GB PCIe 8 GPUs

$12.57

/hr

Inference Speed

65.6 tokens/sec

Training Speed

1.7 sec/epoch

datacrunch

NVIDIA A100-SXM4-80GB 8 GPUs

$13.20

/hr

Inference Speed

40.2 tokens/sec

Training Speed

3.3 sec/epoch

crusoe

NVIDIA A100 80GB PCIe 8 GPUs

$13.20

/hr

Inference Speed

47.7 tokens/sec

Training Speed

2.3 sec/epoch

nebius

NVIDIA H100 80GB HBM3 4 GPUs

$14.20

/hr

Inference Speed

73.5 tokens/sec

Training Speed

1.5 sec/epoch

lambdalabs

NVIDIA A100-SXM4-80GB 8 GPUs

$14.32

/hr

Inference Speed

39.3 tokens/sec

Training Speed

2.5 sec/epoch

crusoe

NVIDIA L40S 10 GPUs

$14.50

/hr

Inference Speed

49.7 tokens/sec

Training Speed

1.4 sec/epoch

crusoe

NVIDIA L40S 10 GPUs

$14.50

/hr

Inference Speed

49.8 tokens/sec

Training Speed

2.9 sec/epoch

hyperstack

NVIDIA H100 PCIe 8 GPUs

$15.20

/hr

Inference Speed

57.2 tokens/sec

Training Speed

1.7 sec/epoch

tensordock

NVIDIA H100 80GB HBM3

$15.87

/hr

Inference Speed

70.8 tokens/sec

Training Speed

2.2 sec/epoch

valdi

NVIDIA H100 80GB HBM3 4 GPUs

$16.56

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.7 sec/epoch

valdi

NVIDIA H100 80GB HBM3 4 GPUs

$16.56

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.2 sec/epoch

datacrunch

NVIDIA H200 4 GPUs

$17.40

/hr

Inference Speed

65.0 tokens/sec

Training Speed

3.2 sec/epoch

vastai

NVIDIA H100 NVL 8 GPUs

$18.13

/hr

Inference Speed

70.3 tokens/sec

Training Speed

1.7 sec/epoch

tensordock

NVIDIA A100-SXM4-80GB

$19.27

/hr

Inference Speed

46.7 tokens/sec

Training Speed

5.0 sec/epoch

vastai

NVIDIA H100 NVL 8 GPUs

$19.73

/hr

Inference Speed

58.9 tokens/sec

Training Speed

1.8 sec/epoch

tensordock

NVIDIA A100-SXM4-80GB

$20.10

/hr

Inference Speed

47.1 tokens/sec

Training Speed

5.1 sec/epoch

paperspace

NVIDIA A100-SXM4-80GB 8 GPUs

$25.76

/hr

Inference Speed

0.0 tokens/sec

Training Speed

2.5 sec/epoch

nebius

NVIDIA H100 80GB HBM3 8 GPUs

$28.39

/hr

Inference Speed

65.6 tokens/sec

Training Speed

1.5 sec/epoch

datacrunch

NVIDIA H200 8 GPUs

$34.80

/hr

Inference Speed

64.6 tokens/sec

Training Speed

3.3 sec/epoch