NEW Bare Metal Servers with 20G Dedicated Unmetered Bandwidth 20G Dedicated Unmetered Servers Read more STATUS

A100, A40 and A10 nodes

GPU Dedicated Servers

A100 80GB, A40 48GB and A10 24GB GPU based server for AI inference, fine-tuning and small teams of AI developers. Instant provision (in minutes) for zero hourly billing and availability in various jurisdictions.

A100 80GB · A40 48GB · A10 24GB · zero hourly billing

12 A100 available
A100 / A40 / A10

  • Fabric200 Gbps
  • Fleet util64%

347

Active jobs

ServerCPURAMStorageNetworkAvailabilityPer monthOrder
ACCELERATORAccelerator RTX6000AMD EPYC 7702p · 64c128 GB2x1TB NVMe1x 10GbE · 100 TB4 readyAmsterdam€349or €314.10 billed yearlyBuy now
ACCELERATORAccelerator H100 NVLinkAMD EPYC 7702p · 64c256 GB2x4TB NVMe2x 10GbE · 100 TBQuoted per siteQuoteGet a quote
ACCELERATORAccelerator A100AMD EPYC 7702p · 64c512 GB2x4TB NVMe2x 10GbE · 100 TBQuoted per siteQuoteGet a quote

3 plans · Monthly prices. Yearly billing takes 10% off. Need a custom build? Talk to engineering →

How your server reaches you

What happens after you order

You order in the shop. We find or build the machine, put it in a rack and install it. Below is how that goes, using the screens from our own portal.

01

You configure it in the shop

On shop.netrouting.com you pick a city first, then memory, disks, bandwidth and IP space. Prices are shown per option, per month. You only need an account when you check out.

Bandwidth is a setting on the switch port. If you start on 10G with 100 TB and later want 20G unmetered, we change the port and the server stays where it is.

The shop configuration page for a Compute EPYC 7702: bandwidth, IPv4 and DDoS options with monthly prices and a running summary
The product page in the shop. Prices update the summary as you choose.

02

Ready now or custom built

Ready now131 ready now

These are already in a rack in that city and have been tested. Once you've paid, we assign one to you and install the OS you picked.

We take that number from the shop's inventory. It's how many are free right now.

Custom build

Custom is for configurations we do not have ready: extra memory, other disks, a RAID or ZFS layout. Our engineers build and burn in the server, which takes longer than a stock machine.

The product page says which one applies to yours.

03

You can watch it happen

In Amóni you see each server go from payment to install. The IP address is there as soon as a machine has been assigned.

No need to keep the tab open, we email you the address and root login when it's done.

Amóni order progress: a Compute EPYC 7702 in Amsterdam installing its operating system, next to a cloud VM that has finished
Order progress in Amóni (demo account).

04

After hand-over

A lot of what used to mean writing to support, you now do yourself in Amóni.

  • Remote console over KVM or IPMI in the browser, down to the BIOS and boot menu.
  • Reinstall or rescue without opening a ticket.
  • Bandwidth graphs with the 95th percentile and the monthly total.
  • Set reverse DNS yourself, for IPv4 and IPv6.
An active remote console session on a bare-metal server in Amóni The Graphs tab in Amóni: link speed, inbound and outbound traffic with now, average, maximum, 95th percentile and total

The people behind it

Engineers who know your rack

Our network and datacenter team is in The Hague, at DFDC THG1, which is also our European head office. Every site is run from there. When a disk has to be swapped or your BGP session set up, it's done by the people who built the network.

See servers ready now Talk to an engineer

Network and add-ons

Your IP space, our network

Anything on this list can go on an Edge server or bigger, either when you order or later on. Express machines are the exception, they come as they are. The prices here are pulled from the shop.

Unmetered, up to 40G

Edge Pro and higher get a 10G port with 100 TB outbound per month, Edge gets 1G, and inbound traffic is free on all of them. If you'd rather not count at all, take an unmetered port. That capacity is reserved for you and we don't throttle it.

At 40G it's either four 10G ports bonded with LACP or one 40G QSFP port, depending on the rack. We'll tell you which one you get.

PortTrafficPer month
10G 100 TB Included
1G Unmetered +€100
2G Unmetered +€200
5G Unmetered +€400
10G Unmetered +€600
20G Unmetered +€1,000
40G Unmetered, 4×10G bonded or 1×40G +€2,000

Private VLAN

Free

For two or more servers in the same datacenter. Replication and database traffic go over the VLAN and stay off your public port.

More IPv4

from +€16

You get one static IPv4 address with the server. Need more, add a block: anything from a /29 (5 usable) to a /26 (61 usable). Reverse DNS for those is yours to set.

IPv6 /64

Free

A /64 for every server.

Bring your own IPs

€25/mo

We can announce your own /24 or larger from our network. You send the LOA, we check it, then the announcement goes live.

Your ASN, your BGP

€25/mo

With your own ASN you can run BGP sessions with our routers. After you open a ticket we create the IRR objects and set the sessions up, which normally takes one business day.

DDoS protection

20 Gbps included

There's 20 Gbps of DDoS protection on every server. Premium takes that to 50 Gbps for +€50 a month.

Rather not run it yourself?

Our engineers can manage the software for you as well, and you reach them through the same ticket queue you use for hardware.

Basic Managed

€50/mo

We patch the OS and set up monitoring for you. When an alert fires we're usually already working on it before you'd have noticed anything. It's covered by the Netrouting Guarantee.

Proxmox VE, managed

€100/mo

We take care of the hypervisor itself, on one host or on a cluster with Ceph distributed storage, and you keep running your own VMs on top.

cPanel / WHM, managed

On request

We supply the cPanel license and manage the server. The license is billed on top, so ask us for a quote.

Added in the shop, managed in Amóni

You pick add-ons on the product page when you order. After that your IP blocks and reverse DNS are in Amóni, right next to the console.

Configure a server Ask about BGP or BYOIP
The IP Addresses page in Amóni: a server's IPv4 and IPv6 addresses with their reverse DNS
IP Addresses in Amóni: every block you hold, with reverse DNS.

Use cases

Match the GPU to the workload

If all your AI production workloads run fine with H100 then you only need capacity for A100 for those workloads and A40 or A10 for the rest.

  • LLM inference A100 80GB supports running Llama 3.1 70B-Q4 at approximately 30 tokens/second. A40 48GB should be fast enough for 13B-34B models. A10 24GB is price-performance sweet-spot for 7B-13B models.
  • Fine-tuning + LoRA 2× A100 NVLink for fine-tuning a 70B model, A100 80GB single A100 for fine-tuning 13B-34B models using LoRA. Note that storage is charged, however there is no egress charge for data that already is stored.
  • CV + embeddings A40 48GB: large batch CV pipelines (Detectron2, SAM, Stable Diffusion XL) - A10: large embeddings / ranking models in production.
  • Render + simulation A few A40's in parallel for work like hours long renderings in Blender, Houdini or Octane Render (for RT cores or NVENC etc).

The lineup

A100, A40, A10, purpose-built for production AI

As the H100 units are for the time being somewhat of a restricted part, price tagged in a manner which does not render it very suitable for the vast majority of AI-focused production workloads, we here at Netrouting are not resellers of this GPU nor do we keep H100 units in stock for immediate deployment to customers.

  • A100 80GB SXM4 80 GB HBM2e / 6,912 CUDA cores / 432 Tensor cores / 600 GB/s NVLink (training + 70B inference). Single card or 2-way NVLink.
  • A40 48GB Inference workhorse + render. 48 GB GDDR6 ECC, 10,752 CUDA cores, 336 Tensor cores, 84 RT cores. Best price/perf for 13B-34B inference and CV pipelines.
  • A10 24GB Our cheapest option for Inference is the A10. It is low cost to purchase and then to serve with, and is therefore best for large scale Embedding Services (7B-13B parameters), and large scale rerankers (similar parameter size). This doesn't need to cost as much as an A100 for training 70B parameters.

Included with every plan

No surprises in the bill or the install

All GPU plans come with everything you'll need after you deploy your inference endpoint.

  • Free always-on DDoS Free always-on DDoS (Edge scrubbing) for all our customers on all our plans - recently we handled a 600+ Gbps DDoS attack on our edge servers without any of the inference endpoints at any of the edge locations to drop a single request.
  • Unmetered 10G network We charge one price for the ability to serve as many inferences. No egress fees, no inferences per GB charges. Whether you download a 70B model from Hugging Face (like we did here for testing purposes) or use a smaller one, and whether you serve 100,000 inferences per month or many, many more, you get to serve as many inferences as your application requires for the price quoted.
  • 24/7 monitoring + engineers Our team of real network engineers is monitoring your infrastructure 24/7. In the event of an incident our engineers will respond within 5 minutes on work days and 15 minutes on non work days 24/7.
  • CUDA-ready images Ubuntu 24.04 Server Edition with the latest available NVIDIA drivers, as well as the CUDA Toolkit installed. Should you happen to encounter a problem with the kernel, we can re-image your server in a matter of minutes.

Why Netrouting

Predictable, fast, jurisdiction-flexible

  • Predictable monthly pricing No hourly charges, no egress fees. A 24/7 running model does not cost more for running over hours or peak traffic hours. Your monthly bill will simply be the same number as always.
  • Fast deploy, real engineers All GPU plans are deployed within the same day. The real network engineers at Netrouting will also assist you with any problems that you might have with your CUDA environment, the NVIDIA drivers or with kernel panics. Automated support-bots will not be involved in solving your problem.
  • Pick your jurisdiction Host your servers in Amsterdam, Frankfurt or Stockholm under our Dutch B.V. or in Miami or New York under our Florida Inc. This way your model weights as well as customer data are subject to the law of the country of your choice and not to that of your hosting provider.

Common questions

GPU Server FAQ

  • Which types of attacks does Netrouting DDoS Protection block automatically?

    Volumetric floods (e.g. UDP, ICMP and TCP floods) as well as reflection/amplification attacks (e.g. DNS, NTP, memcached etc.) and protocol based attacks (e.g. SYN floods, ACK floods etc. as well as fragmentation and malformed packet attacks). We also absorb multi-vector attacks.

  • What happens if a DDoS attack exceeds our mitigation capacity?

    In case the incoming traffic load (DDoS attack) is bigger than the traffic that can be filtered by us, then the targeted IP will be black-holed.

  • Do I need to enable Netrouting DDoS Protection?

    Dedicated DDoS Protection is automatically enabled for all relevant services such as Cloud Compute, Colocation, Bare Metal servers and GPU servers. No activation is required. The protection starts as soon as the related resource goes online.

  • Does Netrouting DDoS Protection cover application-layer (Layer 7) attacks?

    No, Netrouting DDoS Protection is a network-layer attack mitigation service, it is designed to protect against volumetric traffic attacks (so called floods) at network-layer (so called Layer 3/4). For application-layer attacks (so called Layer 7 attacks) like HTTP floods, slowloris, etc. you would use a Web Application Firewall (WAF) or layer 7 packet processing, edge caching services like Cloudflare or Akamai.

  • What is Netrouting DDoS Protection

    Gaming / DDoS | Netrouting DDoS Protection - free, always-on service protecting all Netrouting infrastructure (Cloud Compute, Colocation, Bare Metal servers, GPU servers) from network-layer (L3/L4) DDoS attacks. No setup required.

  • How do I test the network speed from my location?

    Every city page now includes the public test IP address for that location, as well as a link to 100 MB, 1 GB and 10 GB test files. You can download these files from the location nearest to you with curl or wget, or download them from your browser.

  • Is the bandwidth dedicated or shared?

    Netrouting provides dedicated uplink ports (e.g. 1GbE, 10GbE). This means that there is dedicated bandwidth and a dedicated uplink port, which means that there is no loss of performance and quality caused by shared uplink usage as found with other providers.

Available GPU server configurations