> ## Documentation Index
> Fetch the complete documentation index at: https://docs.muna.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Bringing Your Own Compute

> Run compiled models on your own GPUs.

Muna supports deploying compiled models to your GPU fleets, whether on-prem or from third-party GPU platforms. Compiled models can yield up to 45x reductions in cold-start times, along with reduced latency and higher utilization.

<img src="https://mintcdn.com/natml/DosmBe7QcFA8KLH1/images/cttft.png?fit=max&auto=format&n=DosmBe7QcFA8KLH1&q=85&s=2b548042fc1f92e7b77783f4c9d47ce7" alt="Cumulative time to first token" width="1638" height="854" data-path="images/cttft.png" />

## Deploying to Modal

Use the `muna deploy` CLI command to deploy a compiled model to [Modal](https://modal.com):

```bash theme={null}
# Deploy a compiled LLM to Modal
$ muna deploy @google/gemma-4-26b-a4b-it --provider modal --gpu b200
```

This command will create a lightweight app on Modal that runs an [OpenAI-compatible web server](https://github.com/muna-ai/muna-server). This server then forwards requests to the compiled model.

<Tip>
  This command requires the `modal` package to be installed. Run `pip install modal`.
</Tip>

## Deploying to Baseten

Use the `muna deploy` CLI command to deploy a compiled model to [Baseten](https://baseten.co):

```bash theme={null}
# Deploy a compiled LLM to Baseten
$ muna deploy @google/gemma-4-26b-a4b-it --provider baseten --gpu b200
```

This command will create and deploy a lightweight service on Baseten that runs an [OpenAI-compatible web server](https://github.com/muna-ai/muna-server). This server then forwards requests to the compiled model.

<Tip>
  This command requires the `truss` package to be installed. Run `pip install truss`.
</Tip>

### Generating a Truss Config

The `muna deploy` CLI command supports emitting a [Truss](https://docs.baseten.co/reference/truss-configuration) config without deploying the app. To generate a Truss config, use the `--dry-run` flag:

```bash theme={null}
# Generate a Truss config for a compiled model
$ muna deploy @google/gemma-4-26b-a4b-it --provider baseten --dry-run
```