Installing QAnswer on Scaleway
For an optimal cloud experience, we recommend using Scaleway as your cloud provider. Our cloud offering leverages the L40S GPU Instance provided by Scaleway. This instance is pre-configured with the NVIDIA driver, significantly reducing setup complexity and saving you time and effort.
| Instance Size | GPU | GPU Memory (GiB) | vCPUs | Memory (GiB) | Storage (GB) | Network Bandwidth (Gbps) |
|---|---|---|---|---|---|---|
| L40S-1-48G | 1 | 48 | 8 | 96 | ~1600 | 2.5 |
Installing a Container Runtime
Depending on your preference, you can choose to install either Docker or Podman as your container runtime. Follow the respective instructions below:
Installing Docker
If Docker is not yet installed on your machine, follow the official Docker installation guide to set it up.
Installing Podman (Alternative to Docker)
If Podman is not yet installed on your machine, you can install it by following the official Podman installation guide.
Installing podman-compose
To use Podman with docker-compose-like functionality, you’ll need to install podman-compose. Refer to the official podman-compose documentation for installation steps.
Once installed, verify that both Podman and podman-compose are properly set up by running:
podman --version
podman-compose --version
Install NVIDIA Container Toolkit
The NVIDIA Container Toolkit is required for running GPU-enabled containers using Docker or other container runtimes. Below are the steps to install it:
# 1. configure production repo:
curl -fsSL https://nvidia.github.io/libnvidia-container/gpgkey | sudo gpg --dearmor -o /usr/share/keyrings/nvidia-container-toolkit-keyring.gpg \
&& curl -s -L https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list | \
sed 's#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g' | \
sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list
# 2. Update the packages list from the repository:
sudo apt-get update
# 3. Install the NVIDIA Container Toolkit packages:
sudo apt-get install -y nvidia-container-toolkit
After the installation of nvidia-container-toolkit, please restart the service Docker/Podman.
# For Docker
sudo service docker restart
# For Podman
sudo service podman restart
Install & Deploy QAnswer
QAnswer is provided as a docker-compose file. You can clone the repository by running the following command
git clone https://gitlab.the-qa-company.com/qanswer-app/qanswer-bundle.git
To deploy QAnswer, navigate to the qanswer-bundle directory. Depending on your container runtime (Docker or Podman), follow the steps below:
- Docker
- Podman
Steps for Docker:
1. Run our setup script, it will pull all the container images we need. You need to put here the credentials we will provide to you:
QANSWER_REGISTRY_USER=<user-we-provide> \
QANSWER_REGISTRY_PASSWORD=<password-we-provide> \
VERSION=main source ./setup.sh --container_runtime docker --no_documentation
2. Start the QAnswer bundle using docker compose:
Run the docker command:
QANSWER_KEY=<qanswerKey-we-provide> \
VERSION=main docker compose up -d
Steps for Podman:
1. Run our setup script, it will pull all the container images we need. You need to put here the credentials we will provide to you:
QANSWER_REGISTRY_USER=<user-we-provide> \
QANSWER_REGISTRY_PASSWORD=<password-we-provide> \
VERSION=main source ./setup.sh --container_runtime podman --no_documentation
2. Start the QAnswer bundle using podman-compose:
Run the docker command:
QANSWER_KEY=<qanswerKey-we-provide> \
VERSION=main podman-compose up -d