Gpubox - Revision history

Jerkey: /* IPMI Setup */

2026-02-19T00:31:36Z

IPMI Setup

@@ Line 25: / Line 25: @@
 $ ipmitool -H ipmi-compute-2-171.local  -U ADMIN -P pwd dcmi power reading
 [shows electrical power presently being consumed by system]
 </pre>

2026-02-18T23:55:32Z

Bare Metal Configuration

← Older revision		Revision as of 16:55, 18 February 2026
Line 33:		Line 33:
	* Hostname gpubox		* Hostname gpubox
	* Proxmox web ui available at: https://gpubox.local:8006		* Proxmox web ui available at: https://gpubox.local:8006
			* apt install earlyoom && sudo systemctl enable --now earlyoom # prevent system crashes due to running out of RAM

	== GPU Passthrough Configuration ==		== GPU Passthrough Configuration ==

2026-02-17T06:58:37Z

Specific VM Configurations

2026-02-17T06:49:44Z

Specific VM Configurations: add ufw rule for port 11434

← Older revision		Revision as of 23:49, 16 February 2026
Line 130:		Line 130:
	* Install nvidia drivers https://www.xda-developers.com/nvidia-stopped-supporting-my-gpu-so-i-started-self-hosting-llms-with-it/		* Install nvidia drivers https://www.xda-developers.com/nvidia-stopped-supporting-my-gpu-so-i-started-self-hosting-llms-with-it/
	** Pin the driver version so you don't have to re-run the nvidia installer every time the kernel gets updated		** Pin the driver version so you don't have to re-run the nvidia installer every time the kernel gets updated
	* Install ~~<pre>~~ollama~~</pre>~~ with <pre>curl -fsSL https://ollama.com/install.sh \| sh</pre>		* Install ollama with <pre>curl -fsSL https://ollama.com/install.sh \| sh</pre>
	* Use ollama to pull and run deepseek-r1:8b		* Use ollama to pull and run deepseek-r1:8b
			* <pre>sudo ufw allow from 10.0.0.0/24 to any port 11434 proto tcp</pre>
	* Verify: http://ollama.local:11434/ should show the message <pre>Ollama is running.</pre>		* Verify: http://ollama.local:11434/ should show the message <pre>Ollama is running.</pre>

2026-02-17T06:40:11Z

VM Templates & Cloning

← Older revision		Revision as of 23:40, 16 February 2026
Line 114:		Line 114:
	* Upload <pre>debian-13.3.0-amd64-netinst.iso</pre> to storage through the proxmox web ui		* Upload <pre>debian-13.3.0-amd64-netinst.iso</pre> to storage through the proxmox web ui
	* Create a minimal Debian 13 template		* Create a minimal Debian 13 template
	** <pre>apt install -y ufw fail2ban curl git zsh sudo</pre>		** <pre>apt install -y ufw fail2ban curl git zsh sudo net-tools</pre>
	** <pre>sudo apt update && sudo apt full-upgrade -y</pre>		** <pre>sudo apt update && sudo apt full-upgrade -y</pre>
	* Make a user called <pre>deb</pre> with sudo		* Make a user called <pre>deb</pre> with sudo

2026-02-17T06:37:32Z

imgtotext

← Older revision		Revision as of 23:37, 16 February 2026
Line 136:		Line 136:
	=== imgtotext ===		=== imgtotext ===
	* Install ollama as above		* Install ollama as above
	* <pre>ollama run hf.co/noctrex/ZwZ-8B-GGUF:Q8_0</pre>		* <pre>ollama run hf.co/noctrex/ZwZ-8B-GGUF:Q8_0</pre> from the page https://huggingface.co/noctrex/ZwZ-8B-GGUF (i pressed the image-to-text tag and looked at trending models)
	* http://imgtotext.local:11434/ should show ollama is running		* http://imgtotext.local:11434/ should show ollama is running

2026-02-17T06:36:00Z

Specific VM Configurations

← Older revision		Revision as of 23:36, 16 February 2026
Line 133:		Line 133:
	* Use ollama to pull and run deepseek-r1:8b		* Use ollama to pull and run deepseek-r1:8b
	* Verify: http://ollama.local:11434/ should show the message <pre>Ollama is running.</pre>		* Verify: http://ollama.local:11434/ should show the message <pre>Ollama is running.</pre>

			=== imgtotext ===
			* Install ollama as above
			* <pre>ollama run hf.co/noctrex/ZwZ-8B-GGUF:Q8_0</pre>
			* http://imgtotext.local:11434/ should show ollama is running

	=== dockerhost ===		=== dockerhost ===

2026-02-17T05:48:45Z

Hosted Services

← Older revision		Revision as of 22:48, 16 February 2026
Line 3:		Line 3:
	\|+ On gpubox		\|+ On gpubox
	\|-		\|-
	! IP:Port !! Description		! Hostname:Port !! Description
	\|-		\|-
	\| [https://gpubox.local:8006] \|\| Proxmox admin		\| [https://gpubox.local:8006/ gpubox.local:8006] \|\| Proxmox admin
	\|-		\|-
	\| [http://dockerhost.local:3000/] \|\| Open WebUI (to play with LLMs)		\| [http://dockerhost.local:3000/ dockerhost.local:3000] \|\| Open WebUI (to play with LLMs)
	\|-		\|-
	\| [https://ipmi-compute-2-171.local/] \|\| IPMI		\| [https://ipmi-compute-2-171.local/ ipmi-compute-2-171.local] \|\| IPMI
	\|}		\|}

2026-02-17T05:47:56Z

Hosted Services

2026-02-17T05:46:59Z

Hosted Services

← Older revision		Revision as of 22:46, 16 February 2026
Line 1:		Line 1:
	= Hosted Services =		= Hosted Services =
			{\| class="wikitable"
			\|+ On <pre>gpubox</pre>
			\|-
			! IP:Port !! Description
			\|-
			\| [https://gpubox.local:8006] \|\| Proxmox admin
			\|-
			\| [http://dockerhost.local:3000/] \|\| Open WebUI (to play with LLMs)
			\|-
			\| [https://ipmi-compute-2-171.local/] \|\| IPMI
			\|}

	= gpubox Setup =		= gpubox Setup =