Francesco.world
bare-metal.ai Articles

Generative AI on prem: secure, ethical, and accessible.

Igniting 2025 with tons of INT4 Quantizations!

January 01. 2025 • Category: Announcement

e858af29-e433-4acf-955d-56b29195fa29

As we just ignited 2025, and 2024 came to an end, I am proud to share that I have successfully uploaded over 230 quantized SLM/LLM models to my HuggingFace account. These models were entirely quantized using the computational resources of my homelab, achieving approximately 72 TFLOPS of performance-powered solely by "domestic" hardware.

Continue Reading >>>

Tags: , , , , , ,

Notice
 This website does not track you. There are no analytics, no advertising, and no profiling cookies. The only things stored on your device are a session cookie used by the contact form, and a note that you dismissed this message. Web fonts are loaded from Google, which receives your IP address. Full detail is in the cookie policy and the privacy policy. There is nothing here to consent to. Dismiss simply closes this notice.

baremetalai on Substack

Read on Substack