Locally Installed AI: Why Sanctum is the Way to Go
Locally installed AI is the way to go, especially if privacy is important to you. Instead of sending your queries to a third party, you can keep them private, so no one else has access to your questions or the generated answers. When you run a query with the locally installed Sanctum, your data is encrypted, secure, and never leaves the app.
Why Sanctum?
- It’s local
- Data remains private
- Thousands of GGUF models on Hugging Face
- PDF summaries
- Works even in an internet outage
- It’s open-source
- You can choose your LLM (from Gemma, Llama, Mistral, and more)
- You can choose if any information is shared
- Available prompt templates
- Real-time information on system resources in use
How to Install Sanctum
What you’ll need:
The only things you’ll need are either a MacOS or Windows computer (Linux version coming soon) and a network connection. I’ll demonstrate the installation on MacOS. If you’re using a Windows computer, the installation is as simple as installing any other application.
Step-by-Step Installation:
- Download the installer from the Sanctum site and select your OS.
- Locate the downloaded file in Finder and double-click it.
- A new window will pop up, asking you to drag the Sanctum icon to Applications. Do that, and the installation is done.
- You can then eject the Sanctum drive on your desktop and delete the download.
How to Set Up Sanctum
Step-by-Step Setup:
- Save your recovery phrase: Click the Get Started button on the main window, and copy and paste your recovery phrase. This is important because if you lose your login credentials, you’ll need it for recovery.
- Set a password: Create a strong and unique password, and click Continue.
- Download an AI model: Select an LLM (I opted for Mistral) and click Continue.
- Select your privacy level: Select the level of privacy you want for Sanctum. I recommend selecting "Don’t share a single byte."
Conclusion:
Sanctum is a powerful tool that allows you to keep your data private and secure. With its locally installed AI, you can run queries without sending your data to a third party. With its easy installation and setup process, Sanctum is perfect for anyone who wants to maintain their privacy and security.
FAQs:
Q: Is Sanctum available for Linux?
A: Yes, Sanctum is available for Linux and will be available soon.
Q: Can I change my LLM later?
A: Yes, you can change your LLM later from within the Sanctum app.
Q: How do I share information with Sanctum?
A: You can choose if any information is shared during the setup process.
Q: Is Sanctum open-source?
A: Yes, Sanctum is open-source.
Q: Can I use Sanctum even in an internet outage?
A: Yes, Sanctum works even in an internet outage.
