Dify
Dify is an AI application development platform that runs on your self-hosted Olares system. It's one of the key open-source projects that Olares integrates to help you build and manage AI applications while maintaining full data ownership.
How Dify works with Olares
While you can use all of Dify's standard AI development features, Dify integrates natively with your Olares environment to provide:
- Unified account system: Access Dify using your Olares credentials.
- Built-in AI assistant: Get started with Ashia, a customizable AI assistant for your needs.
- Local Knowledge base: Enhance your AI responses by connecting to documents stored in the Files app.
Before you begin
To use local AI models, ensure you have:
- Ollama installed and running in your Olares environment
- Open WebUI installed with your preferred language models downloaded
TIP
For optimal performance, consider using lightweight yet powerful models like
gemma2
, which offer a good balance between speed and capability.
Install
Install Dify from Market based on your role:
- For admin: Install both "Dify For Cluster" and "Dify".
- For team members: Ensure your admin has installed "Dify For Cluster", and install "Dify" only.
Add Ollama as model provider
- Open Dify, and navigate to Settings > Model Provider.
- Select Ollama as the model provider, with the following configurations:
- Model Name: Enter the model name. For example:
gemma2
. - Base URL:
http://ollama.ollama-{admin's Olares ID}:11434
. For example:http://ollama.ollama-alice123:11434
.INFO
You could keep default values for other required fields.
- Model Name: Enter the model name. For example:
- Click Save.
Configure Ashia
- Open Dify and select Ashia under the Studio tab.
- Click Configure in the right panel.
- From the dropdown list, select a model from Ollama.
- Click Publish.
Set up local knowledge base
- In Dify, navigate to the Knowledge tab.
- Locate your default knowledge base. It will be named after your Olares ID and monitors the
/Documents
folder in Files. - Upload documents to
/Documents
in Files, and return to Dify to see if the documents are available in your knowledge base. - In Ashia's orchestration page, click addAdd to add context support for Ashia.
- Click Publish.