Report Nymja.ai MVP| Nym SDK Grant
Nymja.ai was a project funded by NSL’s Grant SDK. It is an MVP, delivering an open-source hub of LLMs (chatbots) with a focus on privacy, as a desktop and mobile web application.
You can test it at: ai.tupinymquim.com
Project Overview
Nymja.ai is an open-source chatbot that integrates multiple LLMs, offering increased privacy, so you can chat without exposing your IP or personal data.
It has the following open-source models:
-
DeepSeek V3 65B
-
Mistral Nemo
-
Llama 3.2-11B Vision
-
Dolphin 3.0 (Mistral 24B)
-
Nous DeepHermes 3 8B
-
Qwen QWQ 32B
-
Gemma 3 27B
-
Kimi Dev 72B
The system operates in two distinct modes:
1.Proxy Mode: where all requests to external APIs are proxied to conceal the client’s IP address.
2. Mixnet Mode: where requests are routed through Nym’s mixnet to anonymize both IP addresses and user metadata.
Features
This MVP allows users to:
-
create an anonymous profile
-
change your credentials
-
chat with 8 LLMs for free (asynchronous stream)
-
Support for code and Markdown
-
Create/delete conversation
-
Mobile/desktop responsiveness
-
support for multiple users.
-
1000 free requests per day (for all users).
Security and Privacy Measures
All data stored from user is end-to-end encrypted.
No personal information is ever persisted on our server.
User registration is fully anonymous and is secured by a 24-word mnemonic phrase.
Conversations and authentication credentials remain encrypted at rest.
Third-Party API Usage
The API consulted for the bots’ responses is OpenRouter. From there, I request the LLMs mentioned above, free of charge, with a total daily limit of 1000 requests. No access to the user’s history, however, only to each conversation.
So it’s not a production infrastructure, but a low-cost one aimed at testing.
To provide template-based responses, we rely on third-party APIs, which necessarily decrypt the conversation content to generate replies.
Implementation Status and Roadmap
At present, Mixnet Mode is not yet available due to temporary unavailability of the Nym TypeScript SDK.
We plan to integrate mixfetch in a future release, enabling all traffic to traverse Nym’s mixnet for metadata anonymity.
Technologies and Frameworks
Nymja.ai is underpinned by a modern and maintainable technology stack. On the server side, we employ Python asynchronously, in conjunction with Django’s ORM to facilitate rapid development, clear code organization, and robust data modeling.
All persistent data is managed by PostgreSQL, ensuring transactional integrity and powerful querying capabilities. To achieve environment consistency and simplify deployment, each service is fully containerized using Docker.
The client interface is built with Next.js and React, augmented by TypeScript for enhanced type safety and developer productivity.
Finally, the application is also backed by nginx and CloudFlare.
The project is open-souce, feel free to view and contribute.
Accomplished Objectives
Through this funded project, we have successfully delivered a Minimum Viable Product that:
- Provides a unified gateway to multiple open-source large language models (LLMs).
- It incorporates Nym’s privacy-by-design principles at every layer, ensuring that user information and IP addresses remain confidential.
- Supports both Proxy Mode and Mixnet Mode (the latter pending SDK availability) to guarantee anonymous interactions.
Future Directions
Ahead, our main focus will be on:
-
Improving scalability and UX: We want to improve our infrastructure in the future to accommodate thousands of simultaneous connections, employing load balancing and horizontal scaling strategies to maintain low latency under heavy load, and also improving on product branding, UI and UX.
-
Feature enrichment: Addition of new features such as file uploads, real-time audio streaming and AI-driven voice calls.
-
Sustainable monetization: We intend to introduce a tiered model offering a free access level alongside premium subscription plans, which will unlock higher capacity models and priority computing resources.
Even though this coming season I have decided to focus on another development project, more in line with the needs of the community at the moment (not yet posted), I believe that Nymja.ai has great commercial value - cause private chatbot/ai are indeed scarce - and I intend to return to it in the future, especially when the TypeScript SDK has been normalized.
User Feedback
Your insights are invaluable in guiding the evolution of this project. I invite all interested users to share their experiences, suggestions, and any encountered issues via the following feedback form:
Finally, I would like to thank the community and the staff for their trust and support.