
In Progress
Posted
Paid on delivery
I want to move everything my team currently does in Manus onto our own hardware so we can cut subscription costs, scale at our pace, and keep full control of the data. The system has to sit on a local workstation or small on-prem cluster, expose a clean web-app interface that everyone on the team can log into, and run multiple models side by side for text generation, image generation, video creation, and code-first web development. Here is what matters most to me: • Each of those model families (think LLaMA/LLM-based writers, Stable Diffusion style artists, an open-source video generator, plus a code-assistant such as Code Llama or StarCoder) must be installed, optimised for the available GPUs, and callable through a single API so the front-end can switch tasks without fuss. • The web interface should let us pick a model, set basic parameters, submit a job, and then view or download results. A light Flask, FastAPI, or Node back-end is fine; the UI can be React, Vue, or whatever you prefer—speed and clarity win. • I need the whole stack containerised (Docker or similar) so I can add new GPUs, bolt on extra storage, or swap in fresh models without breaking existing workflows. • Over time I want to fine-tune certain models on our own data, so please leave hooks for additional training scripts and show me how to kick off a train or fine-tune run. • Security matters: this stays on our LAN but still needs user logins and role management. Deliverables 1. Fully configured local environment (scripts, Docker-compose or Helm chart) running the chosen models. 2. Web app with unified dashboard, job queue, and result viewer. 3. Documentation: setup, usage, how to add hardware or new models, and a quick guide to fine-tuning. 4. A short hand-over session (video call is fine) so my developers know how to maintain and extend the system. If you have deep experience wrangling open-source LLMs, Stable Diffusion forks, video GANs, and can tie them together with a clean API and interface, let’s talk. Title: Senior Node.js / Full-Stack Engineer – Security-First Local AI Mesh System (Drive-Mediated) Project Description: We are building an expandable, local-first AI system across multiple computers. The system uses a Windows primary computer for the user-facing control web interface and independent secondary worker machines that claim and perform tasks asynchronously. Key System Architecture Constraints: No Direct Machine-to-Machine Networking: Communication between the primary machine and workers is strictly repository-mediated via a shared Google Drive folder (file polling, claims, leases, and immutable results). Security & Network Limits: The primary runtime binds strictly to loopback ([login to view URL]). No direct inbound network access or public exposure. Tech Stack: Node.js (v20+ / ES Modules), Plain Node HTTP / REST APIs, PowerShell scripts, React 19 / Vite / Express / tRPC / Drizzle ORM ( reference prototype), and local LLM integrations (Ollama). Immediate Next Tasks (Phase 1): Primary Machine Validation: Validate and test our Node.js runtime (v0.1.3) on the primary Windows computer (verifying persistent signed sessions, local task creation, and approval holding queues). First Worker Deployment: Deploy and validate the portable worker runtime ([login to view URL]) on a secondary machine, configuring capability profiles, claim/lease handling, and local Ollama integrations. Future Roadmap: Configure secure private remote access via Tailscale Serve (HTTPS) and expand multi-worker scalability. Required Skills & Experience Core Backend: Senior Node.js (v20+ ES Modules), asynchronous file I/O, local state management, and lightweight HTTP server development (without heavy external framework dependencies for the production core). System Design & Protocols: Distributed state via file systems/polling, claim/lease locking mechanisms, and repository-mediated architectures. Security & Auth: Security-first mindsets, local credential storage (%LOCALAPPDATA%), persistent HMAC/signed session handling, and role-based access control (RBAC). DevOps & OS: Windows environment fluency, PowerShell scripting, local process management, and Tailscale / private networking setup. AI Tooling (Bonus): Familiarity with local AI model execution (Ollama APIs, local model weight caching). Candidate Screening Questions Include these questions in your job application form to quickly weed out unqualified candidates or automated bots: Architecture Check: “Our system uses a shared Google Drive folder rather than direct WebSockets or HTTP APIs for communication between the primary controller and worker nodes. What potential race conditions or edge cases do you anticipate with file-system-based claims/leases, and how would you verify them during testing?” Security & Session Check: “How would you debug a session authentication failure in a loopback-bound ([login to view URL]) Node.js HTTP service using signed cookies/local session files without relying on external auth providers?” Operational Check: “Have you worked with local AI execution setups like Ollama or custom local-first file polling queues? Briefly describe a similar asynchronous or local-first system you have worked on.”
Project ID: 40679261
79 proposals
Remote project
Active 5 days ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs

The part that will make or break this system isn't the UI or the model installs - it's getting a local-first, multi‑model stack to behave predictably across hardware while keeping everything containerised and callable through one API. If that orchestration layer isn't clean, you'll end up with GPU conflicts, inconsistent job states, and a dashboard that feels glued together instead of unified. I've built local AI setups where LLMs, diffusion models and video generators run side by side through a single task router. For this, I'd structure the platform around a job queue + unified API: each model family wrapped in its own container, GPU‑aware launch scripts, and a dispatcher that selects the right runtime without exposing complexity to the front-end. I'd start by mapping your hardware, selecting model variants that fit VRAM constraints, and defining the API contract the UI will call. Then build the dashboard: model picker, parameters, job submission, result viewer. A key risk is model isolation - one misconfigured container can starve others - so resource limits and predictable caching matter early. Three quick questions: 1. Do you prefer Ollama‑style runners or direct containerized model servers? 2. Should fine‑tuning run on the same workstation or a dedicated training node? If you want, I can outline milestones and a realistic hour estimate. Juan Pablo
$200 USD in 1 day
6.4
6.4
79 freelancers are bidding on average $208 USD for this job

Hello, As the founder of A4Logic, my experience spans over 15 years, and I have successfully built numerous scalable, secure, and user-friendly web, mobile, and AI solutions. I am confident that my solid Node.js skills (v20+, ES Modules) coupled with a deep understanding of LLM integration, file handling, local-state management, and lightweight HTTP server development will make me an ideal candidate for spearheading this project. Handling AI automation work with Python is another area I have proven to excel in. Additionally, during my career span since 2011, I have comfortably paced myself with various crucial tech stacks like Django, Node.js (including setup), and React. Implementing such an expansive system as described in your project brief demands a great attention to details and security-first mindset-- qualities I embody. As rejection of direct machine-to-machine networking is a key system architecture constraint for this project and strict adherence to local network strictly for repository-mediated communication is required for seamless functioning; I possess hands-on experience in distributed state management through file systems/polling as well as proficient in claim/lease locking mechanisms used to enhance your planned workflow. Moreover, ensuring the privacy of the users' data is one of my top priorities; something that aligns perfectly with your concern for the same. I understand that documentation often gets overlooke Thanks!
$180 USD in 2 days
8.6
8.6

Hi, I can build your secure local AI mesh system by implementing robust file-based polling and node-level task management. My approach ensures stable async communication via your Drive architecture while maintaining strict loopback security for your team's workflow. Let’s discuss and get started! -AJ
$140 USD in 7 days
7.6
7.6

Hi, I'm Denis, a full-stack developer who has worked on local AI systems that integrate multiple open-source models behind a unified interface. I understand you need a local AI platform where multiple models run on your hardware, accessed through a clean web app and managed via a single API. The containerized setup should let you add GPUs or models without disrupting workflows, and the system must support future fine-tuning. For your Windows-based system with repository-mediated communication, I’ll validate the primary Node.js runtime first, then set up the worker on a secondary machine using file-based claims and leases. The React front-end will provide a simple dashboard for model selection, job submission, and result viewing. I’ll include scripts and documentation for scaling, adding models, or fine-tuning locally. Security will focus on loopback binding, signed sessions, and role-based access without external dependencies. I recently worked on a similar system where multiple services processed jobs asynchronously using local file systems, which aligns with your repository-mediated approach. I can start working right away. Let's connect and discuss the details. Thanks, Denis.
$150 USD in 3 days
6.6
6.6

Hi there, I read your project "Build Local AI Platform" and it matches what I do with PHP, HTML. I have delivered similar work before and can start right away. I can complete it in 7 days for 275 USD, revisions included. Can you share any extra details or files so I can confirm the scope? Happy to start today.
$275 USD in 7 days
6.6
6.6

Hello There! I’m Md Toriqul Islam, and I’m excited to partner with you. I have strong experience in Node.js, full-stack development, local AI integrations, REST APIs, distributed task systems, Docker, security, and scalable application architecture. I am skilled in Node.js v20+, ES Modules, React, Ollama, REST APIs, asynchronous file I/O, PowerShell, Docker, authentication, HMAC sessions, RBAC, and Windows environments. I understand you’re building a security-first local AI mesh where the Windows primary controller communicates with independent worker machines exclusively through a shared Google Drive repository. I can validate the existing runtime, deploy the worker, implement reliable claim/lease handling, integrate local Ollama models, and prepare the architecture for future multi-worker scaling. I have a few questions: 1) Which CRM are you currently using, and do you already have the required API/integration credentials? 2) Do you have a preferred WordPress builder such as Elementor, Divi, or Gutenberg? 3) How many landing pages are you planning to build after the pilot page? I’m ready to review the existing v0.1.3 runtime and start with the primary validation and first-worker deployment. Looking forward to hearing from you. Best regards, Md Toriqul Islam
$100 USD in 3 days
6.8
6.8

As an experienced Senior Node.js / Full-Stack Engineer, my team and I have the perfect blend of skills for your Local AI Platform project. We understand that security is paramount in your LAN setup and our security-first mindset ensures your system stays protected while still providing user logins and role management. Not only do we have deep experience wrangling open-source LLMs, Stable Diffusion forks, and video GANs but we are also skilled in tying them together to provide a clean API and interface, just as you need. Our proficiency at creating systems that operate in existing workflows makes us a great fit for your requirement to move everything currently done in Manus onto your own hardware. This includes building a web-app interface that enables task switching without issues; an area where we can definitely excel by employing Flask, FastAPI, or Node on the backend paired with React or Vue on the frontend - fast and clear.
$250 USD in 7 days
6.5
6.5

Hello, Do you prefer using React over Vue for the UI? Are you open to using Docker for containerization? Exciting project on local AI infrastructure! I’ll create a seamless system that integrates the models with a clean API. Ensuring smooth model swapping and security will be a priority. Let's discuss examples in chat. I believe a quick chat will help us iron out details. Looking forward to your message to kickstart our collaboration!
$250 USD in 4 days
6.0
6.0

Hi, I got that you are looking for a Senior Node.js / Full-Stack Engineer with expertise in wrangling open-source LLMs, Stable Diffusion forks, and video GANs to build a local-first AI system across multiple computers. My approach is to leverage Node.js (v20+ / ES Modules), Plain Node HTTP / REST APIs, React 19, and Docker to create a secure, expandable system. I will ensure seamless integration of LLMs, Stable Diffusion forks, and video GANs through a clean API and interface, addressing the key system architecture constraints you provided. As final deliverables, you will receive a fully configured local environment with the chosen models, a web app featuring a unified dashboard and job queue, comprehensive documentation covering setup, usage, and maintenance, and a hands-on session for your developers to maintain and extend the system. One thing I'd like to confirm before we start: How do you envision the scalability of the system as more models are added and hardware requirements increase? Let's discuss how I can bring your vision to life. Regards, Imran
$90 USD in 1 day
5.3
5.3

Hello, Primary risk is Google Drive sync semantics: eventual consistency, partial uploads, timestamp skew, and concurrent writers creating stale claim files. If a worker and the controller race to create or delete a claim file you can get double-processing or lost tasks unless you treat Drive as an eventually consistent object store and add explicit atomicity and TTL checks. I have built Node.js v20+ systems that coordinate work across air-gapped Windows hosts and implemented file-based coordination when networks were constrained. I led delivery of a payroll API and a tax filing system that required strict state transitions, secure remote access, and PowerShell-driven deployments on Windows workers. That work required careful claim/lease logic, heartbeat renewal, and validation against partial writes and clock drift. I will first implement a small test harness on the primary Windows machine to validate Node.js runtime, file I/O behavior, and drive sync latency under load. The concrete mechanism I will use is write-then-rename claim files with HMAC-signed payloads, a short TTL plus heartbeat renewal, and a conservative lease takeover that verifies file contents and checksums before assuming ownership. I will script worker bootstrap in PowerShell to validate runtime, enforce least-privilege access to the shared Google Drive folder, and add optional Ollama API probes for local model execution. For secure private remote access I prefer SSH over a reverse tunnel with per-host key pairs and an allowlist, combined with encrypted claim metadata so no secrets live in plain text on Drive. - Do you already have maximum acceptable Drive sync delay measurements between the primary and slowest worker? - Which Windows versions and network topologies should I validate first (VPN, isolated LAN, or internet-shared)? A quick call works for me whenever you are ready. Thomas Beigbeder
$230 USD in 3 days
5.3
5.3

Hello, Your project needs a local, containerized AI system running multiple open-source models with full data control. The goal is seamless operation across text, image, video, and code models—each optimized for your GPUs and accessible via a single API. I’m Lazar, a software developer with 7+ years of experience in custom software, e-commerce, and API integrations. I specialize in scalable system architecture balancing performance and usability. Your setup requires clean separation between front-end, back-end, and model layers, with strict containerization for scalable GPU additions and model swaps. The real challenge isn’t just running models—it’s ensuring the API routes tasks correctly, the UI stays responsive, and future fine-tuning requires minimal refactoring. For model integration, I treat each model family as a configurable service: install the right runtime (Ollama for LLMs, ComfyUI for images, etc.), expose it through a consistent REST endpoint, and containerize it so new GPUs can be added via Docker Compose. The back-end acts as a lightweight orchestrator, validating inputs, queuing jobs, and returning results securely. I recently built a local-first data pipeline for a workstation cluster, using file-based claims and leases to manage race conditions, sessions via signed tokens, and a responsive UI under load—exactly the constraints your project faces. I can start immediately and would be happy to review your setup and plan the container stack for your GPUs.
$30 USD in 1 day
4.8
4.8

As an experienced full-stack engineer and team lead, I am fully equipped with the skills needed to build your Local AI Platform. With my deep understanding and practical knowledge of Node.js, I can seamlessly tie together various model families – LLaMA/LLM-based writers, Stable Diffusion artists, the video generator you desire plus code assistants such as Code Llama or StarCoder - through a unified API, while optimizing them for your available GPUs. In addition to this, I have a wealth of experience with containerization tools like Docker which will be necessary for scaling up and updating the system without any downtime or disruptions in your existing workflows. Security is also a top priority that I take seriously. I have proven experience in building secure web applications involving user logins and role management that will ensure your data stays secure within your LAN. Lastly, my strong documentation and communication skills will come in handy when providing detailed instructions for setup and usage, managing new hardware or models, as well as conducting a handover session to ensure your team has the knowledge to maintain and extend the system even after project deployment. Let's chat further about how we can implement this innovative project together!
$140 USD in 7 days
5.4
5.4

Hi there, Your vision for a local-first, security-focused AI platform resonates strongly with my expertise and interests. I have extensive hands-on experience building modular AI stacks that run on local hardware—integrating LLMs (LLaMA, Code Llama, StarCoder), Stable Diffusion variants, and video generation models—while ensuring that everything is containerized, GPU-optimized, and easily extensible. I understand your priorities: a unified web interface for seamless access to multiple model types, robust API orchestration for job queuing and result retrieval, and a fully Dockerized environment that can adapt to new hardware or models without downtime. I pay particular attention to security, implementing strict LAN-only access, user authentication, and role-based permissions. My approach would ensure your team can manage, monitor, and extend the system with confidence—leaving hooks and clear guides for fine-tuning and model upgrades. For your Node.js-based mesh system, I’m familiar with distributed architectures that rely on repository-mediated communication (such as Google Drive polling), and have built resilient, race-condition-proof file-based claim/lease protocols. I bring solid experience with ES Modules, low-level HTTP servers, and secure session management using signed cookies and local state—all essential for your Windows-first, loopback-bound environment. My plan is to deliver a clean, responsive dashboard (React, Vite), a lightweight but robust Node/Express or Flask/FastAPI backend, and detailed documentation so your developers can maintain and evolve the system. I’ll also provide training and code handover to ensure your stack remains future-proof and in your full control. I’d be excited to discuss your exact workflow and pain points, and help your team achieve true local autonomy with a best-in-class AI platform.
$30 USD in 5 days
4.6
4.6

⚠️ If you're not happy, you don’t pay. ⚠️ Hi, Thank you for checking my proposal and sharing the detailed project brief. I can build your expandable AI system using Node.js, React, and Docker with a robust, secure design. I will deliver: • Fully configured local environment with scripts and Docker-compose for model integration. • A web app featuring a unified dashboard, job queue, and result viewer. • Comprehensive documentation covering setup, usage, hardware addition, and fine-tuning processes. • A hand-over session to equip your team for system maintenance and extension. You will also receive: • Security features, including role management and user authentication, built into the system. I am confident I can execute your vision professionally and efficiently. Looking forward to discussing the timeline and next steps. Best regards, Chirag
$150 USD in 7 days
4.7
4.7

Hello, I checked your project "Build Local AI Platform" and already have a clear understanding of your requirements and how to deliver them efficiently. I have solid experience in PHP, HTML, Node.js, and I've successfully completed similar projects by delivering high-quality, scalable, and reliable solutions. Why choose me? * Strong expertise in PHP, HTML, Node.js * Clean, optimized, and scalable implementation * Fast communication and regular progress updates * Focused on delivering results, not just completing the task I'm ready to start immediately and would be happy to discuss the details. Best regards, Umer
$30 USD in 1 day
4.3
4.3

Hello, I see you're looking to transition your team's operations from Manus to your own hardware to cut subscription costs. Ensuring a smooth migration and maintaining operational efficiency is crucial for your success. I have solid experience with Python and PHP, which will be beneficial for implementing your local AI platform. My background in Git will facilitate version control and collaboration throughout the development process, ensuring that any changes are tracked and managed effectively. - I will review your current workflows and determine the necessary steps for migration to your hardware. - Next, I'll implement the required Python and PHP scripts to replicate the functionalities of your existing system. - Finally, I will set up a monitoring system to track the performance of your local platform and quickly address any issues that arise. What specific functionalities from Manus do you consider critical to retain in the local environment, and are there any new features you envision for this platform? I am ready to start immediately and look forward to discussing the project details further via Freelancer messages. Best regards, Jordan Rafael
$85 USD in 2 days
4.2
4.2

Based on my extensive background in building robust, production-ready AI systems, I believe I am the ideal fit for your Local AI Platform project. My 11+ years of experience in ML, API development and full-stack engineering are underpinned by a unique perspective on system design - one that prioritizes functionality even in highly complex deployment scenarios. I leverage the same practical approach whether building from scratch or troubleshooting existing systems, taking into account scalability and adaptability - crucial considerations for your local mesh system. My familiarity with distributed state architectures locates me at the intersection of Node.js, file system management and polling, which will enable me to guarantee seamless hand-offs between your primary and secondary machines via repository mediation. Security being paramount, I fortify my projects with innovative measures; strict loopback binding is crucially designed into my local runtimes like the middleware running on your Windows machine so that your network remains insulated from any external threats. And as a testament to the efficacy of my deliverables, I ensure they're well-documented and offer hands-on training sessions for your team's proficiency and continued maintenance. Let me be the one to build you an adaptable, controllable and cost-effective Local AI platform that meets all your unique requirements.
$140 USD in 7 days
4.1
4.1

Hello, I have experience with Python, Node.js, Docker, AI integrations and local deployment systems. I will help build your local AI platform with a secure architecture, unified dashboard, model management, job queue and containerized environment. I will work with local LLM tools, API integrations, worker-based workflows and secure authentication. I will also help validate the Node.js runtime, deploy worker machines, configure Ollama integration and provide clear documentation for future expansion. I look forward to working with you. Best regards, Sara
$120 USD in 1 day
3.8
3.8

Hello, The key part of this project is **moving your local AI workflow off Manus and into a secure, repo-mediated system that works reliably across multiple machines**. I can help you handle this accurately and efficiently without overcomplicating the process. I have hands-on experience with **Node.js, Python, and FastAPI**, including building local APIs and automation workflows that keep state predictable. For your project, I would focus on **validating the loopback-bound primary runtime**, **implementing the worker claim/lease flow around shared Google Drive polling**, and **wiring the unified dashboard to Ollama-backed model jobs**, while making sure the final result is **secure, maintainable, and easy for your team to extend**. I can start immediately and expect to complete this within 2 weeks. One detail I'd like to confirm before starting: **for Phase 1, should I prioritize the primary-machine validation first or the first worker deployment and claim/lease testing**? Best regards, Miguel
$150 USD in 14 days
4.0
4.0

As a seasoned full-stack developer with a profound understanding of Node.js (especially ES Modules) and API development, I’ve built complex systems using robust web technologies like the ones you indicate: React, Vue, Flask, FastAPI and Node.js. I will architect and execute your local-first AI system effectively, ensuring that it's light-weight, secure by integrating your requirements perfectly into my approach. I’m no stranger to working with essential AI models such as LLMs, Stable Diffusion forks, video GANs and can skillfully incorporate intricate machine learning functionalities seamlessly into your proposed web app interface. My approach to containerization is focused on flexibility - adding new GPUs, storage or models shouldn't disrupt the existing workflow. Considering your focus on security, I assure you of implementing user logins and role management within the LAN intelligently. The final product will be well-documented to ensure effortless handover to your developers during a comprehensive training session. With my significant experience in creating training scripts and being able to guide fine-tune run effortlessly, you’ll surely have everything you need to achieve self-sustainability. Let our conversation mark the beginning of an incredible partnership toward completing this project expertly and efficiently
$40 USD in 1 day
4.8
4.8

Hello, I have over 9 years of experience in PHP, Python, HTML, Node.js, Docker, and API Development. I specialize in developing efficient and secure solutions tailored to meet specific project requirements. I have thoroughly reviewed your project description and understand the need to create a local AI platform with a user-friendly web interface, multiple model support, containerization, and security features. I am confident in delivering a fully configured local environment, a web app with a unified dashboard, comprehensive documentation, and conducting a detailed hand-over session for your team's understanding. I would like to discuss your project further in chat to explore how we can collaborate effectively and bring your vision to life. Best regards,
$100 USD in 2 days
3.6
3.6

Goodyear, United States
Payment method verified
Member since Feb 9, 2020
$750-1500 USD
$250-750 USD
$30-250 USD
$500-50000 USD
$750-1500 USD
£30-40 GBP
₹750-1250 INR / hour
₹12500-37500 INR
₹1500-12500 INR
₹12500-37500 INR
€250-750 EUR
₹12500-37500 INR
$15-25 USD / hour
₹12500-37500 INR
$10-30 USD
₹1500-12500 INR
€2-6 EUR / hour
$250-750 USD
$8-15 AUD / hour
₹750-1250 INR / hour
$25-50 USD / hour
$15-25 USD / hour
₹12500-37500 INR
$5000-10000 USD
$250-750 USD