Local Deployment of Open Source Large Modeling Tools

Total 28 articles posts
Harbor:一键部署本地LLM开发环境,轻松管理和运行AI服务的容器化工具集

Harbor: a containerized toolset for easily managing and running AI services with one-click deployment of local LLM development environments

Comprehensive Introduction Harbor is a revolutionary containerized LLM toolset focused on simplifying the deployment and management of local AI development environments. It enables developers with a clean command line interface (CLI) and companion application to launch and manage with a single click, including LLM backends, API interfaces, front...
7mos ago
01.6K
EXO:利用闲置家用设备运行分布式AI集群,支持多种推理引擎和自动设备发现。

EXO: Running distributed AI clusters using idle home devices with support for multiple inference engines and automated device discovery.

General Introduction Exo is an open source project designed to run its own AI cluster using everyday devices (e.g. iPhone, iPad, Android, Mac, Linux, etc.). Through dynamic model partitioning and automated device discovery, Exo is able to unify multiple devices into one powerful...
8mos ago
02.5K
LocalAI:开源的本地AI部署方案,支持多种模型架构,WebUI统一管理模型和API

LocalAI: open source local AI deployment solutions, support for multiple model architectures, WebUI unified management of models and APIs

General Introduction LocalAI is an open source local AI alternative designed to provide an API interface compatible with OpenAI, Claude, and others. It supports running on consumer-grade hardware, does not require a GPU, and is capable of text, audio, video, image generation, and speech cloning for multiple...
9mos ago
02.3K
Hyperspace(aiOS):分布式AI算力共享网络,aiOS生成式浏览器,深度知识智能体

Hyperspace (aiOS): distributed AI arithmetic sharing network, aiOS generative browser, deep knowledge intelligences

General Introduction Hyperspace is an innovative generative browser (aiOS) based on the world's largest peer-to-peer AI network, designed to provide users with powerful tools for deep research and analysis. By integrating multiple AI models and data sources, Hyperspace allows users to quickly generate...
5mos ago
02K
Pinokio:一键本地部署各类AI开源项目,小白全自动部署

Pinokio: one-click local deployment of all kinds of AI open source projects, fully automated deployment of white people

Pinokio General Introduction Pinokio is an innovative AI open source project deployment tool that allows users to easily install, run, and programmatically control a wide range of big model related applications with a single click. It is supported across multiple platforms and provides a community scripting library that covers most popular A...
12mos ago
02.2K